EuroScrape

Bulk URL status checker: check thousands of URLs for broken links and redirects

After a site migration, a redesign or a big content cleanup, you end up with a list of URLs and one question: which of them still work? Opening them one by one is not an option, and the usual desktop crawlers either cap the free version at a few hundred URLs or need a licence. This page compares the realistic ways to run a bulk URL status check and shows where the free Bulk URL Status & Redirect Checker fits. It is an unofficial tool that runs on Apify.

What a bulk URL checker should tell you

At minimum, for each URL: the final HTTP status (200, 301, 404, 410, 500), the redirect chain with every hop, the final address, and the response time. For SEO work you also want the title, meta description, canonical, meta robots and the X-Robots-Tag header, so you can spot noindex pages and canonicals pointing elsewhere. For a migration you want redirect chains and loops flagged, and network failures (DNS not found, expired SSL certificate, timeout) kept apart from real HTTP errors.

The options

What the Actor does

Give it a list of URLs, a sitemap.xml (sitemap indexes and .xml.gz work, or just a site address: the sitemap is found in robots.txt) or pages to scan for links. It then returns one row per URL.

Up to 100,000 URLs fit in one run, 10 at a time by default.

A real result

Run on 14 October 2026, five URLs from the Actor’s own example:

URL Status Redirects Final URL Time
http://apify.com 200 1 https://apify.com/ 221 ms
https://www.example.com/this-page-does-not-exist 404 0 same 127 ms
https://lemonde.fr 200 2 https://www.lemonde.fr/en/ 629 ms
https://httpbin.org/redirect/3 200 3 https://httpbin.org/get 121 ms
https://expired.badssl.com/ error CERT_HAS_EXPIRED 0 none 251 ms

The same run as JSON for the 404 row (fields shortened):

{
  "url": "https://www.example.com/this-page-does-not-exist",
  "ok": false,
  "broken": true,
  "statusCode": 404,
  "redirects": 0,
  "responseTimeMs": 127
}

Results are from that date; sites change. On 23 October 2026 a scan of 300 links on one Wikipedia page took 40 seconds and found 8 really broken links (404) and 7 more refused by bot protections, kept apart instead of being reported as broken.

How to check a list in three steps

  1. Open the Bulk URL Status & Redirect Checker on Apify (a free account is enough).
  2. Paste your URLs, or give a sitemap address, or the pages whose links you want to check.
  3. Run it and download the result as CSV, Excel or JSON, or schedule it weekly to catch new broken links.
{
  "urls": [
    "http://apify.com",
    "https://www.example.com/this-page-does-not-exist",
    "https://httpbin.org/redirect/3"
  ]
}

Related guides: extract Impressum data from German websites and find businesses without a website. See also the website technology lookup guide and the Google Trends API guide for another free SEO data tool.

Price

The Actor itself is free. Apify bills only the platform usage of the run: in our test, 7 URLs cost $0.00009. Apify’s free plan includes monthly credit, so occasional checks cost nothing.

FAQ

How do I check all the pages of my website? Put the site address or its sitemap.xml in the Sitemaps field: every listed page is checked. Schedule it weekly to catch new broken links.

Why does a site answer 403 or 429 to the checker? Usually a bot protection. The row then has blockedBy and broken: false, since the page exists. Turning on Apify Proxy (residential) gives their real status.

Does it follow JavaScript redirects? No. It follows HTTP redirects (3xx with a Location header), which search engines rely on first.

Is there a limit on the number of URLs? Up to 100,000 URLs per run. The limit is the platform usage you are willing to pay, which stays at cents for thousands of URLs.

Can I use it from code or an AI assistant? Yes: call it through the Apify API, or add it as a tool through the Apify MCP server.

Run the Bulk URL Status & Redirect Checker on Apify

Related pages: RSS to JSON API Free: Any Feed or Website to JSON

Run these numbers yourself. Every EuroScrape Actor runs on Apify, pay per result; a free Apify account ($5 of monthly credit) covers your first tests. Open the Store page →

EuroScrape Data Letter

Five numbers a week from official registers and public prices, each one reproducible with an Actor. Free, one e-mail on Thursdays.

Archive and unsubscribe: buttondown.com/Euroscrape.