Bulk URL status checker: check thousands of URLs for broken links and redirects
After a site migration, a redesign or a big content cleanup, you end up with a list of URLs and one question: which of them still work? Opening them one by one is not an option, and the usual desktop crawlers either cap the free version at a few hundred URLs or need a licence. This page compares the realistic ways to run a bulk URL status check and shows where the free Bulk URL Status & Redirect Checker fits. It is an unofficial tool that runs on Apify.
What a bulk URL checker should tell you
At minimum, for each URL: the final HTTP status (200, 301, 404, 410, 500), the redirect chain with every hop, the final address, and the response time. For SEO work you also want the title, meta description, canonical, meta robots and the X-Robots-Tag header, so you can spot noindex pages and canonicals pointing elsewhere. For a migration you want redirect chains and loops flagged, and network failures (DNS not found, expired SSL certificate, timeout) kept apart from real HTTP errors.
The options
- Browser extensions and single-page tools. Handy for one page or a handful. They do not scale to a list.
- Desktop crawlers. Powerful for a full site audit. The free tiers of such tools usually limit the number of URLs, and they run on your own machine.
- Free online checkers. Paste a list, get a table. Fine for an occasional check; look at the limit on the number of URLs and whether the redirect chain is shown.
- A script. A few lines with
curlor an HTTP library works, until you need parallel requests, retries, redirect chains and sensible handling of bot protections. - An Apify Actor. You run it in the cloud, on a list, a sitemap or a set of pages, and get the result as a table, JSON or through an API. You can schedule it weekly. That is what this tool does.
What the Actor does
Give it a list of URLs, a sitemap.xml (sitemap indexes and .xml.gz work, or just a site address: the sitemap is found in robots.txt) or pages to scan for links. It then returns one row per URL.
- Status and redirects: code, number of redirects, every hop, final URL, loops detected.
- Broken link checker: give a page and every link on it is checked, internal and external, with the page it was found on and its anchor text.
onlyBrokenkeeps only the problems. - SEO tags: title, meta description, robots, canonical, first H1, language.
- Sitemap audit: each page gets
sitemapIssue(redirects,noindex,canonical elsewhereorbroken), the same problems Google Search Console reports for sitemaps. - Bot protections: links refused by Cloudflare, Akamai, DataDome and similar are not counted as broken. They carry
blockedBy, because the page opens fine in a browser.
Up to 100,000 URLs fit in one run, 10 at a time by default.
A real result
Run on 14 October 2026, five URLs from the Actor’s own example:
| URL | Status | Redirects | Final URL | Time |
|---|---|---|---|---|
| http://apify.com | 200 | 1 | https://apify.com/ | 221 ms |
| https://www.example.com/this-page-does-not-exist | 404 | 0 | same | 127 ms |
| https://lemonde.fr | 200 | 2 | https://www.lemonde.fr/en/ | 629 ms |
| https://httpbin.org/redirect/3 | 200 | 3 | https://httpbin.org/get | 121 ms |
| https://expired.badssl.com/ | error CERT_HAS_EXPIRED |
0 | none | 251 ms |
The same run as JSON for the 404 row (fields shortened):
{
"url": "https://www.example.com/this-page-does-not-exist",
"ok": false,
"broken": true,
"statusCode": 404,
"redirects": 0,
"responseTimeMs": 127
}
Results are from that date; sites change. On 23 October 2026 a scan of 300 links on one Wikipedia page took 40 seconds and found 8 really broken links (404) and 7 more refused by bot protections, kept apart instead of being reported as broken.
How to check a list in three steps
- Open the Bulk URL Status & Redirect Checker on Apify (a free account is enough).
- Paste your URLs, or give a sitemap address, or the pages whose links you want to check.
- Run it and download the result as CSV, Excel or JSON, or schedule it weekly to catch new broken links.
{
"urls": [
"http://apify.com",
"https://www.example.com/this-page-does-not-exist",
"https://httpbin.org/redirect/3"
]
}
Related guides: extract Impressum data from German websites and find businesses without a website. See also the website technology lookup guide and the Google Trends API guide for another free SEO data tool.
Price
The Actor itself is free. Apify bills only the platform usage of the run: in our test, 7 URLs cost $0.00009. Apify’s free plan includes monthly credit, so occasional checks cost nothing.
FAQ
How do I check all the pages of my website?
Put the site address or its sitemap.xml in the Sitemaps field: every listed page is checked. Schedule it weekly to catch new broken links.
Why does a site answer 403 or 429 to the checker?
Usually a bot protection. The row then has blockedBy and broken: false, since the page exists. Turning on Apify Proxy (residential) gives their real status.
Does it follow JavaScript redirects? No. It follows HTTP redirects (3xx with a Location header), which search engines rely on first.
Is there a limit on the number of URLs? Up to 100,000 URLs per run. The limit is the platform usage you are willing to pay, which stays at cents for thousands of URLs.
Can I use it from code or an AI assistant? Yes: call it through the Apify API, or add it as a tool through the Apify MCP server.
Run the Bulk URL Status & Redirect Checker on Apify
Related pages: RSS to JSON API Free: Any Feed or Website to JSON
Run these numbers yourself. Every EuroScrape Actor runs on Apify, pay per result; a free Apify account ($5 of monthly credit) covers your first tests. Open the Store page →
EuroScrape Data Letter
Five numbers a week from official registers and public prices, each one reproducible with an Actor. Free, one e-mail on Thursdays.
Archive and unsubscribe: buttondown.com/Euroscrape.