Set whitelisted header if your site scraping protected.

Name Value

How to detect broken links?

Detecting broken links on a website can be crucial for maintaining a positive user experience and ensuring the functionality of your web pages. Here are several methods to detect broken links:

  1. Manual Check:

    • Periodically go through your website and click on each link to verify if it's working.
    • This method is suitable for small websites but becomes impractical for larger ones.
  2. Online Link Checkers:

  3. Browser Extensions:

    • Install browser extensions that can check for broken links as you browse your own site. 
  4. Command-Line Tools:

    • Tools like wget or curl can be used to crawl your site and report on broken links.
  5. Content Management System (CMS) Plugins:

    • If your website is built on a CMS like WordPress, there are plugins available that can automatically check and report broken links.
  6. Custom Scripting:

    • Write custom scripts using programming languages like Python or JavaScript to crawl your website and check for broken links. Libraries like requests in Python or axios in JavaScript can be helpful.
  7. 404 Error Monitoring:

    • Keep an eye on your server logs for 404 errors, which indicate broken links. Tools like can help in monitoring these errors.
  8. Regular Audits:

    • Conduct regular audits of your website's content, especially after making updates or changes.
  9. Link Maintenance Best Practices:

    • When removing or updating content, make sure to redirect URLs or provide custom 404 pages with helpful information.

Choose the method that best fits your needs and the size of your website. Combining multiple approaches can provide a comprehensive strategy for keeping your links in good shape.



  1. Why broken links is bad?
  2. How fix broken links?
  3. What mean 40x codes?
  4. Why Choose IssueDetector Broken Link Checker