-
-
Notifications
You must be signed in to change notification settings - Fork 78
Description
We previously had a CI workflow to check external links. But it was putting a big load on CI response time and was mostly ignored anyway.
So we dropped that in #921.
Link checking is notoriously difficult. It's a huge task with thousands of links, and it's quite common to see some temporary availability issues here and there.
Also, an increasing number of hosts rejects automated requests to protect against overburdoning scrapers.
This issue is to find a better solution.
We could consider moving this to a separate workflow, maybe on a schedule and not allowed to fail. Then we'd at least know when something is broken.
It could also be useful to check links already in Markdown (https://lychee.cli.rs/ can do this) and only in files that are changed in a pull request. This ensures that links are at least valid at the time of creation.