We have a few links to Stack Overflow answers in our docs, in case users want to know more about how a certain tool works. During CI/CD, there is a (Sphinx) linkcheck job to make sure all the links in the doc are valid.

Recently, the linkcheck started to fail with a 403 error - I'm assuming this is because the caller is being identified as a bot, so the content is not returned. The page loads normally in the browser when you click the link in the CI job log output.

(farmlib_api/farmlib.core: line    3) broken    https://stackoverflow.com/questions/22583391/peak-signal-detection-in-realtime-timeseries-data/22640362#22640362 - 403 Client Error: Forbidden for url: https://stackoverflow.com/questions/22583391/peak-signal-detection-in-realtime-timeseries-data/22640362

Is there a better way to do this? Should we just exclude these pages from the linkcheck?