mirror of
https://github.com/ArchiveBox/ArchiveBox.git
synced 2026-03-25 01:12:35 +10:00
Allows setting Headless Chrome's User-Agent to bypass rudimentary anti-scraper/anti-bot checks by sites. https://intoli.com/blog/making-chrome-headless-undetectable/ has more detections if there is desire to get serious about anti-detection
2.3 KiB
2.3 KiB