Shouldn't the solution be to gate bulk access for automated services for a price? Not just the wayback machine, any personal or corporate website?My blogs are getting slammed and there are issues with cloudflare or captchas.
> Shouldn't the solution be to gate bulk access for automated services for a price?Fine in theory but determined scrapers will use residential proxies in bulk.
Make a user download and hash 100GB of junk data before being allowed in. Residential proxies cost a lot per GB.
ilamont · · focus · HN ↗
My blogs are getting slammed and there are issues with cloudflare or captchas.
iamacyborg · · focus · HN ↗
Fine in theory but determined scrapers will use residential proxies in bulk.
mitxela · · focus · HN ↗