<!-- mobian-agent-page publisher="time" canonical="https://time.com/archive/6893373/web-crawling-19/" -->

[Read the full article at https://time.com/archive/6893373/web-crawling-19/](https://time.com/archive/6893373/web-crawling-19/)
