LLM’s supposedly scrape almost everything immediately. I read a post about a guy who was setting some webpage for his own use, and got instantly overrun by crawlers - even though he never advertised or shared his page anywhere