They gonna focus on high value targets, that mean giving it for free to colleges and others in exchange for their cooperation, giving it for free to Hollywood plus custom solutions for their needs, in exchange again, for their cooperation, the entire internet was just a great bootstrap plan not their lifelong strategy.
1. everyone with any content of value is now blocking the AI crawlers, because they suck up content and resources whilst offering nothing in return
2. the only people not blocking them are websites that are entirely AI slop
the high point may have be in the past...