From Dev.to
Our store's robots.txt says no to AI training and yes to AI search. Here's what that actually means
I opened our own robots.txt this week expecting a few lines. It's mostly a list of bots we turned away, and I didn't write any of it by hand. The store runs behind Cloudflare, and Cloudflare's managed...