From Dev.to
Is your site invisible to ChatGPT? Check your robots.txt
A lot of people now ask ChatGPT or Perplexity "what's a good tool for X" instead of Googling it. If your product never comes up, there might be a dull reason: your robots.txt is telling AI crawlers to...