The /llms.txt file, helping language models use your website github.com 4 points by mooreds 18 hours ago
TimorousBestie 15 hours ago LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.
LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.