1 comments

  • TimorousBestie 7 hours ago
    LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.