1 comments

  • TimorousBestie 2 hours ago
    LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.