{
  "id": "14b39e2399e0",
  "url": "https://openai.com/index/helping-websites-express-ai-training-preferences",
  "title": "Making it easier for websites to express AI training preferences",
  "note": "I can tell you that on any given day about 10% of the traffic to all of my websites is from malicious actors, and then depending on the day about 30-40% is from crawlers. The web is full of robots these days. There are also a lot of folks, particularly in the IndieWeb space that are actively working to fight away bots and don't want anyone indexing their sites.\n\nI'm going the complete other way. I have open `robots.txt` on all my sites. I've adopted the `llms.txt` standard for nearly every site I have. I even have many of my sites publishing static JSON objects to make it easier for agents and other code to interface with them. Check out the [full LLMs.txt for my Things I've Built](https://thingelstad.xyz/llms-full.txt).\n\nMy plan is to lean into discoverability. Lean into what I think of as the true sharing nature of the web. Regardless of who or _what_ is on the other side.",
  "voice": "jamie",
  "saved": "2026-11-02T04:13:55Z",
  "host": "openai.com",
  "kind": "page",
  "tags": [],
  "record": "https://links.thingelstad.xyz/links/14b39e2399e0/",
  "markdown": "https://links.thingelstad.xyz/links/14b39e2399e0.md",
  "issues": [
    {
      "number": 355,
      "slug": "355",
      "title": "Writing, Building, and the Open Web",
      "date": "2026-11-14T12:00:00Z",
      "section": "Notable",
      "position": 5,
      "url": "https://weekly.thingelstad.com/archive/355/",
      "page": "https://links.thingelstad.xyz/issues/355/"
    }
  ],
  "connections": {
    "same_host": {
      "count": 54,
      "page": "https://links.thingelstad.xyz/hosts/openai.com/",
      "nearest": [
        {
          "id": "f806dd97b317",
          "title": "Introducing dots | OpenAI",
          "url": "https://openai.com/index/introducing-dots",
          "record": "https://links.thingelstad.xyz/links/f806dd97b317/"
        },
        {
          "id": "881ae6cc36c3",
          "title": "Introducing dots | OpenAI",
          "url": "https://openai.com/index/introducing-dots/",
          "record": "https://links.thingelstad.xyz/links/881ae6cc36c3/"
        },
        {
          "id": "64b539777c9b",
          "title": "Scaling Git at OpenAI",
          "url": "https://openai.com/index/scaling-git-at-openai",
          "record": "https://links.thingelstad.xyz/links/64b539777c9b/"
        },
        {
          "id": "79d13e040f6e",
          "title": "Introducing ChatGPT Wallet",
          "url": "https://openai.com/index/introducing-chatgpt-wallet",
          "record": "https://links.thingelstad.xyz/links/79d13e040f6e/"
        },
        {
          "id": "b02ac3a3fe5a",
          "title": "Introducing GPT-6.2 Astra and Sol",
          "url": "https://openai.com/index/introducing-gpt-6-2-astra-sol",
          "record": "https://links.thingelstad.xyz/links/b02ac3a3fe5a/"
        }
      ]
    },
    "same_week": {
      "count": 30,
      "nearest": [
        {
          "id": "2686ec1eaed7",
          "title": "API credits benefit for eligible ChatGPT subscriptions",
          "url": "https://simonwillison.net/2026/Oct/29/api-credits/",
          "record": "https://links.thingelstad.xyz/links/2686ec1eaed7/"
        },
        {
          "id": "a0c591335685",
          "title": "Building a multiplayer game world with autonomous Fable-class models",
          "url": "https://simonwillison.net/2026/Oct/29/how-i-built-the-most-ai-pilled-company-in-the-world/",
          "record": "https://links.thingelstad.xyz/links/a0c591335685/"
        },
        {
          "id": "4dbccf41c6d4",
          "title": "OpenAI Adds iCloud Calendar and Mail Plugins and Dot Texting",
          "url": "https://www.macstories.net/linked/openai-adds-icloud-calendar-and-mail-plugins-and-dot-texting/",
          "record": "https://links.thingelstad.xyz/links/4dbccf41c6d4/"
        },
        {
          "id": "3dd0acbbba9c",
          "title": "Dagu: Local-first workflow orchestration that just works",
          "url": "https://dagu.sh/",
          "record": "https://links.thingelstad.xyz/links/3dd0acbbba9c/"
        },
        {
          "id": "dd6465a72513",
          "title": "Vince Cabansag of Clockwork Wins the Public Service Tekne Award 2026",
          "url": "https://www.youtube.com/watch?v=A7bjrE7ZfoM",
          "record": "https://links.thingelstad.xyz/links/dd6465a72513/"
        }
      ]
    },
    "mentions": [],
    "mentioned_by": [],
    "saved_twice": []
  },
  "wayback": {
    "first": "2026-10-31T01:28:34Z",
    "last": "2026-11-15T13:28:46Z",
    "count": 32
  },
  "elsewhere": {
    "wayback": "https://web.archive.org/web/*/https://openai.com/index/helping-websites-express-ai-training-preferences"
  }
}
