# Making it easier for websites to express AI training preferences

<https://openai.com/index/helping-websites-express-ai-training-preferences>

- Host: [openai.com](https://links.thingelstad.xyz/hosts/openai.com/)
- Saved: November 1, 2026 (2026-11-02T04:13:55Z)
- Record: https://links.thingelstad.xyz/links/14b39e2399e0/
- JSON: https://links.thingelstad.xyz/links/14b39e2399e0.json

## What Jamie wrote

I can tell you that on any given day about 10% of the traffic to all of my websites is from malicious actors, and then depending on the day about 30-40% is from crawlers. The web is full of robots these days. There are also a lot of folks, particularly in the IndieWeb space that are actively working to fight away bots and don't want anyone indexing their sites.

I'm going the complete other way. I have open `robots.txt` on all my sites. I've adopted the `llms.txt` standard for nearly every site I have. I even have many of my sites publishing static JSON objects to make it easier for agents and other code to interface with them. Check out the [full LLMs.txt for my Things I've Built](https://thingelstad.xyz/llms-full.txt).

My plan is to lean into discoverability. Lean into what I think of as the true sharing nature of the web. Regardless of who or _what_ is on the other side.

## Facts

- Kind: [Page](https://links.thingelstad.xyz/kinds/page/)
- Wayback Machine: first captured October 2026, 32 captures

## Appears in

- [WT355: WT355 — Writing, Building, and the Open Web](https://weekly.thingelstad.com/archive/355/), Notable

## Same host

- [Introducing dots | OpenAI](https://links.thingelstad.xyz/links/f806dd97b317/) (openai.com, September 30, 2026)
- [Introducing dots | OpenAI](https://links.thingelstad.xyz/links/881ae6cc36c3/) (openai.com, October 8, 2026)
- [Scaling Git at OpenAI](https://links.thingelstad.xyz/links/64b539777c9b/) (openai.com, November 3, 2026)
- [Introducing ChatGPT Wallet](https://links.thingelstad.xyz/links/79d13e040f6e/) (openai.com, November 15, 2026)
- [Introducing GPT-6.2 Astra and Sol](https://links.thingelstad.xyz/links/b02ac3a3fe5a/) (openai.com, November 17, 2026)

## Saved the same week

- [API credits benefit for eligible ChatGPT subscriptions](https://links.thingelstad.xyz/links/2686ec1eaed7/) (simonwillison.net, October 30, 2026)
- [Building a multiplayer game world with autonomous Fable-class models](https://links.thingelstad.xyz/links/a0c591335685/) (simonwillison.net, October 30, 2026)
- [OpenAI Adds iCloud Calendar and Mail Plugins and Dot Texting](https://links.thingelstad.xyz/links/4dbccf41c6d4/) (macstories.net, October 30, 2026)
- [Dagu: Local-first workflow orchestration that just works](https://links.thingelstad.xyz/links/3dd0acbbba9c/) (dagu.sh, November 1, 2026)
- [Vince Cabansag of Clockwork Wins the Public Service Tekne Award 2026](https://links.thingelstad.xyz/links/dd6465a72513/) (youtube.com, November 1, 2026)

## Elsewhere

- Wayback Machine: https://web.archive.org/web/*/https://openai.com/index/helping-websites-express-ai-training-preferences
