# What Is ChatGPT Doing … and Why Does It Work?—Stephen Wolfram Writings

<https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/>

- Host: [writings.stephenwolfram.com](https://links.thingelstad.xyz/hosts/writings.stephenwolfram.com/)
- Saved: February 17, 2023 (2023-02-17T20:19:30Z)
- Record: https://links.thingelstad.xyz/links/e3937fe71418/
- JSON: https://links.thingelstad.xyz/links/e3937fe71418.json

## What Jamie wrote

Wolfram is an expert at many things, including neural nets and the foundational functions of AI. This writeup is very long (I skimmed it and plan to give it a full read later), but the clarity of the models, the math, and how these Generative AI's and LLMs work is fabulous. I love his analysis of our, meaning us humans, view of the things that ChatGPT is doing (bolding my addition).

> But there’s something potentially confusing about all of this. In the past there were plenty of tasks—including writing essays—that we’ve assumed were somehow “fundamentally too hard” for computers. And now that we see them done by the likes of ChatGPT we tend to suddenly think that computers must have become vastly more powerful—in particular surpassing things they were already basically able to do (like progressively computing the behavior of computational systems like cellular automata).
> 
> But this isn’t the right conclusion to draw. Computationally irreducible processes are still computationally irreducible, and are still fundamentally hard for computers—even if computers can readily compute their individual steps. And instead what we should conclude is that tasks—like writing essays—that we humans could do, but we didn’t think computers could do, are actually in some sense computationally easier than we thought.
> 
> In other words, **the reason a neural net can be successful in writing an essay is because writing an essay turns out to be a “computationally shallower” problem than we thought**. And in a sense this takes us closer to “having a theory” of how we humans manage to do things like writing essays, or in general deal with language.

If you find this topic interesting this is a super read, and it helps clearly show the boundaries of this technology. I also love the idea that there are problems that "computationally shallower" than we really think. I wonder how our own view of our unique human-ness plays into that perception.

## Facts

- Kind: [Page](https://links.thingelstad.xyz/kinds/page/)

## Appears in

- [WT243: Weekly Thing #243 / Montaigne, Ordinals, Salsa + Ukraine Fundraiser!](https://weekly.thingelstad.com/archive/243/), Notable

## Same host

- [Wolfram|Alpha as the Way to Bring Computational Knowledge Superpowers to ChatGPT—Stephen Wolfram Writings](https://links.thingelstad.xyz/links/95dfaefb3b90/) (writings.stephenwolfram.com, January 28, 2023)
- [ChatGPT Gets Its “Wolfram Superpowers”!—Stephen Wolfram Writings](https://links.thingelstad.xyz/links/9754b8b1f218/) (writings.stephenwolfram.com, March 28, 2023)
- [Prompts for Work & Play: Launching the Wolfram Prompt Repository—Stephen Wolfram Writings](https://links.thingelstad.xyz/links/0d0c91b4a8fc/) (writings.stephenwolfram.com, June 13, 2023)
- [How to Think Computationally about AI, the Universe and Everything—Stephen Wolfram Writings](https://links.thingelstad.xyz/links/4ef9029dd658/) (writings.stephenwolfram.com, October 31, 2023)

## Saved the same week

- [“Battery Daddy” Battery Organizer Storage Case — Tools and Toys](https://links.thingelstad.xyz/links/c059c9352767/) (toolsandtoys.net, February 16, 2023)
- [What is HRV (Heart Rate Variability)?](https://links.thingelstad.xyz/links/8e53f830191b/) (ouraring.wpengine.com, February 16, 2023)
- [Plan to write. Write to learn. - without bullshit](https://links.thingelstad.xyz/links/6f66d171d0df/) (withoutbullshit.com, February 16, 2023)
- [Why a Conversation With Bing’s Chatbot Left Me Deeply Unsettled - The New York Times](https://links.thingelstad.xyz/links/e7935a15c143/) (nytimes.com, February 16, 2023)
- [Bing: “I will not harm you unless you harm me first”](https://links.thingelstad.xyz/links/fa1b1efc4200/) (simonwillison.net, February 16, 2023)

## Elsewhere

- Wayback Machine: https://web.archive.org/web/*/https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/