arstechnica.com · Saved

The generative AI revolution has begun—how did we get here? | Ars Technica

arstechnica.com/gadgets/2023/01/the-generative-ai-revolution-has-begun-how-did-we-get-here

What Jamie wrote

Great article summarizing what got us so many advances in AI so quickly. What was the key enabling technology, as well as the approaches that allowed such quick progress.

To sum up, the breakthrough with generative image models is a combination of two AI advances. First, there's deep learning's ability to learn a “language” for representing images via latent representations. Second, models can use the “translation” ability of transformers via a foundation model to shift between the world of text and the world of images (via that latent representation).

I found this interesting because it helps frame up domains that are more or less appropriate for these AI models. If you lack a similar structure in a domain, pursing an AI solution to work with it is going to be very difficult.