# Fine-tuning NLP transformers for task automation - Jon Eskin's Blog

<https://jeskin.net/blog/finetune-nlp-transformers/>

- Host: [jeskin.net](https://links.thingelstad.xyz/hosts/jeskin.net/)
- Saved: November 24, 2024 (2024-11-24T14:47:23Z)
- Record: https://links.thingelstad.xyz/links/576ba1093d7a/
- JSON: https://links.thingelstad.xyz/links/576ba1093d7a.json

## What Jamie wrote

This article highlights what I suspect is going to be a very common and powerful way to get benefit from AI. There are many tasks that need to be done where an "intelligent" approach would be a big win, but you don't need "too much" intelligence. Why not bring a simple model with very defined training to the problem.

> For simplicity, I ran with the assumption that each string of text had one and only one classification. It would be much more useful if each string of text instead could have 0-3 classifications. This would also almost certainly bring down the accuracy of the model because determining whether a given string belongs to a single category at all seems like it would be a much more complex task than what it had to learn during training.
> 
> After 3 epochs, the model achieves an **accuracy of 100% and loss of 0.156 on the test set** and an **accuracy of 99.59% and loss of 0.0278 on the training set**.

Here the test was to look at emails and classify them. There are many, many tasks like this in modern workflows.

## Facts

- Kind: [Page](https://links.thingelstad.xyz/kinds/page/)

## Appears in

- [WT303: Weekly Thing 303 / Petnames, Synapse, jless](https://weekly.thingelstad.com/archive/303/), Notable

## Saved the same week

- [Generative AI’s Potential to Improve Customer Experience | Bain & Company](https://links.thingelstad.xyz/links/4d41322641dd/) (bain.com, November 24, 2024)
- [Retool | A better way to build custom software](https://links.thingelstad.xyz/links/95c63e09e8c2/) (retool.com, November 24, 2024)
- [Synapse bankruptcy: Thousands of Americans see their savings vanish](https://links.thingelstad.xyz/links/be9acc5bf43b/) (cnbc.com, November 24, 2024)
- [Oncall shift should be Tuesday to Tuesday](https://links.thingelstad.xyz/links/e4751c877d74/) (arthur-johnston.com, November 24, 2024)
- [Iceland’s shorter working week has been a huge success – and it’s changed my family’s life | The Guardian](https://links.thingelstad.xyz/links/e76ebff02d0d/) (theguardian.com, November 24, 2024)

## Elsewhere

- Wayback Machine: https://web.archive.org/web/*/https://jeskin.net/blog/finetune-nlp-transformers/