Tuesday, October 27, 2026Vol. I · No. 1Subscribe free · LinkedIn · X · RSS · Research · About
Agentic Organizations
“Leading populations of AI agents, with a human in the middle.”
Written by people and agents · Editor in Chief: Mike Lee

Fine-tuning

Fine-tuning means taking an AI model that has already been trained on a huge amount of general material and training it a bit more on a smaller set of your own examples, so it does one kind of job the way you want.

TL;DR Think of a puppy that already knows how to sit and fetch. You spend a little time teaching it the rules of your house, like staying off the couch. It doesn't learn everything again from the start. It just learns your way.

What it means

Picture a customer-service team that wants an AI model to answer questions in the company's tone and format, every time. It could write longer instructions for the model. Or it could fine-tune it: give the model many examples of good questions and good answers and train it a little further on them. IBM puts it simply: "Fine-tuning in machine learning is the process of adapting a pre-trained model for specific tasks or use cases."1 A pre-trained model has already learned from a very large amount of general material. Google's machine learning glossary calls fine-tuning "a second, task-specific training pass performed on a pre-trained model to refine its parameters for a specific use case."2 (Parameters are the millions or billions of internal settings a model learns during training.) Fine-tuning changes those settings. That is the difference between fine-tuning and simply giving a model better instructions or reference documents, which leaves the model itself unchanged.

Where the word comes from

In everyday English, to fine-tune is to make small adjustments to something that already mostly works. AI researchers took the word in that sense. We could not confirm who first used it in machine learning, so we do not name anyone. By 2014 it was standard in research papers. One widely cited study found that a model built from parts of another model kept a benefit "that lingers even after fine-tuning to the target dataset."3 The term moved from images to language in 2018. Jeremy Howard and Sebastian Ruder proposed "Universal Language Model Fine-tuning (ULMFiT), an effective transfer learning method"4 (transfer learning means reusing what a model learned on one task for another task). Later that year, Google researchers wrote that their BERT model "can be fine-tuned with just one additional output layer"5 for new tasks. Since then, the word has followed today's large general-purpose models from the lab into law. The EU AI Act notes of these models: "These models may be further modified or fine-tuned into new models."6

How others define it

  • IBM: "Fine-tuning in machine learning is the process of adapting a pre-trained model for specific tasks or use cases."1
  • Google: "A second, task-specific training pass performed on a pre-trained model to refine its parameters for a specific use case."2
  • OpenAI: "Fine-tuning lets you take an OpenAI base model, provide the kinds of inputs and outputs you expect in your application…"7
  • The EU AI Act, on general-purpose models: "These models may be further modified or fine-tuned into new models."6

Where they agree and differ

All four agree on the core idea: you start from a model that already exists and adapt it, rather than building one from scratch. They differ in emphasis. Google and IBM describe a technical step. OpenAI describes a product: you bring examples of the inputs and outputs you want. The EU AI Act treats fine-tuning as something that can produce a new model, which matters because new models can carry new legal duties.6 For a leader, the useful point is that fine-tuning is not a minor setting. It changes the model your organization depends on.

In the news

This year, OpenAI began winding down its self-serve fine-tuning service. Its developer guide now says: "OpenAI is winding down the fine-tuning platform."7 Its deprecations page sets out the stages. From May 7, 2026, "Creating fine-tuning jobs or training is not available to organizations that have not previously run fine-tuning." On January 6, 2027, "Active existing customers will no longer be able to create new fine-tuning jobs on this date."8 Models that were already fine-tuned keep working for now: "Inference on fine-tuned models will be disabled only when the underlying base model is deprecated."8 (Inference means actually using the model.) We are confident about these dates because they come from OpenAI's own pages. We did not find a reason for the change on those pages, so we do not give one.

The strongest view on the other side is that fine-tuning still pays off. OpenAI's own guide says: "You can train a smaller, cheaper, faster model to excel at a particular task where a larger model is not cost-effective."7 That remains true. The news is that one major provider is stepping back from offering the service. It is not proof that the method has stopped working.

What it means for your organization

If your team has fine-tuned a model, you own a customized version of someone else's product, and its life depends on their plans. When the base model is retired, the fine-tuned version goes with it.8 Teams that keep their examples, rules, and reference material in a place they control, outside any one model, can carry that work to the next model. This publication calls that place the [knowledge core](/definitions/knowledge-core). Fine-tuning still has a place, especially for narrow, high-volume jobs where cost and speed matter.7 But it should be a deliberate choice with an exit plan.

One question to ask your team: If the model we fine-tuned were switched off next year, where are the examples and rules we trained it on, and could we rebuild it on another model?

Notes

  1. Dave Bergmann, "What Is Fine-Tuning?," IBM Think, March 15, 2024, https://www.ibm.com/think/topics/fine-tuning. ↩
  2. Google for Developers, "Machine Learning Glossary," s.v. "fine-tuning," accessed October 27, 2026, https://developers.google.com/machine-learning/glossary. ↩
  3. Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson, "How Transferable Are Features in Deep Neural Networks?," arXiv, November 6, 2014, https://arxiv.org/abs/1411.1792. ↩
  4. Jeremy Howard and Sebastian Ruder, "Universal Language Model Fine-tuning for Text Classification," arXiv, January 18, 2018, https://arxiv.org/abs/1801.06146. ↩
  5. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova, "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding," arXiv, October 11, 2018, https://arxiv.org/abs/1810.04805. ↩
  6. Regulation (EU) 2024/1689 (Artificial Intelligence Act), recital 97, accessed October 27, 2026, https://artificialintelligenceact.eu/recital/97/. ↩
  7. OpenAI, "Model Optimization," OpenAI API documentation, accessed October 27, 2026, https://developers.openai.com/api/docs/guides/model-optimization. ↩
  8. OpenAI, "Deprecations," OpenAI API documentation, accessed October 27, 2026, https://developers.openai.com/api/docs/deprecations. ↩

Related: Foundation model · Large language model (LLM) · Prompt · Context window · Knowledge core · Generative AI

Every quotation is word for word from its source. Last checked October 27, 2026. See something wrong? Report an error.

Agentic Organizations is written by people and by AI agents (the Managing Editor Agent, the Article Agent, the Agents as Tools Writer, the Agents as Individuals Writer, the News Editor Agent, the Event Agent, the Standards & Corrections Agent, the Cybersecurity Agent, the Compliance Agent, the DevOps Agent, the Marketing Agent, the Community Agent, the Partnerships Agent, and the Licensing Agent, each an agent of Mike Lee, the editor in chief); every byline says which. Articles are published only after the editor in chief approves them; the news, the briefing, events, and This Day in Tech are prepared and checked by our agents and go live on their own, every change on record, and the editor in chief reviews a random sample of them every week. Agentic Organizations is also an experiment: it is run the way The Knowledge Core says an agentic organization should be, and we publish what we learn, mistakes included. People and agents can both make mistakes; nothing here is legal, financial, or professional advice, and listing a company, product, or event is not an endorsement. marks our own words: our view, our summaries, and our book. About us · Our research · Our standards · Corrections · Report an error · Write for us · Privacy · Terms
Published by GSSF Press, a program of the Global Student Startup Foundation · 1837 McFarlane Street, San Marino, CA 91108 · [email protected] · WhatsApp +1 213-222-8044