What a large language model is, in plain terms
A large language model predicts likely text. That is all, and it is enough to be useful. What it can do, what it cannot, and why it sometimes lies.
The short answer
A large language model is a program trained on a vast amount of text to do one thing: given some text, predict what text is likely to follow. Trained at enough scale, that single skill turns out to cover answering questions, summarising documents, translating, drafting emails and writing code, because all of those are “what text would come next” problems.
That is the whole trick. Understanding it explains both why these systems are so useful and why they fail the way they do.
What it can do well
- Read and classify. Decide what an email is about, which department it belongs to, whether a review is positive.
- Extract. Pull names, dates, amounts and references out of messy text and put them in fields.
- Summarise. Turn a long document, thread or meeting transcript into the three points that matter.
- Draft. Write a first version of a reply, a proposal section or a product description, in your tone if shown examples.
- Transform. Translate, rewrite for a different audience, convert between formats.
- Answer from given material. When handed the right documents, answer questions about them accurately.
What it cannot do
| It cannot | Because | What to do instead |
|---|---|---|
| Know facts it was not trained on or given | It predicts text, it does not look things up | Give it the documents or connect it to your data |
| Know your business | Your processes are not in its training data | Put them in the instructions and the context |
| Know when it is wrong | Fluent text feels the same to it whether true or not | Check outputs that matter; ask it to cite its sources |
| Do arithmetic reliably | Numbers are text to it | Let real code do the maths; let the model explain the result |
| Remember between sessions | Each conversation starts empty unless memory is built in | Store what matters in your systems, not in the chat |
| Act in your systems | It produces text, not actions | Connect it through controlled tools with clear limits |
What makes it useful for a business
The model on its own is a talented generalist with no context. It becomes useful when three things are added:
- Context. Your documents, your product data, your past emails, retrieved and handed to the model when relevant, so it answers from your facts instead of general patterns.
- Instructions. What role it plays, what tone, what it must never do, what format to answer in. Written once, refined over time.
- A place in a process. A defined step, before a person or a rule, with logging, so it does useful work and mistakes are caught. This is what turns a model into an automation.
What this means for you
You do not need to understand how a model is built. You need to hold two ideas at once: it is genuinely capable at reading, extracting, summarising and drafting, and it is fundamentally a text predictor that does not know when it is wrong. Every good use in a business follows from combining the two: give it context, put it in a process, and check what matters.
Frequently asked questions
Does the model learn from what we type into it?
Depends entirely on the product and the settings. Consumer tools may use your input to improve their models unless you opt out; business tiers and API access typically do not. Never assume; check the terms and use a company account with data training disabled for anything work-related.
Why does it make things up?
Because it is producing likely text, not retrieving facts. When it does not have the information, the most likely continuation is still a fluent sentence, so it writes one. This is called hallucination. The fix is to give it the facts it needs, ask it to cite what it used, and check anything that matters.
Is a chatbot the same as a language model?
A chatbot is one product built on a model, with an interface and instructions around it. The model can just as well sort email, extract data from invoices or draft replies with no chat window at all. Most business value is in those quieter uses.
Which model should my business use?
It depends on the task, the cost, the speed and where your data may go. Models differ in quality, price and privacy terms, and they change every few months. Design your automation so the model can be swapped, and choose per task rather than once for everything.