What a large language model is, in plain terms

A large language model predicts likely text. That is all, and it is enough to be useful. What it can do, what it cannot, and why it sometimes lies.

3 minread 724words last updated

The short answer

A large language model is a program trained on a vast amount of text to do one thing: given some text, predict what text is likely to follow. Trained at enough scale, that single skill turns out to cover answering questions, summarising documents, translating, drafting emails and writing code, because all of those are “what text would come next” problems.

That is the whole trick. Understanding it explains both why these systems are so useful and why they fail the way they do.

What it can do well

  • Read and classify. Decide what an email is about, which department it belongs to, whether a review is positive.
  • Extract. Pull names, dates, amounts and references out of messy text and put them in fields.
  • Summarise. Turn a long document, thread or meeting transcript into the three points that matter.
  • Draft. Write a first version of a reply, a proposal section or a product description, in your tone if shown examples.
  • Transform. Translate, rewrite for a different audience, convert between formats.
  • Answer from given material. When handed the right documents, answer questions about them accurately.

What it cannot do

It cannotBecauseWhat to do instead
Know facts it was not trained on or givenIt predicts text, it does not look things upGive it the documents or connect it to your data
Know your businessYour processes are not in its training dataPut them in the instructions and the context
Know when it is wrongFluent text feels the same to it whether true or notCheck outputs that matter; ask it to cite its sources
Do arithmetic reliablyNumbers are text to itLet real code do the maths; let the model explain the result
Remember between sessionsEach conversation starts empty unless memory is built inStore what matters in your systems, not in the chat
Act in your systemsIt produces text, not actionsConnect it through controlled tools with clear limits

What makes it useful for a business

The model on its own is a talented generalist with no context. It becomes useful when three things are added:

  1. Context. Your documents, your product data, your past emails, retrieved and handed to the model when relevant, so it answers from your facts instead of general patterns.
  2. Instructions. What role it plays, what tone, what it must never do, what format to answer in. Written once, refined over time.
  3. A place in a process. A defined step, before a person or a rule, with logging, so it does useful work and mistakes are caught. This is what turns a model into an automation.

What this means for you

You do not need to understand how a model is built. You need to hold two ideas at once: it is genuinely capable at reading, extracting, summarising and drafting, and it is fundamentally a text predictor that does not know when it is wrong. Every good use in a business follows from combining the two: give it context, put it in a process, and check what matters.

Written by the CivSec S.M.A.R.T team

We build and run websites, software and AI systems for businesses. We write about what we see in that work, in plain language, and we update articles when things change.

Last checked . Spotted something outdated? Tell us.

Frequently asked questions

Does the model learn from what we type into it?

Depends entirely on the product and the settings. Consumer tools may use your input to improve their models unless you opt out; business tiers and API access typically do not. Never assume; check the terms and use a company account with data training disabled for anything work-related.

Why does it make things up?

Because it is producing likely text, not retrieving facts. When it does not have the information, the most likely continuation is still a fluent sentence, so it writes one. This is called hallucination. The fix is to give it the facts it needs, ask it to cite what it used, and check anything that matters.

Is a chatbot the same as a language model?

A chatbot is one product built on a model, with an interface and instructions around it. The model can just as well sort email, extract data from invoices or draft replies with no chat window at all. Most business value is in those quieter uses.

Which model should my business use?

It depends on the task, the cost, the speed and where your data may go. Models differ in quality, price and privacy terms, and they change every few months. Design your automation so the model can be swapped, and choose per task rather than once for everything.