What an AI agent is, and when it is more than a chatbot

An AI agent does not just answer, it acts: plans steps, uses tools, checks results. What that means, where it is ready for business use, and where it is not.

3 minread 650words last updated

The short answer

A chatbot takes a message and returns an answer. An AI agent takes a goal and works towards it: it decides what to do first, does it using a tool it has been given, looks at what came back, decides what to do next, and keeps going until the goal is reached or it cannot continue. The model is the same kind of language model as in a chatbot. What makes it an agent is the loop and the tools.

That is a large step up in usefulness, and a large step up in what can go wrong.

Chatbot versus agent

ChatbotAgent
InputA messageA goal
OutputTextA completed task, or a report on why not
ToolsNone, or searchWhatever it is permitted: email, CRM, calendar, files, APIs
StepsOneMany, decided as it goes
Failure modeA wrong answerA wrong action
NeedsContext and instructionsContext, instructions, tools with limits, logging, a stop condition

Where the power comes from, and the risk

An agent that can read your inbox, search your CRM and draft replies can triage a morning’s email before you sit down. An agent that can also send those replies can send the wrong one to a customer. Same agent, one extra permission.

What agents do well today

  1. Research and summarise. Read across many documents or pages, extract what matters, produce a structured summary with sources. Reversible, checkable, valuable.
  2. Prepare and propose. Draft the reply, the quote, the report, the plan. A person approves. The agent did the ninety percent that was typing.
  3. Gather and structure data. Pull information from several systems into one place, in a consistent format, for a person or another process to use.
  4. Sort and route. Read incoming work, classify it, attach the relevant context, put it in front of the right person.
  5. Run checks. Review a document against a checklist, compare two versions, flag what does not match. Tireless and consistent.

Where they are not ready

Anything unattended where a wrong action is expensive or hard to reverse: sending to customers without review, moving money, changing prices, deleting data, committing the company to anything. Not because the technology cannot try, but because “usually right” is not the standard for those actions, and no amount of prompting changes the fact that the model does not know when it is wrong.

What this means for you

If you are offered an “AI agent”, ask three questions: what goal is it given, which tools may it use, and who reviews the result before anything irreversible happens. Good answers describe a bounded task with read and draft permissions and a person at the end. From there, the agent earns more autonomy the way anyone does, by a record of getting it right.

Written by the CivSec S.M.A.R.T team

We build and run websites, software and AI systems for businesses. We write about what we see in that work, in plain language, and we update articles when things change.

Last checked . Spotted something outdated? Tell us.

Frequently asked questions

Is an agent just a chatbot with extra steps?

The extra steps are the point. A chatbot produces text in response to a message. An agent loops: decide what to do next, do it using a tool, look at the result, decide again, until the goal is met or it gets stuck. That loop lets it complete tasks, not just describe them.

What tools can an agent use?

Anything you connect and permit: web search, reading and sending email, your CRM, your calendar, a database, a spreadsheet, other software through its API. Each tool is a capability and a permission. The design work is deciding which ones, with which limits.

Can an agent make expensive mistakes?

Yes, if it is allowed to. An agent with permission to send email will occasionally send the wrong email. The fix is not to hope it will not; it is to give it draft permission rather than send permission, to cap what it can do per run, and to log everything so mistakes are visible and reversible.

Where do agents work well today?

Research and summarising across many sources, preparing drafts that a person approves, gathering and structuring data from several systems, sorting and routing incoming work, and running multi-step checks such as reviewing a document against a checklist. Bounded goals, reversible actions, a person at the end.