Continuous security: why one test per year is not enough
Why a yearly security test leaves a website exposed for most of the year, and what continuous security looks like for a small business without a security team.
The short answer
A security test once a year gives a business a snapshot: on that day, against what was known, the site had these findings. It says nothing about the other three hundred and sixty-four days, during which vulnerabilities in the packages the site is built from are disclosed weekly, the site changes, accounts change hands and configuration drifts. A site is exposed from the day a vulnerability in one of its dependencies is announced until the day the update is applied, and with a yearly rhythm that can be months. Continuous security replaces the snapshot with a baseline: checks that run on every change and on a schedule, updates applied within days of a relevant advisory, monitoring that notices when something is wrong, and a monthly routine that confirms all of it. For a small business without a security team this is mostly automation and a partner’s routine, it costs less than the incident it prevents, and it leaves the yearly test with its proper role as the deep check on top rather than the only check.
Snapshot versus baseline
| Aspect | Yearly test only | Continuous baseline plus a yearly deep check |
|---|---|---|
| New vulnerability in a dependency | Unknown until the next test, or an incident | Flagged within hours; updated within days |
| A leaked secret | Found a year later, if at all | Blocked at commit or flagged the same day |
| Configuration drift | Accumulates | Checked on every change and monthly |
| A compromised account or an anomaly | Noticed by a customer | Alerted by monitoring |
| Changes to the site | Untested until the next test | Scanned on every change; reviewed when material |
| Evidence for clients | One report, ageing | Monthly reports plus the yearly report |
| Cost profile | One invoice | Small routine plus one invoice |
| Exposure window | Up to a year | Days |
What continuous security consists of
- Scanning in the pipeline: dependencies, secrets and static analysis on every change.
- Advisory monitoring: alerts when a package you use has a disclosed vulnerability, with updates applied within a defined time by severity.
- Scheduled application scans against the live site or its preview, weekly or monthly.
- Configuration checks after every change to hosting, headers or DNS.
- Monitoring and alerting: uptime, errors, unusual traffic, failed logins, changes to DNS and certificates.
- A monthly routine: updates applied, backups tested, access reviewed, logs sampled, report written.
- A yearly deep check: manual review or penetration test, on top of the baseline.
- A response plan for when any of the above finds something.
What it asks of the business
Very little beyond an arrangement that names it and a monthly report that proves it. The scanning, updating and monitoring are the partner’s work; the business’s part is reading the report, approving the occasional update that needs a decision, and keeping access and accounts current. That is a manageable routine for any business, and it is the difference between a year of exposure and a year of small, handled events.
What this means for you
Treat a yearly test as the deep check, not the baseline. Put scanning in the pipeline, watch advisories and update within days, scan on a schedule, monitor and alert, run a monthly routine with a report, and keep the yearly deep check on top. For a small business that is a maintenance arrangement and an hour of reading a month, and it turns a year-long exposure window into a few days.
Frequently asked questions
We passed a security test in March. Are we safe now?
You were safe against what was known in March, at the state the site was in in March. Since then, dependencies have had vulnerabilities disclosed, the site has changed, accounts have come and gone, and configurations have drifted. A test is a valuable point in time; safety over the year comes from what runs between tests.
What does continuous security cost a small business?
Mostly setup and routine. Dependency and secret scanning are free features of modern platforms. Automated updates with tests cost the pipeline minutes. Monitoring and alerting are a small monthly fee. The monthly routine is an hour or two of a partner's time. Compared with a yearly test alone, the total is similar; compared with an incident, it is a rounding error.
Who does this if we have no technical staff?
Your partner, under a maintenance arrangement that names it: scanning in the pipeline, updates within defined times after advisories, a monthly routine with a report, monitoring with alerts to them, and a yearly deeper review. The report is how you know it happened. Without such an arrangement, nobody is doing it, and the yearly test is discovering a year of drift.
Sources
- NCSC (UK): Vulnerability management guidance (accessed 2026-09-12)