M ManySignal
← All posts
How-To Guides Mar 8, 2026 · 9 min read

The Analyst Feedback Loop

MH

Marcus Hale

Head of Detection

The Analyst Feedback Loop is not an abstract topic for enterprise security teams — it sits at the intersection of the pressures that define modern security operations: alert volumes that outrun human capacity, budgets taxed by ingestion pricing, auditors demanding evidence, and a talent market that cannot fill the seats. This piece looks at the operational reality behind the headline, drawing on the patterns we see across enterprise SOCs and MDR practices every week.

The thread connecting all of it: the traditional SOC operating model scales with headcount, and headcount is the one input enterprises cannot scale. What follows is an honest tour of the pain points — and what changes when the work itself, rather than the humans, becomes the thing that scales.

01

The talent market will not save you

The global shortfall of security professionals is estimated at around four million people, and the gap widens every year. For enterprises outside the tech-salary tier — hospitals, manufacturers, regional banks, public agencies — the practical reality is that senior detection engineers and experienced responders are effectively unhirable. The job postings stay open for nine months and then get quietly rewritten to junior level.

So the industry props itself up on outsourcing, and the maths of shared-service MDR asserts itself: one provider analyst covers many clients, so the analyst who catches your incident at 4 a.m. has never seen your environment, does not know your naming conventions, and escalates with a generic ticket that your on-call engineer must re-investigate from scratch. You have outsourced the alert, not the understanding.

The uncomfortable strategic conclusion is that any operating model whose scaling unit is 'experienced human' is structurally broken for the next decade. The only inputs that scale are compute and context. The enterprises getting ahead are the ones re-basing their SOC on those inputs and reserving their scarce humans for judgment, governance, and the genuinely novel.

02

Reporting risk upward without losing the plot

Somewhere between the SOC floor and the boardroom, security information degrades into decoration. The team works in findings and indicators; the board wants exposure, trend, and dollars. The translation layer is usually a slide deck assembled the night before the risk committee, cherry-picking metrics that are easy to extract rather than metrics that are true: alert counts (meaningless), phishing click rates (noise), patching percentages (stale on arrival).

The metrics that would actually inform a capital-allocation decision — time from detection to verdict, percentage of alerts investigated to conclusion, containment time by asset criticality, false-positive trend by detection — are precisely the ones a human-queue SOC cannot produce honestly, because producing them would document the backlog. Nobody presents a slide that says 'we investigate 40 percent of what we detect'.

This is how boards end up approving eight-figure security budgets on vibes and fear. The fix is not better slide design. It is an operational system where every alert reaches a recorded verdict, so the numbers reported upward are queries against reality rather than curated samples of it.

03

The automation trust gap

Every enterprise has automation it is afraid to turn on. The SOAR playbook that could disable a compromised account runs in 'create a ticket' mode, because the one time it ran for real it locked out a departmental VP during quarter close. The lesson organisations draw — automation is dangerous — is the wrong lesson. The right one is that automation without graduated governance is dangerous.

The change board's questions are legitimate: What exactly will this action touch? What happens if the verdict is wrong? Who approved this scope, and how do we undo it? Most automation platforms answer none of these. They offer a run button and a log, which is why enterprise response automation stalls at sending notifications while actual containment still waits for a human with production access and a change ticket.

Closing the gap requires treating autonomy as something earned per action class, not granted globally: recommend-only until precision is proven, approval gates where blast radius warrants, dry-run previews before anything writes, rollback state recorded for everything reversible, and a kill switch that stops it all instantly. With those primitives, automation stops being a leap of faith and becomes a controlled delegation — which is the only form of delegation an enterprise should accept.

04

Burnout is an architecture problem

The average tenure of a tier-1 SOC analyst in a large enterprise is under two years, and exit interviews are monotonous in their consistency: the work is repetitive, the false-positive rate is demoralising, and the path to interesting work is blocked by the queue itself. Organisations respond with wellness programmes and retention bonuses, treating an architectural problem as an HR problem. No bonus makes it fulfilling to close the same impossible-travel false positive forty times a week.

The cost compounds quietly. Every departure takes environment-specific knowledge that never made it into a runbook — which service accounts behave strangely at month-end, which subnet the scanner lives on, which VP travels constantly and trips geo-velocity rules. The replacement starts from zero, triages worse for six months, escalates more noise to tier 2, and the seniors who should be hunting spend their days re-answering questions the departed analyst had already answered.

This is the hidden tax of the human-queue model: the institution never accumulates judgment. Knowledge lives in people, people leave, and the SOC's effective experience level stays permanently junior no matter how long the SOC has existed. Any serious fix has to move that judgment into a system that does not resign.

05

The ingestion tax: paying more to know less

SIEM economics are the quiet scandal of enterprise security budgets. Per-gigabyte pricing means the bill scales with data growth, not with value delivered — and security telemetry grows 30 to 40 percent a year as estates move to cloud. Security leaders now spend real engineering time deciding which logs not to collect, which is a sentence that should alarm every board member: the team charged with seeing everything is financially incentivised to look at less.

The workarounds have become an industry of their own. Routing verbose sources to cold storage, sampling flow logs, dropping DNS queries, keeping ninety days when investigations routinely need a hundred and eighty. Every one of these decisions is invisible until an incident, at which point the responder discovers the exact telemetry needed to scope the breach was filtered out to save four thousand dollars a month. The fine for the breach starts at seven figures.

Meanwhile the SIEM itself does less than buyers assume. It stores, indexes, and alerts. The expensive part — deciding what an alert means — is left to the customer. Enterprises effectively pay a premium tax on raw material and then pay again, in analyst salaries, to refine it.

06

False positives and the tuning treadmill

Ninety-plus percent of alerts in a typical enterprise queue are false positives, and every one of them costs the same analyst minutes as a real one. But the deeper damage is psychological: after the four-hundredth benign impossible-travel alert, an analyst's prior flips. The default assumption becomes 'this is noise', and the one alert in a thousand that is real gets pattern-matched into the same dismissal. Alert fatigue is not laziness; it is Bayesian reasoning applied to a broken signal.

So teams tune. Detection engineers spend their weeks adding exceptions — this service account, that IP range, this VP who travels. Each exception fixes today's noise and silently narrows tomorrow's coverage, and nobody re-reviews the pile because there is no time. Tuning debt accumulates exactly like technical debt, invisible until an attacker walks through a hole that was carved out to silence a false positive in 2024.

The root cause is that static rules cannot encode context. Whether a login from Lisbon is suspicious depends entirely on who the identity is and what it usually does. Without a behavioural baseline per identity and per asset, every threshold is wrong for someone — too loud for the traveller, too quiet for the service account that should never leave the building.

"The agentic SOC only works if every verdict can show its evidence. That is the bar this platform is built to."

The ManySignal take

What an agentic SOC changes

The agentic model attacks these pain points at their common root: the assumption that investigation capacity must be human. In ManySignal's architecture, telemetry from cloud, identity, endpoint, and code normalises into a temporal entity graph with behavioural baselines computed per identity and per asset. When a detection fires, an AI triage agent answers a structured question set against that graph — is this normal for this entity, is it correlated with other findings, how close is it to critical assets — and renders a verdict with a confidence score and the full evidence trail attached. Every alert gets this treatment, not the fraction a human rota can reach.

Response is governed rather than merely automated. The autonomy ladder grants capability per action class — recommend-only, approve-gated, autonomous — with dry-run previews, blast-radius limits, rollback state, and a tenant-level kill switch enforced by the engine itself. Compliance evidence generates itself as a by-product: every question, answer, weight, verdict, and action lands on an immutable timeline that auditors can replay. The result is a SOC whose capacity scales with compute, whose knowledge compounds instead of resigning, and whose every decision can show its work — run in-house, or consumed as transparent MDR.

None of these pain points is new, and none of them is solved by another dashboard. They are symptoms of an operating model that asks humans to do machine-shaped work — repetitive, contextual, around-the-clock — and then wonders why the queue grows and the people leave. The enterprises pulling ahead are not the ones with the most tools; they are the ones that moved investigation into software, kept judgment with humans, and made every automated decision auditable.

That is the bet behind ManySignal's agentic SOC and MDR platform: every alert worked to an evidence-weighted verdict, every action governed by an autonomy ladder you control, every decision on an immutable record. If the analyst feedback loop is on your roadmap this year, start by asking one question of your current operation: what percentage of your alerts reach a documented conclusion? If the honest answer makes you uncomfortable, the model — not the team — is the problem.

MH

Marcus Hale

Head of Detection

Writes about detection engineering, agentic security operations, and what it actually takes to move an enterprise SOC beyond the alert queue.

Frequently asked questions

What is The Analyst Feedback Loop in an agentic SOC?

The Analyst Feedback Loop is part of ManySignal's agentic SOC and MDR platform, where AI agents detect, triage, investigate, and respond to threats with human-governed autonomy.

How does ManySignal handle the analyst feedback loop?

ManySignal grounds the analyst feedback loop in a temporal entity graph and behavioural baselines, so every verdict is backed by auditable evidence rather than opaque scores.

Can ManySignal replace my SOAR or MDR for the analyst feedback loop?

Yes. ManySignal combines detection, triage, investigation, response, and reporting in one platform, and can operate as your MDR or augment an existing SOC team.

How is autonomy governed?

Through an autonomy ladder: recommend-only, approve-gated, and autonomous modes per action class, with dry-run previews, blast-radius limits, and a one-click tenant kill switch.

How fast is time to value?

Declarative connectors and shipped detections typically produce AI agent verdicts on live alerts within days, not quarters — no parsing projects or playbook-building phase.

Is ManySignal available as a managed service?

Yes. Consume ManySignal as MDR with 24/7 coverage and monthly reporting, run it as your in-house agentic SOC, or use it as the platform behind your own MDR practice.

How does ManySignal license the platform?

Pricing scales with protected assets and autonomy tier, not per-GB ingestion or per-alert volume. Starter, Growth, and Enterprise plans are available; MDR providers receive volume discounts for multi-tenant deployments.

Where does our data reside?

By default in AWS us-east-1. Enterprise tenants can pin data to specific AWS regions, deploy self-hosted on their own Kubernetes cluster, or use customer-managed encryption keys (CMK) to retain cryptographic control.

What does the evidence trail contain?

Each verdict stores the full question set, per-question agent answers, confidence weights, source event references, entity graph snapshots, and operator attestation — preserved immutably for the retention period chosen at contract time.

How does ManySignal handle a false-positive alert?

The triage agent auto-closes findings it assesses as false positives with a documented rationale — which rule fired, why the evidence fails to support escalation, and the entity baseline that informed the decision. Auto-closure rates typically reach 85–95% within 90 days as baselines mature.

Continue reading

See the agentic SOC in action

Watch AI agents work a real alert queue — verdicts, evidence, and confidence scores included. In-house SOC or MDR, your call.