Threat Hunting Fundamentals
What is threat hunting?
Threat hunting is the proactive practice of searching through your security data for evidence of attacker activity that no alert has fired on yet. A SOC waits for a detection rule to trip and then works the alert. Threat hunting goes the other way, a hunter forms a hypothesis about what an attacker might be doing, then investigates through logs across the environment to prove or disprove it.
Most organizations do not have the time or resources to hunt deeply enough, broadly enough, or frequently enough to meaningfully reduce their risk. A single hypothesis can take an analyst hours to validate by hand across Sentinel, Splunk, EDR, and cloud sources. Meanwhile alerts continue to demand immediate attention. As a result, threat hunting drops to a periodic, secondary activity and the team stays reactive.
What a hunter is really looking for is evidence, such as a compromised identity moving laterally, or a low-and-slow campaign that deliberately moves slowly enough to stay under the detection rules. That kind of activity often shows up in historical data. Threat hunting is the discipline of looking for that data before the incident, not after.
Is threat hunting proactive or reactive?
Proactive. Threat hunting is the proactive counterpart to the reactive alert queue, intended to find threats before they ever surface as a SOC alert. A reactive workflow waits for a detection rule to fire and then responds. A hunt goes looking on a hypothesis, before anything has tripped, which is what makes it proactive rather than a response to something that already happened.
Historically threat hunting has been hard to use properly because hunting is expensive in analyst hours and most teams can only run a handful of hypotheses a week. Every threat you catch in a hunt, though, is one less set of alerts in your SOC queue, one less incident your responders have to work later, and one less attack that goes undetected until after it has occurred.
What's the difference between threat hunting and threat detection?
Threat detection is a set of pre-written rules that watch for activity associated with known attacks. The SIEM or EDR use detection rules to match activity against a signature or correlation rule that a detection engineer built ahead of time. When the activity matches, an alert fires. That is efficient and necessary, but it only ever catches what someone already knew to look for.
Hunting operates in the space the rules don't cover. A hunter assumes an attacker may already be inside, forms a hypothesis about what the attacker's behavior would look like, and goes digging through the logs to see if it's there. The output of a good hunt often becomes a new detection rule to automate looking for those same behaviors, so hunting actually feeds detection over time.
Detection is bounded by its rule set. Hunting is bounded only by what a hunter can imagine and the data can prove. When the Simbian AI Threat Hunt Agent finds a legitimate kill-chain-shaped pattern that never fired an alert, it flags the specific missing detection rule and recommends it, such as adding auto-isolate on ransomware detection in CrowdStrike. As a result, every hunt hardens detection, even the ones that come back benign, because the pattern was real, the rule was just missing.
What's the difference between threat hunting and incident response?
Threat hunting answers "did a security incident happen," and thus sits upstream of incident response. Incident response is "we know an incident happened, now what are we going to do about it?" Hunting is initiated when a human decides to go looking for something that nobody has confirmed is there. Incident response is initiated when a case is opened, triggering responders to contain and remediate. That is the structural difference, one is a reaction to a confirmed event and the other is a deliberate search for an unconfirmed one.
Because hunting sits upstream, a confirmed hunt finding is often what triggers incident response in the first place. The hunter validates the hypothesis, confirms the threat, and then the finding gets escalated for containment. Incident response without hunting only ever responds to threats that were known ahead of time and announced themselves. Hunting is how you catch the quiet ones, the low-and-slow campaigns that never tripped a rule, and hand them to IR before they turn into the breach nobody saw coming. Hunting finds it. Response fixes it.
How is threat hunting different from a SIEM alert?
A SIEM alert only tells you what you already knew to ask for, while threat hunting discovers what you didn't. A SIEM is rules-driven — someone writes a correlation rule or a use case ahead of time, and the SIEM fires when the data matches. That means the coverage of your SIEM is exactly the set of questions your detection engineers thought to encode. Anything outside that set is invisible, no matter how much telemetry you're collecting.
Hunting exists to reach into that blind spot. Instead of waiting for a pre-written use case to match, a hunter poses a new question the SIEM may or may not have been configured to answer, then works through months of historical data to see if the pattern is there. The evidence is usually sitting in the data lake already. The problem is that no use case was ever written to surface it.
The payoff is that a hunt's output becomes the SIEM's next use case. When a hunt uncovers a real kill-chain pattern with no alert coverage, that gap becomes a recommended detection rule, and the thing you found by hunting turns into the thing your SIEM catches automatically from then on. A SIEM tells you about the attacks you anticipated, hunting is how you find the ones you didn't and then teach the SIEM to see them too.
Why is threat hunting important, and what are its benefits?
Threat hunting is important because it is one of the most powerful proactive security practices, and one of the most underused. The challenge is that threat hunters are usually the same people who are responding to alerts. Threat hunters aren't underperforming, they're burdened with responding to alerts. Most teams have good hypotheses, they just can't validate them fast enough, so hunting stays a periodic activity and the real benefit never lands.
The core benefit is that hunting catches what alert-based detection structurally can't. Attackers increasingly run low-and-slow campaigns designed to move slowly enough to avoid tripping detection rules, but those campaigns are visible in historical data. One SOC alert rarely tells the full story. The pattern usually lives across weeks of alerts and "informational" notifications that nobody has time to review. Hunting is the discipline of reviewing that whole.
The measurable payoff is dwell-time reduction. Advanced threats can sit undetected for weeks or months, and every day of dwell time is a day the attacker moves deeper. Finding the activity in months of logs closes that window before the damage compounds. There is a second benefit teams underrate, every hunt hardens your defenses, because a hunt that comes back benign still often surfaces a detection gap worth closing. So you get proactive coverage and better detection out of the same work.
What's the difference between threat hunting and threat intelligence?
Threat intelligence feeds the hypotheses, while threat hunting validates them. Threat intelligence is the knowledge, the campaign telemetry, the indicators of compromise, the actor profiles, the leaked-credential feeds from sources such as Google TI, Palo Alto Unit 42, or Intel 471. It tells you what adversaries are doing out in the world. On its own, though, intel doesn't tell you whether any of it is happening inside your environment.
Hunting is where that intel gets tested against your actual data. A hunter takes an intel report, such as a threat actor known to abuse a specific service or a set of leaked credentials tied to an employee, and turns it into a concrete hypothesis to run against months of logs. Together, intel points the hunt and the hunt proves whether the threat is real in your environment.
Threat Hunting Methodology and Frameworks
What are the steps of the threat hunting process?
Threat hunting usually starts with a trigger, then investigation, then resolution. A hunt starts from something (a hypothesis, a piece of threat intel, an odd pattern), somebody digs into the data to prove or disprove it, and the hunt ends with an outcome. The fuller models just break those three phases into finer stages so a team can hand a hunt off between people without losing the thread. Here is how the three-step shape maps onto the longer versions most hunters run:
- Trigger: a hypothesis forms, usually from a SOC signal, a threat-intel report, or something a hunter noticed. This is the "what am I looking for and why" stage.
- Investigation: enumerate the log sources that can prove or disprove the hypothesis, establish what normal looks like in the environment, then run the queries and chase the anomalies. Most of the hunter's hours have historically gone here.
- Resolution: issue a verdict with evidence, map it to MITRE ATT&CK, hand confirmed threats to response, and capture anything reusable such as a new detection rule.
What is a threat hunting hypothesis, and how do you write one?
A threat hunting hypothesis is a testable statement about attacker activity you suspect is present in your environment, specific enough that the log data can prove or disprove it. A good one names the behavior, the technique, and the scope: "an attacker is using WMI for lateral movement in the finance VLAN over the last ninety days" is a hypothesis you can actually hunt. "Are we compromised?" is not, it's a feeling. The tighter the statement, the less of the environment the hunt has to search, so scoped hypotheses tend to cost less and finish faster.
Good hypotheses usually come from four places: SOC signals, threat intelligence such as a current campaign or a leaked-credential report, the MITRE ATT&CK framework, and plain environment knowledge.
What is a threat hunting framework?
A threat hunting framework is a repeatable structure for planning, running, and capturing hunts so the work doesn't depend on one person's memory. Without a framework, hunting tends to be ad hoc, a skilled person pokes around when they have a free afternoon, finds something interesting sometimes, and none of it is reproducible next quarter. A framework fixes that by defining how a hypothesis gets formed, how a hunt gets scoped and executed, how findings get recorded, and how what you learn feeds back into detection. The three most cited ones are PEAK (Prepare, Execute, Act with Knowledge, from Splunk's SURGe team), TaHiTI (Targeted Hunting integrating Threat Intelligence, developed by a group of Dutch banks), and the older Sqrrl hunting loop (from Sqrrl and David Bianco, around 2015), which most of the later frameworks build on. There is also the Hunting Maturity Model, or HMM, a zero-to-four scale for rating how developed a team's hunting practice is, which is less a process and more a yardstick. None of these frameworks is a product you buy. They are shared vocabulary and a checklist, and any of them is better than none.
What is the PEAK threat hunting framework?
PEAK stands for Prepare, Execute, and Act with Knowledge, a threat hunting framework published by Splunk's SURGe research team (David Bianco was the lead author). It's a three-phase loop meant to make hunts repeatable and to make sure the output of each hunt actually improves the security program instead of evaporating once the hunt is done. Prepare is where you form the hypothesis, scope the hunt, and figure out which data sources you'll need. Execute is the hunt itself, running the queries, analyzing the data, and confirming or refuting the hypothesis. Act with Knowledge is the part most teams skip: documenting findings, creating new detections from what you found, and feeding lessons back into the next hunt and into the SOC.
PEAK also names three hunt types, which is part of why it caught on. Hypothesis-driven hunts start from a specific suspected behavior. Baseline hunts, sometimes called exploratory data analysis or EDA, start by establishing what normal looks like and then hunting the outliers. Model-assisted hunts, which PEAK calls MABTH, use machine learning or statistical models to surface candidates for a human to investigate. Most mature programs run a mix of all three rather than committing to one.
PEAK vs TaHiTI vs Sqrrl — which framework should you use?
Pick the framework by your team's maturity and what you're hunting for, not by which one has the newest whitepaper. The three sit at different points on the age-and-detail curve. The Sqrrl loop is the ancestor, TaHiTI is the intel-heavy one, and PEAK is the modern general-purpose one that absorbed lessons from both. Here's the rough shape of each:
| Framework | Origin | Best when |
|---|---|---|
| Sqrrl hunting loop | Sqrrl / David Bianco, ~2015 | You want the simplest possible loop to get a nascent practice off the ground |
| TaHiTI | A group of Dutch banks | Your hunts are mostly driven by threat intelligence and you need tight handoff to incident response |
| PEAK | Splunk / SURGe (David Bianco) | You want a general framework with named hunt types and a strong "turn findings into detections" phase |
In practice most teams starting today land on PEAK because it's the most complete and it explicitly bakes in the detection-engineering feedback loop. TaHiTI is worth a look if your program lives and dies on external intel feeds. The Sqrrl loop is still perfectly usable and, honestly, most of PEAK is a refinement of it. Whatever you choose, the framework matters far less than actually running hunts on a cadence.
How do you start a threat hunting program?
Start with data coverage, not with hypotheses, because a hunt is only as good as the logs it can reach. Before anyone writes a hypothesis, confirm you're actually collecting and retaining the telemetry that matters, endpoint or EDR data, authentication logs, DNS, and network or proxy logs, with enough retention (ideally several months) that a low-and-slow attacker actually shows up in the window you can search. Data gaps kill hunts, so this step is load-bearing.
Once coverage is in place, the sequence is straightforward: create a hypothesis (borrow from SOC false positives, threat intel, or ATT&CK to start), run it as a short sprint of two weeks or less, capture what you learned, and repeat. Keep the first hunts small and scoped. A tight hypothesis on a single VLAN teaches you more about your own process than an "investigate everything" hunt that never finishes. Track a couple of simple metrics, such as hunts run per month and detections created per hunt, so you can show the program is compounding.
The hard constraint most teams hit is capacity: trained hunters are scarce, and hypothesis validation eats their hours. Simbian's AI Threat Hunt Agent is built to scale the capacity of a nascent practice rather than replace the practitioner, the hunter still directs the hunts and owns the verdicts, the agent takes the manual validation work off their desk so a small team can test far more hypotheses than headcount would otherwise allow.
What data sources and logs do you need for threat hunting?
Data gaps kill hunts, so this is the operational blocker most teams hit first: if the log a hypothesis needs isn't there, the hunt can't run no matter how good the idea was. The essentials are endpoint and EDR telemetry (Sysmon and Windows process-creation events, the 4688 logs, are the workhorses here), authentication logs from your identity provider, DNS query logs, network and proxy logs, and cloud audit logs such as CloudTrail or the Azure activity log if you run in the cloud. Each covers a different part of the kill chain, endpoint telemetry catches execution and lateral movement, auth logs catch credential abuse, DNS and proxy catch command-and-control and exfiltration, cloud audit logs catch identity and configuration abuse in the control plane.
Retention matters as much as coverage. Attackers using AI run low-and-slow campaigns designed to dwell quietly, and advanced threats sit in an environment for weeks or months on average before anyone notices, so a thirty-day window often isn't enough. Aim for several months of searchable history for the sources that matter most.
How do you turn a threat hunt into a detection rule?
This is the payoff loop, and it's the whole reason a mature hunting practice compounds instead of repeating itself. If a hunt finds a repeatable, kill-chain-shaped pattern, that pattern should become a detection so nobody ever has to hunt it by hand again. The point isn't just to catch today's instance, it's to make sure the next instance fires an alert automatically. The interesting part is that even a benign hunt can produce a Detection Opportunity: the activity turned out legitimate this time, but the pattern was real and no existing SOC rule covered it, so an attacker could replay it undetected. Every hunt hardens detection, even the ones that come back clean.
The shape of turning a hunt into a rule is consistent. Capture the query logic that surfaced the pattern, generalize it so it catches the behavior rather than the one specific instance, deploy it as a detection rule in your SIEM or EDR, then tune it against false positives so it doesn't drown the SOC in noise. Simbian recommends the specific missing rule (for example, add auto-isolate host on ransomware detection in CrowdStrike) and the customer decides whether to implement it. That recommendation closes the loop straight back into the AI SOC Agent, so a finding from the hunting layer becomes durable coverage in the alert queue.
Threat Hunting Techniques, Types, and Surfaces
What are the three types of threat hunting?
Threat hunting usually breaks into three types, and most mature teams run all three depending on what triggered the hunt. Structured hunting is hypothesis-driven and planned around attacker behavior, for example "if an adversary is doing credential dumping in this environment, I'd expect to see LSASS access from an unusual process," mapped to a MITRE ATT&CK technique. Unstructured hunting is triggered by an indicator or an anomaly you stumbled onto, such as a single odd domain in DNS logs that you decide to pull the thread on. Situational or entity-driven hunting centers on a specific asset, user, or crown-jewel system, for instance "hunt everything touching the finance file server over the last ninety days," usually because that entity matters more than the rest of the estate.
The three are not really competitors, they overlap constantly. A structured hunt often surfaces an anomaly that kicks off an unstructured one, and both frequently narrow down to a single entity worth a deeper look.
What's the difference between structured and unstructured threat hunting?
Structured hunting starts from a hypothesis. Unstructured hunting starts from a clue. That is really the whole distinction, but it matters in practice.
A structured hunt is planned around attacker behavior, usually anchored to a MITRE ATT&CK technique. You decide up front what you're testing for, such as lateral movement over SMB, and you go looking for evidence that confirms or refutes it. An unstructured hunt is exploratory, it typically kicks off when an indicator of compromise (IOC) or an odd anomaly shows up in the data and you follow it without a formal hypothesis written down first.
Structured wins when you want repeatable coverage you can measure against a framework and report on. Unstructured wins when your telemetry or threat intel surfaces something weird and waiting for a formal hunt plan would waste the lead. Most teams need both.
What are common threat hunting techniques?
Four techniques come up in almost every hunt, and they layer on top of each other. Stack counting, sometimes called frequency analysis, aggregates a field and looks at the rare tail. Count every parent process that spawned PowerShell across ten thousand endpoints, and the three hosts where that count is one are often the interesting ones. Grouping takes a set of events that share a specific attribute and looks at them together, such as pulling every authentication event tied to one service account inside a two-hour window. Clustering is the machine-learning cousin of grouping, it lets the data form its own buckets: group logins by time, geography, and device and see which cluster does not fit the others. Searching is the simplest, you already have a concrete indicator such as a hash or a domain and you query directly for it.
In practice you rarely run just one. A hunt often opens with stack counting to find the statistical outliers, then groups the events around a suspicious entity, then searches for the specific artifacts that confirm intent.
What's the difference between IOCs and IOAs?
An indicator of compromise (IOC) is evidence of something that already happened. An indicator of attack (IOA) is the behavior of something happening right now. That timing difference is the whole point, and it changes what you can catch.
An IOC is a forensic artifact left behind, such as a file hash, a malicious IP address, or a command-and-control domain. It tells you a specific known-bad thing was present. The problem is that attackers rotate this infrastructure constantly, so an IOC often goes stale within weeks. An IOA describes intent and technique, the pattern of an adversary doing something, such as a process injecting into another process and then reaching out to the network, regardless of which specific file or IP is involved.
Here is the practical contrast:
| Dimension | IOC | IOA |
|---|---|---|
| What it captures | An artifact from a past event (hash, IP, domain) | A behavior in progress (technique, intent) |
| Shelf life | Short, attackers rotate infrastructure | Long, techniques are harder to change |
| Best for | Fast matching against known-bad | Catching new or unseen campaigns |
Good hunting pivots off stale IOCs toward the behavior underneath. If you only sweep for known artifacts, the low-and-slow adversary who changed their infrastructure last week walks right past you.
What are IOCs, IOAs, and TTPs in threat hunting?
These three terms describe the same attacker at increasing levels of durability, and threat hunting generally works best when you climb from the bottom toward the top. An indicator of compromise (IOC) is a concrete forensic artifact, such as a file hash, an IP address, or a domain, cheap to detect but cheap for the attacker to change. An indicator of attack (IOA) is a behavior that signals intent, such as a suspicious parent-child process chain, which describes what the adversary is doing rather than which file they used. TTPs, tactics, techniques, and procedures, are the highest level, they describe how an adversary operates as a matter of habit, such as "uses valid accounts for lateral movement and living-off-the-land binaries for execution."
David Bianco's Pyramid of Pain maps these directly. Hashes and IPs sit at the bottom because an attacker swaps them out in minutes. TTPs sit at the top because changing them means changing how the whole crew operates, which is genuinely hard and expensive for them. TTPs are the most durable of the three, so a hunt built around TTPs keeps catching the same actor even after they burn their infrastructure. That durability is why hunting behavior beats hunting artifacts.
What is the Pyramid of Pain in threat hunting?
The Pyramid of Pain is a model David Bianco published in 2013 that ranks indicators by how much pain it causes an attacker when you detect and block them. It has become one of the standard mental models threat hunters use to decide what is actually worth hunting for.
At the bottom sit hash values, then IP addresses, then domain names. These are trivial for an adversary to change. A new hash is one recompile away, a new IP is one hosting account away, so detecting them causes the attacker almost no pain. In the middle sit network and host artifacts, then tools, which cost the attacker more to swap. At the very top sit TTPs, the tactics, techniques, and procedures that describe how the adversary actually operates. Forcing an attacker to change their TTPs is genuinely painful, because it means retraining, retooling, and rethinking their entire approach.
The lesson hunters take from the pyramid is to hunt as high up as they can. Hunting a hash catches one sample. Hunting a technique, such as credential dumping from LSASS or lateral movement over remote services, catches the actor no matter how many hashes and IPs they rotate through. Every rung you climb costs the adversary more, and that cost is the whole game.
How do you use MITRE ATT&CK for threat hunting?
MITRE ATT&CK is used two ways in hunting: as a menu to build hypotheses from, and as a map to find your coverage gaps. It is a knowledge base of real-world adversary tactics and techniques, things such as T1003 credential dumping or T1021 remote services, organized by the stages of an attack.
As a hypothesis menu, you scan the techniques relevant to your threat model and turn each into a testable question. "Do we see any evidence of T1021.001 remote desktop lateral movement in the last sixty days?" is a structured hunt straight off the matrix. As a coverage map, you lay your existing detections over the framework and the blank cells show you where an attacker could operate without tripping an alert. Those blanks are your best hunting ground, because that is where SOC rules are not watching.
Simbian maps every finding to MITRE ATT&CK, and that matters more than it sounds. ATT&CK is the shared coordinate system across all of Simbian's agents, so a technique the AI Threat Hunt Agent confirms in your logs lines up with what the AI SOC Agent sees in the alert queue. Every completed hunt renders a full kill-chain view, initial access through impact, with the entities attributed to each tactic, so you are reading findings in the same language your detection stack already speaks.
Why hunt for TTPs instead of IOCs?
Because IOCs go stale and TTPs don't. An indicator of compromise, such as a hash or a command-and-control IP, often has a useful shelf life measured in weeks. Attackers rotate infrastructure as a routine part of operations, so the domain you block today is dead to them tomorrow anyway. Hunting IOCs keeps you one step behind by design.
TTPs, the tactics, techniques, and procedures behind the artifacts, are durable because they reflect how an adversary actually works. A crew that favors living-off-the-land execution and pass-the-hash for lateral movement tends to keep doing that across campaigns, even after they burn every hash and IP you caught them with. Hunt the behavior and you keep catching the actor.
This matters most against low-and-slow adversaries. They deliberately move slowly enough to stay under alert thresholds, and they change infrastructure often enough to evade IOC sweeps, but they still have to execute techniques that leave a behavioral trace in your historical data, if someone looks.
What is identity threat hunting (ITDR)?
Identity threat hunting is hunting for identity-based attacks: credential abuse, token theft, anomalous authentication, privilege escalation, and MFA fatigue attacks where an attacker spams push prompts until a tired user approves one. ITDR (Identity Threat Detection and Response) is the broader category this sits inside. The premise is straightforward, identity is the new perimeter. SANS noted in 2025 that identity has become a primary attack surface, and once an adversary has valid credentials, most of their activity looks exactly like a normal user until you hunt for the seams.
This is entity-driven hunting, and it runs across your identity provider and authentication logs, the sign-in data, the token issuance records, the privilege-grant events. You are looking for the login that comes from an impossible location, the service account that suddenly authenticates interactively, the account that escalates its own permissions, or the burst of failed MFA prompts followed by one success at 3 a.m.
The reason identity hunts are hard by hand is that the signal lives in high-volume, mostly-benign auth data, and the malicious login is one row among millions.
What is living-off-the-land (LOTL), and how do you hunt for it?
Living-off-the-land is when an attacker uses the legitimate tools already installed on your systems, PowerShell, WMI, certutil, PsExec, instead of dropping their own malware. There is no malicious file to block and no signature to match, because every binary they touch is one your operating system shipped with and your admins use daily. That is exactly why it works, and why hunting is often the only way to catch it.
Since there is no IOC to sweep for, you hunt the behavior instead. The tells live in how these tools get used, not whether they run. Anomalous parent-child process chains are the classic starting point. Microsoft Word spawning PowerShell is not something a normal document does. Unusual command lines are another, such as certutil being used to download a file from the internet, which is a legitimate feature almost nobody invokes on purpose. Encoded PowerShell commands, WMI used for remote execution, and PsExec creating services on hosts that never see it are all worth a hard look.
This matters more every year. SANS flagged in 2025 that nation-state actors lean heavily on LOTL specifically to evade detection.
What is lateral movement, and how do you hunt for it?
Lateral movement is what an attacker does after initial access, moving host-to-host through your network to reach the systems that actually matter, using techniques such as pass-the-hash, RDP chains, remote service creation, and anomalous internal authentication. The hard part is that most of these techniques ride on legitimate administrative mechanisms. Admins use RDP, create remote services, and authenticate across hosts all day, so the malicious version and the benign version look nearly identical in the logs.
That similarity is exactly why lateral movement is a strong place to show the elimination game. When the threat hunter finds a candidate, say a service account authenticating to five servers it has never touched before, then creating a remote service on each, it does not just flag it and move on. Before it issues a verdict, the hunter actively tests the benign explanation: is this a patch-management run, a legitimate admin doing maintenance, a backup job that happens to fan out this way? Our threat hunt engineers describe it as an elimination game. On first glance it looks like a threat, but you go deeper on the alternatives until either they all fail or one holds up.
Every hunt report shows the benign explanations the agent tested and rejected, not just the conclusion. So when the verdict comes back Confirmed Threat, you can see the admin activity it ruled out to get there, and if it comes back Benign, you can see why.
AI and Autonomous Threat Hunting
What is AI threat hunting?
AI threat hunting is the practice of using agentic AI, usually built on large language models (LLMs), to plan a hunt, run the queries it needs, and interpret what comes back, with a human directing the effort. At its core instead of a hunter manually writing every query, waiting on results, and piecing together evidence across log sources, an AI Threat Hunt Agent takes a hypothesis in plain language, such as "is there evidence of lateral movement from this identity over the last ninety days," and validates it end to end.
The human still sets the scope and owns the verdict. What changes is who does the manual validation work. A single hypothesis that used to cost a hunter hours of sifting through Sentinel, Splunk, and EDR logs gets validated in minutes, which makes it rational to test far more hypotheses than a team ever could by hand. AI threat hunting does not replace the hunter's judgment. It removes the part of the job that was mostly waiting and querying.
What is autonomous threat hunting?
Autonomous threat hunting is hunting where the agent executes a hunt end to end within a single run, it writes the queries, runs them, and interprets the results, without a human driving each step. A hunter sets the scope and the hypothesis, then the agent operates. The person does not sit there approving each query or reading each intermediate result.
The practical difference is speed and reach. A manual hunt is sequential and bounded by analyst availability, so a hypothesis might take hours and usually looks only at recent data. An autonomous hunt runs in minutes per hypothesis, reaches across months of historical logs, and can run several hypotheses in parallel, around the clock. That around-the-clock reach is easy to underrate, because low-and-slow attacks are designed to move slowly enough to stay under alert rules, and the evidence often sits in old data nobody has time to revisit.
Autonomous does not mean unaccountable. The human sets the time window and the scope, and the human owns the verdict at the end. The agent runs the hunt; the person decides what the finding means and what to do about it. Autonomy here is about execution, not authority.
What is agentic threat hunting?
Agentic threat hunting is hunting performed by an AI agent, reasoning, tools, and memory working together, rather than by a fixed script running on a schedule. The distinction matters. A scheduled query or a rule fires the same way every time regardless of what it finds. An agent composes its own hypotheses or takes one from the human, decides what evidence would prove or disprove each one, and adapts its investigation path as results come in.
The other half of "agentic" is memory. The AI Threat Hunt Agent draws on org-specific context through Simbian's Context Lake™, so it knows what normal looks like in your environment before it starts flagging things. That is what separates an agent from rules-on-a-schedule. Rules do not learn your environment. An agent does, and it reasons about each finding instead of matching it.
Can threat hunting be automated?
Yes. The step that gets automated is hypothesis validation, the slow, manual work of writing queries across Sentinel, Splunk, and EDR, running them, and reading the results to decide whether a hypothesis holds. That validation step is the bottleneck in most hunting programs, and it is exactly the part an AI Threat Hunt Agent takes off the desk.
The reason automation works here is economics. A "bad" hypothesis used to cost hours of analyst time to disprove, so teams tested three a week instead of thirty. When a bad hypothesis costs minutes instead of hours, testing more of them becomes rational, and volume is what surfaces the attacker that matters. Automation does not remove the hunter. It removes the reason not to hunt.
Does AI replace human threat hunters?
No. AI changes what hunters spend their time on, it does not replace them. AI takes the manual validation, the query-writing, and the first-pass triage off the hunter's desk and moves the person onto the work where judgment actually matters, novel hypotheses, ambiguous findings, and the calls that need someone who knows the business.
An AI Threat Hunt Agent runs a single hunter at roughly five to ten times their manual output, because the hunter is now directing hunts instead of hand-writing every query. Every hunter on the team starts to operate like a small team. The bottleneck in most programs was never a shortage of good hypotheses. It was the capacity to validate them, and that is the constraint the agent lifts.
The hunter sets the scope, the agent operates within it, and the hunter owns every verdict the agent returns. A senior offensive engineer still decides what a finding means. The agent does the sifting so the person can do the thinking.
How does AI-powered threat hunting work?
AI-powered threat hunting works by handing a hypothesis to an agent that writes the queries, runs them against your connected data sources, interprets the results, and returns a verdict with the evidence behind it. The human directs; the agent operates. Here is the shape of a single run.
The agent starts from a hypothesis and first checks what it can actually query, your log sources and tables across Microsoft Sentinel, Splunk, and EDR tools such as CrowdStrike or Microsoft Defender. If a lane needs email logs and those are not connected, it flags that as a gap rather than pretending. It then establishes what normal looks like in your environment, hunts for anomalies and cross-source correlations, and runs rigorous deep dives on each candidate the way a senior hunter would.
Before it commits to a verdict, the agent tests the benign explanations for what it found. Then it returns one of four verdicts, Confirmed Threat, Suspicious Activity, Detection Opportunity, or Benign, each with entity attribution, a MITRE ATT&CK kill-chain map, and the evidence trail. Confirmed findings get escalated for containment. Every query it ran stays downloadable, so the whole run is auditable by a human afterward.
What are the benefits and limitations of AI in threat hunting?
The benefits and the limitations of AI in threat hunting both come from the same source: the agent is fast, tireless, and consistent, but it does not have a human's judgment or full context. Being honest about both is what makes the technology usable in production rather than a demo. Here is the split.
| Benefits | Limitations |
|---|---|
| Scale, runs many hypotheses in parallel, not one at a time | Novel judgment calls still need a human hunter |
| Speed, minutes per hypothesis instead of hours | Context it was never given, it cannot reason about |
| Always on, runs around the clock, no shift changes | The first few runs take trust calibration |
| Reach, queries months of historical logs, not recent weeks | Missing or unreachable log sources bound what it can prove |
| Consistency, same rigor every hunt, no fatigue drift | A confident verdict is still the customer's call to review |
Threat Hunting Tools and Platforms
What tools do threat hunters use?
Threat hunters usually work across a stack of tools rather than one, and the stack falls into a few categories. The center of it is a SIEM (Security Information and Event Management system) or security data lake, such as Splunk, Microsoft Sentinel, or Elastic, where most of the log data lives and where most hunting queries actually run. Around that sits EDR (Endpoint Detection and Response), such as CrowdStrike, SentinelOne, or Microsoft Defender, for process and host telemetry. Network and NDR (Network Detection and Response) tooling like Zeek and Corelight give the hunter visibility into traffic and connections. Threat intelligence platforms feed in indicators and actor context. Then there's the analysis layer, Jupyter notebooks for ad-hoc data work, Sigma for portable detection logic, and YARA for pattern matching against files.
A single hunt often touches several of these at once, because the evidence for one hypothesis is usually spread across endpoint, network, and identity logs. That's part of why hunting is slow. Simbian's AI Threat Hunt Agent sits above this stack as the reasoning layer. It queries these tools in place, correlates what comes back, and returns a verdict, so the hunter directs the hunt instead of operating each console by hand.
What are the best open-source threat hunting tools?
There isn't one best open-source tool, since threat hunting spans several jobs and the open-source options are strongest in different ones. A neutral rundown of the commonly used projects:
| Tool | Category | What it does |
|---|---|---|
| Wazuh | Open XDR / SIEM | Collects and correlates host and log data, alerting on rules |
| Zeek | Network analysis | Turns raw traffic into structured connection and protocol logs |
| Security Onion | Bundled distro | Packages Zeek, Suricata, and Elastic into one hunting-ready platform |
| Velociraptor | Endpoint DFIR / hunting | Queries endpoints live for artifacts and hunt indicators |
| YARA | Pattern matching | Matches files and memory against author-written signatures |
| Sigma | Detection rules | A portable rule format that converts to many SIEM query languages |
| MITRE ATT&CK Navigator | Coverage mapping | Maps techniques you can hunt for against your detection coverage |
These tools are good, and a lot of mature hunting programs run on them. It's worth being clear on where they stop, though. They collect data and match patterns you tell them to look for. The reasoning, forming the hypothesis, deciding which sources to pull, and judging whether a hit is a real threat or a benign explanation, is still on the hunter. Open-source tools shorten the data-gathering step; they don't remove the manual validation step, which is usually the part that eats the hours.
Can you use a SIEM for threat hunting?
Yes, and in most organizations the SIEM is where hunting actually happens. Platforms such as Splunk, Microsoft Sentinel, and Elastic hold the log data a hunt needs, and their query languages (SPL for Splunk, KQL for Sentinel) are built to slice that data across time. So the SIEM is a genuine hunting surface, not just a storage layer.
The catch is that a SIEM is query-driven and analyst-bound. You only find what you write a query for, which means every hunt is limited by the questions the analyst thought to ask and had time to ask. Writing good queries takes skill, and interpreting the results takes more of it. A single hypothesis can take hours of sifting across several searches before it's confirmed or ruled out, so teams end up testing a handful of hypotheses instead of dozens.
Simbian's AI Threat Hunt Agent works on top of the SIEM rather than replacing it. The agent queries Sentinel or Splunk natively, reads the results, and reasons about them, so the SIEM stays the data layer and the query-writing and interpretation are automated. No data migration; the logs stay where they are.
How do you evaluate a threat hunting tool or platform?
The useful criteria for evaluating a threat hunting tool are less about feature counts and more about how much of the actual hunt the tool takes off the analyst's desk. A few dimensions that tend to separate tools in practice:
- Automation depth. Does the tool just collect and surface data, or does it validate the hypothesis end to end and return a verdict? Many tools stop at "here's a faster query interface," which leaves the hard part with the hunter.
- Data federation. Can it reason across your existing sources, SIEM, EDR, identity, cloud, network, or does it only see one of them? Evidence for a single hypothesis is usually spread across several.
- Explainable evidence chain. When the tool reaches a conclusion, can a human replay every query it ran and audit how it got there? A verdict you can't verify isn't worth much.
- Rip-and-replace versus layering. Does it require centralizing your logs into a new platform, or does it query what you already have in place?
- Analyst-workload impact. After deployment, does the team spend less time on manual validation, or has the tool just added another console to babysit?
Cost matters too, but the tool that surfaces data without validating it usually costs more in analyst hours than it saves in license fees.
What should you look for in an AI threat hunting tool?
The main thing to look for in an AI threat hunting tool is whether it validates a hypothesis end to end or just collects and surfaces data faster. A lot of "AI hunting" is a better query interface, the analyst still has to interpret the output and decide what it means. That's a real convenience, but the validation bottleneck is still there.
Beyond full validation, a few things worth checking:
- Execution-log auditability. Can a human download and replay every query the agent ran, in order, to check the reasoning for hallucinations? If you can't audit it, you're trusting a verdict blindly.
- Benign-explanation testing. Before the tool calls something a threat, does it actively test the innocent explanations and show which ones it ruled out? An AI that only shows its conclusion, not its rejected alternatives, is harder to trust.
- Org-specific context. Does it apply knowledge of your environment, known assets, normal behavior, past findings, or run generic threat intel against generic logs? Context is what keeps false positives down.
- Native querying, no migration. Does it query your existing Sentinel, Splunk, or connected EDR in place, or does it want you to copy your data somewhere new first?
Splunk vs Microsoft Sentinel vs Elastic for threat hunting — how do they compare?
Splunk, Microsoft Sentinel, and Elastic are the three data platforms most hunting programs end up on, and they trade off along fairly predictable lines. Here is a neutral comparison of where each tends to fit:
| Dimension | Splunk | Microsoft Sentinel | Elastic |
|---|---|---|---|
| Query language | SPL, mature and very powerful | KQL, clean, strong for Azure/M365 data | Elasticsearch DSL / ES|QL |
| Strength | Deep, flexible search over almost any data | Cloud-native, tight Microsoft and Azure integration | Flexible and cost-effective, open ecosystem |
| Deployment | On-prem or cloud | Cloud-native (Azure) | Self-managed or Elastic Cloud |
| Trade-off | Can get expensive at high data volume | Best value inside a Microsoft-heavy shop | More assembly and tuning required yourself |
| Best fit | Teams that want maximum search power | M365 E5 / Sentinel data-lake customers | Teams wanting flexibility and lower cost |
None of the three is the wrong choice on its own. The right one usually comes down to what data you already have, what you already pay for, and whether your environment is Microsoft-centric.
Simbian's AI Threat Hunt Agent runs as the automation layer above any of these, not as a replacement for your data platform. The agent queries Splunk, Sentinel, or Elastic natively, so the platform you already chose stays the data layer and the reasoning runs on top.
What threat hunting queries should you start with?
If you're building a starter set of hunts, the highest-value queries look for behavior that attackers reliably produce but that rarely fires a clean alert. A practical starting list, grouped by the behavior each one targets:
- Rare parent-child process chains, for example Office applications spawning a command shell, which is common in initial access.
- Anomalous or encoded PowerShell, long base64-encoded commands, or PowerShell launched from unusual parents.
- New service creation, services installed outside a normal change window, a common persistence move.
- Unusual outbound beaconing, regular, low-volume connections to one external host, which often signals command-and-control.
- Impossible-travel logins, the same account authenticating from two distant locations inside a window too short to travel.
- Spikes in failed authentication, bursts of failures against one account or across many, which can indicate password spraying or credential stuffing.
You write these in your SIEM's language, KQL in Microsoft Sentinel, SPL in Splunk, and each one usually takes a few iterations to tune down the false positives before it's worth running regularly. That tuning is where a lot of hunter time goes.
Metrics, ROI, and Maturity
How do you measure threat hunting success?
The most useful measure of a threat hunt is not how many threats it found. A hunt that finds nothing is often not a failed hunt, and treating "threats found" as the only scoreboard quietly pushes hunters toward the loudest, easiest hypotheses instead of the ones that matter. Better measures are the detection gaps you closed, the number of hypotheses you actually tested, how much of your environment the hunt covered, and whether the dwell time on real intrusions is trending down over successive hunts. The PEAK threat hunting framework says this plainly: a hunt that finds no evil has still hardened the program, because you now know that ground is clear and you usually learned something about your own visibility along the way. Even a benign verdict can produce a Detection Opportunity, the AI Threat Hunt Agent flags a legitimate kill-chain-shaped pattern that never fired a SOC alert, and recommends the specific rule that would catch it next time. So the honest scoreboard for hunting counts coverage and closed gaps, not scalps. If your only metric is confirmed threats, most of your good hunts will look like wasted time, and they weren't.
What are good threat hunting metrics and KPIs?
Good threat hunting metrics measure risk reduced, not hunts completed. Counting hunts run or hours logged is a vanity metric, it tells leadership you were busy, not that the organization got safer. The metrics that actually track program value tend to be a small set. Hypotheses validated per period, since volume of tested ideas is what eventually finds the quiet attacker. Detection rules created per hunt, which is the concrete output of Detection Opportunities and the reason a benign hunt still pays for itself. Mean dwell-time reduction on the intrusions you do catch. Coverage measured against the MITRE ATT&CK matrix, so you can see which tactics and techniques you have actually hunted for and which you have never looked at. And false positives fed back to the SOC, because a hunt that teaches the alert queue to be quieter frees analyst capacity downstream. A useful way to frame all of these to a board is coverage per analyst, how much ground one hunter can now cover, which is where automation moves the number. Track the handful of KPIs that map to risk, and ignore the ones that only map to effort.
What is the threat hunting maturity model (HMM)?
The Hunting Maturity Model, or HMM, is David Bianco's five-level scale for how capable an organization's threat hunting actually is. It runs from HMM0 to HMM4. HMM0 (Initial) is a team that relies almost entirely on automated alerting and does no real hunting. HMM1 (Minimal) starts to incorporate threat intelligence indicators but still mostly follows the alerts. HMM2 (Procedural) can follow and apply hunting procedures other people have created, though it rarely creates its own. HMM3 (Innovative) is where a team develops new hunting procedures and analysis techniques for itself. HMM4 (Leading) automates the majority of its successful, repeatable hunting procedures so hunters spend their time on genuinely new problems rather than rerunning old ones. The thing worth saying out loud is that you cannot buy your way to HMM4. Maturity is a property of your people and process. What automation does is scale the capacity a team needs to climb, the AI Threat Hunt Agent takes the repeatable hypothesis-validation work off the hunter's desk so the same people can operate at a higher level of the model, but the judgment that defines HMM3 and HMM4 stays with them.
How does threat hunting reduce dwell time?
Threat hunting reduces dwell time by going looking for compromises that alerting never caught, instead of waiting for them to trip a rule. Dwell time is the window between when an attacker first compromises the environment and when someone finally detects them. In recent industry reporting, the median has hovered around two weeks, and advanced persistent threats can sit undetected for months. Those numbers are industry figures, not Simbian metrics. Periodic manual hunting barely moves them, because a team that can validate three hypotheses a week and only looks at recent data will miss the slow campaign that shows up across months of logs. Continuous, automated hunting is what actually compresses the window. The AI Threat Hunt Agent searches months of historical telemetry around the clock and validates far more hypotheses in parallel than a human team can work through sequentially, so the low-and-slow campaigns that were designed to evade alert-based detection get surfaced earlier, in historical data, instead of after the damage has landed. Shorter dwell time is the direct result, you find the intruder in week one rather than after the exfiltration.
Roles, Skills, and the Team
What does a threat hunter do?
A threat hunter forms hypotheses, pulls and analyzes log data, confirms or refutes attacker activity, maps what they find to MITRE ATT&CK, escalates confirmed threats, and turns each finding into a detection rule so the SOC catches the same thing next time. That is the loop most days. A hunter usually starts from a question rather than an alert, something like "if a credential leaked six months ago, is there evidence someone used it for lateral movement?", and then spends hours in Sentinel, Splunk, EDR logs, and cloud telemetry trying to prove or kill that idea. Most of that time goes into the validation, not the idea itself.
What skills do you need to become a threat hunter?
Curiosity and an attacker mindset come first, the instinct to ask "what would I do if I were already inside, and where would that show up?" Everything else is learnable on top of that. You need ATT&CK and TTP fluency, comfort reading large volumes of log data, and at least one query language such as KQL or SPL. Operating-system and network internals matter, because you cannot spot the odd process or the strange outbound connection if you do not know what the normal ones look like. Knowing "normal" for a given environment is honestly half the job.
Mindset beats tooling here. A hunter with sharp instincts and average query skills usually outperforms the reverse. The real bottleneck for most teams isn't a shortage of good hypotheses, it's validation capacity. A single hypothesis can take hours to check by hand across several systems, so teams test three a week instead of thirty. That capacity gap is exactly what automation addresses, and it is why the "attacker mindset" skill matters more than the query-syntax skill going forward. The agent can write the query. It can't decide what's worth asking.
Is threat hunting a dedicated role or part of the SOC analyst job?
Both exist, and which one you see depends mostly on the size of the org. In larger enterprises threat hunting is often a dedicated senior role, a Tier 3 hunter or a small hunt team whose whole job is proactive investigation, separate from the alert queue. In most other places it is a hat that experienced SOC analysts, usually Tier 2 or Tier 3, put on when the alert queue lets them breathe, which is rarely. The queue almost always wins.
That "when they have time" problem is the real constraint, not head count or ideas. Hunting is the thing that gets dropped first when reactive work piles up, so it quietly becomes a periodic, secondary activity in teams that would genuinely benefit from doing it weekly. An AI Threat Hunt Agent gives that time back by taking the manual validation work off the SOC's desk, the agent runs the hypotheses in parallel across months of historical data, and the analyst reviews verdicts instead of writing queries. The role doesn't disappear either way. The hours it needs stop competing with the queue.
