Skip to content
← All articles

May 3, 2026

Auditor interviews for AI companies

By Ben Draffin · Director of Security at Decagon

Auditor interviews reward a deceptively simple outcome: a coherent story about how controls work, backed by evidence an auditor can follow. The hard part is not the interview itself. It is assembling that story from policies, tickets, infrastructure configs, and prior responses scattered across systems — often under a deadline that does not care how fast the product shipped last month.

Audit preparation sits at the intersection of assurance, engineering reality, and time. Most published guidance predates LLMs being genuinely useful for search, drafting, and synthesis. That does not mean auditors accept AI-generated fiction. It does mean teams that still prepare exactly the way they did in 2022 are leaving time and quality on the table — without cutting corners on integrity.

What auditors are actually testing

Fieldwork is not a vocabulary exam. Interviewers are looking for:

  1. Traceable evidence — Can you produce artifacts that support the control as operated, not only as written?
  2. Operational clarity — Can the control owner explain what runs, how often, and what happens when it fails?
  3. Consistency — Do policy, implementation, and questionnaire answers describe the same system?

LLMs can accelerate finding, structuring, and stress-testing answers to those three tests. They are poorly suited to inventing controls that do not exist.

A responsible workflow: search, draft, verify

The pattern mirrors how strong engineering teams use automation elsewhere: machines accelerate mechanical work; humans own judgment and accountability.

1. Search (grounded in source artifacts)

Point tools at evidence stores — policy repositories, ticket history, infrastructure configuration, prior audit responses. The task is retrieval and clustering: what do we already have that speaks to this control?

Always require citations to source artifacts. If the model cannot cite it, it does not belong in the prep document.

2. Draft (structured, bounded)

Use templates auditors recognize: control objective, implementation description, population and sampling approach, known exceptions. Models accelerate first drafts from your evidence summaries — not from generic compliance boilerplate.

A useful instruction in practice: Only use facts from the attached evidence list. Flag any sentence that requires an assumption.

3. Verify (human-owned)

People own accuracy of claims, decisions on exceptions and compensating controls, and credibility in the room. AI output is input to judgment, not a substitute for it.

The table below summarizes how we think about dividing responsibility.

Task AI-assisted? Human-owned?
Finding evidence across systems Yes Scope and completeness review
First draft of control narrative Yes Factual accuracy
Exceptions and compensating controls Partial (options) Decision
Interview answers and tone No Yes
“Do we actually meet this control?” No Yes

Interview prep: adversarial follow-ups beat polished prose

Mock questions that surface gaps early are more valuable than elegant paragraphs. Examples we use internally:

  • Show me how this is enforced in production.
  • What happens when this control fails?
  • Who owns this control, and how do you know it ran last month?

AI can generate adversarial follow-ups from draft narratives and known evidence gaps. That exercise often reveals policy-only claims before an auditor does.

AI-specific controls expect questions frameworks barely name

If you operate an AI product, expect topics that may not map cleanly to legacy control libraries:

Topic Why auditors and customers ask
Training / fine-tuning on customer data Data boundary and contractual alignment
Model input retention and deletion Privacy and incident response
Human oversight for high-risk outputs Safety and accountability
Red-team or safety evaluation evidence Model risk management
Subprocessors and model-provider chains Third-party and data-flow transparency

Prepare these with the same search → draft → verify loop. Waiting for the framework to name the control explicitly usually means waiting too long.

Lines that should not be crossed

It is worth stating plainly:

  • Do not generate fake logs, screenshots, or tickets.
  • Do not let a model paraphrase evidence into stronger claims than the source supports.
  • Do not outsource the question “do we actually meet this control?” to automation.

AI-augmented audit prep is not a shortcut around assurance. It is a way to operate at the speed your product already ships — with evidence surface area that is not getting smaller and questions that are not getting easier.

Done well, preparation becomes a continuous discipline tied to release cadence, not a two-week panic before fieldwork. That is the standard enterprise buyers and auditors increasingly expect, whether or not the framework language has caught up yet.


Previous: Coding agents and policies · Next: Policies and controls: two-way loop

Newsletter

Email when I publish.

You'll get a confirmation email first.

Pushback? LinkedIn is fine.