Skip to content
← All articles

Operating GRC at AI Speed · Episode 4

May 3, 2026

Auditor interviews for AI companies

By Ben Draffin · Director of Security at Decagon

Auditor interviews reward a simple outcome: a coherent story about how controls work, backed by evidence the auditor can actually follow. The interview itself usually isn’t the hard part. The work is in assembling that story from policies, tickets, infrastructure configs, and prior responses scattered across systems, on a deadline that doesn’t care how fast the product shipped last month.

The good news is that LLMs are now genuinely useful for search, drafting, and synthesis, and most published audit-prep guidance hasn’t caught up. The opportunity isn’t to lower the bar on integrity. Auditors won’t accept AI-generated fiction. It’s to spend your prep time on the parts that actually need human judgment.

What auditors are actually testing

Fieldwork isn’t a vocabulary exam. Interviewers are looking for three things:

  1. Traceable evidence: Can you produce artifacts that support the control as it actually operates, not just as it’s written?
  2. Operational clarity: Can the control owner explain what runs, how often, and what happens when it fails?
  3. Consistency: Do policy, implementation, and questionnaire answers describe the same system?

LLMs are well suited to finding, structuring, and stress-testing answers to those three tests. They aren’t suited to inventing controls that don’t exist.

A responsible workflow: search, draft, verify

The pattern is familiar from how strong engineering teams use automation: machines do the mechanical work, humans own judgment. Three steps, run on a cadence rather than at the deadline.

1. Search (grounded in source artifacts)

Point tools at evidence stores: policy repositories, ticket history, infrastructure configuration, prior audit responses. The task is retrieval and clustering: what do we already have that speaks to this control?

Always require citations to source artifacts. If the model can’t cite it, it doesn’t belong in the prep document yet. Either find the evidence, or rephrase the claim to match what you actually have.

2. Draft (structured, bounded)

Use templates auditors already recognize: control objective, implementation description, population and sampling approach, known exceptions. Models accelerate first drafts from your evidence summaries, not from generic compliance boilerplate.

A useful instruction in practice: Only use facts from the attached evidence list. Flag any sentence that requires an assumption.

3. Verify (human-owned)

People own the accuracy of claims, the decisions on exceptions and compensating controls, and the credibility in the room. AI output feeds your judgment; it doesn’t replace it.

The table below shows one useful split of responsibility.

Task AI-assisted? Human-owned?
Finding evidence across systems Yes Scope and completeness review
First draft of control narrative Yes Factual accuracy
Exceptions and compensating controls Partial (options) Decision
Interview answers and tone No Yes
“Do we actually meet this control?” No Yes

Adversarial follow-ups beat polished prose

Mock questions that surface gaps early are more valuable than elegant paragraphs. A few worth running:

  • Show me how this is enforced in production.
  • What happens when this control fails?
  • Who owns this control, and how do you know it ran last month?

AI is great at generating adversarial follow-ups from your draft narratives and known evidence gaps. Run that exercise on yourself a week before fieldwork; it usually surfaces policy-only claims while there’s still time to fix them.

AI-specific topics frameworks barely name

If you operate an AI product, expect topics that may not map cleanly to legacy control libraries:

Topic Why auditors and customers ask
Training / fine-tuning on customer data Data boundary and contractual alignment
Model input retention and deletion Privacy and incident response
Human oversight for high-risk outputs Safety and accountability
Red-team or safety evaluation evidence Model risk management
Subprocessors and model-provider chains Third-party and data-flow transparency

Prepare these with the same search → draft → verify loop. You don’t need the framework to name a control explicitly to start practicing the answer.

What stays human

A few rules keep AI-augmented prep honest, and they’re worth pinning to the wall:

  • Don’t generate fake logs, screenshots, or tickets.
  • Don’t let a model paraphrase evidence into stronger claims than the source actually supports.
  • Don’t outsource the question “do we actually meet this control?” to automation.

AI-augmented audit prep isn’t a shortcut around assurance. It’s a way to operate at the speed your product already ships, even as evidence surface area keeps growing.

Done well, preparation becomes a continuous discipline tied to release cadence. Fieldwork stops being a two-week sprint and becomes a checkpoint.


Previous: Coding agents and policies · Next: Policies and controls: two-way loop

Series

Newsletter

Email when I publish.

You'll get a confirmation email first.

Share on LinkedIn · Pushback? LinkedIn is fine.