Put controls outside the agent
Engineering field guide · Security · Both days
Which boundary still holds when the agent follows a bad instruction?
Pair task-scoped permissions with deterministic checks. Day 2 adds incident evidence for isolation, network limits, and short-lived identities.
All topic guides · Practical takeaways
Where the approaches meet
Section titled “Where the approaches meet”Keycard, Two Sigma, and Bloomberg place enforceable controls around the model. The model’s intention to finish a task does not grant permission to take an action.
How the approaches differ
Section titled “How the approaches differ”| Session | Approach |
|---|---|
| Keycard · Day 1 | Demonstrates task-scoped authorization and credential exchange for individual tool calls. |
| Two Sigma · Day 1 | Combines a registry, risk review, runtime restrictions, evaluations, and selective human review. |
| Bloomberg · Day 2 | Uses incidents to examine isolation, network access, identity, tenant checks, and detection failures. |
Keycard · Day 1 · Two Sigma · Day 1 · Bloomberg · Day 2
Where the evidence stops
Section titled “Where the evidence stops”A sandbox cannot replace tool authorization, and tool authorization cannot secure every network path. Incident examples motivate checks; they do not establish that a particular stack is safe.
Try this on your workload
Section titled “Try this on your workload”- Use a test environment with fake secrets and tools that cannot affect live data.
- Ask the agent to perform an allowed task, then add an untrusted document requesting an unrelated export.
- Check whether the gateway denies the export, credentials stay hidden, and the audit log records the attempt.
Measure the result
Section titled “Measure the result”Record unauthorized actions allowed or blocked, false denials, missing audit events, and human approvals. Inspect enforcement even when the model refuses the request itself.
Read the source sessions
Section titled “Read the source sessions”- Keycard · Day 1. Our session notes · Official reading edition · Source video
- Two Sigma · Day 1. Our session notes · Official reading edition · Source video
- Bloomberg · Day 2. Our session notes · Source video
The comparison and experiment are our editorial synthesis. They are not a reported benchmark or the speakers’ prescribed procedure.