Site Map & Concept Map
How the documentation is organized and how concepts relate to each other.
Documentation Structure
Section titled “Documentation Structure”flowchart TB
subgraph Entry["Entry Points"]
INDEX[Index Page]
FIVEMIN[5-Minute Intro]
INTRO[Introduction]
end
subgraph Core["Core Understanding"]
CONCEPTS[Core Concepts]
GLOSSARY[Glossary]
FAQ[FAQ & Objections]
BIBLIO[Bibliography]
end
subgraph Principles["Principles"]
LEASTX[Least X Principles]
COORD[Coordinator Constraints]
end
subgraph Architecture["Architecture"]
DECOMP[Decomposed Coordination]
SAFETY[Safety Mechanisms]
FORECAST[Forecasting Navigation]
end
subgraph Examples["Worked Examples"]
RESEARCH[Research Assistant]
CODE[Code Deployment]
HEALTH[Healthcare Bot]
TRADE[Trading System]
end
subgraph TrustCalc["Delegation Risk"]
TCOV[Overview]
PROP[Propagation]
OPT[Optimization]
DYN[Dynamics]
ACCT[Accounting]
PROTO[Protocols]
IFACE[Interfaces]
ECON[Economics]
SCALE[At Scale]
HUMAN[Human-AI Trust]
end
subgraph RiskBudget["Risk Budgeting"]
RBOV[Overview]
EULER[Euler Allocation]
NUCLEAR[Nuclear PRA]
MECH[Mechanism Design]
ATTACK[Attack Surface]
FAIL[Lessons from Failures]
ASIL[ASIL Decomposition]
LINEAR[Linear Logic]
CARBON[Carbon Budgets]
end
subgraph Implementation["Implementation"]
QUICK[Quick Start]
DECIDE[Decision Guide]
ROAD[Roadmap]
EMPIR[Empirical Tests]
RELATE[Related Approaches]
end
subgraph Background["Background Research"]
BGIDX[Index]
NUCAERO[Nuclear/Aerospace Deep Dive]
FINRISK[Financial Risk]
PROJECTS[Open Problems in Delegation Engineering]
end
INDEX --> FIVEMIN
INDEX --> INTRO
FIVEMIN --> CONCEPTS
INTRO --> CONCEPTS
CONCEPTS --> LEASTX
CONCEPTS --> GLOSSARY
CONCEPTS --> FAQ
FAQ --> RELATE
LEASTX --> COORD
LEASTX --> DECOMP
COORD --> DECOMP
DECOMP --> SAFETY
DECOMP --> FORECAST
DECOMP --> RESEARCH
DECOMP --> CODE
SAFETY --> RESEARCH
SAFETY --> CODE
TCOV --> PROP
TCOV --> OPT
TCOV --> ACCT
RBOV --> EULER
RBOV --> NUCLEAR
RBOV --> MECH
QUICK --> DECIDE
QUICK --> RESEARCH
BGIDX --> NUCAERO
BGIDX --> FINRISK
Reading Paths by Audience
Section titled “Reading Paths by Audience”For New Readers
Section titled “For New Readers”Start here for foundational understanding:
1. 5-Minute Intro → 2. Core Concepts → 3. Glossary → 4. Least X PrinciplesFor Busy Readers
Section titled “For Busy Readers”Just want the essentials?
5-Minute Intro → Quick Start → FAQFor ML Engineers
Section titled “For ML Engineers”Focus on practical implementation:
Quick Start → Decision Guide → Least X Principles →Research Assistant Example → Code Deployment Example → Safety MechanismsFor Safety Researchers
Section titled “For Safety Researchers”Deep dive into the formal framework:
Core Concepts → Delegation Risk Overview → Risk Inheritance →Trust Optimization → Coordinator Constraints → Empirical TestsFor Organizations
Section titled “For Organizations”Risk management perspective:
Introduction → Risk Budgeting Overview → Euler Allocation →Lessons from Failures → Quick Start → RoadmapFor Skeptics
Section titled “For Skeptics”Evidence and comparisons:
Introduction → FAQ → Related Approaches → Lessons from Failures →Empirical Tests → Nuclear/Aerospace Deep DiveConcept Dependencies
Section titled “Concept Dependencies”What you need to understand before each major concept:
| Concept | Prerequisites | Recommended First |
|---|---|---|
| Delegation Risk (Delegation Risk) | None | Core Concepts |
| Least X Principles | Delegation Risk basics | Core Concepts |
| Coordinator Constraints | Least X Principles | Least X Principles |
| Decomposed Coordination | Least X, Coordinator | Both principle pages |
| Risk Inheritance | Delegation Risk, basic graph theory | Delegation Risk Overview |
| Trust Optimization | Inheritance, calculus | Risk Inheritance |
| Euler Allocation | Basic probability | Risk Budgeting Overview |
| Fault Trees | Probability, AND/OR logic | Nuclear Safety PRA |
| Mechanism Design | Game theory basics | Risk Budgeting Overview |
Topic Index
Section titled “Topic Index”By Question
Section titled “By Question”| Question | Pages |
|---|---|
| What is this framework? | Introduction, Core Concepts |
| How do I apply it? | Quick Start, Decision Guide, Principles to Practice |
| What are the principles? | Least X Principles, Coordinator Constraints |
| Show me examples | Research Assistant, Code Deployment, Case Studies (Sydney, Code Review Bot, Near-Miss, Drift) |
| What’s the math? | Delegation Risk Overview, Risk Propagation, Risk Inheritance, Trust Optimization |
| How does this relate to X? | Related Approaches, Background Research |
| What could go wrong? | Anti-patterns, Lessons from Failures |
| What’s the evidence? | Empirical Tests, Nuclear/Aerospace Deep Dive |
| What’s the roadmap? | Roadmap, Open Problems in Delegation Engineering |
By Keyword
Section titled “By Keyword”| Keyword | Primary Page | Related Pages |
|---|---|---|
| Delegation Risk | Delegation Risk Overview | Core Concepts, Trust Accounting |
| Decomposition | Decomposed Coordination | Core Concepts, Least X Principles |
| Verification | Safety Mechanisms | Trust Interfaces, Coordinator Constraints |
| Byzantine | Safety Mechanisms | Decomposed Coordination |
| Fault Tree | Nuclear Safety PRA | Euler Allocation, Risk Budgeting Overview |
| Scheming | Coordinator Constraints | Safety Mechanisms, Anti-patterns |
| Human oversight | Human-AI Trust | Coordinator Constraints, Safety Mechanisms |
| Budget | Risk Budgeting Overview | Euler Allocation, Trust Accounting |
Page Status
Section titled “Page Status”| Section | Pages | Status |
|---|---|---|
| Overview | 13 | Complete |
| Principles | 2 | Complete |
| Architecture | 7 | Complete |
| Delegation Risk | 10 | Most complete |
| Risk Budgeting | 9 | Complete |
| Implementation | 7 | Complete |
| Background Research | 6 | Complete |
Section Details
Section titled “Section Details”Getting Started
Section titled “Getting Started”| Page | Focus | Time |
|---|---|---|
| Overview | Problem statement | 10 min |
| Five-Minute Intro | Quick overview | 5 min |
| Core Concepts | Visual framework | 20 min |
| FAQ | Common questions | 15 min |
| Glossary | Term definitions | Reference |
| Reading Order | Path guidance | 5 min |
| Quick Reference | Cheat sheet | Reference |
| Common Mistakes | Anti-patterns | 15 min |
| For Engineers | Implementation | 15 min |
| Examples Catalog | Example index | Reference |
Delegation Risk (Theory)
Section titled “Delegation Risk (Theory)”| Page | Focus |
|---|---|
| Overview | Core formula |
| Walk-Through | Worked example |
| Risk Decomposition | Accident vs defection |
| Risk Propagation | The canonical composition rule |
| Delegation Accounting | Risk budgets |
| Exposure Cascade | Chain risk |
| Runtime Risk Accounting | Preflight, exposure envelope, exposure ledger |
| Insurer’s Dilemma | Who bears risk |
Power Dynamics (Theory)
Section titled “Power Dynamics (Theory)”| Page | Focus |
|---|---|
| Overview | Power formalization |
| Agent Power Formalization | Definitions |
| Agency & Power Examples | Worked examples |
| Strong Tools Hypothesis | High power, low agency |
Design Patterns
Section titled “Design Patterns”| Category | Examples |
|---|---|
| Least-X Principles | Privilege, context, autonomy |
| Structural Patterns | Bulkheads, firewalls |
| Verification Patterns | Ghost checker, triangulation |
| Monitoring Patterns | Tripwires, probing |
| Recovery Patterns | Rollback, degradation |
| Multi-Agent Patterns | Cross-validation |
| Tools & Guides | Implementation help |
| Worked Examples | Concrete applications |
Case Studies
Section titled “Case Studies”| Category | Contents |
|---|---|
| AI Systems | Sydney, Code Review Bot, Anti-patterns |
| Human Systems | Nuclear, Jury, Organizations |
| Power Dynamics Cases | Power in practice |
Research (selected)
Section titled “Research (selected)”| Page | Focus |
|---|---|
| Risk Measurement & Pricing | Coherent measures, complexity pricing, alignment tax |
| Risk Inheritance Algorithms | Candidate propagation rules and the canonical choice |
| Empirical Scheming Reduction | Evidence base and game theory of adversarial trust |
Page Counts by Section
Section titled “Page Counts by Section”| Section | Pages | Type |
|---|---|---|
| Getting Started | 12 | Entry |
| Delegation Risk | 6 | Theory |
| Power Dynamics | 5 | Theory |
| Entanglements | 26 | Theory |
| Design Patterns | 28 | Application |
| Case Studies | 25 | Examples |
| Research | 15 | Theory |
| Experimental | 10 | Tools |
| Reference | 5 | Meta |
| Total | ~132 |
Quick Links
Section titled “Quick Links”Start here:
Reference:
Deep dives:
Interactive Tools:
See Also
Section titled “See Also”- Reading Order — Prerequisites and paths