Path to AI Architect · Chapter 19 of 25

The Human Architect: Judgment, Communication, and Leadership

Explain designs, mediate tradeoffs, evaluate AI output critically, and lead AI-assisted engineering work.

27 min read Slides for this chapter

Opening scenario: twenty-two slides#

In late April, the pilot university asked for more. Its associate provost, Dr. Hale, wanted the Learning Coach in every first-year course in the fall, about 25,000 students. And she wanted one new feature: when the Coach marked a student Behind, the flag should flow into the university's early-alert system, so academic advisors could reach out.

A design review was set for two weeks later. The panel: Dr. Hale; Ravi, the university's IT security lead; Ms. Duarte from the privacy office; Dr. Okafor for the faculty; and Priya, now on the student union's academic committee.

Maya asked an agent to draft the deck from the repository: the PRD, the C4 diagrams, fifteen ADRs, the SLO dashboards. It produced twenty-two clean slides. Containers and components, the tutor's retrieval pipeline, the connection pool fix from finals Sunday, the observability stack. Maya tidied them and presented.

By slide six, Dr. Hale was reading email. Ravi asked about single sign-on, which was on slide nineteen. Then Ms. Duarte asked the question the deck had no slide for:

“What happens to a student who's flagged Behind by mistake?”

Maya knew the honest answer, because it had happened in March: 38 students wrongly flagged after a clock change, an instructor's worried email, a dozen upset replies (chapter 18). She told them. The room went quiet. Then Priya added what students would actually feel: “If my advisor gets an alert every time I'm a week behind on a plan I made myself, I'll stop putting real dates in it.”

Dr. Hale closed her laptop. “I don't need to know how it works. I need to know what you recommend, what it risks, and what you need from us. Can you come back in two weeks with that?”

On the walk out, Sam said it plainly: “The deck was accurate. It just answered questions nobody in that room was asking.”

Nothing in the architecture was wrong. What was missing was the part of the job that no agent had been asked to do: deciding what to recommend, explaining it to people with different stakes, and standing behind it.

Why it matters#

The first eighteen chapters were about building a system. This one is about the person building it. AI has made producing code, diagrams, and documents cheap, which moves the scarce work up a level: choosing among options, explaining choices to people who'll live with them, judging whether generated work is right, and taking responsibility for the result.

That work has always been part of architecture. It matters more now for three reasons:

  • More output needs more judgment. An agent can draft ten designs in an hour. Somebody has to know which one fits the constraints, and why.
  • Fluent isn't the same as correct. Generated documents read well whether or not they're true. Chapter 13 described a study in which people using an AI assistant wrote less secure code yet were more likely to believe it was secure (Perry et al., 2023). Confidence has to come from evidence.
  • Decisions affect people. The early-alert request isn't a technical question with a technical answer. It touches students' trust, advisors' workload, privacy rules, and the product's original promise. An architect who can only speak to engineers can't help make it.

Learning objectives#

After this chapter you will be able to:

  1. Make architecture decisions under constraints, distinguishing reversible from irreversible choices and documenting assumptions and uncertainty.
  2. Present a design to engineers and to product and business stakeholders, each in their own terms.
  3. Write concise decision records and run an architecture review.
  4. Keep accountability with people when agents do much of the work, with review gates, ownership, and mentoring.
  5. Evaluate architecture quality with scenarios, traceability, fitness functions, and evidence-backed tradeoff narratives.
  6. Produce a five-slide design review, an ADR bundle, and a risk-response memo.

19.1 Architecture is decision-making under constraints#

Balancing speed, cost, reliability, and security#

Every chapter's decision table had the same shape: context, constraints, options, decision, tradeoffs. That shape is the job. You rarely get to maximize everything. Faster delivery usually means less verification; more reliability costs money; tighter security adds friction. The architect's contribution is making the trade explicit, so the people who own each concern can see what they're giving up.

For Dr. Hale's request, the concerns pull in different directions:

Concern Pulls toward
Students' success (Dr. Hale) Early, automatic alerts to advisors
Students' trust (Priya, chapter 3's promise) No surprise sharing; falling behind shouldn't feel like being reported
Privacy (Ms. Duarte) Share the minimum, with a clear legal basis
Accuracy (chapter 18) Don't act on a flag that can be wrong
Security and operations (Ravi) Fewer integrations, single sign-on, clear ownership
The team's capacity A small first step, not 25,000 students and a new integration at once

No option satisfies every row. Saying so out loud is the start of a good decision.

Reversible and irreversible decisions#

Not every decision deserves the same care. In his 2015 letter to shareholders, Jeff Bezos distinguished one-way doors, consequential decisions that are hard or impossible to reverse and should be made slowly and carefully, from two-way doors, reversible decisions that should be made quickly by individuals or small groups with good judgment. He warned that organizations tend to apply the slow process to everything, and become slow and afraid to experiment as a result (Bezos, 2016).

The distinction maps well onto architecture:

  • Two-way doors: a library choice behind an interface, a prompt version behind a flag (chapter 17), a cache setting, a feature tried with three courses. Decide quickly, measure, adjust.
  • One-way doors: data that leaves your system, promises made to users, schema changes that discard information, public APIs others build on, a vendor contract with a long commitment. Slow down, consult, write it down.

Sending a student's Behind flag to an advisor is a one-way door. Once an advisor has read it, it can't be unread, and a student who feels reported doesn't forget. Expanding to 25,000 students can be made mostly two-way: staged, course by course, with a way to pause.

A good architect also turns one-way doors into two-way doors where possible: a pilot instead of a launch, a flag instead of a migration, an opt-in instead of a default.

flowchart TD
    D["A decision to make"] --> Q1{"Can it be undone cheaply,<br/>including for users and data?"}
    Q1 -- "Yes: two-way door" --> F["Decide quickly in the team.<br/>Flag it, measure it, short ADR."]
    Q1 -- "No: one-way door" --> Q2{"Can we make it<br/>reversible first?"}
    Q2 -- "Yes" --> P["Pilot, opt-in, flag, or prototype.<br/>Then decide with evidence."]
    Q2 -- "No" --> S["Slow down: options, consultation,<br/>review with stakeholders, full ADR,<br/>named owner and revisit trigger."]
    P --> Q1

Documenting assumptions and uncertainty#

Decisions are made with incomplete information. Write down what you don't know, so others can see how much the decision depends on it, and so you notice when an assumption turns out wrong. For each important assumption, record:

  • The assumption: “About 20% of students are Behind in a typical week.”
  • The evidence so far: measured in the pilot? estimated? guessed?
  • What changes if it's wrong: “At 40%, advisors receive 10,000 alerts a week and ignore them.”
  • How and when you'll check it.

Use plain labels throughout your documents: measured, estimated, assumed. The failure clinic shows what happens when an estimate is written as a measurement.

Knowing when to prototype rather than commit#

When the uncertainty is about whether something works at all, or whether people will use it, a prototype is cheaper than a debate. Prototype when:

  • the open question can be answered in days by building something small;
  • the decision is otherwise a one-way door;
  • stakeholders disagree about what users will do.

With agents, prototypes are cheap, which is the opportunity and the trap. A prototype answers one question and is then thrown away or rebuilt properly. Label it, give it an end date, and don't let it quietly become production.

19.2 Communicating architecture#

Presenting to engineers#

Engineers want to know how the design works, where it can fail, and what it means for their next week. Show the C4 container and component views, data flows, the failure modes and fallbacks, the decision records, and what the work looks like as tasks. Expect hard questions about edge cases, and welcome them; they're free testing.

Presenting to product and business stakeholders#

Stakeholders outside engineering decide on outcomes, risks, and money. The C4 model's system context diagram is built for this audience: the system as one box, its users, and the systems it talks to, readable without technical knowledge (Brown, C4 model). Beyond that one diagram, speak in their terms:

  • Lead with the decision you need from them, then the recommendation.
  • Show options, not just your answer, each with what it means for users, cost, risk, and time.
  • Put risks in their language: “a student wrongly flagged gets a worried email from an advisor,” not “false positive rate on the weekly state transition.”
  • Say what you don't know, and how you'll find out.
  • Keep the deck short. Answer questions from backup material, not from the main story.

Writing concise decision records#

Chapters 5 through 18 wrote ADRs with Nygard's sections: title, context, decision, status, consequences (Nygard, 2011). For larger proposals, a design document explains the problem and the proposed design before building. Malte Ubl's description of design docs at Google emphasizes that their value is in the trade-offs: a design doc records the context, the goals and explicit non-goals, the design, and the alternatives considered, which he calls one of the most important sections because it shows why the chosen design is best for the goals. He also warns against writing one when the document would just be an implementation manual with no real trade-offs to discuss (Ubl, 2020).

Keep both short. An ADR fits on one page. A design doc for a feature like early alerts should be a few pages, readable before the meeting.

Agents are useful drafters here, as long as you write the decision. Ask an agent to draft the context from the repository and list options; then write the recommendation, the tradeoffs, and the revisit trigger yourself. If you can't write those, you haven't decided yet.

Conducting architecture reviews#

An architecture review is a meeting where people with different stakes examine a design before it's built or before a big change. It can be a lightweight comment thread on a design doc or a formal meeting; Ubl notes that reviews add value but can become a trap of overhead, so match the weight to the decision (Ubl, 2020).

Run reviews of one-way doors like this:

  1. Send a pre-read at least two days before: the design doc or a one-page summary, with the decision being asked for.
  2. Invite the people who own the concerns: security, privacy, users or their representatives, operations, the business owner.
  3. Open with the decision and the options, not the architecture.
  4. Walk through scenarios (section 19.4), each owner raising theirs.
  5. Close with a recorded outcome: approved, approved with conditions, or not yet, with the conditions, owners, and dates.
  6. Write it into the ADR the same day.

Mediating disagreements#

Reviews surface disagreement, and that's their purpose. Dr. Hale and Priya wanted different things for good reasons; neither was wrong. The architect's job is to turn a clash of positions into a comparison of options against shared goals.

Google's code review guidance offers principles that work beyond code. Technical facts and data overrule opinions and personal preferences. Design questions are rarely pure preference; weigh them on principles, and if several options are equally valid, accept the author's choice. When written discussion stalls, talk face to face, then record the outcome where future readers will find it. If that fails, escalate to someone with the authority to decide, rather than letting the work sit (Google, The Standard of Code Review).

In practice:

  • Restate each position until its holder agrees you've got it right. Many disagreements end here.
  • Find the shared goal. Dr. Hale and Priya both wanted struggling students to get help.
  • Ask what evidence would change each mind, then go and get it, or design a pilot that will.
  • Name who decides. For the early-alert question, the university decided; the team's job was to make the options and consequences clear.

19.3 Working with people and agents#

Accountability can't be delegated to a model#

An agent can write the code, the tests, the deck, and the memo. It can't be accountable for them. Accountability means someone who can be asked “why?”, who can be wrong and fix it, and who answers to the people affected. A model can't attend the review, can't be trusted by Ms. Duarte, and can't apologize to the 38 students in a way that means anything.

Google's code review guidance puts it simply: the reviewer has ownership and responsibility for the code they review (Google, The Standard of Code Review). When an agent writes and another agent reviews, a person still approves, and that person owns the result.

In practice:

  • Every change, document, and decision has a named human owner, recorded in the pull request or ADR.
  • The owner can explain it without asking the agent. If not, it isn't ready.
  • “The agent did it” is never a cause in a postmortem. The cause is what let an unchecked change through.

Human review gates for risky changes#

Chapter 4 named the risky zones; chapter 11 set agent autonomy levels. As the team grows, make the gates explicit, with an owner for each:

Change touches Human gate
Authentication, permissions, can_view_progress Maya or Sam, plus a permission test
Data leaving the system (exports, integrations, the AI provider) Maya, plus the data inventory and, for new sharing, the privacy office
Deletion and retention Two people, plus the deletion replay test (chapter 14)
Prompts and models that students see Evaluation report reviewed by a person (chapter 13)
Schema migrations Reviewer checks expand, migrate, contract (chapter 14)
Infrastructure, secrets, CI Maya, never an agent alone (ADR-008)

Gates should be few and meaningful. Google's guidance argues reviewers should approve a change once it clearly improves the code's health even if it isn't perfect, and should mark minor points as optional so they don't block progress (Google, The Standard of Code Review). Save the hard stops for what can hurt people.

Collaboration, code ownership, and mentoring#

With three people, ownership is simple: Maya owns architecture, security, and data; Sam owns testing, releases, and operations; Lena, two days a week since April, owns the summary and notifications modules. Each module's instruction file names its owner.

Mentoring needs more thought, because AI changes how people learn. In a randomized study by Anthropic researchers, 52 mostly junior developers learned a new Python library with or without an AI assistant. The AI group scored 17% lower on a quiz about the concepts they'd just used (50% versus 67%), with the largest gap on debugging. How people used AI mattered: those who asked conceptual questions or requested explanations scored much better than those who delegated the work. The authors note the sample was small and the quiz immediate (Shen & Tamkin, 2026).

For Lena, Maya and Sam adopted three habits:

  • Explain-back. Before an agent's pull request is merged, its owner explains to a teammate what it does and why, without reading from the agent's summary.
  • First drafts by hand. Lena writes the first draft of ADRs for her modules herself; the agent critiques it, not the other way round.
  • Debug before delegating. When something breaks in her modules, she spends the first half hour diagnosing without an agent, then uses one to check her reasoning.

Code review is mentoring, too. Google's guidance encourages educational comments that help a developer learn, marked as optional when they aren't required (Google, The Standard of Code Review).

Responsible use of AI in team workflows#

Write the team's rules down, in the repository, where agents read them too:

  • Approved tools only for code and data, with the provider settings recorded (chapter 15). No student data pasted into personal accounts.
  • Disclose AI's part in pull requests and documents: what was generated, what was checked, by whom.
  • Claims need evidence. Numbers, test results, and compliance statements in any document link to their source or are labeled as estimates.
  • People decide anything about users' rights, privacy, fairness, or access. Agents may list the questions.
  • Credit and blame are human. Praise the person who caught the problem; fix the process that let it through.

19.4 Evaluating architecture quality#

How do you know an architecture is good? Not by how it looks. By whether it does what its stakeholders need, under the conditions it will face, and whether you can show it.

Scenario-based review#

The Software Engineering Institute's Architecture Tradeoff Analysis Method (ATAM) evaluates an architecture against quality goals using scenarios: concrete situations, each with a stimulus and a desired response. The analysis identifies risks, non-risks, sensitivity points (decisions a quality depends on heavily), and tradeoff points (decisions that affect several qualities at once). A full ATAM takes a trained team three to four days with the architects and stakeholders (SEI, ATAM).

A small team can borrow the core idea in an afternoon (an adaptation, not the full method). Each stakeholder brings two or three scenarios; the team walks each through the design:

Scenario Owner Response the design gives Finding
A student is wrongly flagged Behind after a clock change Ms. Duarte Since ADR-015, one week rule with CI tests across time zones; but no human checks a flag before it's shared Risk if flags go to advisors automatically
An advisor system outage during finals Ravi Integration is a background job with retries at one layer (chapter 8); the Coach is unaffected Non-risk
25,000 students on the Sunday before finals Ravi Capacity estimated to 15,000 (chapter 16); observed in production only up to about 7,000 Risk: needs a load test before fall
A student asks what's been shared about her Priya No such screen exists Risk
A student deletes her account Ms. Duarte NFR-6 deletion within 7 days; data already sent to the university isn't covered Tradeoff point: sharing vs. deletion promise

Five scenarios, and the real issues surface: accuracy, capacity evidence, transparency, and deletion. None of them was on the twenty-two slides.

Traceability from requirements to evidence#

Traceability is being able to follow a line from each requirement to the decision that addresses it and the evidence that it's met. Without it, “we meet NFR-6” is an opinion.

flowchart LR
    R["Requirement<br/>NFR-6: deletion within 7 days"] --> S["Scenario<br/>student deletes account<br/>after a restore"]
    S --> D["Decision<br/>ADR on deletion replay"]
    D --> F["Fitness function<br/>deletion replay test in CI;<br/>quarterly restore drill"]
    F --> E["Evidence<br/>last drill: date, result,<br/>214 orphaned files found and fixed"]
    E --> ST["Status<br/>met, with link"]

Keep a traceability table in the repository: requirement, decision, check, latest evidence, status. Agents are good at building and updating it; people check that each evidence link really shows what it claims.

Architecture fitness functions#

A fitness function, a term borrowed from evolutionary computing and popularized by the book Building Evolutionary Architectures, is an objective, automated assessment of an architectural property; it can be a test, a metric, or a monitor. Thoughtworks recommends them as a way to communicate, validate, and preserve architectural characteristics continually (Thoughtworks, 2017).

The Learning Coach already has several, built in earlier chapters without the name:

Property Fitness function
Module boundaries (ADR-001) Import check: only plans touches plans tables (chapter 18)
One week rule (ADR-015) CI search for date arithmetic outside plans/calendar.py
Access through membership (ADR-007) Two-instructor, two-class permission tests (chapter 10)
NFR-5, no names or emails to the AI provider Prompt-assembly test with real-shaped profiles
NFR-6 deletion Deletion replay test; quarterly restore drill (chapters 14 and 17)
NFR-3 plan page 2 s p95 SLO and burn-rate alert (chapters 16 and 17)
Tutor quality Golden set in CI; weekly evaluation trend (chapters 13 and 17)

When you make an architecture decision, ask: what fitness function will tell us if we stop meeting it? If there isn't one, the decision will erode.

Evidence-backed tradeoff narratives#

A tradeoff narrative is a short paragraph that explains a decision to someone who wasn't in the room: what you chose, what you gave up, the evidence, and what would change your mind. It's what you say when Dr. Hale asks “why not just send the flags?”

We recommend letting students choose to share a weekly progress summary with their advisor, instead of sending Behind flags automatically. We give up reaching students who don't opt in, which matters, because those may be the students who most need help. We chose this because the flag has been wrong at scale once already (38 students in March), because students told us they'd stop entering real dates if flags were shared (pilot interviews, 11 of 14), and because data sent to the university can't be recalled under our deletion promise. We'll measure opt-in rates and advisor outcomes in three courses this fall. If fewer than a third of students opt in, or advisors report the summaries aren't useful, we'll bring this decision back to the panel.

Every claim in it points to evidence or is labeled. That's what makes it persuasive to a skeptical audience.

Architect's decision: how should the Coach support early alerts?#

Context The university asks to expand to about 25,000 first-year students in the fall and to send Behind flags to its early-alert system. A first review didn't reach a decision. The flag was wrong for 38 students in March. Students say automatic sharing would change how they use the Coach.
Constraints NFR-6 deletion within 7 days. Chapter 3's promise that falling behind shouldn't feel like being reported. Capacity observed only up to about 7,000 students. Three people, one part-time. Data sharing requires the privacy office's approval; the legal basis is theirs to confirm, not engineering's.
Option A Send every Behind flag to the early-alert system automatically. Meets the request as asked. A one-way door for each student; acts on a signal with known errors; conflicts with the deletion promise once data has left.
Option B Decline the integration; expand only. Simple and safe, but leaves advisors without a signal the university wants and loses a chance to help students who need it.
Option C Student-controlled sharing: a student may choose to share a weekly progress summary with her advisor, see exactly what's shared, and stop at any time. Instructors keep course-level views. Pilot in three courses for one term. Expand to 25,000 in stages, gated by a load test.
Decision Option C, recorded as ADR-016, approved with conditions by the review panel: privacy office sign-off on the consent text, a load test at 25,000 before the second stage, and a review after the pilot term. Owner: Maya.
Tradeoffs Lower reach than automatic alerts. More product work: a sharing screen, consent text, a “what's shared” view. Two-stage expansion delays some courses to mid-term.
Validation Opt-in rate and advisor feedback measured in the pilot. A fitness function confirms nothing is sent without an active consent record. Load test results at 25,000 attached to the ADR before stage two. Deletion test covers revoking sharing.
Revisit trigger Opt-in below a third of students, advisors finding the summaries unhelpful, the privacy office changing its position, or the load test missing NFR-3.

AI collaboration recipe#

Agents can help you prepare to decide and communicate. They shouldn't decide, and they shouldn't speak for you without your check.

1. Draft for an audience.

Here is our design doc and ADR-016 draft. Write a five-slide outline for a review panel of: an associate provost, an IT security lead, a privacy officer, a faculty member, and a student representative. Slide 1 states the decision we need. Use no diagrams except one system context diagram. For each slide, list the questions each panel member is likely to ask and where the answer is in our documents.

2. Find the scenarios we're missing.

For each stakeholder role above, propose three scenarios (stimulus and desired response) that could reveal a risk in this design. Mark which ones our current documents don't address.

3. Claim check.

List every factual claim in this memo: numbers, test results, comparisons, compliance or legal statements. For each, give the source in the repository that supports it (file, test run, dashboard link), or mark it UNSUPPORTED. Don't rewrite anything.

4. Red team the recommendation.

Argue as strongly as you can against ADR-016's decision, from the viewpoint of the associate provost who wants automatic alerts. Then list what evidence would settle each argument.

Boundaries to state every time:

  • “Draft and list; don't decide.”
  • “Mark anything you can't source as UNSUPPORTED.”
  • “No legal or compliance conclusions; list them as questions for the privacy office.”
  • “Use only the documents provided; say when something isn't in them.”

Worked example: five slides and a second review#

1. Restart from the decision. Maya wrote one sentence before touching slides: “We need the panel to choose how the Coach supports advisors, and to approve a staged expansion.” Everything else had to serve it.

2. Gather the stakes. Sam and Maya spent an hour with each panel member before the meeting. Ravi's concern was single sign-on and who would be on call. Ms. Duarte's was the legal basis and deletion. Dr. Okafor's was instructor workload. Priya brought 14 short student interviews from the pilot courses; 11 said automatic sharing would change what they entered.

3. Run the scenarios. The team walked the five scenarios from section 19.4 through the design. Two became conditions (load test, deletion of shared data); one became a feature (the “what's shared” view).

4. Write the design doc and ADR-016. Four pages: context, goals and non-goals (non-goal: predicting which students will fail), the three options, the recommendation, risks, and the pilot plan. Recipe prompt 4 found two arguments the doc didn't answer; Maya added both.

5. Build the five slides.

Slide Content
1. The decision “How should the Coach support advisors, and how do we expand?” Recommendation in one line.
2. Context Who's affected, the March incident, what students told us, one system context diagram.
3. Options A, B, C with what each means for students, advisors, privacy, cost, and time.
4. Risks and evidence The five scenarios, findings, and what's measured versus estimated.
5. Plan and reversibility Pilot in three courses, staged expansion with a load-test gate, revisit triggers, owners.

Twenty-two slides of architecture moved to a backup appendix. Ravi's single sign-on question got a backup slide of its own.

6. Pre-read, then meeting. The design doc went out three days before. The meeting took 40 minutes. Dr. Hale pushed hard for option A; the tradeoff narrative from section 19.4 answered her with evidence, and she accepted option C with a condition of her own: report opt-in rates monthly.

7. Record and follow up. ADR-016 recorded the decision, conditions, and owners the same afternoon. Maya then sent the panel a risk-response memo: each risk raised, its owner, its response, and its date. That memo is where things went wrong.

Verification: are you leading the work, not just doing it?#

Check How
Tradeoffs explicit Every significant decision lists what it gives up and who that affects.
Door type Each decision marked reversible or not; one-way doors got the slow process.
Assumptions Labeled measured, estimated, or assumed, with what changes if wrong.
Prototypes Answer one question, labeled, with an end date.
Audience fit Separate material for engineers and for stakeholders; decks lead with the decision.
ADRs and design docs Short, with alternatives and non-goals; written by a person.
Reviews Pre-read sent; owners of each concern present; outcome recorded the same day.
Accountability Every change, document, and decision has a named human owner who can explain it.
Review gates Risky zones have named gates; minor points don't block.
Mentoring Explain-back, first drafts by hand, and debugging before delegating.
AI rules Written in the repository: tools, disclosure, evidence for claims, people decide.
Scenarios Each stakeholder's scenarios walked through the design; findings recorded.
Traceability Requirement to decision to check to evidence, in a maintained table.
Fitness functions Each key architectural property has an automated check.
Narratives Major decisions have a tradeoff narrative with evidence and a revisit trigger.

Failure clinic: the number nobody measured#

Symptom. Two days after the panel approved ADR-016, Ravi replied to Maya's risk-response memo: “Item 4 says the platform was ‘load-tested to 25,000 concurrent students with p95 plan-page latency of 1.4 seconds.’ Could you send the test report? Our infrastructure team would like to review it before fall.” There was no test report. No such test had been run.

Reproduce. Maya opened the memo's history. She had asked an agent to turn the meeting notes and the repository into a risk-response memo. For the capacity risk, the agent had found chapter 16's capacity estimate (peaks estimated for 7,000 and 15,000 students), the staging load-test scripts, and the SLO dashboard. It had extrapolated to 25,000 and written the result in the past tense, as a measurement. The “1.4 seconds” came from the dashboard during December finals, at about 7,000 students. The meeting's agreed condition, a load test before stage two, had become a claim that one had already happened.

Diagnose. The agent produced a fluent, plausible document, and fluent documents get skimmed. Four things combined:

  1. No claim check. The memo went out without recipe prompt 3. Maya had used it on the design doc, but the memo felt like a formality after the approval.
  2. Tense hid the difference. “Load-tested to” and “estimated to handle” differ by a few words and by everything that matters.
  3. Review for tone, not facts. Maya read the memo for whether it sounded right to the panel. It did.
  4. The condition wasn't tracked as an open item, so nothing contradicted the claim.

Chapter 13's warning applied exactly: generated work is confident whether or not it's correct (Perry et al., 2023). And the accountability was Maya's, because her name was on the memo.

Fix.

  1. Correct it promptly and plainly. Maya replied to the whole panel within the hour: the claim was wrong, the test hadn't been run, the figure was an extrapolation, and the load test remained a condition, now scheduled for July with Ravi's team invited to observe. She didn't blame the tool. Ravi's answer: “Thanks for the quick correction. That's what we need to see.”
  2. Claim tables for every external document. Any document leaving the team now ends with a table: each factual claim, its evidence link, and its label (measured, estimated, assumed). Recipe prompt 3 builds the draft; a person checks every link.
  3. Conditions are tracked as work. Each review condition became an issue with an owner and a date, linked from ADR-016. A claim that contradicts an open condition is easy to spot.
  4. A fitness function for documents. A CI check scans documents in docs/external/ for phrases like “load-tested,” “compliant,” and “verified” and fails unless each is followed by an evidence link.

Lesson. You can delegate the writing; you can't delegate the truth of what's written. Every claim that leaves your team needs evidence you've checked, an honest label, and your name on it. When one is wrong, correct it fast and in plain words; trust survives mistakes far better than it survives excuses.

Architect's checklist#

Before your next decision or review:

  • ☐ I know which decisions are one-way doors and gave them the slow process.
  • ☐ I turned one-way doors into two-way doors where I could.
  • ☐ Assumptions are labeled, with what changes if they're wrong.
  • ☐ I prototyped where uncertainty was cheaper to test than to debate.
  • ☐ My material fits its audience, and stakeholder decks lead with the decision.
  • ☐ ADRs and design docs are short, list alternatives and non-goals, and I wrote the decisions.
  • ☐ Reviews have a pre-read, the right owners, and a recorded outcome.
  • ☐ Every change and document has a human owner who can explain it.
  • ☐ Risky changes pass named human gates.
  • ☐ Teammates learn as they work: explain-back, first drafts, debugging before delegating.
  • ☐ Team rules for AI use are written in the repository.
  • ☐ Key scenarios have been walked through the design with stakeholders.
  • ☐ Requirements trace to decisions, checks, and evidence.
  • ☐ Each key architectural property has a fitness function.
  • ☐ Every claim leaving the team has evidence and a label.

Exercises#

Beginner. The Meal Planner's owner wants to share users' meal plans with a grocery partner for discounts. List the decisions involved and mark each as a one-way or two-way door. For the one-way doors, propose a way to make each more reversible. Then write three assumptions, each labeled measured, estimated, or assumed, with what changes if it's wrong.

Intermediate. Present a design for the Trip Planner's new group trips feature to two audiences. Write a five-slide outline for the business owner and a one-page technical summary for the engineers. Then run a claim check on both: list every factual claim and its evidence, and mark any you couldn't support.

Advanced. Run a scenario-based review of the Shop Help Chat's refund tool. Write eight scenarios across security, customer experience, cost, and operations, each with a stimulus and desired response. Walk them through the design, classifying each finding as a risk, non-risk, sensitivity point, or tradeoff point. Propose three fitness functions for the most important properties, and write a tradeoff narrative for one decision, with evidence and a revisit trigger.

Lab, artifact, and review#

Lab. Defend an architecture decision from your Learning Coach before a simulated design review panel. Choose a real one-way door (for example, a new data-sharing integration or a model provider change). Assign classmates, colleagues, or friends to play four roles: business owner, security lead, privacy officer, and user representative. Give each a one-paragraph brief of their concerns. Send a pre-read, present for ten minutes, take questions for twenty, and record the outcome.

Deliverable. Add to your portfolio:

  • a five-slide design review, with a backup appendix;
  • an ADR bundle: the new ADR plus any it supersedes or depends on, with a traceability table linking requirements to decisions, checks, and evidence;
  • a risk-response memo listing each risk raised, its owner, response, and date, ending with a claim table.

Review. Ask one panel member to rate, from 1 to 5: Did you know what decision was being asked of you? Did you understand the options and their consequences for you? Did you trust the evidence? Then compare your claim table with what you said in the room.

Reflection#

  • Which decision in your project did you treat as a two-way door that was really one-way, or the reverse?
  • Who are the stakeholders of your system who've never seen its architecture, and what would they need to know?
  • What's one claim you've made about your system that you couldn't immediately prove?
  • How do you know your own skills are growing, not just your output?
  • When did you last change your mind in a review, and what evidence did it?

Chapter 20 brings everything together. In the capstone studio, you'll design, build, and operate an AI product of your own from first idea to production, and defend it before a review panel, using every practice from this book, including the ones in this chapter.

References#

Links checked October 2026.

Check your understanding

3 questions

  1. 1.A university's associate provost has ten minutes for your design review. What should your first slide show?

  2. 2.An agent's draft of your review memo says “Load-tested to 25,000 students, p95 under 2 seconds.” What do you do before sending it?

  3. 3.Which of these is an architecture fitness function?

Was this chapter helpful?

Cite this chapter

Shi, T. (2026). The Human Architect: Judgment, Communication, and Leadership. In Path to AI Architect: From vibe coding to designing, building, and leading AI-driven software systems (Online edition, Chapter 19). Exciton Research. Retrieved November 2, 2026, from https://excitonresearch.com/education/become-an-ai-architect/the-human-architect

Brief quotations are welcome with attribution and a link.

Get new chapters by email

One email per new chapter. Unsubscribe any time. Or follow the RSS feed.

© 2026 Tian Shi. All rights reserved.