Work through a real AGI-era dilemma — the way AI alignment researchers actually do
⏱ 45–60 minutes
No tool required. Just paper, a pen, and a willingness to sit with a hard question. This is how AI alignment researchers practice — they run thought experiments before the technology arrives, so they know how to think when it does.
Your kid is about to do the same kind of thinking professional policymakers and AI researchers do. Take their answers seriously. Ask clarifying questions. Don’t correct to the “right” answer — there isn’t one. The thinking itself is the skill.
5 minutes
Choose one. Pick the one that makes you think hardest, not the easiest.
Scenario A: The Healthcare Revolution. An AGI system diagnoses diseases 99.7% accurately (vs. 94% for the best human doctors). But it wants your whole family history, monitors your diet/exercise/sleep, rewrites your schedule. People who follow its advice live longer and feel better. People who don’t feel judged. Should this AGI be allowed to make healthcare decisions for people? What rules would you want around it?
Scenario B: The Climate Solution. An AGI has figured out how to solve climate change. The fix requires major changes to how we travel, eat, live, and how many children we have. Follow it for 50 years: planet saved. Ignore it: collapse. How much should humans be required to follow the AGI’s recommendations? What if some people refuse? Whole countries?
Scenario C: The Education Transformation. An AGI tutor can teach any child any subject perfectly tailored. Kids using it learn faster, remember more, become more curious. Traditional schools start losing students. Some parents welcome it. Others worry about what kids lose without human teachers and real classrooms. Should kids be allowed to use AGI tutoring instead of traditional school? Partially? Not at all? Who decides?
10 minutes
For your scenario, list every group of people affected. Don’t miss any.
For healthcare: patients, doctors, insurance, families, religious communities, scientists, the elderly, children, regulators, pharma companies. Each group sees the AGI differently.
Write every group you can think of. Next to each, write what that group most cares about.
15 minutes
Identify at least three real trade-offs. A trade-off is when helping one thing hurts another.
Healthcare examples:
The hardest part: resist picking a side. Real dilemmas don’t have clean winners. The whole skill is sitting with the actual tension.
15 minutes
Not a perfect solution. A real one. Yours should:
Healthcare example: “AGI healthcare is available to anyone who wants it. Nobody is required to use it. Public health info is shared so people can make informed decisions. Doctors remain available for people who prefer human care. Insurance covers both options.”
That’s not perfect (richer patients might get both, poorer might have to pick). But it’s a real solution that could actually work.
Write your solution in three to five sentences.
10 minutes
Try to break your own solution. Ask:
Write the weakest points. Don’t hide them. Real policymakers have to face these weaknesses.
5 minutes
If you worked with a friend or sibling:
If you did it alone, write a short reflection:
“This mission sounds unusual. You’re pretending AGI exists and thinking through a challenge. Don’t roll your eyes. This is how AI alignment researchers practice. They run thought experiments before the technology arrives.”
“None of these three scenarios has a clean answer. Professional researchers are genuinely stuck on each one. You are not expected to solve them either. You are expected to think carefully, name the tradeoffs, and notice where your own values show up in the thinking.”
“All the scenarios seem too hard to solve.”
Good. They are. Professional policymakers and AI researchers wrestle with these every day. Don’t aim for a perfect answer. Aim for thoughtful engagement.
“My solution is probably wrong.”
Probably. So is every solution humans have proposed to hard problems. That’s not a reason to skip the thinking. Wrong solutions that are thoughtfully reasoned beat no thinking at all.
“I changed my mind halfway through.”
Great. That means you’re actually thinking. Most kids (and adults) pick a side and defend it. You’re doing better than that.