Research for Systems Mapping
How I Investigate Complex Topics Without Getting Lost
Research is often framed as the process of gathering information. In practice, information is abundant. The challenge is determining which information meaningfully improves understanding.
The goal of research is not to accumulate facts. The goal is to build increasingly accurate models of reality.
A useful model should:
Explain observed outcomes.
Survive contact with contradictory evidence.
Generate testable predictions.
Remain adaptable as new information emerges.
Core Principle
When investigating any topic, shift from asking:
What happened?
to:
What system would reliably produce this outcome?
This framing moves attention away from isolated events and toward underlying structures.
Signals vs. Noise
Not all information is equally valuable.
A signal is information that meaningfully improves understanding.
Noise is information that is interesting, emotionally compelling, or highly visible but does not materially improve understanding.
Common mistake:
Pattern recognition → immediate explanation
Preferred approach:
Pattern recognition → hypothesis generation → evidence gathering
Questions:
Is this a genuine signal or merely an interesting observation?
Is the pattern repeatable?
Does it appear across independent sources?
Is there a simpler explanation?
Signal strength can be evaluated on a spectrum.
Weak Signals
Anecdotes
Personal experiences
Social media posts
Individual observations
Medium Signals
Surveys
Expert analysis
Investigative reporting
Case studies
Strong Signals
Primary documents
Financial records
Large datasets
Independent replication
Direct observation
Weak signals are not useless. They are leads, not conclusions.
The Baseline Question
Many claims sound significant in isolation.
Always ask:
Compared to what?
Examples:
Compared to previous years?
Compared to similar organizations?
Compared to neighboring regions?
Compared to historical averages?
Without a baseline, significance cannot be evaluated.
10 studies for mapping systems
Every system can be analyzed through the same set of lenses.
1. Actors
Identify decision-makers and influential participants.
Questions:
Who makes decisions?
Who has influence?
Who benefits?
Who bears costs?
Who is excluded?
Examples:
Individuals
Teams
Companies
Governments
Institutions
Algorithms
2. Incentives
Behavior follows incentives more reliably than stated intentions.
Questions:
What gets rewarded?
What gets punished?
What gets measured?
What gets funded?
What gets promoted?
Focus on actual incentives rather than stated goals.
3. Resources
Resources determine what is possible.
Examples:
Money
Time
Talent
Attention
Data
Political capital
Land
Energy
Questions:
What is scarce?
What is abundant?
Who controls access?
Where are the bottlenecks?
4. Constraints
Many outcomes are better explained by constraints than by intentions.
Examples:
Legal constraints
Technical constraints
Geographic constraints
Financial constraints
Organizational constraints
Human cognitive limitations
Questions:
What cannot happen?
What is expensive?
What is difficult?
What limitations shape behavior?
5. Flows
Everything important moves.
Examples:
Information
Money
Authority
Resources
Trust
Attention
Questions:
What is flowing?
Who controls the flow?
Where are the chokepoints?
Where does accumulation occur?
Where do losses occur?
6. Feedback Loops
Feedback loops determine growth, decline, stability, and collapse.
Reinforcing Loops
Output increases future output.
Example:
Good product
→ More users
→ More revenue
→ More investment
→ Better product
Balancing Loops
System self-corrects.
Example:
Traffic increases
→ Commutes worsen
→ Fewer trips occur
→ Traffic decreases
Questions:
What amplifies itself?
What stabilizes itself?
Which loop currently dominates?
7. Time Delays
Many systems operate on delayed feedback.
Examples:
Housing
Education
Climate
Infrastructure
Organizational change
Technical debt
Questions:
What effects are delayed?
How long is the delay?
Who notices the delay?
Who ignores it?
8. External Forces
No system exists independently.
Questions:
What larger systems influence this one?
What external shocks can affect outcomes?
What dependencies exist?
Examples:
Economic conditions
Technology shifts
Regulation
Demographics
Climate
9. Failure Modes
Every system has predictable failure patterns.
Questions:
How does this system degrade?
What causes collapse?
What are the early warning signs?
Examples:
Design systems:
Governance collapse
Component sprawl
Low adoption
Cities:
Fiscal crisis
Brain drain
Infrastructure decay
Organizations:
Incentive misalignment
Communication breakdown
Leadership instability
10. Emergent Behavior
Emergent outcomes occur without centralized planning.
Examples:
Traffic jams
Housing shortages
Bureaucracy
Design debt
Cultural trends
Research question:
If every actor is behaving rationally according to their incentives, why is the system producing this outcome?
This often reveals more than assigning blame to individual actors.
Research Workflow
Step 1
Observe a pattern.
Do not explain it yet.
Step 2
List multiple possible explanations.
Avoid attachment to any single theory.
Step 3
Gather evidence for and against each explanation.
Track both supporting and contradicting information.
Step 4
Map the system.
Actors.
Incentives.
Resources.
Constraints.
Flows.
Feedback loops.
Delays.
External forces.
Failure modes.
Step 5
Evaluate confidence.
Avoid binary thinking.
Instead of:
True
or
False
Use:
Low confidence
Moderate confidence
High confidence
Step 6
Generate predictions.
Ask:
If this explanation is correct, what else should I observe?
Predictions are often more valuable than explanations.
Research Mindset
Think like a detective, not a lawyer.
Lawyers begin with conclusions and build cases.
Detectives begin with uncertainty and eliminate possibilities.
Useful phrases:
Interesting.
Possible.
Plausible.
Unclear.
Needs more evidence.
Low confidence.
Moderate confidence.
I don't know yet.
The objective is not certainty.
The objective is continuously improving the accuracy of the model.