⚑ ForecastIQ
🎯

How ForecastIQ Works

A plain-English guide to the method behind the predictions β€” and how to use the app.

1

The Big Idea

Most people predict things by gut feeling. They read the news, form an opinion, and say "I think X will happen." The problem is that gut feelings are often wrong β€” and we rarely keep score.

ForecastIQ uses a method developed by Philip Tetlock, a professor who spent 20 years studying thousands of predictions made by experts and ordinary people. His finding? Most experts are barely better than random chance β€” but a small group of "superforecasters" could consistently beat the odds.

What made superforecasters different wasn't insider knowledge. It was their process. This app follows that process.

2

Two Views, One Number

πŸ“ Outside View

Start by forgetting everything specific about the situation. Instead ask: "How often does this type of thing happen in general?"

Example: Before predicting whether a specific government will call a snap election, ask: historically, how often do governments call snap elections? The answer is about 18% of the time per year. That's your starting point.
πŸ” Inside View

Now bring in the specifics. What's actually happening in this case right now? The app searches current news and scores 6 key factors.

Example: For that same government β€” how stable is it? What's the economic situation? What are experts saying? What does the media narrative look like? Each factor gets scored from the news.
The two views are combined using this formula:
Final % = (Outside View Γ— 1) + (Factor₁ Γ— w₁) + (Factorβ‚‚ Γ— wβ‚‚) + …
Γ· (number of inside factors + 1)
Example with 6 inside factors:
Outside view (base rate): 45% Γ— 1 = 45.00
Factor 1 (Polling, 20% weight): 70% Γ— 0.20 = 14.00
Factor 2 (Stability, 20%): 60% Γ— 0.20 = 12.00
… + 4 more factors …
Sum Γ· 7 (6 factors + 1) = Final Probability

The outside view always counts as one full term. Each inside factor is weighted by how important it is.

3

The 6 Factors (Inside View)

For political forecasts, the app automatically searches the news and scores these six factors. Each has a weight showing how much it matters. You can customise these weights in the Weights page.

πŸ“Š
Polling & Public Sentiment20% default

What do polls, surveys, and approval ratings say? High poll numbers = positive signal.

πŸ›οΈ
Political Stability & Leadership20% default

Is the government stable? Is there opposition pressure, protests, or a strong incumbent? Stability is a powerful predictor.

🌍
Geopolitical & External Pressure20% default

What are foreign governments, international bodies, or external actors doing? Sanctions, diplomacy, or proxy interference all shift probabilities.

πŸ’°
Economic Indicators & Coercion15% default

GDP growth, inflation, unemployment, and trade pressure. Economic pain often precedes political change.

🎯
Expert Consensus & Prediction Markets15% default

What are analysts, think tanks, and prediction markets saying? Aggregated expert opinion is a strong signal.

πŸ“°
Media Narrative & Information Environment10% default

How is the media framing the story? Is the narrative turning positive or negative? Propaganda and disinformation are also factored in.

4

Not All News Is Equal

The app assigns a credibility score to every news source it finds. A Reuters article counts more than a random blog. This prevents low-quality sources from skewing the result.

Tier 1
1.00Γ—
Reuters, AP, BBC, NYT, FT
Tier 2
0.85Γ—
CNN, Bloomberg, Politico, WSJ
Tier 3
0.65Γ—
Established regional outlets
Tier 4
0.50Γ—
Unknown / blogs
5

Keeping Score β€” The Brier Score

The point of forecasting is to get better over time. ForecastIQ tracks your accuracy using the Brier Score β€” the standard measure used by forecasting researchers.

Brier Score = (your probability βˆ’ actual outcome)Β²
Example: You said there was a 70% chance (0.70) of an event. It happened (outcome = 1).
Brier = (0.70 βˆ’ 1.00)Β² = 0.09 β†’ Very Good!
< 0.10
πŸ† Superforecaster
0.10–0.20
βœ… Very Good
0.20–0.25
βš–οΈ Average
0.50
🎲 Random Guess
β†’

How to Use ForecastIQ

1
Enter a username

No password needed. Just pick a username on the homepage to start tracking your forecasts and building your accuracy score over time.

2
Ask a clear, resolvable question

Good forecast questions have a definite YES or NO answer by a specific date. Example: "Will X happen before December 2026?" Bad: "Will things get better?"

3
Choose Political Forecasts or Sports

Political mode automatically searches current news and scores 6 factors. Sports mode lets you manually score 6 factors with sliders.

4
Set the news window (political only)

Choose how many days back to search for news β€” from 7 days (very current) to 90 days (longer trend). Default is 14 days.

5
Watch the live calculation

The centre panel streams every step in real-time β€” searching news, scoring factors, applying weights, calculating the blend. You can see exactly how the number was reached.

6
Review the result and evidence

The right panel shows your final probability, the outside view base rate, and an evidence trail. Click "View Dataset" to see the academic sources behind the base rate.

7
Customise your weights (optional)

Go to Weights to adjust how much each factor matters. If you think polling matters more than media sentiment for a particular type of question, adjust accordingly.

8
Resolve and build your score

When the event happens (or doesn't), go to History or Profile and mark the outcome YES or NO. Your Brier score updates automatically. Over time, you'll see how well-calibrated you are.

πŸ’‘

Tips for Better Forecasts

β†’ Don't ignore the base rate

Many people jump straight to "but this situation is different." Start with the base rate first, then adjust.

β†’ Use specific numbers

Say 63%, not "probably." Vague language hides bad thinking. Exact numbers force you to commit.

β†’ Update when new information arrives

Run the forecast again with a fresh news window as events evolve. Small updates beat big flip-flops.

β†’ Resolve your forecasts

Your Brier score only improves if you mark outcomes. Don't forecast and forget β€” close the loop.

β†’ Use "My Reference Class" for niche topics

If your question doesn't match a standard category, type your own reference class. The app fires a 9-query search battery across RAND, Brookings, UCDP, SIPRI, Metaculus, and academic databases β€” no date limit β€” to estimate a base rate from real data.

β†’ Compare with the community

Check the Community page to see how others have forecasted the same type of question. Learn from superforecasters.

β†’ Customise weights for your domain

If you're an expert in economics, weight the economic indicator factor higher. Your domain knowledge should be reflected in your weights.

⚑

Ready to make your first forecast?

It takes less than a minute. Pick a question, run the model, see the result.

Start Forecasting β†’
Method based on Tetlock & Gardner, Superforecasting: The Art and Science of Prediction (2015) Β· Good Judgment Project Β· IARPA ACE Tournament