Hinsley Documentation
Crowdsourcing Scenario Likelihoods
After building scenarios, the next step is assessing how likely each one is. Rather than relying on a single analyst's judgment, Hinsley lets you crowdsource likelihood estimates from multiple people - team members, subject-matter experts, and external guests - and automatically aggregates them into a consensus view.
Invite People to Assess a Scenario Set
- Open the scenario set in your analysis. In the gear menu, select Crowdsource Likelihoods.
- Choose who can submit: analysis collaborators, all account members, or anyone with the link. Collaborators only is the default. Anyone with the link permits guests without a Hinsley account.
- To send invitations, enter the recipients in Invite by email. Select Save to apply the access setting and send the invitations.
- To share through another channel, use Copy Link in the same settings panel. Recipients must meet the access setting you selected.
- Review estimates and their history on the scenario detail page as responses arrive.
When accepting submissions from anyone with the link, invitation emails provide a personalized link with the recipient's email filled in. Guests supply their name and assessments without creating a Hinsley account.
The Likelihood Scale
Every likelihood estimate in Hinsley uses a standardized seven-point scale aligned with common intelligence community probability language:
| Rating | Probability Range |
|---|---|
| Almost no chance | 1 – 5% |
| Very unlikely | 5 – 20% |
| Unlikely | 20 – 45% |
| Roughly even chance | 45 – 55% |
| Likely | 55 – 80% |
| Very likely | 80 – 95% |
| Almost certain | 95 – 99% |
This scale keeps assessments comparable across forecasters, and when estimates are aggregated the math maps cleanly to probability values.
Three Sources of Likelihood
Each scenario can display up to three likelihoods side by side:
- Hinsley estimate - An AI-generated likelihood with a written justification. Hinsley draws on the analysis's evidence, decomposition, and scenario details to produce this estimate. It also tracks trend direction over the past seven days. See How the Hinsley Estimate Is Produced, below.
- Your estimate - Your personal likelihood rating. You can set or update it from the scenario detail view at any time. In a set that is both mutually exclusive and exhaustive, editing one estimate opens the form for every scenario in the set.
- Aggregate estimate - The combined consensus of all individual estimates. This appears automatically once a scenario has estimates from two or more contributors. The Hinsley estimate counts as one contributor.
How the Hinsley Estimate Is Produced
The Hinsley estimate combines assessments from several AI models into one likelihood per scenario and a shared justification. It counts as one contributor in the aggregate. If a new estimate cannot be produced, the previous estimate remains visible.
How Aggregation Works
When multiple humans submit their estimates, Hinsley computes an aggregate likelihood using the following approach:
- Each estimate is converted to a probability. An estimate entered as a percentage is used as is. An estimate entered as a rating is converted to a point near the middle of its range. For example, Likely maps to 68% and Very unlikely maps to 13%.
- The arithmetic mean of all individual probabilities is calculated.
- The mean is mapped back to the corresponding rating on the seven-point scale.
In a set that is both mutually exclusive and exhaustive, Hinsley scales the mean probabilities so that the aggregate totals exactly 100% before it maps each one to a rating.
This process runs automatically each time a new estimate is submitted or an existing one is updated. The aggregate includes every current individual estimate from logged-in users and guest forecasters, plus the Hinsley estimate as a single contributor.
Tracking Changes Over Time
Hinsley preserves a full history of every likelihood estimate. Each time a forecaster updates their rating, the previous value is retained in the history log. You can review this history from the scenario detail view to see how assessments have shifted as new information emerged.
The likelihood history also includes a chart that visualizes trends over time, plotting the aggregate likelihood, the Hinsley AI estimate, and individual forecaster estimates on a timeline, so divergence between forecasters or between human and AI assessments is visible on a single chart.