Reasoned Rule Mining on VCBench
Reasoned Rule Mining scores F0.5 32.2 on VCBench, the venture capital benchmark from the University of Oxford and Vela Research, with 34.8% precision and 24.9% recall on the 4,500-founder private test set. That is rank 6 of 32, 3.0× the F0.5 of tier-1 VCs and 3.7× Y Combinator, at $0.31 per 1,000 founders scored.
- Rank
- #6 of 32
- F0.5
- 32.2
- Precision
- 34.8%
- Recall
- 24.9%
- Cost / 1k founders
- $0.31
Scored on the 4,500-founder private test set, mean over three folds. That is 3.0× the F0.5 of tier-1 VCs. See the full leaderboard.
Compared with the reference rows
| Entry | Precision | Recall | F0.5 | Cost / 1k |
|---|---|---|---|---|
| Reasoned Rule Mining | 34.8% | 24.9% | 32.2 | $0.31 |
| Think-Reason-Learn Ensemble | 40.6% | 30.1% | 37.9 | $0.87 |
| Tier-1 VCs | 23.0% | 5.2% | 10.7 | n/a |
| Y Combinator | 14.0% | 6.9% | 8.6 | n/a |
| Random Classifier | 9.0% | 9.0% | 9.0 | $0 |
Human rows are normalized to the dataset's 9% success rate, so every entry is compared on the same base rate. Costs use list prices on 2026-09-24.
How it was scored
An LLM reads each founder profile at scoring time and returns a prediction. Reasoned Rule Mining used about 7,441 input and 1,928 output tokens per founder on Typesafe System One (jev-1.13.0), measured from the API usage fields. Cost is tokens times the provider's list price on 2026-09-24 ($0.042 input and $0 output per million tokens), so it recomputes when prices change. Build costs such as question or policy generation are excluded.
Read more
- Reasoned Rule Mining: Calibrated LLM Predictions of Startup Success: Reasoned Rule Mining calibrates LLM log-probabilities and mines readable rules to predict founder success, 12x the market index in the paper.
Frequently asked questions
- What does Reasoned Rule Mining score on VCBench?
- Reasoned Rule Mining scores F0.5 32.2 on VCBench, with 34.8% precision and 24.9% recall, rank 6 of 32 as of 2026-10-07.
- Does Reasoned Rule Mining beat human investors at predicting founder success?
- Yes. Its F0.5 is 3.0 times that of tier-1 VCs (10.7) and 3.7 times Y Combinator (8.6), after both are normalized to the dataset's 9% base rate.
- How much does Reasoned Rule Mining cost per 1,000 founders?
- About $0.31 per 1,000 founders at list prices on 2026-09-24. An LLM reads each founder profile at scoring time and returns a prediction. Reasoned Rule Mining used about 7,441 input and 1,928 output tokens per founder on Typesafe System One (jev-1.13.0), measured from the API usage fields. Cost is tokens times the provider's list price on 2026-09-24 ($0.042 input and $0 output per million tokens), so it recomputes when prices change. Build costs such as question or policy generation are excluded.