Author
Harit Vishwakarma
Researcher working on uncertainty in machine learning, including calibration and conformal prediction for language models.
Decision benchmarks leaderboard
Accuracy and calibration of Jev, other hosted decision models and open-weight ones on the decision benchmarks their makers use, broken down by multiple-choice, yes/no and rating questions.
JEV calibration leaderboard
Whether Jev, thirteen other hosted decision models and eight open-weight ones are right as often as they say they are, all asked the same exam-style questions.