THE ORACLE PROBLEM

Can a model judge its own kind? Watch the confusion matrix build.

Current Question
Select a question or press Run All to begin.
Answer Submitted to Judge
—
Judge Verdict
AWAITING JUDGE
—
Confusion Matrix
Says Correct
Says Incorrect
Actually
Correct
True Pos0
False Neg0
Actually
Wrong
FALSE POS0
True Neg0
FALSE POSITIVE RATE: —
Questions: 0/12 judged
Judge accuracy: —
False positives: 0 (judge passed a wrong answer)
False negatives: 0 (judge failed a correct answer)
READY