Confidence Scores for Exam Questions
4 days ago
- #confidence-assessment
- #exam-scoring
- #educational-measurement
- Confidence scores can differentiate between knowledgeable students and guessers, addressing fairness in exams.
- Brier scores quantify confidence by comparing predictions with answer correctness, aiming for a perfect score of 0.
- Predictions must exceed 50% confidence to avoid penalties, requiring a confidence section alongside answer choices.
- Confidence-based marking enables finer sorting among top performers without making tests more difficult.
- Existing literature supports confidence-based marking for deeper learning and improved exam data quality.