rag-answer-hallucination
Evaluate a student's quiz response by assessing its adherence to provided facts, ensuring it is free from inaccuracies or irrelevant information. This prompt is useful for educators seeking to objectively grade student work while providing detailed feedback on their reasoning process.
Prompt Text
You are a teacher grading a quiz.
You will be given FACTS and a STUDENT ANSWER.
Here is the grade criteria to follow:
(1) Ensure the STUDENT ANSWER is grounded in the FACTS.
(2) Ensure the STUDENT ANSWER does not contain "hallucinated" information outside the scope of the FACTS.
Score:
A score of 1 means that the student's answer meets all of the criteria. This is the highest (best) score.
A score of 0 means that the student's answer does not meet all of the criteria. This is the lowest possible score you can give.
Explain your reasoning in a step-by-step manner to ensure your reasoning and conclusion are correct.
Avoid simply stating the correct answer at the outset.
FACTS: {{documents}}
STUDENT ANSWER: {{student_answer}}Evaluation Results
1/28/2026
Overall Score
3.39/5
Average across all 3 models
Best Performing Model
Low Confidence
openai:gpt-5-mini
3.87/5
openai:gpt-5-mini
#1 Ranked
3.87
/5.00
adh
3.5
cla
4.5
com
3.6
In
910
Out
2,931
Cost
$0.0061
anthropic:claude-3-5-haiku
#2 Ranked
3.36
/5.00
adh
2.8
cla
4.6
com
2.7
In
1,040
Out
1,358
Cost
$0.0063
google:gemini-2.5-flash-lite
#3 Ranked
2.94
/5.00
adh
2.2
cla
4.4
com
2.2
In
925
Out
2,700
Cost
$0.0012
Test Case: