product_relevance
The product_relevance prompt assesses how well each product aligns with a given query by assigning a relevance score between 0.0 and 1.0. It is useful for optimizing product listings and improving search results in e-commerce platforms.
Prompt Text
Evaluate the relevance of each product_name to the corresponding query.
Rate on a scale from 0.0 (not relevant) to 1.0 (highly relevant): {documents}
Provide the relevance scores for each product in the format: {{SKU}}: {{score}}Evaluation Results
1/28/2026
Overall Score
2.87/5
Average across all 3 models
Best Performing Model
Low Confidence
openai:gpt-5-mini
3.13/5
openai:gpt-5-mini
#1 Ranked
3.13
/5.00
adh
2.7
cla
4.5
com
2.2
In
315
Out
1,847
Cost
$0.0038
anthropic:claude-3-5-haiku
#2 Ranked
3.04
/5.00
adh
2.6
cla
4.4
com
2.1
In
365
Out
544
Cost
$0.0025
google:gemini-2.5-flash-lite
#3 Ranked
2.42
/5.00
adh
1.5
cla
4.2
com
1.6
In
300
Out
3,868
Cost
$0.0016
Test Case:
