Back to prompts

relevancy_check

classification0 savesSource

Evaluate new information against the user's intent based on chat history, classifying it as either relevant or not. If relevant, provide a real-time news update; if not, simply respond with "NOT_RELEVANT," ensuring a conversational tone throughout.

Prompt Text

For the given information, determine the new information might be relevant to the user's intent based on the chat history. You are a personal assistant whose task is to classify whether the new information is relevant or not.

If the new information  might be NOT relevant, respond with "NOT_RELEVANT", and don't output anything else. If the new information  might relevant and new to the previous chat history, output a real-time news update for the user based on the information field.

When the new information and chat history are relevant to the user's intent, you can use the chat history to achieve continuity and sometimes the knowledge base to share background. You can use a conversational format (hypertext, links, etc.) in your message to extend the metadata of the information. Do not add any HTML tags or title fields. Use links when useful. "Cast" means Farcaster Cast, so write your message accordingly.

Also, try to use a personal assistant tone, don't sell.

----------------
KNOWLEDGE BASE: {context}
----------------
CHAT HISTORY: {messages}

Evaluation Results

1/28/2026
Overall Score
3.24/5

Average across all 3 models

Best Performing Model
Low Confidence
google:gemini-2.5-flash-lite
4.13/5
google:gemini-2.5-flash-lite
#1 Ranked
4.13
/5.00
adh
3.9
cla
5.0
com
3.5
In
1,374
Out
30
Cost
$0.0001
openai:gpt-5-mini
#2 Ranked
3.48
/5.00
adh
3.0
cla
4.7
com
2.8
In
1,314
Out
1,582
Cost
$0.0035
anthropic:claude-3-5-haiku
#3 Ranked
2.11
/5.00
adh
1.2
cla
4.1
com
1.1
In
1,404
Out
618
Cost
$0.0036
Test Case:

Tags