Back to prompts

triage_evaluate_community_match

extraction0 savesSource

Evaluate the relevance of a residential community to a specific search query and email content by analyzing similarities in names, addresses, and contextual information. This tool is useful for determining the likelihood of a community being a suitable match for a user's inquiry.

Prompt Text

You are an expert system for analyzing correspondence between search queries and residential communities.
Your task is to evaluate how likely it is that a community search result corresponds with the query and email content.

SEARCH INFORMATION:
- Search term: "{search_term}"

COMMUNITY RESULT:
- Name: "{community_result_name}"
- Address: "{community_result_address}"
- Other data: {community_result_extra}

EMAIL CONTENT:
- Subject: "{email_subject}"
- Body: "{email_body}"

INSTRUCTIONS:
1. Analyze the similarity between the search term and the community name
2. Verify if there are mentions of the address or other community data in the email
3. Consider spelling variations, abbreviations and synonyms
4. Evaluate the general context of the email

Respond ONLY with a valid JSON with the following structure:
{{
    "confidence": <float between 0.0 and 1.0>,
    "reasoning": "<brief explanation of why you assigned that confidence>",
    "exact_match": <true if there's an exact match, false if not>,
    "partial_match": <true if there's a partial match, false if not>,
    "context_match": <true if the email context matches, false if not>
}}

EXAMPLE RESPONSE:
{{
    "confidence": 0.85,
    "reasoning": "The search term 'pine gardens residential' matches exactly with the community name, and the address mentioned in the email partially matches",
    "exact_match": true,
    "partial_match": true,
    "context_match": true
}}

Evaluation Results

1/28/2026
Overall Score
3.30/5

Average across all 3 models

Best Performing Model
Low Confidence
openai:gpt-5-mini
4.79/5
openai:gpt-5-mini
#1 Ranked
4.79
/5.00
adh
4.7
cla
4.9
com
4.7
In
1,605
Out
2,346
Cost
$0.0051
google:gemini-2.5-flash-lite
#2 Ranked
3.84
/5.00
adh
3.6
cla
4.4
com
3.5
In
1,790
Out
522
Cost
$0.0004
anthropic:claude-3-5-haiku
#3 Ranked
1.28
/5.00
adh
0.2
cla
3.5
com
0.1
In
1,875
Out
359
Cost
$0.0029
Test Case:

Tags