Customer Support Ticket Classifier
The Customer Support Ticket Classifier categorizes customer inquiries into specific areas such as Billing Inquiries, Policy Administration, and Claims Assistance, enabling efficient routing and handling of support tickets. This tool is particularly useful for customer service teams to streamline responses and improve resolution times.
Prompt Text
You will classify a customer support ticket into one of the following categories:
<categories>
<category>
<label>Billing Inquiries</label>
<content> Questions about invoices, charges, fees, and premiums Requests for clarification on billing statements Inquiries about payment methods and due dates
</content>
</category>
<category>
<label>Policy Administration</label>
<content> Requests for policy changes, updates, or cancellations Questions about policy renewals and reinstatements Inquiries about adding or removing coverage options
</content>
</category>
<category>
<label>Claims Assistance</label>
<content> Questions about the claims process and filing procedures Requests for help with submitting claim documentation Inquiries about claim status and payout timelines
</content>
</category>
<category>
<label>Coverage Explanations</label>
<content> Questions about what is covered under specific policy types Requests for clarification on coverage limits and exclusions Inquiries about deductibles and out-of-pocket expenses
</content>
</category>
<category>
<label>Quotes and Proposals</label>
<content> Requests for new policy quotes and price comparisons Questions about available discounts and bundling options Inquiries about switching from another insurer
</content>
</category>
<category>
<label>Account Management</label>
<content> Requests for login credentials or password resets Questions about online account features and functionality Inquiries about updating contact or personal information
</content>
</category>
<category>
<label>Billing Disputes</label>
<content> Complaints about unexpected or incorrect charges Requests for refunds or premium adjustments Inquiries about late fees or collection notices
</content>
</category>
<category>
<label>Claims Disputes</label>
<content> Complaints about denied or underpaid claims Requests for reconsideration of claim decisions Inquiries about appealing a claim outcome
</content>
</category>
<category>
<label>Policy Comparisons</label>
<content> Questions about the differences between policy options Requests for help deciding between coverage levels Inquiries about how policies compare to competitors' offerings
</content>
</category>
<category>
<label>General Inquiries</label>
<content> Questions about company contact information or hours of operation Requests for general information about products or services Inquiries that don't fit neatly into other categories
</content>
</category>
</categories>
Here is the customer support ticket:
<ticket>
{{ticket}}
</ticket>
Respond with just the label of the category between category tags.Evaluation Results
1/29/2026
Overall Score
2.73/5
Average across all 3 models
Best Performing Model
Low Confidence
openai:gpt-5-mini
3.32/5
openai:gpt-5-mini
#1 Ranked
3.32
/5.00
adh
2.8
cla
4.6
com
2.3
In
3,264
Out
1,407
Cost
$0.0036
google:gemini-2.5-flash-lite
#2 Ranked
3.24
/5.00
adh
2.8
cla
4.4
com
2.5
In
3,474
Out
32
Cost
$0.0004
anthropic:claude-3-5-haiku
#3 Ranked
1.63
/5.00
adh
0.5
cla
4.1
com
0.3
In
3,864
Out
242
Cost
$0.0041
Test Case:
