Reporting on Agent Acknowledgement

Updated 

Tracking Disputed Comments

The Dispute Comment dimension can be plotted alongside other audit-related data, such as the auditor’s name, checklist, and agent details. This widget consolidates key information, including:

  • Case ID

  • Dispute comments provided by the agent

  • Associated checklist

  • Average evaluation score

  • Auditor and agent names

    The report highlights dispute comments as its dimension, using the format:

    Dispute Comments

Example:

A report may show cases like Rahul (#338276 Sprinklr_live_chat) with comments such as “Please re-review the evaluation”, along with:

  • Checklist name (For example, QM: Email BPO)

  • Average evaluation score (For example, 45)

  • Auditor and agent details

By presenting these dimensions together, the widget provides a clear view of dispute-related feedback and supports better analysis of dispute patterns and resolution processes.

Category-Level Dispute Details

This widget offers a consolidated view of category-level scores after agent disputes, enabling deeper insights into dispute outcomes and performance trends. It displays:

  • Case ID and associated channel

  • Checklist name

  • Number of checklist responses

  • Auditor and agent names

  • Timestamps for initial checklist response and re-evaluation

The report highlights category-level scores before and after the dispute for specific dimensions, using the format:

<Category Name> [Checklist Name] Score (Disputed)

Example dimensions:

  • Rapport [QM: Email V2] Score (Disputed)

  • Diagnosis [QM: Email V2] Score (Disputed)

  • Solution [QM: Email V2] Score (Disputed)

By consolidating this information, the widget supports transparent analysis of performance changes and helps identify areas for improvement in dispute resolution.

Item-Level Dispute Details

This widget provides a detailed view of item-level scores following an agent dispute, enabling granular analysis of the resolution process. It includes:

  • Evaluated agent’s name

  • Auditor associated with the dispute

  • Checklist name under dispute

  • Timestamps for:

    • Initial checklist response

    • Re-evaluation of disputed items

    The report highlights Item-level scores before and after the dispute for specific dimensions, using the format:

    <Item Name> Score (Disputed)

By consolidating these details, the widget offers a structured perspective on score changes, supporting accurate and informed dispute reviews.

Note: To plot item-level comments and item-level dispute comments added by auditors in the reporting, please work with your Success Manager.

Identifying Dispute Questions

This table displays audit cases with disputed checklist questions. Calculations for dispute counts and related metrics are based on the last two columns, Disputed Items and Disputed Item List, which list the specific questions flagged for review.

Re-evaluation Call Audits

In disputed flows, it is important to track how scores change after re-evaluation. A sample report provides visibility into call audits that have been re-evaluated following disputes. It includes:

  • Agent name

  • Case ID and associated channel

  • Auditor name

  • Checklist response count

  • Timestamps for:

    • Initial evaluation submission

    • Dispute assignment for re-evaluation

    • Completion of re-evaluation

      The report also displays:

      • Average evaluation score before and after the dispute

      • Percentage change in score

This consolidated view ensures transparency and provides actionable insights into quality assurance and dispute handling.

​​

Refer to the following table for dimensions and definitions of Dispute reporting.

Dimension/Metric Name

Definition

For User

Agent on which evaluation is done.

Case

Case number on which evaluation is done.

User

User who audited the evaluation.

Checklist Response Count

Total Response filled on the checklist.

Evaluation Submitted At

The first submission date of the audit.

Assigned for Re-Evaluation At

Date when dispute was raised on the audit.

Re-Evaluated At

Date when dispute audit was re-evaluated.

Evaluation Score(Disputed)

Evaluation Score on which the dispute is raised on the audit.

Evaluation Score

Final Evaluation score on the audit.

% Change in Evaluation Score - Custom Metric

% change in the Evaluation score after and before the evaluation.

Disputed Items

Parameter on which an agent raises the dispute.

Disputed Item List

All the parameters separated by comma on which an agent raises the disputes.

Dispute Comments

Comments provided during dispute.

<CategoryName> + <Checklist_Name> + Score (Disputed)

Category level dispute details of the checklist category - <CategoryName> + (<Checklist_Name>).

<ItemName> + Score (Disputed)

Item level dispute details - <ItemName>.

For more information, please refer to the reporting glossary article.