Evaluating an Interaction

When a quality planClosed A tool for quality assurance. It samples random interactions based on filters you define, and sends those interactions to evaluators for review. assigns you an interaction for evaluation, you can play the interaction and open the associated evaluation formClosed A collection of questions used to evaluate agent interactions. directly from your Tasks page.

Two types of evaluations can be distributed via the Quality Planner:

  • Standard Evaluation—You receive an agent's interaction to playback and answer the questions on the assigned form.
  • Collaborative Evaluation—You receive an agent's interaction to playback and answer the questions on the assigned form. At the same time, the agent receives their interaction and performs a self-assessment using the same form.

For standard evaluations, you can delete or replace the tasks if necessary. You cannot delete or replace collaborative evaluations.

If you replace a task, you will be assigned a new one that matches the same filter criteria. If you delete a task, you can add a reason for the deletion. This information will be included in the Evaluation report. Keep in mind that the quality plan will not send you a new interaction for evaluation if you delete an evaluation task.

Davis Jones receives a number of interactions to review and evaluate in the Classics, Inc. contact center. When reviewing an interaction, he notices it is too short before he even scores it. Believing it won’t provide enough information for a fair evaluation, he decides to replace it.

He initiates the replacement process, fills in the reason, and clicks Replace. The system looks for a new interaction to evaluate that matches the quality plan parameters. Davis then continues his evaluation with the new interaction.

A flag in a form means that it contains at least one critical question. A wrong answer on a critical question will fail the form, automatically setting the score to zero.

To evaluate an interaction:

  1. Click the app selector icon of app selector and select My Zone.
  2. Click Tasks.

  3. Click on the interaction you want to evaluate.

    The player and the form open in new windows.

    If one of the windows does not open, ensure you have enabled your browser's pop-ups.

  4. Play back the interaction and answer the questions on the form.

    You can view the points earned and the maximum possible points for each individual question as you assess and score them. You can see the total score at the top of the form and the section score at the top of each section.

    A flag before a question means it is a critical question.

  5. You can add a comment on any of the questions. These comments will be visible to anyone viewing the evaluation.

    Click the comment icon, enter your comment, and click Submit.

  6. If the evaluation is standard, you can change the form if necessary. Click Change Form and select a new one from the list.

  7. Once you have completed the evaluation, save it by doing one of the following:

    • Click Save as Draft to save the evaluation for later.

    • Click Send to Agent to complete the evaluation.

    • Click Close to cancel the evaluation.

    Depending on the evaluation workflow defined in the form, the evaluation may or may not go to the agent.

Evaluating a Ticket

Evaluators can now evaluate and calibrate the tickets from the Ticket Search page allowing you to create a new evaluation and calibration for each ticket.

When a quality planClosed A tool for quality assurance. It samples random interactions based on filters you define, and sends those interactions to evaluators for review. assigns you an evaluation for a ticket, you can access the ticket and open the corresponding evaluation form directly from your Tasks page. Each time a ticket is resolved and closed, it will be distributed for evaluation. This helps the evaluators to stay updated and manage their ticket evaluations more effectively. Evaluating a ticket involves a comprehensive review of the ticket information, agent interaction, ticket information, and quality metrics.

To create an evaluation on a ticket:

  1. Click the app selector icon of app selector and select Interactions Hub.
  2. Click Tickets Search on the left.

  3. Click Options and select Evaluate.

    You can see Evaluate in the Actions menu only if the ticket belongs to a team that is assigned to you in views.

  4. In the Create New Evaluation window, select evaluator, agent, and a form. Click Evaluate.

    The evaluation is saved successfully.

  5. The Ticket conversation and evaluation form is displayed together side by side.

  6. From To evaluate an interaction, follow Step 4, Step 5, Step 6, and Step 7. Depending on the evaluation workflow defined in the form, the evaluation of a ticket may or may not go to the agent.

CXone Mpower Evaluation Summary

  • Content in this section is for a product or feature in controlled release (CR). If you are not part of the CR group and would like more information, contact your Account Representative.

  • Evaluation Summary is available only for the completed evaluations.

Evaluation Summary is a CXone MpowerQM feature that uses Generative AI to provide a clear, concise, and actionable summary of an agent's performance.

It simplifies the evaluation process by highlighting key strengths and areas for improvement, enabling managers and supervisors to quickly understand an agent's performance and develop effective strategies for improvement.

It analyzes evaluation formsClosed A collection of questions used to evaluate agent interactions., including scores, comments, and text responses, and creates clear and helpful summaries.

This feature is available only to users with the Quality ManagementAdvanced or Quality ManagementPremium license who purchased an advanced QM offering for Generative AI (this offering is still being developed).

Evaluation Summary Preview

Evaluation Summary preview provides a quick and focused snapshot of the agent’s performance.

  1. Click the app selector and select My Zone  >  Quality Performance.
  2. Select Teams, Groups and then desired dates.

  3. Click on the agent to see the evaluations.

  4. For the completed evaluations, Evaluation Insights Preview is displayed in the last column. Click on the Evaluation Insights Preview to display Evaluation Summary preview. It gives high level summary of the agent performance.

  5. Click Evaluation Summary to display Evaluation Summary tab with detailed summary of the evaluation.

Evaluation Summary Details

The Evaluation Summary tab shows detailed insights of the evaluation for the agent. It has different sections:

Short Overview

The short overview section of the Evaluation Summary offers a holistic performance review in under 100 words. It highlights strengths, improvement areas, and addresses any important aspects. It’s a quick, comprehensive performance snapshot.

Detailed Overview

The detailed overview section of the Evaluation Summary summarizes the agent’s overall performance. It also includes insights for questions that fall outside specific sections. This comprehensive overview is capped at 500 words, it offers a concise yet detailed analysis of the agent’s evaluation.

Strengths And Improvements

This section spotlights the top three areas of an agent’s performance, identifying strengths and areas for improvement. These insights are derived from score weightings or, in the absence of scoring, from question and answer analysis. This targeted approach helps managers in prioritizing coaching efforts, fostering a balanced perspective on strengths and growth areas. It’s a key tool for data-driven decision-making and performance improvement strategies.

Suggestions

The Evaluation Summary gives ideas based on comments and questions from evaluations. It extracts key feedback and offers tips for improvement, aiding supervisors in using this feedback to help agents enhance their performance. This makes coaching and skill development more personalized.

Feedback

The Give Feedback option on the Evaluation Summary tab offers a platform for user feedback on its usefulness, capturing satisfaction and value. It provides space for additional insights and fostering continuous improvements. It highlights the organization’s commitment to feedback and collaboration, aiding data-driven decisions and iterative enhancements.

Use Cases

1. Enhancing Contact Center Performance with Evaluation Summary

Personas: Sarah (Contact Center Manager), Contact Center Agents.

Preconditions: Sarah has a team of 20 agents. Each agent has a detailed evaluation form.

Details: Sarah wants to review her team’s performance and identify areas of improvement. Instead of manually going through each agent’s detailed evaluation form, which is time-consuming and inefficient, Sarah uses the Evaluation Summary feature. The Evaluation Summary provides concise overviews of each agent’s evaluations. These summaries automatically highlight the key strengths and areas needing improvement for each agent. Sarah uses the Evaluation Summary to easily pinpoint specific aspects of performance that require attention, without getting lost in the details. Based on the identified areas of improvement, Sarah creates targeted coaching sessions for each agent.

Benefits:

  • The use of the Evaluation Summary enables Sarah to provide more effective coaching.

  • This results in improved agent performance and an enhanced customer experience.

Business Value: The Evaluation Summary feature increases the efficiency of performance reviews, enables targeted coaching, and ultimately leads to improved agent performance and customer experience. It saves time for the manager and provides a clear direction.

2. Saving Time in the Evaluation Process

Personas: Michael, an Evaluator at a contact center.

Preconditions: The contact center has recently hired many new agents. Michael is tasked with assessing the performance of these new agents.

Details: Michael turns to the Evaluation Summary tool to streamline the evaluation process. Instead of navigating through lengthy, detailed evaluation forms for each agent, Michael can access concise overviews of each agent’s evaluation through the Evaluation Summary. The Evaluation Summary provides a clear snapshot of the agent’s performance, highlighting their key strengths and areas for improvement.

Benefits: By leveraging the Evaluation Summary, Michael can quickly create the essential insights from each evaluation, significantly reducing the time spent on the evaluation process. This increased efficiency allows Michael to evaluate more agents in less time.

Business Value: Ensuring that all new agents receive timely feedback and support not only improves the performance of the agents but also enhances the overall productivity and service quality of the contact center. This, in turn, can lead to increased customer satisfaction and business growth.

Deleting an Evaluation

Evaluations can be deleted once they have been acknowledged by the agent or after the evaluation process is fully completed. When deleting an evaluation, you must provide a reason for the deletion, which will be displayed in one of the Quality Management reports.

You can delete an evaluation when:

  • The evaluation is complete.

  • The agent has acknowledged the evaluation.

  • For a disputed evaluation, if the appeal has been resolved.

To delete an evaluation:

  1. Click the app selector icon of app selector and select My Zone.
  2. Click Quality Performance.

  3. In the list, click on delete against the evaluation that you want to delete.

  4. Add a Reason to explain why you are deleting the evaluation in the Delete Task pop-up window.

    OR

  5. You can access completed evaluation from My Zone > Quality Performance.

  6. Click on delete against the evaluation that you want to delete.

  7. Add a Reason to explain why you are deleting the evaluation in the Delete Evaluation pop-up window and click Delete.

    The following message displays: Deleting this evaluation may change the average evaluation score. Continue?

  8. Click Yes to delete the evaluation.