COTA: Improving Uber Customer Care with NLP & Machine Learning

Huaixiu Zheng, Yi-Chia Wang, Piero Molino
14 min readintermediate
--
View Original

Overview

The article discusses COTA, Uber's Customer Obsession Ticket Assistant, which utilizes natural language processing (NLP) and machine learning (ML) to enhance customer support efficiency. It highlights the tool's architecture, its impact on ticket resolution times, and the integration of advanced ML models to improve agent performance and customer satisfaction.

What You'll Learn

1

How to leverage machine learning models to improve customer support ticket resolution

2

Why integrating NLP techniques can enhance the accuracy of issue identification

3

How to implement a pointwise ranking algorithm for solution selection

Prerequisites & Requirements

  • Understanding of machine learning concepts and natural language processing
  • Familiarity with Uber's Michelangelo platform(optional)

Key Questions Answered

How does COTA improve the customer support experience at Uber?
COTA enhances the customer support experience by reducing ticket resolution time by over 10 percent while maintaining or improving customer satisfaction levels. It achieves this by suggesting the top three likely solutions to agents based on ticket content and context.
What is the architecture of the COTA system?
The COTA architecture follows a seven-step workflow that includes collecting ticket features, predicting solutions using machine learning models, and suggesting the top-ranked solutions to agents. This structured approach streamlines the ticket resolution process.
What results were observed from implementing COTA in customer support?
The implementation of COTA led to a reduction in ticket handling time by about 10 percent and an increase in customer satisfaction scores by a few percentage points, demonstrating its effectiveness in improving support efficiency.
What machine learning techniques are used in COTA?
COTA utilizes various machine learning techniques, including pointwise ranking algorithms and topic modeling, to identify issue types and suggest solutions. These techniques enhance the accuracy and speed of ticket resolution.

Key Statistics & Figures

Ticket resolution time reduction
over 10 percent
This reduction was achieved while maintaining or improving customer satisfaction levels.
Customer satisfaction increase
a few percentage points
This was observed during A/B testing comparing control and treatment groups.

Technologies & Tools

Backend
Michelangelo
Used as the machine learning-as-a-service platform for COTA.
AI/ML
Natural Language Processing (nlp)
Utilized to analyze customer messages and improve issue identification.
AI/ML
Machine Learning (ml)
Employed to predict solutions and enhance customer support efficiency.

Key Actionable Insights

1
Implementing machine learning models like COTA can significantly enhance customer support efficiency.
By reducing resolution times and improving accuracy, businesses can increase customer satisfaction and reduce operational costs.
2
Utilizing NLP techniques in customer support can streamline the issue identification process.
This approach allows for a better understanding of customer issues, leading to quicker resolutions and improved service quality.
3
Adopting a pointwise ranking algorithm can improve solution selection accuracy.
This method allows support agents to focus on the most relevant solutions, enhancing their efficiency and effectiveness.

Common Pitfalls

1
Relying solely on traditional methods for ticket resolution can lead to inefficiencies.
Without leveraging advanced ML and NLP techniques, support teams may struggle to keep up with the increasing volume and complexity of customer inquiries.

Related Concepts

Machine Learning
Natural Language Processing
Customer Support Automation
AI In Customer Service