Automating Merchant Live Monitoring with Real-Time Analytics: Charon

Marco Vita, Ujwala Tulshigiri, Dharak Kharod
12 min readintermediate
--
View Original

Overview

The article discusses the development and implementation of Charon, a real-time analytics framework at Uber designed for automating merchant live monitoring. It highlights how Charon addresses marketplace reliability issues, particularly during the COVID-19 pandemic, by leveraging Uber's data platform to enhance operational efficiency and improve merchant experiences.

What You'll Learn

1

How to leverage real-time analytics for operational efficiency in a marketplace

2

Why monitoring merchant-level metrics is crucial for reliability

3

How to implement rules for managing order fulfillment during peak times

Prerequisites & Requirements

  • Understanding of real-time data processing concepts
  • Familiarity with Apache Kafka and Apache Pinot(optional)

Key Questions Answered

How does Charon improve merchant reliability during COVID-19?
Charon was adapted to address COVID-19 challenges by implementing rules that prevent courier crowding and manage kitchen capacities. This allowed restaurants to operate safely while maintaining service levels, ensuring that they could continue to fulfill orders despite reduced staffing and new regulations.
What is the Long Request (LR) metric and why is it important?
The Long Request (LR) metric counts live orders that have been prepared but not assigned to a courier for over 10 minutes. It is crucial because it identifies orders likely to remain unfulfilled, helping to manage merchant capacity and improve customer experiences by preventing delays.
What technology stack does Charon utilize?
Charon relies on Uber's real-time analytics systems, particularly Apache Kafka for data ingestion and Apache Pinot for real-time querying. This stack allows Charon to efficiently process and analyze large volumes of order data, enabling timely decision-making.
How does Charon handle the influx of orders during peak times?
Charon automatically closes merchants when the Long Request count exceeds a set threshold, preventing additional orders from being added to a queue that may not be fulfilled. This helps manage order flow and reduces negative experiences for both merchants and customers.

Key Statistics & Figures

Long Request (LR) threshold
10 minutes
Orders that are prepared but not assigned to a courier for over 10 minutes are flagged as Long Requests, indicating potential fulfillment issues.

Technologies & Tools

Some links below are affiliate links. We may earn a commission if you make a purchase.

Data Streaming
Apache Kafka
Used for ingesting data from various sources into Uber's data infrastructure.
Real-time Analytics
Apache Pinot
Serves as the real-time datastore for querying and analyzing order-level data.
Data Workflow Management
Uworc
Facilitates the ingestion of data from Apache Kafka to Apache Pinot.

Key Actionable Insights

1
Implement real-time monitoring tools to enhance operational efficiency.
By leveraging frameworks like Charon, businesses can gain immediate insights into marketplace dynamics, allowing for quick adjustments to operations based on live data.
2
Establish clear metrics for assessing marketplace reliability.
Using metrics such as Long Request can help identify potential issues before they escalate, ensuring better service delivery and customer satisfaction.
3
Adapt business operations to changing circumstances, such as during a pandemic.
Flexibility in operational rules allows businesses to respond effectively to external challenges, maintaining service levels and supporting merchant partners.

Common Pitfalls

1
Failing to monitor real-time metrics can lead to operational inefficiencies.
Without proper monitoring, businesses may miss critical issues that affect service delivery, leading to customer dissatisfaction and lost revenue.

Related Concepts

Real-time Data Processing
Marketplace Reliability Metrics
Data-driven Decision Making