Uber logo

Uber Engineering Blog & Tech Articles

Transportation technology company connecting riders and drivers through innovative ride-sharing and delivery platforms

850 engineering articles, tutorials, and technical insights from Uber's engineering team

Latest Articles

Filter:
Uber logo
Uber
Beginner
The article provides essential guidelines for drivers operating at Los Angeles International Airport (LAX) while using the Uber app.
4 min read
Has Summary
--
Uber logo
Uber
Advanced
Uber’s Rate Limiting System details the evolution of Uber's approach to managing service overload through a unified rate-limiting architecture.
Chien-Chih Liao, Rahul Gutal, Smit Sheth, Ying Jiang
14 min read
Includes Code
Has Summary
--
Uber logo
Uber
Intermediate
This article introduces uForwarder, Uber's open-source push-based consumer proxy for Apache Kafka's async queuing system.
Zhifeng Chen, Yang Yang, Haifeng Chen
12 min read
Has Summary
--
Uber logo
Uber
Intermediate
This article details how Uber optimized Apache Hadoop's Distcp (Distributed Copy) tool to scale their data replication infrastructure from handling 250 TB to petabytes of daily data movement.
Abhay Yadav, Radhika Patwari, Sanjay Sundaresan
15 min read
Has Summary
--
Uber logo
Uber
Advanced
This article details how Uber built and scaled Apache Hudi to power one of the world's largest data lakes, managing 19,500 datasets with trillions of records across a multi-hundred-petabyte reposit...
Prashant Wason, Balajee Nagasubramaniam, Surya Prasanna Kumar Yalla, Meenal Binwade, Xinli Shang, Jack Song
19 min read
Has Summary
--
Uber logo
Uber
Advanced
This article details Uber's multi-year evolution from static, quota-based rate limiting to an intelligent, priority-aware load management system for their distributed databases (Docstore and Schema...
Dhyanam Vaidya, Prathamesh Deshpande, Mike Ma, Chaitanya Yalamanchili
15 min read
Has Summary
--
Uber logo
Uber
Intermediate
Uber Engineering details their migration from a legacy monolithic monitoring system to a modern, cloud-native observability platform for their corporate network infrastructure.
Razvan Cicu, Giovanni Pepe
9 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses Uber's transition from traditional keyword-based search using Apache Lucene to implementing semantic vector search with Amazon OpenSearch.
Hao Sun, Jiasen Xu, Smit Patel, Anand Kotriwal, Xu Zhang
11 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses how Uber utilizes a pull-based ingestion model in OpenSearch™ to effectively index streaming data.
Yupeng Fu, Varun Bharadwaj, Shuyi Zhang, Xu Xiong, Michael Froh
14 min read
Has Summary
--
Uber logo
Uber
Intermediate
The article discusses Uber's collaboration with Oracle Cloud Infrastructure (OCI) and Ampere Computing to optimize the OCI AmpereOne M A4 Compute instances.
Vikrant Soman, Dan Royal, Nav Kankani, Kamran Zargahi
7 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses Uber's transition from batch to streaming data ingestion using Apache Flink, which significantly enhances data freshness and operational efficiency.
Xinli Shang, Peter Huang, Jing Li, Jing Zhao, Jack Song
6 min read
Has Summary
--
Uber logo
Uber
Intermediate
This article discusses Uber's implementation of Apache Pinot to manage and analyze its extensive inventory and catalog data efficiently.
Suraj Modi, Ankit Sultana, Tarun Mavani
11 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses how Uber improved MySQL cluster uptime by adopting MySQL Group Replication (MGR) at scale.
Siddharth Singh, Raja Sriram Ganesan, Amit Jain, Debadarsini Nayak
13 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses the improvements made to MySQL cluster uptime at Uber through the implementation of MySQL Group Replication (MGR).
Siddharth Singh, Raja Sriram Ganesan, Amit Jain, Debadarsini Nayak
10 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses the evolution and scaling of Uber's Delivery Search Platform, emphasizing the transition from traditional lexical search to a semantic search model that enhances user experien...
Divya Nagar, Zheng Liu, Jiasen Xu, Bo Ling, Haoyang Chen
11 min read
Has Summary
--
Uber logo
Uber
Intermediate
Ceilometer is Uber's adaptive benchmarking framework designed to enhance the performance and reliability of their infrastructure by automating benchmarking processes and providing actionable insigh...
Nav Kankani, Nate Cloud-Rouzan, Derrick Tseng, Rajat. Sharma
11 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses how Uber enhanced its Guidance Heatmap using deep probabilistic models to provide drivers with better insights into potential earnings.
Bob Zheng, Jane Hung, Arushi Singh, Dhruv Ghulati, Yifan Yu, Paul Frend, Elif Eser
9 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses Uber's implementation of I/O observability for its massive petabyte-scale data lake, focusing on the challenges and solutions in monitoring data access patterns across its hyb...
Arnav Balyan, Kartik Bommepally, Amruth Sampath, Jing Zhao, Akshayaprakash Sharma
10 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses the implementation of zone failure resilience in Apache Pinot at Uber, detailing strategies to ensure uninterrupted service during zone failures.
Si Lao, Christina Li, Xuanyi Li, Yang Yang, Ujwala Tulshigiri
10 min read
Has Summary
--
Uber logo
Uber
Intermediate
The article discusses Uber's approach to enhancing the safety of machine learning (ML) model deployments through a series of mechanisms integrated into their ML life cycle.
Sophie Wang, Jia Li, Joseph Wang
10 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses how Uber has integrated explainability into its machine learning platform, Michelangelo, using Integrated Gradients (IG) to provide interpretable attributions for deep learni...
Hugh Chen, Eric Wang, Gaoyuan Huang, Howard Yu, Jia Li, Sally Lee
14 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses how Uber AI Solutions enhances data labeling quality through a framework called Requirement Adherence, which utilizes Large Language Models (LLMs) for real-time validation and...
Siddarth Reddy Malreddy, Akshay Arora, Aditi Agarwal, Subrat Sahu, Nikhil Mittal, Rupal Khare
6 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses the rebuilding of Uber's Apache Pinot™ query architecture, focusing on the transition from Neutrino to a new query system that utilizes Pinot's Multi-Stage Engine Lite Mode.
Ankit Sultana, Christina Li, Shaurya Chaturvedi, Tarun Mavani, Shreyaa Sharma
11 min read
Has Summary
--
Uber logo
Uber
Advanced
The article announces that the Cadence project has joined the Cloud Native Computing Foundation (CNCF), highlighting its commitment to open-source development.
Uber Engineering
3 min read
Has Summary
--
Uber logo
Uber
Advanced
This article details how Uber standardized its mobile analytics system to improve data consistency and quality across its applications.
Ben Hjerrild, Rajat Sharma, Shawn Dong, Wugang Zhao
12 min read
Has Summary
--
Uber logo
Uber
Advanced
Uber's migration from Spark 2. 4 to Spark 3. 3 involved upgrading over 2 million Spark applications, utilizing innovative automation tools like Iron Dome.
Amruth Sampath, Arnav Balyan, Nimesh Khandelwal, Sumit Singh, Parth Halani, Suprit Acharya
8 min read
Has Summary
--
Uber logo
Uber
Intermediate
The article discusses the implementation of a Policy Simulator at Uber to enhance the safety and determinism of Identity and Access Management (IAM) policy changes.
Avinash Srivenkatesh, Zi Wen, Zakir Akram
15 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses the open-source release of Starlark Worker, a tool that integrates Cadence workflow orchestration with the Starlark scripting language.
Andrii Kalishuk, Taylan Isikdemir
8 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses the architecture and implementation of Uber's HiveSync, a critical service for data replication across its massive data lake.
Radhika Patwari, Trivedhi Talakola, Rajan Jaiswal, Chayanika Bhandary, Mukesh Verma, Sanjay Sundaresan
14 min read
Has Summary
--
Uber logo
Uber
Intermediate
This article discusses the challenges and solutions Uber faced in controlling the rollout of large-scale changes in a monorepo environment.
Aron Lorincz, Goncalo Alvarez, Rasmus Vestergaard
13 min read
Has Summary
--
Uber logo
Uber
Intermediate
This article discusses how Uber's CacheFront serves over 150 million reads per second while ensuring stronger consistency guarantees.
Eli Pozniansky, Preetham Narayanareddy
13 min read
Has Summary
--
Uber logo
Uber
Advanced
Uber is transitioning its enterprise network from a centralized backbone model to a scalable, flexible SD-WAN architecture to enhance performance, reduce costs, and streamline operations across its...
Almaz Rakhimbekov, Giovanni Pepe
7 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses the development and implementation of forecasting models aimed at improving driver availability at airports, which are critical to Uber's ridesharing ecosystem.
Bob Zheng, Dhruv Ghulati, Manoj Panikkar, Michael (Yichuan) Cai
15 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses Uber's implementation of encryption at rest and disk isolation at scale using their Stateful Platform, Odin.
Ivan Shibitov, Johan Abildskov
14 min read
Has Summary
--
Uber logo
Uber
Advanced
uReview is an AI code review platform developed by Uber to enhance the code review process by providing timely, high-quality feedback.
Sonal Mahajan, Shauvik Roy Choudhary, Akshay Utture, Will Bond, Joseph Wang
14 min read
Has Summary
--
Uber logo
Uber
Intermediate
The article discusses the evolution of Uber Eats from a restaurant-focused service to a comprehensive retail platform, highlighting the development of the INventory and CAtalog (INCA) system.
Kristian Lassen
14 min read
Has Summary
--
Uber logo
Uber
Advanced
PerfInsights is a performance optimization tool developed by Uber that leverages Generative AI to automatically detect performance antipatterns in Go services.
Lavanya Verma, Ryan Hang, Sung Whang, Joseph Wang
10 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses Finch, Uber's conversational AI data agent designed to streamline financial data retrieval within the Slack environment.
Austin Harrison, Eddie Huang, Spencer Garth, Tim Ross, Taya Yusuf
13 min read
Has Summary
--
Uber logo
Uber
Intermediate
The article discusses how Uber processes early chargeback signals to mitigate payment fraud and enhance customer trust.
Avadhut Thakar
7 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses how Uber utilizes reinforcement learning techniques to enhance the efficiency of its marketplace by improving the balance between drivers and demand.
Prateek Jain, Soheil Sadeghi, Mehrdad Bakhtiari
11 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses how Uber has optimized its Continuous Integration (CI) system, SubmitQueue, to reduce resource usage by 53% and speed up wait times by 37% while maintaining a green mainline.
Dhruva Juloori, Matthew Williams, Zhongpeng Lin
17 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses the evolution of Uber's Search Platform, highlighting its transition from Elasticsearch to an in-house solution called Sia, and ultimately to the adoption of OpenSearch.
Yupeng Fu, Shubham Gupta, Shanshan Song, Mingmin Chen
15 min read
Has Summary
--
Uber logo
Uber
Intermediate
The article discusses Uber's automation of Kerberos keytab rotation, detailing the challenges faced and the solutions implemented through their Keytab Distribution Pipeline (KDP).
Junyan Guo, Matt Mathew
14 min read
Has Summary
--
Uber logo
Uber
Intermediate
This article details Uber's migration from Apache Hive to Apache Spark SQL for ETL workloads, highlighting the motivations behind the transition, the architecture involved, and the challenges faced...
Kumudini Kakwani, Akshayaprakash Sharma, Nimesh Khandelwal, Aayush Chaturvedi, Chintan Betrabet, Suprit Acharya
14 min read
Has Summary
--
Uber logo
Uber
Intermediate
The article discusses Uber's implementation of a configuration-driven archival and retrieval framework designed to manage vast amounts of regulatory data efficiently.
Abhishek Dobliyal, Aakash Bhardwaj
12 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses the Enhanced Agentic-RAG (EAg-RAG) framework developed by Uber to improve the accuracy and relevance of chatbot responses in the engineering security and privacy domain.
Arnab Chakraborty, Paarth Chothani, Christopher Settles, Adi Raghavendra
13 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses Uber's robust database backup recovery system, highlighting its importance for business continuity and disaster recovery.
Arjav Jain, Shivam Vijay, Debadarsini Nayak, Mohammed Khatib, Ramnik Jain
11 min read
Has Summary
--
Uber logo
Uber
Advanced
This article discusses the development of Uber's Multi-Cloud Secrets Management Platform, designed to enhance security across its extensive microservices architecture.
Matt Mathew, Ludi Li, Chen Xi, Yiting Fan
16 min read
Has Summary
--
Uber logo
Uber
Intermediate
The article discusses Uber's migration of large-scale interactive compute workloads from Peloton to Kubernetes, focusing on minimizing disruption while enhancing resource management and cloud readi...
Sayan Pal, Rishabh Mishra
12 min read
Has Summary
--
Uber logo
Uber
Advanced
The article discusses FixrLeak, a generative AI-based framework developed by Uber to automate the detection and repair of resource leaks in Java applications.
Chris Zhang, Akshay Utture, Manu Sridharan
7 min read
Has Summary
--