How Uber Uses Google Cloud
25 engineering articles about Google Cloud from Uber's engineering team
Other Uber Technologies
Other Companies Using Google Cloud
Articles
Filter:
This article details how Uber built and scaled Apache Hudi to power one of the world's largest data lakes, managing 19,500 datasets with trillions of records across a multi-hundred-petabyte reposit...
Prashant Wason, Balajee Nagasubramaniam, Surya Prasanna Kumar Yalla, Meenal Binwade, Xinli Shang, Jack Song
19 min read
Has Summary
--
The article discusses Uber's collaboration with Oracle Cloud Infrastructure (OCI) and Ampere Computing to optimize the OCI AmpereOne M A4 Compute instances.
Vikrant Soman, Dan Royal, Nav Kankani, Kamran Zargahi
7 min read
Has Summary
--
The article discusses Uber's implementation of I/O observability for its massive petabyte-scale data lake, focusing on the challenges and solutions in monitoring data access patterns across its hyb...
Arnav Balyan, Kartik Bommepally, Amruth Sampath, Jing Zhao, Akshayaprakash Sharma
10 min read
Has Summary
--
The article discusses the implementation of a Policy Simulator at Uber to enhance the safety and determinism of Identity and Access Management (IAM) policy changes.
Avinash Srivenkatesh, Zi Wen, Zakir Akram
15 min read
Has Summary
--
This article discusses the architecture and implementation of Uber's HiveSync, a critical service for data replication across its massive data lake.
Radhika Patwari, Trivedhi Talakola, Rajan Jaiswal, Chayanika Bhandary, Mukesh Verma, Sanjay Sundaresan
14 min read
Has Summary
--
The article discusses the evolution of Uber's Search Platform, highlighting its transition from Elasticsearch to an in-house solution called Sia, and ultimately to the adoption of OpenSearch.
Yupeng Fu, Shubham Gupta, Shanshan Song, Mingmin Chen
15 min read
Has Summary
--
This article discusses the development of Uber's Multi-Cloud Secrets Management Platform, designed to enhance security across its extensive microservices architecture.
Matt Mathew, Ludi Li, Chen Xi, Yiting Fan
16 min read
Has Summary
--
The article discusses Uber's migration of large-scale interactive compute workloads from Peloton to Kubernetes, focusing on minimizing disruption while enhancing resource management and cloud readi...
Sayan Pal, Rishabh Mishra
12 min read
Has Summary
--
The article discusses Uber's migration from Apache Mesos to Kubernetes, detailing the motivations, challenges, and solutions encountered during the transition.
Aditya Bhave, Arun Krishnan
11 min read
Has Summary
--
The article discusses Uber's transition to a multi-architecture environment by adopting Arm-based hosts at scale.
Uber's article discusses the strategic migration from on-premise data centers to cloud infrastructure while integrating Arm-based computers to enhance cost efficiency and hardware flexibility.
Andreas Lykke, Jesper Borlum
9 min read
Has Summary
--
The article discusses how Uber optimizes the training of Large Language Models (LLMs) using both open-source and in-house models.
ApacheApache KafkaApache SparkCometDockerGoogle CloudGPTGPT-4Hugging FaceKubernetesMistralPyTorchSQLTransformers
Bo Ling, Jiapei Huang, Baojun Liu, Chongxiao Cao, Anant Vyas, Peng Zhang
11 min read
Has Summary
--
The article discusses Uber's migration of its batch data platform to the cloud, focusing on the implementation of DataMesh principles.
Arun Mahadeva Iyer, Abhi Khune, Sahana Bhat
11 min read
Has Summary
--
This article discusses Uber's migration of its Apache Hadoop-based data lake to Google Cloud Storage (GCS) and the security measures implemented during this transition.
Matt Mathew, Alexander Gulko, Lei Sun, KK Sriramadhesikan, Alan Cao, Omkar Kakade
20 min read
Includes Code
Has Summary
--
Uber is modernizing its batch data infrastructure by migrating to Google Cloud Platform (GCP) to enhance data analytics and machine learning capabilities.
Abhi Khune, Arun Mahadeva Iyer, Sahana Bhat, Matt Mathew
7 min read
Has Summary
--
DataCentral is Uber's proprietary platform designed for Big Data observability, chargeback, and governance.
Arnav Balyan, Atul Mantri, Krishna Karri, Amruth Sampath
10 min read
Has Summary
--
The article discusses how Uber utilizes Apache Pinot for real-time analytics of mobile app crashes, enhancing their ability to detect and resolve issues quickly.
Kriti Dangi, Anil Purohit, Parijat Bansal, Rohit Yadav
17 min read
Has Summary
--
The article discusses the evolution of Data Lifecycle Management (DLM) at Uber, detailing the journey from initial implementations to the development of a unified system.
Sumanth Srinivasa Krishnaswamy, Matt Mathew, Sonali Goyal
13 min read
Has Summary
--
The article discusses Uber's implementation of Attribute-Based Access Control (ABAC) to manage access across its microservices architecture.
Alan Cao
10 min read
Has Summary
--
This article discusses how Uber engineers successfully halved the CI build time for their Go Monorepo by implementing various optimizations.
Tyler French, Mindaugas Rukas, Xiaoyang Tan
15 min read
Has Summary
--
This article discusses the development of Uber's Fulfillment Platform using Google Cloud Spanner, focusing on its architecture, scalability, and operational efficiency.
Ankit Srivastava, Fabin Jose, Jean He, Nandakumar Gopalakrishnan, [email protected], Ramachandran Iyer, Uday Kiran Medisetty
20 min read
Has Summary
--
The article discusses Uber's comprehensive re-architecture of its Fulfillment Platform, aimed at enhancing its Go/Get strategy.
Ashwin Neerabail, Ankit Srivastava, Kamran Massoudi, Madan Thangavelu, Uday Kiran Medisetty
19 min read
Has Summary
--
This article discusses how Uber implemented the QUIC protocol to enhance the performance of its mobile applications, particularly in low-latency and unreliable network conditions.
The article discusses how Uber manages its data workflows at scale, detailing the evolution from multiple overlapping data workflow systems to a centralized management system called Piper.
The article discusses the challenges of using Android Bundles for data transfer and how Uber Engineering developed the AutoValue: Bundle Extension to streamline this process.
Zachary Sweigart
5 min read
Has Summary
--
You've reached the end! All 25 articles loaded.