How Uber Uses Docker
33 engineering articles about Docker from Uber's engineering team
Other Uber Technologies
Other Companies Using Docker
Articles
Filter:
The article discusses Uber's migration of large-scale interactive compute workloads from Peloton to Kubernetes, focusing on minimizing disruption while enhancing resource management and cloud readi...
Sayan Pal, Rishabh Mishra
12 min read
Has Summary
--
The article discusses the MySQL fleet at Uber, which consists of over 2,300 independent clusters that support critical operations for the platform.
Banty Kumar, Debadarsini Nayak, Raja Sriram Ganesan, Amit Jain
15 min read
Has Summary
--
The article discusses how Uber utilizes Ray®, a general compute engine for Python®, to enhance the efficiency of its rides business through improved machine learning model performance and optimizat...
Kaichen Wei, Matt Walker, Peng Zhang
15 min read
Has Summary
--
The article discusses how Uber optimizes the training of Large Language Models (LLMs) using both open-source and in-house models.
ApacheApache KafkaApache SparkCometDockerGoogle CloudGPTGPT-4Hugging FaceKubernetesMistralPyTorchSQLTransformers
Bo Ling, Jiapei Huang, Baojun Liu, Chongxiao Cao, Anant Vyas, Peng Zhang
11 min read
Has Summary
--
The article discusses Uber's strategy for shifting end-to-end (E2E) testing left in their development process to improve efficiency and reduce operational costs.
Quess Liu, Daniel Tsui
11 min read
Has Summary
--
The article discusses Uber's overhaul of flaky tests through the introduction of Testopedia, a centralized system designed to enhance visibility and control over test reliability.
The article discusses Uber's evolution in machine learning (ML) through its centralized platform, Michelangelo, highlighting its transition from predictive to generative AI.
ApacheApache SparkAutoMLDeep LearningDockerGenerative AIHugging FaceKerasKubernetesPaLMPrompt EngineeringPyTorchTensorFlowXGBoost
Kai Wang, Min Cai, Joseph Wang, Eric Chen
28 min read
Has Summary
--
This article discusses Uber's journey in adopting arm64 architecture using the Zig programming language for their infrastructure.
Motiejus Jakštys, Laurynas Lubys, Neringa Lukoševičiūtė
14 min read
Has Summary
--
This article discusses Uber's journey in containerizing Hadoop NameNodes within their infrastructure, detailing the motivations, challenges, and architectural strategies employed during the migrati...
The article discusses Uber's journey in scaling the adoption of Kerberos authentication across its extensive data analytics platform.
Alexander Gulko, Matt Mathew
13 min read
Includes Code
Has Summary
--
The article discusses how Uber has enhanced developer productivity through the implementation of DevPods, a remote development environment.
Ali-Reza Adl-Tabatabai, Serdar Badem, Matas Antanas Strukčinskas, Aistis Jokubauskas
17 min read
Has Summary
--
The article discusses uBuild, Uber's platform for building container images efficiently and securely.
The article discusses Uber's implementation of an automated vertical CPU scaling system that optimizes resource allocation for storage workloads, leading to significant cost savings and improved re...
Lasse Vilhelmsen
10 min read
Has Summary
--
The article discusses Uber's approach to automating offline inferences using machine learning and natural language processing on support interaction data.
The article discusses Uber's implementation of security features for its Kafka infrastructure, detailing the importance of securing data integrity and access control.
Prateek Agarwal, Ryan Turner, KK Sriramadhesikan
20 min read
Includes Code
Has Summary
--
This article discusses Uber's journey in containerizing their Apache Hadoop infrastructure, detailing the challenges faced and the solutions implemented over two years.
The article discusses Uber's open source initiatives in 2019, highlighting the company's contributions to the open source community, the establishment of the Open Source Program Office (OSPO), and ...
Uber
7 min read
Has Summary
--
The article discusses the evolution of the Michelangelo model representation at Uber to enhance flexibility and scalability in machine learning model serving.
Anne Holler, Michael Mui
15 min read
Has Summary
--
The article introduces Kraken, an open-source peer-to-peer Docker registry developed by Uber to address performance issues with their legacy Docker registry stack.
Cody Gibb, Evelyn Liu, Yiran Wang
3 min read
Has Summary
--
The article discusses how Uber manages its data workflows at scale, detailing the evolution from multiple overlapping data workflow systems to a centralized management system called Piper.
The article introduces Makisu, Uber's open-source Docker image builder designed for Apache Mesos and Kubernetes.
Evelyn Liu, Ed Oakes, Caspar, Yiran Wang
13 min read
Has Summary
--
The article discusses how NVIDIA leverages Uber's Horovod to enhance the training of deep learning models for autonomous vehicles.
Molly Vorwerck
6 min read
Has Summary
--
The article discusses Peloton, Uber's unified resource scheduler designed to manage diverse cluster workloads efficiently.
ApacheApache KafkaApache SparkCassandraDockerHAProxyKerasKubernetesMySQLProtocol BuffersPyTorchRedisResNetTensorFlow
Leslie Williams, Mayank Bansal
20 min read
Has Summary
--
The article introduces Michelangelo PyML, Uber's platform designed for rapid Python machine learning model development.
ApacheApache SparkDockergRPCJavaJSONMachine LearningPySparkPyTorchscikit-learnSQLTensorFlowThriftXGBoost
Kevin Stumpf, Stepan Bedratiuk, Olcay Cirit
15 min read
Has Summary
--
The article discusses the scaling of Uber's Customer Support Ticket Assistant (COTA) system using deep learning techniques.
Huaixiu Zheng, Guoqin Zheng, Naveen Somasundaram, Basab Maulik, Hugh Williams, Jeremy Hermann
15 min read
Has Summary
--
The article discusses Uber's Databook platform, which transforms big data into actionable knowledge by managing metadata.
The article discusses Queryparser, an open-source tool developed by Uber Engineering for parsing and analyzing SQL queries.
Cherami is a distributed, scalable, durable, and highly available message queue system developed by Uber Engineering to transport asynchronous tasks.
The article discusses Uber Engineering's approach to managing MySQL clusters using Docker, highlighting the challenges faced with scaling and the solutions implemented through a design called Schem...
The article discusses Pyflame, a high-performance profiler developed by Uber Engineering for Python applications.
Evan Klitzke
12 min read
Has Summary
--
The article provides an in-depth look at Uber's engineering tech stack, focusing on the foundational elements that support its complex systems.
Uber Engineering's Micro Deploy is an in-house deployment system designed to streamline the process of deploying code across its services.
The article discusses Uber's transition from a monolithic architecture to a microservices architecture, highlighting the implementation of Tincup, a currency and exchange rate service.
Emily Reinhold
9 min read
Has Summary
--
You've reached the end! All 33 articles loaded.