How Airbnb Uses Apache Spark
7 engineering articles about Apache Spark from Airbnb's engineering team
Other Companies Using Apache Spark
Articles
Filter:
The article discusses the migration of Airbnb's streaming processing architecture from Hadoop Yarn to Kubernetes using Apache Flink.
Ran Zhang
11 min read
Has Summary
--
The article discusses Riverbed, a data framework developed by Airbnb to optimize data access and processing at scale.
Amre Shakim
8 min read
Has Summary
--
This article discusses Airbnb's upgrade of its Data Warehouse infrastructure to Spark 3 and Iceberg, addressing challenges faced with the previous Hive and S3 setup.
Ronnie Zhu
10 min read
Has Summary
--
This article discusses how Airbnb developed Minerva, a metric platform that ensures metric consistency across the company, enhancing data quality and analytics capabilities.
Robert Chang
12 min read
Has Summary
--
The article discusses Himeji, a scalable centralized system for authorization developed at Airbnb, which addresses challenges faced during the transition from a monolithic Ruby on Rails architectur...
Alan Yao
10 min read
Includes Code
Has Summary
--
The article discusses how Airbnb developed a robust cost data foundation to enhance infrastructure efficiency and achieve significant cost savings.
Anna Matlin
11 min read
Has Summary
--
The article discusses how Airbnb's Payments team scaled their financial reporting system to handle increasing transaction volumes and complexity.
Alice Liang
16 min read
Has Summary
--
You've reached the end! All 7 articles loaded.