How Airbnb Uses Apache

The article provides an in-depth exploration of Riverbed, a framework within Airbnb's tech stack that optimizes data consumption from system-of-record data stores and updates secondary read-optimiz...

The article discusses the migration of Airbnb's streaming processing architecture from Hadoop Yarn to Kubernetes using Apache Flink.

The article discusses Riverbed, a data framework developed by Airbnb to optimize data access and processing at scale.

The article discusses Metis, Airbnb's next-generation data management platform designed to empower the company to manage its complex data ecosystem at scale.

The article discusses Mussel, Airbnb's scalable key-value store designed for derived data.

This article discusses Airbnb's upgrade of its Data Warehouse infrastructure to Spark 3 and Iceberg, addressing challenges faced with the previous Hive and S3 setup.

The article discusses Airbnb's Safe Deploy system, focusing on its architecture and engineering choices for implementing near real-time experiments.

Airbnb's article discusses their centralized access management system designed to enforce the principle of least privilege at scale.

The article discusses the Airflow Smart Sensor Service, which aims to optimize resource usage in Airflow by consolidating long-running lightweight tasks.

This article discusses how Airbnb leverages the Minerva API to provide a consistent and simplified data consumption experience at scale.

The article discusses how Airbnb developed the Wall framework to enhance data quality and prevent data bugs across its data engineering workflows.

This article discusses how Airbnb standardized metric computation at scale through its Minerva platform, focusing on the design principles that enable efficient dataset management, consistency, and...

This article discusses how Airbnb developed Minerva, a metric platform that ensures metric consistency across the company, enhancing data quality and analytics capabilities.

The article discusses Himeji, a scalable centralized system for authorization developed at Airbnb, which addresses challenges faced during the transition from a monolithic Ruby on Rails architectur...

The article discusses how Airbnb developed a robust cost data foundation to enhance infrastructure efficiency and achieve significant cost savings.

The article discusses Airbnb's journey towards achieving cloud efficiency, focusing on the challenges faced due to rising AWS costs and the strategies implemented to manage and optimize cloud resou...

The article discusses how Airbnb has enhanced Apache Superset, an open-source data exploration and visualization platform, to meet its enterprise-level business intelligence needs.

The article discusses Airbnb's approach to ensuring data quality through the Midas initiative, which establishes a 'gold standard' for data quality across the organization.

The article discusses Airbnb's commitment to improving data quality through a comprehensive initiative that addresses ownership, architecture, and governance of data.

The article discusses Dynein, an open-source distributed delayed job queueing system developed by Airbnb to enhance the scalability and reliability of job scheduling.

The article discusses the development and iteration of a machine learning-powered search ranking platform for Airbnb Experiences, detailing its growth from a small dataset to a more complex model t...

The article discusses how Airbnb utilizes Druid, a big data analytics engine, to enhance their analytics capabilities for real-time and batch processing.

The article discusses the development of SpinalTap, Airbnb's Change Data Capture (CDC) system, which enables real-time propagation and reaction to data mutations across its service-oriented archite...

The article discusses how Airbnb is optimizing its server configurations for Server Side Rendering (SSR) using Node. js.

This article discusses the tooling and standards that support the service-oriented architecture (SOA) at Airbnb, focusing on the importance of a standardized service platform to enhance development...

The article discusses the development of an internal online marketing system at Airbnb aimed at acquiring new hosts through effective online advertising.

This article discusses Airbnb's transition to a service-oriented architecture (SOA) and introduces the Service IDL (Interface Definition Language) as a key component for scaling service development.

The article discusses Airbnb's development and open-sourcing of Sparsam, a fast Thrift binding for Ruby that significantly improves serialization and deserialization speeds.

The article discusses how Airbnb democratizes data science through its initiative called Data University, aimed at empowering all employees to make data-informed decisions.

The article discusses how Airbnb's Payments team scaled their financial reporting system to handle increasing transaction volumes and complexity.

StreamAlert is an open-source real-time data analysis framework designed for automated alerting and security.