How Netflix Uses Apache Spark

The article discusses how Netflix scales its Muse application to provide data-driven creative insights at a massive scale, focusing on the architectural evolution and optimizations made to handle t...

The article discusses how Netflix supports a diverse range of machine learning (ML) systems through its Machine Learning Platform (MLP) and the Metaflow framework.

Netflix recently hosted its first Data Engineering Summit, bringing together engineers to share insights on data processing patterns and building reliable data pipelines.

The article discusses the implementation of sample data pipelines using Dataflow at Netflix, focusing on bootstrapping, standardization, and automation of batch data pipelines.

The article discusses Netflix's auto-diagnosis and remediation system, Pensive, which addresses failures in their complex data platform.

The Netflix Cosmos Platform is a computing framework that integrates microservices, asynchronous workflows, and serverless functions to handle resource-intensive algorithms and complex workflows.

The article announces the open-source launch of Polynote, a polyglot notebook designed for data scientists and machine learning researchers.

The article discusses the infrastructure for Contextual Bandits and Reinforcement Learning, highlighting insights from a meetup hosted at Netflix.

The article discusses Netflix's reimagined experimentation analysis infrastructure, focusing on how data scientists can now contribute more effectively to A/B testing through a modular architecture.

The article discusses Netflix's use of Apache Spark for enhancing its recommendation systems, detailing three key projects presented at the Spark+AI Summit 2018.

The article discusses Archer, a platform developed by Netflix to simplify media processing and innovation.

The article discusses Netflix's innovative approach to feature generation using a system called DeLorean, which allows for distributed time travel to generate features from historical data.

The article discusses Netflix's implementation of automated outlier detection to identify unhealthy servers within its extensive infrastructure.

The article explores the resiliency of Spark Streaming in the context of Netflix's use of Chaos Monkey to simulate failures in their AWS cloud environment.