How Spotify Uses Scala

This article continues the exploration of Spotify's data platform, detailing its building blocks, scalability, and the community-driven approach to managing a complex data ecosystem.

Spotify has introduced Voyager, a new nearest-neighbor search library that significantly improves upon its predecessor, Annoy, by offering increased speed and accuracy.

This article discusses Spotify's migration of its Event Delivery Infrastructure (EDI) to Google Cloud Platform (GCP), detailing the challenges faced, solutions implemented, and the resulting improv...

This article discusses how Spotify optimized its largest Dataflow job for Wrapped 2020 by implementing Sort Merge Bucket (SMB) joins, significantly reducing costs and improving performance.

The article discusses Spotify's 'Listening Together' campaign, which visualizes real-time musical connections among users worldwide.

The article discusses Spotify's journey in improving its Machine Learning infrastructure using TensorFlow Extended (TFX) and Kubeflow.

Scio 0. 7 is a Scala API for Apache Beam and Google Cloud Dataflow, designed to simplify large-scale data processing for Spotify engineers.

This article delves into Scio, a Scala API for Apache Beam and Google Cloud Dataflow, highlighting its unique features, basic concepts, and practical use cases at Spotify.

This article discusses Spotify's transition to Google Cloud and the development of Scio, a Scala API for Apache Beam, which facilitates big data processing.

The article discusses Spotify's approach to reliably exporting Cloud Pub/Sub streams to Cloud Storage, detailing the architecture and processes involved in handling over 100 billion events generate...

The article discusses how Spotify processes vast amounts of user-generated data using Apache Crunch on Hadoop.