How Spotify Uses Java

This article discusses the development and optimization of background coding agents at Spotify, focusing on context engineering to enhance their functionality in code migration tasks.

The article discusses Spotify's evolution in developer productivity through the use of background coding agents within their Fleet Management system.

The article features a Q&A with maintainers of projects supported by the Spotify FOSS Fund, highlighting the impact of financial contributions on open source projects like Jdbi, AssertJ, and Testco...

The article discusses Spotify's innovative approach to automating content marketing to efficiently acquire users at scale.

Spotify has introduced Voyager, a new nearest-neighbor search library that significantly improves upon its predecessor, Annoy, by offering increased speed and accuracy.

The article announces the recipients of the 2023 Spotify FOSS Fund, which supports free and open source software projects critical to Spotify's technology stack.

This article discusses fleet-wide refactoring at Spotify, detailing the tools and strategies developed to manage code changes across thousands of Git repositories.

This article discusses Spotify's transition to a fleet-first mindset in managing their software infrastructure.

The article announces the recipients of the 2022 Spotify FOSS Fund, aimed at financially supporting independent open source projects that are crucial for Spotify's operations.

This article discusses Spotify's transition from using Luigi and Flo for data orchestration to adopting Flyte.

The article discusses the development and implementation of Blend, a personalized playlist feature at Spotify that combines the musical tastes of two users.

The article discusses the evolution and challenges of machine learning models used for personalizing content on Spotify's Home interface.

This article discusses Spotify's use of machine learning (ML) models to personalize content on the Home page, focusing on the candidate generation stage.

This article discusses how Spotify optimized its largest Dataflow job for Wrapped 2020 by implementing Sort Merge Bucket (SMB) joins, significantly reducing costs and improving performance.

The article discusses the development and open-sourcing of Klio, a framework designed for building efficient data pipelines for audio processing at scale.

Spotify's Event Delivery system is a crucial component for understanding user behavior and delivering personalized content.

Scio 0. 7 is a Scala API for Apache Beam and Google Cloud Dataflow, designed to simplify large-scale data processing for Spotify engineers.

The article discusses the Bigtable Autoscaler developed by Spotify to automate cluster rightsizing in Google Cloud's Bigtable, aiming to save costs and reduce operational load.

This article delves into Scio, a Scala API for Apache Beam and Google Cloud Dataflow, highlighting its unique features, basic concepts, and practical use cases at Spotify.

This article discusses Spotify's transition to Google Cloud and the development of Scio, a Scala API for Apache Beam, which facilitates big data processing.

This article discusses Spotify's management of its DNS infrastructure, highlighting the challenges and solutions they have implemented over time.

This article discusses Spotify's transition to a new event delivery system built on Google Cloud managed services, focusing on the architecture and design choices made to improve reliability and ef...

The article discusses Spotify's use of Cassandra for data-driven configuration, emphasizing the importance of load testing and capacity planning for performance optimization.

The article discusses common Java linking problems, particularly focusing on runtime errors like NoSuchMethodError and NoClassDefFoundError that arise from dependency management issues.

The article discusses an underflow bug encountered in a Java implementation of the round-robin algorithm, where overflow was expected but did not occur.

The article discusses Spotify's transition from a PostgreSQL database to a Cassandra database for user data management.

The article discusses how Spotify scales its real-time data processing pipelines using Apache Storm, focusing on architecture, maintainability, and performance optimization.

The article discusses how Spotify processes vast amounts of user-generated data using Apache Crunch on Hadoop.

The article discusses the challenges of deploying Python software in Debian packages at Spotify and introduces dh-virtualenv as a solution that combines the advantages of Debian packaging with Pyth...

Sparkey is a new open-source key-value store developed by Spotify, designed for fast random access lookups of mostly static data.

The article discusses Snakebite, a pure Python client for HDFS developed by Spotify to improve interaction speed with Hadoop's HDFS.

The article discusses how Spotify utilizes Python primarily for backend services and data analysis, highlighting its integration into various systems and the benefits it brings in terms of developm...

The article discusses Spotify's reliance on mature technologies for its backend architecture, emphasizing the benefits of using proven tools like PostgreSQL and DNS for service discovery.