A Product Story: The Lessons of Backstage and Spotify’s Autonomous Culture

Spotify Engineering
8 min readbeginner
--
View Original

Overview

The article discusses Spotify's development of Backstage, a developer portal that emerged from the need to improve onboarding and productivity amidst rapid growth. It highlights the importance of autonomy in Spotify's culture and how Backstage addresses issues like context switching and discoverability for engineers.

What You'll Learn

1

How to reduce onboarding time for new engineers in a fast-growing company

2

Why a developer-friendly platform like Backstage is essential for productivity

3

How to balance autonomy and centralization in software development

Prerequisites & Requirements

  • Understanding of software development processes and team dynamics

Key Questions Answered

What challenges did Spotify face with onboarding new engineers?
Spotify faced significant onboarding challenges, with new engineers taking over 60 days to merge their tenth pull request. This was attributed to issues like context switching and discoverability, where new hires struggled to find necessary resources and documentation.
How does Backstage improve developer productivity at Spotify?
Backstage enhances developer productivity by centralizing access to over 2,000 backend services and 4,000 data pipelines, allowing engineers to find what they need without constant interruptions. This has resulted in higher satisfaction among internal users, with 80% reporting positive experiences.
Why is autonomy important in Spotify's engineering culture?
Autonomy is crucial in Spotify's engineering culture as it fosters innovation and allows teams to work independently. However, too much autonomy can lead to fragmentation, which Backstage aims to resolve by providing a centralized platform that respects team independence.
What metrics indicate the success of Backstage at Spotify?
The success of Backstage is indicated by its adoption across 280 engineering teams managing over 2,000 services and the contribution of over 200 engineers, with 80% of contributions coming from outside the core team. This shows widespread engagement and utility.

Key Statistics & Figures

Onboarding time for new engineers
over 60 days
This was the time taken for new engineers to merge their tenth pull request, highlighting significant onboarding challenges.
Number of backend services managed by Backstage
over 2,000
This indicates the scale at which Backstage operates within Spotify's engineering teams.
Percentage of internal users satisfied with Backstage
80%
This statistic reflects the positive reception of Backstage among Spotify's engineers and other users.

Technologies & Tools

Developer Portal
Backstage
Used to manage services, improve discoverability, and enhance developer productivity.

Key Actionable Insights

1
Implement a centralized developer portal to streamline access to resources and reduce onboarding time.
As seen with Backstage, centralizing documentation and service access can significantly improve new hire productivity and reduce the time it takes for them to contribute effectively.
2
Conduct regular user research among engineers to identify pain points in the development process.
By treating engineers as users, Spotify was able to pinpoint issues like context switching and discoverability, leading to targeted improvements that enhance overall productivity.
3
Balance autonomy with necessary centralization to avoid fragmentation in software development.
Spotify's experience shows that while autonomy fosters innovation, a lack of coordination can lead to inefficiencies. Finding the right balance is key to maintaining productivity.

Common Pitfalls

1
Failing to provide adequate documentation can lead to increased onboarding times and decreased productivity.
As highlighted in the article, new hires at Spotify struggled due to a lack of documentation, which caused them to rely on others for information. Ensuring comprehensive documentation can mitigate this issue.

Related Concepts

Developer Portals
Autonomous Teams In Software Development
User Research In Engineering Environments