Building for Inclusivity: The Technical Blueprint of Pinterest’s Multidimensional Diversification

Pinterest Engineering
7 min readintermediate
--
View Original

Overview

The article discusses Pinterest's commitment to inclusivity through its technical advancements in machine learning, particularly focusing on body type representation alongside existing skin tone signals. It outlines the processes involved in developing these signals, the implementation of diversification in search results, and the positive impacts on user engagement.

What You'll Learn

1

How to develop a visual body type signal for machine learning applications

2

Why diversification in search results enhances user engagement

3

How to leverage Determinantal Point Process for ranking diversity

Prerequisites & Requirements

  • Understanding of machine learning concepts and algorithms
  • Experience with data collection and model training(optional)

Key Questions Answered

How does Pinterest ensure algorithmic fairness in its recommendations?
Pinterest ensures algorithmic fairness by integrating inclusive design principles and developing signals for skin tone and body type representation. This approach helps to surface diverse content and improve the overall user experience by making recommendations more representative of various demographics.
What improvements were observed after implementing body type diversification?
After implementing body type diversification, Pinterest observed a 454% improvement in the representation of all body types in search results and a 772% increase in body types represented in closeup recommendations. These changes also led to statistically significant improvements in user engagement metrics.
What role do external partnerships play in Pinterest's inclusivity efforts?
External partnerships, such as with the National Association to Advance Fat Acceptance, are crucial for understanding size representation nuances. These collaborations help Pinterest develop a more human-centric approach to building its body type signal and ensure that diverse perspectives are included in the design process.
How does the Determinantal Point Process algorithm work in Pinterest's system?
The Determinantal Point Process (DPP) algorithm is used to balance utility scores from ranking models with similarity scores for diversification. It allows Pinterest to optimize search results by considering multiple diversity dimensions, enhancing the representation of various body types and skin tones in recommendations.

Key Statistics & Figures

Improvement in body type representation in search results
454%
Observed after implementing body type diversification in women's fashion and wedding related searches.
Increase in body types represented in closeup recommendations
772%
Noted during the rollout of body type diversification for women's fashion and wedding interests.

Technologies & Tools

Algorithm
Determininantal Point Process
Used for diversifying search results and recommendations by balancing utility and similarity scores.
Machine Learning Model
Unified Visual Embedding
Serves as the basis for training the body type signal model.

Key Actionable Insights

1
Integrate diverse representation signals into your machine learning models to enhance inclusivity.
By ensuring that your models account for various demographics, you can improve user engagement and satisfaction, as seen with Pinterest's implementation of body type and skin tone signals.
2
Utilize external partnerships to gain insights into underrepresented communities.
Collaborating with organizations that focus on diversity can provide valuable perspectives that inform your product design and development, leading to more inclusive outcomes.
3
Implement iterative feedback loops with experts during model training.
Regular feedback from both internal and external experts can help refine your models, ensuring they remain accurate and fair over time.

Common Pitfalls

1
Neglecting to consider diverse user demographics in algorithm design can lead to biased recommendations.
Without inclusive signals, algorithms may reinforce existing biases, alienating users from underrepresented groups and reducing overall engagement.

Related Concepts

Machine Learning
Algorithmic Fairness
Inclusive Design
Diversity In AI