A New Ranking Framework for Better Notification Quality on Instagram

We’re sharing how Meta is applying machine learning (ML) and diversity algorithms to improve notification quality and user experience.  We’ve introduced a diversity-aware notification ranking frame…

Xian Sun
6 min readintermediate
--
View Original

Overview

Meta has introduced a diversity-aware notification ranking framework for Instagram that leverages machine learning (ML) to enhance notification quality and user engagement. This framework aims to reduce uniformity in notifications, thereby improving user experience and driving higher engagement rates.

What You'll Learn

1

How to apply diversity algorithms to improve notification systems

2

Why balancing personalization and diversity is crucial for user engagement

3

When to implement adaptive demotion strategies in notification systems

Key Questions Answered

How does Instagram's new ranking framework improve notification quality?
Instagram's new ranking framework improves notification quality by introducing a diversity-aware layer that balances user engagement with content diversity. It applies multiplicative penalties to reduce the similarity of notifications, ensuring users receive a varied mix of content, which enhances their overall experience and engagement.
What are the risks of notifications without diversity?
Without diversity in notifications, users may experience overexposure to the same authors or product types, leading to a repetitive and less engaging experience. This can result in users feeling overwhelmed or bored, ultimately increasing the likelihood of them disabling notifications altogether.
What metrics are used to optimize notification engagement?
The ML models used for optimizing notification engagement focus on metrics such as click-through rate (CTR) and time spent on content. These metrics help determine which notifications to send and when, aiming to maximize user interaction and satisfaction.
How does the mathematical formulation of the diversity layer work?
The mathematical formulation of the diversity layer involves applying a multiplicative demotion factor to each notification candidate's base relevance score. This score is adjusted based on the similarity of the candidate to previously sent notifications, promoting diversity while maintaining relevance.

Key Statistics & Figures

Reduction in daily notification volume
Significantly reduced
This reduction was achieved while improving click-through rates (CTR

Technologies & Tools

Backend
Machine Learning
Used to optimize notification delivery based on user engagement metrics.

Key Actionable Insights

1
Implement a diversity-aware ranking system to enhance user engagement in notifications.
By reducing the uniformity of notifications, you can create a more engaging experience for users, encouraging them to interact more with the content shared on your platform.
2
Utilize machine learning models to optimize notification timing and content.
Leveraging ML can help determine the best times to send notifications and what content to include, ultimately improving user interaction rates.
3
Incorporate adaptive demotion strategies based on user behavior.
Dynamic adjustments to notification strategies can help mitigate user fatigue from repetitive notifications, ensuring a more balanced and satisfying experience.

Common Pitfalls

1
Overprioritizing past engagement can lead to repetitive notifications.
This happens when the system focuses too heavily on users' previous interactions, causing them to miss out on diverse content that could enhance their experience.