The technology behind fighting harassment on LinkedIn

Grace Tang
6 min readintermediate
--
View Original

Overview

The article discusses LinkedIn's approach to combating harassment on its platform, focusing on the use of technology and human expertise to create a safer environment for its users. It highlights the proactive and reactive measures taken to address harassment, particularly in private messaging, and outlines the machine learning models developed to detect and mitigate such behavior.

What You'll Learn

1

How to implement machine learning models for detecting harassment in messaging

2

Why reporting harassment is crucial for community safety on LinkedIn

3

When to apply proactive measures against harassment on social platforms

Key Questions Answered

What strategies does LinkedIn use to combat harassment in messaging?
LinkedIn employs a combination of education on community policies, machine learning models to detect harassment, and support for affected members. These strategies aim to minimize harassment and ensure a safe environment for users, particularly in private messaging.
How does LinkedIn detect inappropriate advances through machine learning?
LinkedIn's detection system consists of three models: a behavior model that scores sender behavior, a message model that analyzes the content of messages, and an interaction model that evaluates the dynamics between users. This sequential approach helps identify harassment with high precision.
What types of harassment are identified by LinkedIn's models?
The models categorize harassment into three types: romance scams, inappropriate advances, and targeted harassment. Each type is addressed with specific detection strategies to enhance user safety and platform integrity.
Why is harassment reporting underreported on LinkedIn?
Many members feel targeted and choose to block offenders instead of reporting them, often due to fear of retribution. This underreporting complicates the platform's ability to address harassment effectively.

Technologies & Tools

Backend
Machine Learning
Used to detect potential harassment in messaging through various models.

Key Actionable Insights

1
Encourage users to report harassment rather than blocking offenders to improve detection rates.
By reporting incidents, LinkedIn can gather data to enhance their machine learning models and create a safer environment for all users.
2
Implement educational initiatives about community policies to empower users against harassment.
Educating users on what constitutes harassment and how to report it can foster a more supportive community and increase engagement in reporting.
3
Utilize machine learning models to proactively identify and mitigate harassment in messaging.
By applying advanced detection techniques, LinkedIn can minimize the impact of harassment before it escalates, ensuring user safety.

Common Pitfalls

1
Underreporting of harassment incidents by users can hinder the effectiveness of detection systems.
This occurs because users may fear retribution or feel that reporting will not lead to action. Encouraging a culture of reporting can help mitigate this issue.