How LinkedIn Built the Engineering Infrastructure to Ignite Professional Knowledge Sharing

Shweta Patira
6 min readbeginner
--
View Original

Overview

The article discusses how LinkedIn developed its engineering infrastructure to facilitate professional knowledge sharing through Collaborative Articles, leveraging Generative AI to connect experts with users seeking advice. It highlights the challenges faced, the systems built, and the success achieved in fostering a community of knowledge exchange among its members.

What You'll Learn

1

How to build an AI-driven knowledge sharing platform

2

Why prompt engineering is crucial for Generative AI applications

3

When to use collaborative articles for professional advice

Prerequisites & Requirements

  • Understanding of Generative AI concepts(optional)
  • Experience in software engineering and AI tooling

Key Questions Answered

How did LinkedIn launch Collaborative Articles?
LinkedIn launched Collaborative Articles by generating real-life questions and pairing them with AI-generated starter articles. They matched experts to provide meaningful answers, creating a platform where professionals could share advice on work-related challenges.
What challenges did LinkedIn face while building its AI product?
LinkedIn faced challenges such as generating a wide array of questions, matching experts to answers, and delivering content to relevant members. They had to build much of the necessary Generative AI tooling from scratch during a rapid development phase.
What systems did LinkedIn implement for Collaborative Articles?
LinkedIn implemented various systems, including prompt engineering for AI, an article viewing experience, and a contribution system to facilitate expert identification and matching, all aimed at enhancing user engagement and knowledge sharing.
How does LinkedIn ensure trust in Collaborative Articles?
LinkedIn employs trust classifiers to identify and filter out harmful content while allowing diverse viewpoints. They also have mechanisms for users to report problematic content, ensuring a safe environment for knowledge sharing.

Key Statistics & Figures

Expert contributions
1 million
This milestone was reached just over six months after the launch of Collaborative Articles.
Increase in articles read
74%
This surge occurred in the past month, indicating growing interest in expert answers.

Technologies & Tools

AI/ML
Generative AI
Used to generate starter articles and facilitate knowledge sharing.

Key Actionable Insights

1
Leverage AI to generate content ideas and starter articles for professional topics.
Using AI can streamline the content creation process, allowing for a broader range of topics and expert contributions, ultimately enhancing user engagement.
2
Implement a robust system for expert identification and matching based on both explicit and implicit signals.
This approach ensures that the most relevant experts are connected with users seeking advice, improving the quality of interactions and knowledge sharing.
3
Establish clear guidelines for content moderation to maintain trust within the community.
By actively managing content quality and safety, platforms can foster a more inclusive and supportive environment for knowledge exchange.

Common Pitfalls

1
Failing to accurately identify and match experts can lead to irrelevant content being shared.
This often happens when the signals used for identification are not comprehensive or precise enough, which can diminish the quality of the knowledge-sharing experience.

Related Concepts

Generative AI Applications
Knowledge Sharing Platforms
Expert Identification Systems