How Pinterest Uses MySQL

The article discusses Pinterest's transition to a next-generation database ingestion framework designed to address the limitations of legacy systems.

The article discusses Change Data Capture (CDC) at Pinterest, detailing its importance for real-time data processing and the implementation of a Generic CDC solution using Debezium.

The article discusses Pinterest's migration from Druid to StarRocks for delivering faster analytics.

The article discusses Pinterest's adoption of TiDB as a replacement for HBase, detailing the motivations, selection methodology, and the journey of integrating TiDB into their infrastructure.

The article discusses the integration of Ray infrastructure at Pinterest, detailing the journey, challenges, and solutions implemented to optimize machine learning workflows.

The article discusses Pinterest's transition from HBase, its first NoSQL datastore, to a new serving architecture with a unified storage service.

The article discusses Pacer, Pinterest's new asynchronous computing platform designed to address the limitations of its predecessor, Pinlater.

The article discusses how Pinterest leverages machine learning to foster a healthy comment ecosystem on its platform.

The article discusses Pinterest's annual holiday load testing for its Druid system, focusing on ensuring the platform can handle increased traffic and data ingestion during peak holiday periods.

This article discusses Pinterest's transition to using Druid as its next-generation analytics data store, detailing the architecture and optimization strategies for host types.

The article discusses how Pinterest utilizes machine learning to maintain a positive comment ecosystem amidst a growing creator community.

This article discusses Pinterest's transition to using Druid as their analytical data store, detailing the challenges faced with HBase, the architecture of their Druid implementation, and insights ...

Pinterest has open sourced Querybook, a collaborative big data hub designed to improve data access and analysis for teams, especially in a remote working environment.

The article discusses Guardian, a real-time analytics and rules engine developed by Pinterest's Trust & Safety team to combat spam.

The article discusses the challenges of data inconsistencies at Pinterest due to its rapid growth and asynchronous data processing.

The article discusses the improvements made to Pinlater, an asynchronous job execution system, particularly focusing on the transition from Redis to MySQL/InnoDB as the backend data store.

The article discusses Pinterest's transition from using Apache HBase to Apache Druid for ads analytics, highlighting the challenges faced and the benefits of Druid's capabilities in handling comple...

The article discusses how Pinterest implemented a bulk write platform using Kafka to manage high query per second (QPS) on MySQL shards, improving the performance of write APIs for internal service...

The article discusses the importance of upgrading outbound Pin links from HTTP to HTTPS to enhance user security on Pinterest.

The article discusses the development and implementation of Expanded Targeting for Pinterest ads, a feature designed to enhance ad performance by automatically connecting Promoted Pins to relevant ...

The article discusses Pinterest's implementation of a near real-time experimentation platform using Apache Flink to analyze thousands of experiments daily.

This article discusses the importance of annotations in Pinterest's visual discovery engine, focusing on how these keywords help in understanding text associated with Pins.

This article discusses the implementation of a feature that allows users to reorder Pins on Pinterest boards, addressing the technical challenges involved in scaling the backend service.

The article discusses the development of the Experience Framework at Pinterest, aimed at enhancing user experience for over 175 million monthly active users by managing various in-product experienc...

This article discusses advancements in MySQL compression techniques at Pinterest, specifically focusing on improving the compression ratio of Pin data stored as JSON blobs.

The article discusses the open-sourcing of Rocksplicator, a real-time data replication library for RocksDB, developed by Pinterest to address the challenges of real-time data replication and cluste...

The article discusses the evolution of MySQL compression techniques at Pinterest, particularly focusing on the challenges faced with InnoDB page compression and the development of a new column comp...

This article discusses the implementation details of Tracker, a system designed for ingesting MySQL data at scale, focusing on the improvements made to the data upload process to S3.

The article discusses Pinterest's approach to ingesting large volumes of MySQL data at scale through a system called Tracker.

The article discusses the implementation of a real-time metrics dashboard for monitoring A/B experiments at Pinterest.

The article discusses PinQueue, a generic content review system developed by Pinterest to enhance manual moderation processes alongside machine learning.

The article discusses the implementation of security measures in Pinterest's in-house deployment service system, Teletraan.

The article discusses the open-sourcing of PinLater, an asynchronous job execution system developed by Pinterest.

Pinterest has announced the open-sourcing of its MySQL management tools, detailing the automation processes that maintain its MySQL infrastructure.

Skyline is an ETL-as-a-Service platform developed by Pinterest to streamline data processing and reporting for its users.

This article details Pinterest's approach to scaling its MySQL database through sharding, which was implemented in early 2012 and remains in use today.

This article discusses MySQL performance optimization techniques implemented at Pinterest, achieving a significant increase in throughput and a reduction in latency variance.

The article discusses Teletraan, Pinterest's internal deploy system designed to streamline and enhance the deployment process for developers.

The article discusses the importance of using mature technologies like MySQL over newer, unproven options in startup environments.

The article discusses the development of Pinalytics, Pinterest's customizable big data analytics platform designed to enhance data accessibility and analysis for employees.

The article discusses the design and implementation of a new statistics collection engine for Hadoop jobs at Pinterest, aimed at improving data management and analysis.

The article discusses Pinterest's scalable A/B experimentation framework, detailing the architecture and technologies used to manage and analyze hundreds of experiments simultaneously.

The article discusses how Pinterest manages its big data infrastructure, detailing the evolution from a single cluster Hadoop setup to a self-serving platform that supports extensive data processin...