How Pinterest Uses Java

The article reflects on a decade of AI platform development at Pinterest, detailing the evolution from fragmented machine learning stacks to a unified AI platform that supports various models.

The article discusses Pinterest's transition to Moka, a next-generation data processing platform built on AWS Elastic Kubernetes Service (EKS).

This article discusses Pinterest's transition from a Hadoop-based platform to a Kubernetes-based data processing solution named Moka.

This article discusses the redesign of Pinterest's ad serving systems, focusing on achieving zero downtime during the transition.

This article discusses the complete redesign of Pinterest's ad serving system, known as Mohawk, which was rewritten to eliminate technical debt and improve performance, enabling the company to meet...

The article discusses the implementation and operational benefits of the Unified PubSub Client (PSC) at Pinterest, highlighting improvements in developer velocity, stability, and scalability.

This article discusses the integration of Python-based anomaly detection algorithms into Pinterest's Warden platform, originally built in Java.

The article discusses the critical issue of Python dependency confusion at Pinterest, highlighting the security risks associated with software supply chains.

The article outlines the engineering interview process at Pinterest, emphasizing a positive candidate experience and the importance of showcasing real-world problem-solving skills.

The article discusses the development and implementation of DrSquirrel, a self-service diagnosis tool at Pinterest aimed at enhancing the troubleshooting process for Apache Flink jobs.

The article discusses the development of Ixia, a scalable near-real-time secondary indexing solution built on HBase at Pinterest.

Pinterest utilizes Flink as its stream processing engine to build a reliable and scalable platform called Xenon.

The article discusses how Pinterest improved data processing efficiency by implementing partial deserialization of Thrift encoded data.

The article discusses enhancements made to Kafka MirrorMaker, specifically the development of Shallow Mirror, which aims to reduce CPU and memory pressure during data replication across Kafka clust...

The article discusses how Pinterest employs machine learning to combat misinformation, hate speech, and self-harm content on its platform.

The article discusses the upgrade of Pinterest's operational metrics system, detailing the transition from the deprecated Ostrich library to an in-house solution called Pinterest StatsCollector.

The article discusses Pinterest's implementation of Presto, an open-source distributed SQL query engine, detailing the challenges faced and solutions developed to manage large-scale data analysis.

The article discusses the open-sourcing of Singer, Pinterest's logging agent designed for efficient and reliable data collection from numerous hosts.

The article discusses the interview process at Pinterest, emphasizing a positive candidate experience that reflects the company's values and culture.

The article discusses the evolution of Pinterest's backend architecture from a static content serving model to a dynamic and responsive system.

The article discusses the technological framework that supports Pinterest's growth, detailing the company's mission to help users discover and do things they love.

The article discusses the challenges Pinterest faced with their Apache Thrift schemas, which had become tightly coupled and complex, leading to inefficiencies in development cycles.

The article discusses the implementation of automated cluster management and recovery for Rocksplicator at Pinterest, highlighting the transition from manual management to using Apache Helix.

This article discusses the implementation of a feature that allows users to reorder Pins on Pinterest boards, addressing the technical challenges involved in scaling the backend service.

The article discusses how Pinterest utilizes the Kafka Streams API to create a predictive budgeting system that minimizes ad overdelivery.

The article discusses the development and implementation of the Linchpin Domain-Specific Language (DSL) at Pinterest, which streamlines the process of building and deploying machine learning models...

The article discusses the advantages of using Kotlin over Java, emphasizing how Kotlin simplifies code and enhances safety, particularly in terms of properties and nullability.

The article discusses Manas, a high-performing customized search system developed by Pinterest to handle billions of queries and improve search relevance among over 100 billion Pins.

The article discusses the challenges and considerations of adopting Kotlin for Android development, highlighting potential pitfalls such as the learning curve, build times, development stability, s...

The article 'Kotlin for grumpy Java developers' provides a guide for Java developers transitioning to Kotlin, highlighting key language features and practical coding tips.

Soundwave is an open-source configuration management database (CMDB) developed by Pinterest to manage and track AWS EC2 instances and their metadata.

The article discusses how Pinterest revamped its legacy experiment pipeline using Spark to improve computational speed, scalability, and performance.

The article discusses enhancements made to Pinterest's security measures, specifically the introduction of email notifications for new logins and the ability for users to view and revoke active ses...

The article discusses Pinterest's implementation of distributed tracing using their open-source tool, Pintrace, which tracks requests across microservices in their backend.

The article discusses strategies for handling large data sets at scale, particularly focusing on the challenges faced by Pinterest in managing search queries.

The article discusses the development of Pinterest's A/B testing platform, highlighting the need for a reliable and user-friendly system to manage a large volume of experiments.

The article introduces new open-source tools for the Elixir community, highlighting the advantages of Elixir and Erlang in handling concurrency and errors.

The article discusses the open-sourcing of PinLater, an asynchronous job execution system developed by Pinterest.

The article discusses the open-sourcing of Terrapin, a serving system designed to handle large data sets generated by Hadoop jobs.

The article discusses the importance of using mature technologies like MySQL over newer, unproven options in startup environments.

The article discusses how Pinterest engineers addressed the challenge of serving configuration data at scale with high availability.

The article discusses the development of a scalable and highly available home feed service at Pinterest, emphasizing the importance of user experience and system reliability.

This article discusses effective strategies for password storage to enhance security against hacking attempts.