Thrift Programming Tutorials & Engineering Articles

This article discusses the re-architecture of the serving stack for next-generation ads lightweight ranking models at Pinterest, moving from a traditional Two-Tower architecture to a more complex G...

The article introduces Zoomer, Meta's automated debugging and optimization platform designed to enhance AI performance across its extensive infrastructure.

The article reflects on a decade of AI platform development at Pinterest, detailing the evolution from fragmented machine learning stacks to a unified AI platform that supports various models.

This article details how Uber standardized its mobile analytics system to improve data consistency and quality across its applications.

The article discusses Airbnb's migration of its JVM monorepo from Gradle to Bazel, detailing the motivations, process, and outcomes of this significant transition.

The article discusses the implementation of Impulse, an internal load-testing-as-a-service framework at Airbnb, designed to enhance system reliability and performance through comprehensive load tes...

The article discusses how Meta manages and understands large-scale data ecosystems through innovative solutions and substantial investments in data understanding technologies.

Pinterest successfully migrated 3. 7 million lines of code from Flow to TypeScript over eight months, enhancing type safety and developer experience.

The article discusses Glean, Meta's open-source code indexing system designed to efficiently collect and manage information about source code.

The article discusses the Structured DataStore (SDS), a unified multi-model data management platform developed by Pinterest.

The article discusses Pinterest's implementation of feature caching in their recommender systems using Cachelib, an in-process caching engine developed by Meta Open Source.

This article discusses the redesign of Pinterest's ad serving systems, focusing on achieving zero downtime during the transition.

The article discusses Pinterest's adoption of TiDB as a replacement for HBase, detailing the motivations, selection methodology, and the journey of integrating TiDB into their infrastructure.

This article discusses the advancements in graph analytics through a next-generation architecture utilizing NVIDIA cuGraph acceleration.

The article introduces Foundations, an open-source Rust service foundation library developed by Cloudflare, designed to simplify the creation of distributed, production-grade systems.

The article discusses the redesign of the Goku-Ingestor at Pinterest, focusing on enhancing performance, reducing costs, and minimizing code complexity.

This article discusses the integration of Python-based anomaly detection algorithms into Pinterest's Warden platform, originally built in Java.

This article discusses how GPU-CPU fusion can dramatically enhance graph analytics performance, achieving speedups of over 100x compared to traditional CPU processing.

This article discusses the debugging process of a direct memory leak encountered in Apache Flink applications at Pinterest.

The article discusses improvements made to the training foundations of Pinterest's Closeup Recommendation Ranker, focusing on data logging, sampling strategies, and an auto-retraining framework.

The article discusses Pacer, Pinterest's new asynchronous computing platform designed to address the limitations of its predecessor, Pinlater.

The Journey Platform is a low-code tool developed by Airbnb that enables users to create interactive user workflows for notifications.

The article discusses the development of a large-scale user signal platform at Pinterest, which enables real-time indexing of user events and construction of user sequences for machine learning app...

The article discusses the Unified Action Platform (uAct) developed by Uber, aimed at consolidating various internal communication systems into a single interface for managing requests and notificat...

Meta has open-sourced the Anonymous Credential Service (ACS), a multitenant service designed for de-identified client authentication, enhancing privacy and security while being compute-conscious.

The article discusses Tulip, a binary serialization protocol developed by Meta to enhance data schematization and support schema evolution.

This article discusses the process of migrating data from HBase to TiDB at Pinterest with zero downtime.

The article discusses Uber's transition from a Server-Sent Events (SSE) architecture to a gRPC-based push platform, detailing the motivations, implementation challenges, and outcomes of this migrat...

Shadower is a minimalistic load testing tool developed by Uber that enables load testing as a service for microservices.

The article discusses the importance of data governance in large organizations like LinkedIn, emphasizing the need for effective schema annotations and automation in managing vast datasets.

The article discusses how Meta implements de-identified authentication at scale through its Anonymous Credential Service (ACS), which enhances user privacy while maintaining secure authentication.

This article is the second part of a series focused on debugging deadlock issues in the PininfoService during an upgrade to Ubuntu 18.

The article introduces Ballast, an adaptive load testing framework developed by Uber to efficiently test microservices under peak loads.

This article discusses the automation of data protection at scale within Airbnb, focusing on the Data Protection Service (DPS) and its role in enhancing security and privacy engineering capabilitie...

This article discusses Pinterest's transition to using Druid as its next-generation analytics data store, detailing the architecture and optimization strategies for host types.

The article discusses Facebook's approach to autonomous testing of back-end services at scale, highlighting the challenges of maintaining a stable infrastructure for over 3 billion users.

This article discusses the architecture and functionality of Airbnb's data classification systems, Inspekt and Angmar, which automate the detection of personal and sensitive data and secrets in the...

This article discusses how Airbnb leverages the Minerva API to provide a consistent and simplified data consumption experience at scale.

The article discusses the development of the YAML Generator application at Uber, designed to streamline the creation of funnel YAML files for mobile data workflows.

The article discusses how data analytics shapes the Uber Rider App, focusing on the collection, processing, and application of rider data to enhance user experience and improve app functionality.

This article discusses Pinterest's transition to using Druid as their analytical data store, detailing the challenges faced with HBase, the architecture of their Druid implementation, and insights ...

The article discusses Uber's Customer Support Automation Platform, focusing on the development and implementation of the Policy Engine (PE) to enhance customer service efficiency.

The article discusses how Pinterest utilizes Apache Spark SQL for interactive querying, detailing the architecture, challenges faced, and solutions implemented to enhance user experience.

The article discusses how Pinterest improved data processing efficiency by implementing partial deserialization of Thrift encoded data.

The article discusses Pinterest's efforts to develop fast and reliable iOS builds by optimizing their build process and adopting Bazel as their primary build tool.

The article discusses the scaling of Uber's API Gateway, focusing on the critical components of configuration management and runtime.

This article discusses the development of a label-based enforcement pipeline at Pinterest aimed at enhancing Trust & Safety.

The article discusses the architecture of Uber's API gateway, detailing its evolution, components, and functionalities.

Facebook has increasingly embraced Rust, a programming language known for its performance and safety, by joining the Rust Foundation and expanding its internal Rust development team.

The article discusses the Facebook Ordered Queueing Service (FOQS), a distributed priority queue designed to enhance asynchronous computing within Facebook's ecosystem.