Caching Programming Tutorials & Engineering Articles

The 2026-07-28 Model Context Protocol (MCP) specification replaces legacy stateful constraints with a fully stateless core, enabling cloud-native horizontal scaling, serverless deployments, and standard round-robin load balancing. This architectural shift introduces standardized HTTP headers for efficient routing without deep packet inspection, caching controls, and Multi Round-Trip Requests (MRTR) to handle interactive and long-running tasks without blocking connections. Developers can immediately begin migrating their agentic applications to this highly scalable infrastructure using the newly available beta SDKs for Python, TypeScript, Go, and C#.

How the GitHub Issues team used client-side caching, smart prefetching, and service workers to make navigation feel instant.

By Brian Yu and Ashwin Nathan, Members of the Technical Staff

The article discusses how PeerDB facilitates large-scale PostgreSQL migrations, specifically achieving a 1TB migration in just 2 hours.

The article discusses the collaboration between NVIDIA and Black Forest Labs to optimize the FLUX. 2 text-to-image model for NVIDIA Blackwell Data Center GPUs.

OpenAI details how they scaled PostgreSQL to support 800 million ChatGPT users, achieving millions of queries per second through a single-primary architecture with nearly 50 read replicas across mu...

Slack's build pipeline team reduced build times for Quip and Slack Canvas from 60 minutes to as little as 10 minutes by applying classic software engineering principles—separation of concerns, cach...

Netflix redesigned Maestro's internal workflow engine, replacing the legacy Conductor 2. x-based stateless worker model with a custom stateful actor model built on Java 21 virtual threads.

This article discusses how Netflix built a resilient data platform using a Write-Ahead Log (WAL) to address data consistency, reliability, and operational efficiency challenges at scale.

The article discusses Pinterest's journey in enhancing developer experience through the creation of PinConsole, an Internal Developer Platform built on Backstage.

The article discusses the evolution of Netflix's Tudum architecture, transitioning from a CQRS model utilizing Kafka to a more efficient system based on RAW Hollow.

The article discusses the transition of ClickHouse Cloud to a fully stateless compute architecture, enabled by the introduction of a Shared Catalog.

This article discusses the development of a distributed cache for ClickHouse Cloud, aimed at providing low-latency access to hot data across compute nodes.

The article discusses the introduction of implicit caching support in Gemini 2. 5 models, enabling developers to benefit from significant cost savings without needing to create an explicit cache.

The article discusses the importance of structuring application prompts to enhance the security of key-value (KV) caching in large language model (LLM) applications.

The article discusses Mobile Bridge, a framework developed by Shopify to enhance WebViews in their mobile app, making them feel more native.

The article discusses the requirements and best practices for deploying AI in production within the insurance underwriting sector.

The article introduces new KV cache reuse optimizations in NVIDIA TensorRT-LLM, focusing on improving memory management and throughput for large language models (LLMs).

The article discusses the implementation of data-efficient knowledge distillation using NVIDIA NeMo-Aligner during supervised fine-tuning (SFT).

The article discusses how NVIDIA TensorRT-LLM enhances the inference throughput of Meta's Llama 3. 3 70B model by up to 3x through optimizations like speculative decoding and KV caching.

ClickHouse version 24.

Netflix's TimeSeries Data Abstraction Layer is designed to efficiently store and query vast amounts of temporal event data with low latency.

The article discusses the Structured DataStore (SDS), a unified multi-model data management platform developed by Pinterest.

The article discusses Preon, a microservice developed by Uber for intelligent and efficient query analysis using the Presto SQL engine.

The article discusses Pinterest's implementation of feature caching in their recommender systems using Cachelib, an in-process caching engine developed by Meta Open Source.

The article introduces Contextual Retrieval, a method that enhances Retrieval-Augmented Generation (RAG) by improving the retrieval step through Contextual Embeddings and Contextual BM25.

The article discusses how Meta has optimized the deployment of its AI-generated image animation feature to serve billions of users efficiently.

This article discusses Uber's migration of its Apache Hadoop-based data lake to Google Cloud Storage (GCS) and the security measures implemented during this transition.

The article discusses Pinterest's adoption of TiDB as a replacement for HBase, detailing the motivations, selection methodology, and the journey of integrating TiDB into their infrastructure.

The article announces the General Availability of AI Gateway, a unified interface for managing and scaling generative AI workloads.

The article discusses Pinterest's transition from HBase, its first NoSQL datastore, to a new serving architecture with a unified storage service.

The article recaps the Google I/O 2024 event, highlighting advancements in AI technologies aimed at making AI accessible for developers.

Notion has significantly improved the launch speed of its Android app, making it more than twice as fast compared to the beginning of 2023.

The article delves into Uber's comprehensive accounting data testing strategies, emphasizing the importance of precision and integrity in financial processes.

The article discusses how Uber serves over 40 million reads per second from its online storage using an integrated caching solution called CacheFront.

Cloudflare celebrated its 13th birthday with a series of announcements aimed at enhancing its services for customers and the broader internet community.

This article discusses how to build a distributed inference cache using NVIDIA Triton and Redis, highlighting the benefits and drawbacks of local versus distributed caching.

The article discusses the concept of 'prompt design' and draws parallels between prompting in AI and web design.

The article discusses Pacer, Pinterest's new asynchronous computing platform designed to address the limitations of its predecessor, Pinlater.

This article discusses Uber's implementation of a local caching solution for HDFS DataNodes to optimize performance while adopting high-density HDDs.