gRPC Programming Tutorials & Engineering Articles

Real-time AI agents break traditional request-response load balancing paradigms because they rely on long-lived, stateful bidirectional streams that obscure true server capacity. To solve this, developers must implement application-level session tracking directly within the runtime to accurately measure the committed concurrent workload of active conversations. By feeding these precise session counts alongside standard CPU utilization metrics into a hybrid routing algorithm, infrastructure can effectively distribute stateful AI traffic and prevent individual backend bottlenecks.

A walkthrough of adding OpenTelemetry instrumentation to two ASP.NET services — an Order API and a Payment Service — and shipping traces, logs, and metrics to ClickStack, with auto-correlated signals and cross-service trace waterfalls out of the box.

The path from a trained AI model to production should be smooth, but rarely is. Many teams invest weeks fine-tuning models, only to discover that exporting to a…

Google Cloud has introduced a high-performance integration that connects Rapid Storage directly to PyTorch via the fsspec interface to eliminate AI training bottlenecks. By utilizing Google’s Colossus architecture and bidirectional gRPC streaming, the solution offers up to 15 TiB/s aggregate throughput and significant reductions in latency. These improvements allow developers to speed up total training time by 23% with zero code changes required beyond updating the storage bucket type.

By Brian Yu and Ashwin Nathan, Members of the Technical Staff

In this post we’ll dive into how we built a virtual cashless payment method that works for prepaid and Stripe-issued credits, and cleanly integrates with our accounting, compliance, and other frameworks.

SimGym infrastructure for synthetic customers at scale. A Shopify + NVIDIA collaboration.

The article discusses Spotify's multi-agent architecture designed to enhance advertising workflows by addressing structural issues within their ad business.

The article discusses the ecdysis library developed by Cloudflare, which enables graceful restarts for Rust services without dropping live connections.

This article introduces uForwarder, Uber's open-source push-based consumer proxy for Apache Kafka's async queuing system.

The article discusses how LinkedIn developed the Contextual Agent Playbooks & Tools (CAPT) to enhance AI coding agents with organizational context, enabling them to better assist engineers in their...

The article discusses NVIDIA's Alpamayo, a comprehensive ecosystem designed for developing reasoning-based autonomous vehicle (AV) systems.

The article discusses how to simulate an accurate radio environment for 5G and 6G systems using the NVIDIA Aerial Omniverse Digital Twin (AODT).

This article discusses how Uber utilizes a pull-based ingestion model in OpenSearch™ to effectively index streaming data.

The article discusses the evolution of AI data centers into AI factories and the necessity for advanced telemetry solutions like NVIDIA Spectrum-X Ethernet to optimize AI workloads.

The article discusses the transformation of AI-native 6G network design through the NVIDIA Aerial Omniverse Digital Twin, emphasizing the need for a dynamic, continuous integration approach to Radi...

The article discusses how LinkedIn enhanced its recommendation systems using SGLang, an open-source LLM serving framework.

The article discusses the role of the distributed User Plane Function (dUPF) in the evolution of telecommunications towards 6G, emphasizing its importance for enabling ultra-low latency and high th...

This article discusses how to connect Stripe events to frontend applications using various integration methods, enhancing user experience through real-time updates.

ClickHouse version 25. 8 introduces 45 new features, 47 performance optimizations, and 119 bug fixes, enhancing its capabilities as a high-performance analytical database.

The article explores the potential of Large Language Models (LLMs) to replace Site Reliability Engineers (SREs) in performing root cause analysis (RCA) for production issues.

The article discusses the evolution of Uber's Search Platform, highlighting its transition from Elasticsearch to an in-house solution called Sia, and ultimately to the adoption of OpenSearch.

The article announces the general availability of Gemini Code Assist in Apigee API Management, highlighting its AI-assisted capabilities for API development.

The article discusses Netflix's Unified Data Architecture (UDA), which aims to streamline data modeling across its various platforms by allowing teams to define business concepts once and use them ...

Google Cloud has announced the general availability of the Apigee APIM Operator, which enhances API management capabilities within Google Kubernetes Engine (GKE).

The article discusses advancements in Federated Learning (FL) specifically in the context of large language models (LLMs), focusing on the challenges of communication overhead and memory constraint...

The article announces the general availability of the Apigee Extension Processor, a new capability that enhances Apigee's ability to manage and secure backend services and modern application archit...

The article discusses the integration of physical AI and autonomous systems in industrial operations through the use of digital twins.

The article discusses the integration of Flower and NVIDIA FLARE, two significant frameworks in the federated learning ecosystem.

The article discusses NVIDIA DGX Cloud Serverless Inference, an auto-scaling AI inference solution that simplifies the deployment and scaling of AI applications across multi-cloud and on-premises e...

SafetyCulture describes how they streamlined gRPC development for their offline-first mobile apps by automating code generation for their C++ middleware layer called Crux.

This article discusses the open sourcing of kubenetmon, a tool developed by ClickHouse to monitor data transfer in ClickHouse Cloud.

This article details SafetyCulture's comprehensive approach to secure string input validation in microservices, covering the four essential steps: decode, normalize/canonicalize, sanitize, and vali...

The article discusses LinkedIn's implementation of a Stateful Workload Operator for managing stateful systems on Kubernetes.

The article discusses the introduction of AI-RAN technology by NVIDIA, which aims to revolutionize telecom infrastructure by integrating AI capabilities into Radio Access Networks (RAN).

The article discusses the release of new Unreal Engine 5 on-device plugins for NVIDIA ACE, aimed at simplifying and scaling AI-powered MetaHuman character deployment on Windows PCs.