How Shopify Uses Apache Kafka

This article presents three additional tips for optimizing Apache Flink applications, focusing on enhancing performance through proper parallelism, avoiding sink bottlenecks, and utilizing HybridSo...

The article discusses the implementation of Server Sent Events (SSE) to enhance real-time data streaming for Shopify's BFCM Live Map.

The article discusses how a team at Shopify discovered a query in BigQuery that could potentially cost them nearly $1 million per month and outlines the steps they took to reduce this cost signific...

The article discusses Shopify's innovative compensation system, Flex Comp, which allows employees to customize their total rewards.

This article discusses how Shopify scaled its Server Pixels service to enhance event processing performance by 170% using Go worker pools.

The article discusses the development of a real-time buyer signal data pipeline for Shopify Inbox, aimed at enhancing merchants' ability to identify and convert customer conversations into sales.

The article discusses Shopify's evolution from a traditional data warehouse to a more dynamic data platform using Change Data Capture (CDC) and event streaming technologies.

The article discusses the evolution of Kit, a virtual marketing assistant for Shopify business owners, transitioning from a heuristic rules-based system to a machine learning-driven recommendation ...

This article discusses five common data stores—Relational Database, Non-Relational (NoSQL) Database, Key-Value Store, Full-Text Search Engine, and Message Queue—highlighting their characteristics a...

The article discusses Shopify's journey of running Apache Kafka on Kubernetes, detailing the transition from data centers to cloud infrastructure and the benefits of using Kubernetes for managing K...