How Shopify Uses MySQL

This article discusses the issue of deadlocks in MySQL during high concurrency environments and presents a solution using composite primary keys to mitigate these deadlocks.

This article discusses the horizontal scaling of the Rails backend for the Shop app using Vitess, a database system abstraction over MySQL.

The article discusses Shopify's transition to using Remix as the recommended framework for building Admin apps, emphasizing the importance of web standards and developer experience.

The article discusses the concept of monkey patching in Ruby, highlighting its dangers and advocating for its limited use.

The article discusses the implementation of Server Sent Events (SSE) to enhance real-time data streaming for Shopify's BFCM Live Map.

This article discusses the safe addition of NOT NULL columns to database tables, focusing on the use of the Large Hadron Migrator (LHM) gem for schema changes in MySQL databases.

The article discusses Shopify's Isospin tooling, which is built on top of systemd to manage applications within their cloud development platform, Spin.

Shopify's journey to cloud development involved transitioning from a local development tool called 'dev' to a more scalable and flexible cloud-native solution named Isospin.

The article discusses the experiences and lessons learned from running Apache Airflow at scale within Shopify.

The article discusses Maestro, a domain-specific orchestration language developed by Shopify to enhance the functionality of Shopify Flow.

The article highlights ten of Shopify's favorite engineering posts from 2021, showcasing a variety of technologies and disciplines.

The article discusses the development of a real-time buyer signal data pipeline for Shopify Inbox, aimed at enhancing merchants' ability to identify and convert customer conversations into sales.

This article discusses the recent MySQL upgrade at Shopify, detailing the motivations behind the upgrade, the challenges faced during the process, and the internal tools developed to streamline fut...

This article provides ten essential tips for building resilient payment systems, drawing from the author's extensive experience at Shopify.

The article discusses Shopify's engineering strategies and technological advancements for 2022, focusing on modular code architecture, cloud development environments, and enhanced load testing prac...

The article discusses the challenges faced by Shopify's KateSQL, a Database-as-a-Service platform, in managing MySQL instances on Kubernetes, particularly focusing on a performance issue caused by ...

The article discusses Shopify's approach to shard balancing within its MySQL database infrastructure, emphasizing the importance of maintaining balanced database utilization to prevent failures and...

The article discusses the importance of high availability in applications, particularly during peak traffic periods, and how offloading work into background jobs can enhance performance and user ex...

The article discusses the implementation and management of dynamic ProxySQL query rules at Shopify, focusing on their importance for database resiliency and performance.

The article discusses how Shopify improved its storefront traffic routing by utilizing dynamic rules and a Lua-based verification system.

This article provides a comprehensive guide on building a web application using Ruby, both with and without Rails libraries.

The article discusses Shopify's evolution from a traditional data warehouse to a more dynamic data platform using Change Data Capture (CDC) and event streaming technologies.

The article discusses how Shopify's Test Infrastructure team significantly improved the speed of their Continuous Integration (CI) system, reducing the 95th percentile build time from 45 minutes to...

The article discusses the challenges and solutions related to read consistency when using database replicas at Shopify.

The article discusses the importance of resiliency planning for high-traffic events, particularly focusing on strategies employed by Shopify to prepare for peak traffic periods like Black Friday Cy...

This article discusses the optimization of Shopify's server-side storefront rendering engine, focusing on techniques such as simplifying data access, implementing caching layers, and reducing memor...

This article discusses how Shopify's Data Platform Engineering team scaled their data platform to handle the unprecedented data volume during Black Friday and Cyber Monday (BFCM).

The article discusses Shopify's capacity planning strategies for handling increased traffic during the Black Friday and Cyber Monday (BFCM) shopping period.

The article discusses Shopify's approach to performance testing, emphasizing the importance of ensuring stability and speed during high-traffic sales events like Black Friday Cyber Monday (BFCM).

The article discusses how Shopify improved database efficiency by introducing composite primary keys in their Rails application.

The article discusses how to track historical state using Type 2 dimensional models in application databases, contrasting it with the traditional Type 1 dimension approach.

The article discusses the importance of properly configuring circuit breakers to enhance application resilience against service failures.

This article discusses five common data stores—Relational Database, Non-Relational (NoSQL) Database, Key-Value Store, Full-Text Search Engine, and Message Queue—highlighting their characteristics a...

This article discusses strategies for writing fast code in Ruby on Rails, focusing on performance optimization techniques in Active Record, Rails, and Ruby.

This article discusses how Shopify manages MySQL backups and restores at a petabyte scale using Google Cloud Platform's Persistent Disk snapshots.

This article details how an intern at Shopify successfully freed up 3 terabytes of storage in preparation for Black Friday Cyber Monday (BFCM) by implementing a background job to delete unnecessary...

The article discusses Shopify's efforts to enhance its platform for internationalization and localization, addressing challenges such as hardcoded strings and the need for a robust translation proc...

The article provides an in-depth look at Shopify's tech stack and engineering practices, detailing how the platform scales to support over 600,000 merchants and 80,000 requests per second.

The article discusses how Shopify tackled the challenges of handling high-write traffic during flash sales using scriptable load balancers.