How Shopify Uses Docker

Shopify uses SkyPilot, an open-source framework, to manage GPU-intensive ML training workloads across multiple cloud providers (Nebius and GCP).

Shopify open-sources Tangle, an ML experimentation platform built to solve six common failure modes in machine learning development.

The article discusses Shopify's Merlin machine learning platform, focusing on its online inference capabilities for real-time predictions.

The article discusses the Spin infrastructure team's transition to Container Optimized OS (COS) and the challenges faced with Kubernetes, systemd, and cgroups.

Shopify's journey to cloud development involved transitioning from a local development tool called 'dev' to a more scalable and flexible cloud-native solution named Isospin.

This article presents a curated list of ten tech podcasts recommended by Shopify's engineering team, highlighting their favorite shows that cover a variety of topics relevant to software engineers.

Shopify's new machine learning platform, Merlin, is designed to enhance the efficiency of data scientists by providing a robust infrastructure and tools for machine learning workflows.

The article discusses the use of Terraform for managing infrastructure, particularly in the context of integrating with third-party applications like Twilio TaskRouter.

This article discusses how Shopify addressed the dependency confusion vulnerability affecting over 600 Ruby applications.

The article discusses how Shopify's Test Infrastructure team significantly improved the speed of their Continuous Integration (CI) system, reducing the 95th percentile build time from 45 minutes to...

The article discusses the importance of securing Docker images through code signing and Binary Authorization, particularly in the context of Kubernetes.

The article discusses the software release culture at Shopify, emphasizing the importance of developer autonomy, feedback mechanisms, and an efficient release process.

The article discusses the implementation of test retries in Shopify's Android monorepo to combat flaky tests and improve Continuous Integration (CI) pass rates.

The article provides an in-depth look at Shopify's tech stack and engineering practices, detailing how the platform scales to support over 600,000 merchants and 80,000 requests per second.

The article discusses Shopify's approach to scaling its iOS Continuous Integration (CI) system using Anka, a virtualization technology that allows for efficient macOS environment provisioning.

Shopify is collaborating with Google to enhance its cloud infrastructure, focusing on scalability and performance for its commerce platform.

This article details Shopify's upgrade from Rails 4. 2 to Rails 5.

This article discusses the development of a dynamic mobile Continuous Integration (CI) system at Shopify, highlighting the transition from a static setup to a scalable, efficient architecture.

The article discusses Shopify's transition from a traditional Development and Operations model to a Production Engineering model, aimed at improving operational efficiency and developer autonomy.

The article discusses Shopify's implementation of automatic deployment, which streamlines the deployment process by triggering deployments automatically upon merging code in GitHub.

The article discusses effective strategies for debugging production issues in Rails applications at Shopify, focusing on the use of tools like gdb and rbtrace.

Shipit is an open-source deployment tool developed by Shopify, designed to enhance developer productivity by facilitating fast and easy code deployments.

This article discusses the introduction of EJSON at Shopify, a library designed to securely manage application secrets in a Docker-powered environment.

This article discusses Shopify's transition to a Docker-powered, containerized data center, detailing the creation of containers that support over 100,000 online shops.

The article discusses the implementation of an internal cloud using Docker and CoreOS at Shopify, focusing on the advantages of containerization for scaling and managing applications.

The article discusses the integration of Kafka into Shopify's Ruby on Rails infrastructure to address various infrastructure challenges, including event data collection and service-oriented archite...