Monday, December 06, 2021

2021-12-05 Sunday - Interesting Shopify Black Friday and Cyber Monday performance notes

https://www.linkedin.com/posts/vladmihalcea_shopify-uses-a-monolith-architecture-built-activity-6872785087985946624-Dh1N

Shopify uses a monolith architecture built with Ruby on Rails and MySQL.

https://twitter.com/ShopifyEng/status/1465806691543531525

  • "2021 was our biggest Black Friday Cyber Monday ever! Together with our friends at @GoogleCloud"
  •  "we achieved near-perfect uptime while averaging ~30TB/min of egress traffic across our infrastructure. That’s a massive ~43PB/day!"
  • "To keep up with the traffic over BFCM our Core MySQL fleet performed over 11 Million QPS and delivered 11 TERABYTES per second read I/O."
  • "We use @Splunk to monitor second-to-second data on how production systems are performing. Beyond engineering this is important to our support team for real-time visibility into what's happening on the platform."
  • "The storefront caching infrastructure serviced 1.8B commands. 3.18PB of data written and 15PB of data retrieved!"
  • "To keep our system responsive under heavy load this weekend we processed over 24 Billion (yes, with a B) asynchronous tasks using Resque. The ​​median queue time for those billions of jobs was 16ms."

  • "We can’t do it all alone, we have a lot of friends — over this weekend we answered 42B API calls and delivered 11.67B webhooks to support the thousands of apps in the @ShopifyDevs ecosystem."
  • "We have a strong belief in the role of flash sales in the future of commerce and our platform is built to withstand these huge floods of traffic. In one of the largest holiday shopping events, one merchant generated enough load to use over 20% of our TOTAL computing capacity."

  • "$6.3B in global sales from Shopify merchants."
  • "$3.1M/minute at peak on Friday."
       

Also see the related Google Cloud team's blog post:
 

Shopify engineers deliver on peak performance during Black Friday Cyber Monday 2021
https://cloud.google.com/blog/topics/retail/shopify-and-google-cloud-team-up-for-an-epic-bfcm-weekend


No comments:

Copyright

© 2001-2021 International Technology Ventures, Inc., All Rights Reserved.