Chaos Monkey on my Laptop

GothamGo · 2015 · New York · 2015-11-24
gotestingdevopschaos video

GothamGo 2015 · New York

Chaos engineering for apps that cannot tolerate silent netsplits — from Thomson Reuters Eikon Messenger experience.

Story

  • Netflix Chaos Monkey randomly kills production processes; we needed the same before production
  • Spin up multi-VM / Docker topologies on a developer laptop
  • Script NIC failures, host churn, latency between replicas (MySQL/Redis)
  • Push the same suite into Jenkins and cloud VMs even when prod is bare metal
  • Cut release-cycle risk by making ops confidence automatic

Audience takeaways

Bulletproof middleware and microservices with integration tests that actually model datacenter failure.

Related appearance around Velocity NYC.