Software Misadventures · Ronak Nathani, Guang Yang

Charity Majors - On database outages, journey as a co-founder, thriving under pressure and growing as an engineer - #7

March 20, 2021·1 hr 7 min·5 clips
Charity Majors reveals why senior engineers must know what happens to their code after hitting merge.
Charity Majors, CTO and co-founder of Honeycomb.io, joins the hosts to discuss engineering culture and handling production incidents. The conversation draws from her extensive career, which includes being on-call as a teenager. Hosts Ronak and Guang explore her transition from engineer to founder and her current hiring philosophy. Majors argues a senior engineer must understand what happens to their code after merging to production. She states their professional instincts depend on a "data corpus" trained on real production systems. The episode recounts specific past outages, including one requiring a physical drive to a data center to flip a database switch. Discussions cover practical strategies for maintaining calm during severe production incidents. A core insight is that production outages provide the deepest learning opportunities about system behavior. Majors shares her perspective on building a resilient engineering culture that normalizes incident response. She introduces the concept of the "engineer manager pendulum," describing shifts between technical and managerial focus. For hiring, she prioritizes backend and production-oriented experience, which she acknowledges as a potential bias. The episode is highly conversational, blending personal anecdotes with direct career advice. Its tone is both educational and candid, featuring "real talk" about industry pressures. Engineers focused on system reliability and DevOps practices will find this episode particularly valuable. Listeners seeking highly theoretical or front-end-centric content might find the discussion less aligned with their interests.
Listen to the show on