API World + CloudX + Dev Innovation Summit 2024: Full Schedule

2:30pm PST

PRO SESSION (CloudX): Petabyte-Scale Deployments: Balancing Immutability and Flexibility

Thursday November 7, 2024 2:30pm - 2:55pm PST

Anup Ghatage, Salesforce, Lead Member of Technical Staff
Varun Shah, Salesforce, Software Engineer

At Salesforce, our team does Kubernetes deployments at the petabyte scale, with 100+ clusters, 10000+ pods, and 25+ PiB of provisioned storage and innumerable Kubernetes jobs. Operating at this massive scale necessitates an approach that reduces engineering toil. Maintaining such mammoth clusters while keeping security in mind is a whole different challenge.

We specifically talk about how and why we picked immutability and Infra-as-code as the cornerstone of our design and the challenges around it. Immutability provides security and scalability and eliminates config drift. Infra-as-code guarantees that changes to our infrastructure follow the same software lifecycle. but the trade-off is a lack of flexibility to adapt to changing requirements.

In this talk, we go over the unique design choices that help us manage, grow, and configure petabyte-scale deployments at Salesforce.

Speakers

Anup Ghatage

Lead Member of Technical Staff, Salesforce

Anup works on Salesforce's Infrastructure platform.Previously, he has worked on database internals, query processing and storage at SAP, Cisco Systems and other companies for more than 8 years. Anup holds a BS from the University of Pune and an MS from Carnegie Mellon University... Read More →

Varun Shah

Software Engineer, Salesforce

BE with a specialization in Computer EngineeringMS in Electrical EngineeringWorking on enterprise software since 2009 with companies like Brocade (now Broadcom) / VMware and currently with Salesforce.Using cloud native technologies to scale Salesforce software stack.

Thursday November 7, 2024 2:30pm - 2:55pm PST
CloudX -- Stage 1

CloudX: DevOps Summit, Infrastructure-as-Code

Talk Type PRO Session
Track or Conference CloudX, Infrastructure-as-Code (CloudX), CloudX: DevOps Summit, CloudX: Cloud Architecture & Infrastructure, Containers & Kubernetes (CloudX), CloudX: Cloud Strategy Conference, Cloud Talent & Skills (CloudX)
In-Person/Virtual In Person