Back to 2024 AgendaBlueprints for Scaling: Practical Steps for Scaling Your Data Platform to Handle Exponential Growth
🕓 2:45 pm - 3:05 pm📍 Room 6 - Victory Lounge (Lv 2)Data platforms come in all shapes and sizes. There’s no one-size-fits-all.
As a company grows, the data platform you’ve built will start experiencing bottlenecks. What should you do when you start experiencing bottlenecks? How do you scale your data platform to cope with exponential growth?
The speaker answers these questions by drawing upon his experience from building and scaling some of the world’s largest data platforms, housing over 10PB in storage, 10K data workloads, and 3K users.
The speaker will discuss 6 practical steps on how to scale data platforms, and provide real-world examples from the data platforms he’s built at leading tech companies:
1. Decentralize the platform and empower your teams
2. Define and provide shared platform services
3. Define and provide composable primitives and paved roads
4. Enforce policies
5. Nudge theory
6. Provide education and training

Jonathan Neo