Loading…
Virtual Event
May 4 - May 7
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon Europe 2021 Virtual to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Central European Summer Time (UTC +2). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change.

Back To Schedule
Wednesday, May 5 • 14:15 - 14:50
Scaling Apache Spark on Kube to Apple Scale - Amanda Moran & Holden Karau, Apple

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Amanda and Holden will explore the customer workloads that easily ported to Apache Spark on Kubernetes, and which ones had more difficulty. The goal of this talk is to help the audience in their journey as either the operators of an Apache Spark-Kubernetes platform or as an end user. Considerations and best practices for end users of an Apache Spark on Kubernetes platform will be discussed. Additional advice for folks migrating from YARN with HDFS to Kubernetes will be included. This talk will include how to effectively deploy the new enhancements of Spark on Kube, like shuffle tracking and graceful decommissioning, as well as when not to use this.

Speakers
HK

Holden Karau

Software Engineer, Apple
Holden Karau is a queer transgender Canadian, Apache Spark committer, Apache Software Foundation member, and an active open source contributor. She also extends her passion for building community with industry projects including Scaling for Python for ML and teaching distributed computing... Read More →
avatar for Amanda Moran

Amanda Moran

Software Engineer, Apple
Amanda Moran is a Software Engineer at Apple, her focused is on helping teams adopt Kubernetes. Her passion is helping partners, customers, users, and the community be successful. Previously, she worked for HP, Teradata, DataStax, and Databricks. Amanda’s an Apache Committer and... Read More →



Wednesday May 5, 2021 14:15 - 14:50 CEST
ML Theater
  Machine Learning + Data