Loading…
Timezone
Virtual Event
May 4 - May 7
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon Europe 2021 Virtual to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Central European Summer Time (UTC +2). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change.

Back To Schedule
Friday, May 7 • 12:40 - 13:15
Petabyte Scale Logging with Fluentd and Fluent Bit: A Use Case From Intuit - Hanzel Jesheen, Intuit & Anurag Gupta, Calyptia

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
LINK TO VIDEO RECORDING
In financial and software companies like Intuit, it’s mandatory to provide a reliable observability layer so internal end-users like developers from different line-of-businesses can access their application data. In the last few years, we faced several problems when scaling up logging. For all the new applications we deployed in our Kubernetes clusters, the data rate increased, creating decreased throughput, higher resource consumption, and unexpected backpressure. In this session, you will learn how we leveraged CNCF projects, Fluentd and Fluent Bit, to configure reliable buffering for network outages, flexible configurations for backpressure management, and tips to avoid common mistakes that will save you hours of troubleshooting. A secondary title for this talk would be: “How we achieved Petabyte scale logging with Fluentd and Fluent Bit”.
Speakers
avatar for Anurag Gupta

Anurag Gupta

Head of Product, Calyptia
Anurag is a maintainer of the Fluentd and Fluent Bit project as well as a co-founder of Calyptia. Previously he has worked at Elastic, driving cloud product and creating the Elastic Operator product. He has also worked at Treasure Data heading enterprise open source with Fluentd... Read More →
avatar for Hanzel Jesheen

Hanzel Jesheen

Senior Software Engineer, Intuit
Hanzel Jesheen is a Cloud Observability engineer at Intuit working on Petabyte scale logging and infrastructure monitoring. Hanzel has experience implementing, optimizing, and using technologies such as Kubernetes, Amazon Web Services (AWS), Fluentd, and Fluent Bit.

KubeCon EU Petabyte Scale (1) pdf
Plain Text Transcript 30 WBIW 3521
Friday May 7, 2021 12:40 - 13:15 CEST
Observability Theater
  Observability