​​eBay’s Journey to Planet-Scale Observability with Open Source - OpenObservability Talks S4E01 episode artwork

EPISODE · Jun 29, 2023 · 1H

​​eBay’s Journey to Planet-Scale Observability with Open Source - OpenObservability Talks S4E01

from OpenObservability Talks · host Dotan Horovits

eBay is a high scale end user of open source observability. Collecting telemetry from millions of endpoints, and running thousands of queries per second, presents serious scaling challenges. eBay has chosen to use an open source stack to meet those challenges. On this episode I hosted Vijay Samuel, Observability Architect at eBay, to hear about the challenges eBay faced in monitoring large Kubernetes installations. We discussed why eBay chose the open source stack, and the strategic decision behind eBay's migration from Elastic Beats to OpenTelemetry, and the remarkable experiences they had while deploying massively large scale telemetry installations using OpenTelemetry and Prometheus. We also discussed a fascinating new proposal for a query language standard for observability, which eBay spearheads together with Netflix under the auspices of the CNCF’s TAG Observability (the CNCF’s technical advisory group for observability). The episode was live-streamed on 8 June 2023 and the video is available at https://www.youtube.com/watch?v=-UsU3nRglhA OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat. https://www.twitch.tv/openobservability https://www.youtube.com/@openobservabilitytalks   Show Notes: 3rd anniversary eBay monitoring solution  planet scale at eBay in numbers distributed tracing at eBay migrating from Elastic Beats to OpenTelemetry why eBay chose open source  open-sourcing eBay’s metrics store platform? scaling Prometheus ramping up tracing, from backend to frontend and mobile running OpenTelemetry Collector at scale Query Language Standardization for Observability under the CNCF Resources: New CNCF working group for Observability Query Language Standardization: https://github.com/cncf/tag-observability/blob/main/working-groups/query-standardization.md Why and How eBay Pivoted to OpenTelemetry: https://tech.ebayinc.com/engineering/why-and-how-ebay-pivoted-to-opentelemetry/ Socials: Twitter: https://twitter.com/OpenObserv Twitch: https://www.twitch.tv/openobservability YouTube: https://www.youtube.com/@openobservabilitytalks Dotan Horovits ============ Twitter: @horovits LinkedIn: in/horovits Mastodon: @horovits@fosstodon Vijay Samuel ========== Twitter: @vjsamuel_ LinkedIn: vjsamuel

eBay is a high scale end user of open source observability. Collecting telemetry from millions of endpoints, and running thousands of queries per second, presents serious scaling challenges. eBay has chosen to use an open source stack to meet those challenges. On this episode I hosted Vijay Samuel, Observability Architect at eBay, to hear about the challenges eBay faced in monitoring large Kubernetes installations. We discussed why eBay chose the open source stack, and the strategic decision behind eBay's migration from Elastic Beats to OpenTelemetry, and the remarkable experiences they had while deploying massively large scale telemetry installations using OpenTelemetry and Prometheus. We also discussed a fascinating new proposal for a query language standard for observability, which eBay spearheads together with Netflix under the auspices of the CNCF’s TAG Observability (the CNCF’s technical advisory group for observability). The episode was live-streamed on 8 June 2023 and the video is available at https://www.youtube.com/watch?v=-UsU3nRglhA OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat. https://www.twitch.tv/openobservability https://www.youtube.com/@openobservabilitytalks   Show Notes: 3rd anniversary eBay monitoring solution  planet scale at eBay in numbers distributed tracing at eBay migrating from Elastic Beats to OpenTelemetry why eBay chose open source  open-sourcing eBay’s metrics store platform? scaling Prometheus ramping up tracing, from backend to frontend and mobile running OpenTelemetry Collector at scale Query Language Standardization for Observability under the CNCF Resources: New CNCF working group for Observability Query Language Standardization: https://github.com/cncf/tag-observability/blob/main/working-groups/query-standardization.md Why and How eBay Pivoted to OpenTelemetry: https://tech.ebayinc.com/engineering/why-and-how-ebay-pivoted-to-opentelemetry/ Socials: Twitter: https://twitter.com/OpenObserv Twitch: https://www.twitch.tv/openobservability YouTube: https://www.youtube.com/@openobservabilitytalks Dotan Horovits ============ Twitter: @horovits LinkedIn: in/horovits Mastodon: @horovits@fosstodon Vijay Samuel ========== Twitter: @vjsamuel_ LinkedIn: vjsamuel

NOW PLAYING

​​eBay’s Journey to Planet-Scale Observability with Open Source - OpenObservability Talks S4E01

0:00 1:00:21

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

No similar podcasts found.

Frequently Asked Questions

How long is this episode of OpenObservability Talks?

This episode is 1 hour and 0 minutes long.

When was this OpenObservability Talks episode published?

This episode was published on June 29, 2023.

What is this episode about?

eBay is a high scale end user of open source observability. Collecting telemetry from millions of endpoints, and running thousands of queries per second, presents serious scaling challenges. eBay has chosen to use an open source stack to meet those...

Can I download this OpenObservability Talks episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!