At Perforator, we also started from Google's beautiful pprof, but then eliminate... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

BigRedEye 5 months ago | parent | context | favorite | on: OpenTelemetry profiles enters public alpha

At Perforator, we also started from Google's beautiful pprof, but then eliminated all nested repeated fields, converging to https://github.com/yandex/perforator/blob/main/perforator/pr.... Repeated fields in protobufs are really memory & CPU hungry.

This layout allows us to quickly merge hundreds of millions of samples into a single profile. The only practical limit is protobuf's 2GB message size cap.

felixge 5 months ago [–]

We had reached out to y'all last year to explore taking ideas from your format. It definitely looks interesting! But IIRC nobody from your team ended up making it to one of our SIG meetings?

https://github.com/yandex/perforator/issues/13

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact