I'm evaluating running .net core API and microservices on Orleans in kubernetes. The apm story though is leaving me puzzled. There don't seem to be decent options:

1. App insights: works on dot net core for app specific counters and metrics but I can't get machine (container/node) perf counters (cpu, ram) since that needs full. Net profile
2. K8s : heapster/grafana/influx can give me pod metrics but there doesn't seem to be much in way of app metrics. Would pushing app metrics logging into influx/grafana be even an option?
3. Roll out elk.. but again in this case, how do you correlate it with container metrics?

Basically looks like it's hard to get both app and infra metrics in one single place. I realise that containers themselves are ephemeral.. but let's say when you hit an issue, is like to rule out the infra (underlying node of the container)

Hoping to get some insights from the reddit hivmind.

Thanks for reading