Published: 15 December 2022
Tags: cpu, go, optimization
Irfan Sharif uses control theory, studies CPU scheduler latencies, builds forms of cooperative scheduling, and patches the Go runtime to reduce the impact of CPU utilization on tail latencies.
- Tail latency is the small percentage of response times from a system, out of all of the responses to the input/output (I/O) requests it serves, that takes the longest in comparison to the majority of its response times
- With CPU sometimes high utilization is moderate over-utilization
- The patch to the Go language was to track CPU use at the level of individual goroutines