====================================================================
Published: 15 December 2022
Tags: cpu, go, optimization
Irfan Sharif uses control theory, studies CPU scheduler latencies, builds forms of cooperative scheduling, and patches the Go runtime to reduce the impact of CPU utilization on tail latencies.
Some highlights:
- Tail latency is the small percentage of response times from a system, out of all of the responses to the input/output (I/O) requests it serves, that takes the longest in comparison to the majority of its response times
- With CPU sometimes high utilization is moderate over-utilization
- The patch to the Go language was to track CPU use at the level of individual goroutines