The rate of processing, typically measured in requests per second or tokens per second. Throughput affects system capacity and cost; it may be specified in SLAs and is often tested under realistic load conditions.
Throughput
C
T
See: Latency; Rate limiting; Service Level Agreement / Service Level Objective