| Metric | Old Version | New Version | Difference | % Change | P-Value |
|---|---|---|---|---|---|
| Requests/Sec | 49,990.09 | 49,990.28 | +0.00 | +0.00% | 0.6247 |
| Avg Latency ★★ | 13.3290ms | 8.9559ms | 0.0000ms | -32.81% | 0.0084 |
| P50 Latency | 0.9821ms | 0.9451ms | -0.0370ms | -3.76% | 0.1562 |
| P90 Latency | 3.3574ms | 2.4942ms | -0.8632ms | -25.71% | 0.1833 |
| P95 Latency | 5.3705ms | 3.5122ms | -1.8583ms | -34.60% | 0.0859 |
| P99 Latency ★★ | 18.0764ms | 10.6606ms | -7.4158ms | -41.02% | 0.0089 |
| P99.9 Latency ★★ | 50.9068ms | 30.7791ms | -20.1278ms | -39.54% | 0.0067 |
| P99.99 Latency ★★ | 72.1945ms | 47.7131ms | -24.4814ms | -33.91% | 0.0080 |
| P99.999 Latency ★★ | 75.9779ms | 51.6883ms | -24.2896ms | -31.97% | 0.0090 |
* P-Value < 0.05 indicates statistical significance at 95% confidence level
* Significance levels: ★ (p < 0.05), ★★ (p < 0.01), ★★★ (p < 0.001)
* Percentage changes: negative values for latency metrics indicate improvement (faster response), positive values for throughput indicate improvement (more requests handled)
* Color coding: green indicates the new version is better, red indicates the old version is better