| Metric | Old Version | New Version | Difference | % Change | P-Value |
|---|---|---|---|---|---|
| Requests/Sec | 39,992.35 | 39,992.41 | +0.00 | +0.00% | 0.4256 |
| Avg Latency | 2.7912ms | 2.6256ms | 0.0000ms | -5.93% | 0.1095 |
| P50 Latency ★★ | 1.0911ms | 1.0954ms | 0.0043ms | +0.40% | 0.0018 |
| P90 Latency ★ | 2.2247ms | 2.2196ms | -0.0052ms | -0.23% | 0.0111 |
| P95 Latency ★★★ | 2.5394ms | 2.5263ms | -0.0131ms | -0.52% | 0.0000 |
| P99 Latency ★★★ | 3.1576ms | 3.1002ms | -0.0574ms | -1.82% | 0.0000 |
| P99.9 Latency ★★ | 4.9767ms | 4.3570ms | -0.6197ms | -12.45% | 0.0093 |
| P99.99 Latency | 9.9654ms | 8.9604ms | -1.0051ms | -10.09% | 0.1349 |
| P99.999 Latency | 12.9120ms | 11.7656ms | -1.1463ms | -8.88% | 0.1537 |
* P-Value < 0.05 indicates statistical significance at 95% confidence level
* Significance levels: ★ (p < 0.05), ★★ (p < 0.01), ★★★ (p < 0.001)
* Percentage changes: negative values for latency metrics indicate improvement (faster response), positive values for throughput indicate improvement (more requests handled)
* Color coding: green indicates the new version is better, red indicates the old version is better