| Metric | Old Version | New Version | Difference | % Change | P-Value |
|---|---|---|---|---|---|
| Requests/Sec ★★ | 52,423.01 | 52,955.12 | +0.00 | +1.02% | 0.0031 |
| Avg Latency | 0.6473ms | 0.6433ms | 0.0000ms | -0.61% | 0.0509 |
| P50 Latency ★★ | 0.1676ms | 0.1656ms | -0.0021ms | -1.23% | 0.0010 |
| P90 Latency | 0.3238ms | 0.3234ms | -0.0004ms | -0.13% | 0.8272 |
| P95 Latency ★★ | 0.3385ms | 0.3352ms | -0.0033ms | -0.98% | 0.0033 |
| P99 Latency ★★★ | 0.3626ms | 0.3584ms | -0.0042ms | -1.15% | 0.0009 |
| P99.9 Latency | 0.6606ms | 0.6544ms | -0.0063ms | -0.95% | 0.1942 |
| P99.99 Latency | 2.5615ms | 2.5419ms | -0.0196ms | -0.77% | 0.6062 |
| P99.999 Latency | 8.3967ms | 8.3704ms | -0.0263ms | -0.31% | 0.2789 |
* P-Value < 0.05 indicates statistical significance at 95% confidence level
* Significance levels: ★ (p < 0.05), ★★ (p < 0.01), ★★★ (p < 0.001)
* Percentage changes: negative values for latency metrics indicate improvement (faster response), positive values for throughput indicate improvement (more requests handled)
* Color coding: green indicates the new version is better, red indicates the old version is better