Daily iOS
Performance and debugging

Baselines for performance improvements

You're reviewing a PR that claims the search results screen got 40% faster. It looks like it mixes the author's laptop simulator numbers with QA's real device numbers. How would you set the baseline and the metrics to verify the claim?

How would an interviewer hear this answer? You'll see whether they'd move on, dig in, or say no, and which sentences would trip you up. Your score doesn't change.
See the short answer

Fix the device model and OS version, the data fixture and network conditions, and cold versus warm, measure the pre-change commit 10 or more times under those conditions as the baseline, and use the median and the top 5% tail latency instead of the average, then measure the post-change commit under exactly the same conditions. Bake those conditions into an XCTest performance test or a CI job so the next regression gets caught too.

Share a question