Discuss sources of variance in the user guide #1481
Conversation
|
could you pull this out of the user guide into its own document? i think it's important enough to get that but also isn't something someone who just wants to know how to use/run the thing needs to know right away. |
Add reducing_variance.md as a place to discuss things related to variance and, in the future, statistical interpretation of benchmark results.
Done. I also moved the performance governor discussion to the new document, but a small forwarding paragraph in the user guide in case people have links there, or find the specific error message issued by the benchmark code there. |
|
Oopse, reopening. I'm not very familiar with github and didn't realize what "close with comment" did. ;-) |
|
this is great. i think we'll also move the "random interleaving" into this reducing variance doc too as it is meant precisely for that. let me know if you want to do that too or if not i'll just merge this. |
My preference is to merge it now and then make further changes. |
|
thank you! |
* Discuss sources of variance in the user guide * Mention cpufreq/boost * Pull variance material into a new document Add reducing_variance.md as a place to discuss things related to variance and, in the future, statistical interpretation of benchmark results. Co-authored-by: Dominic Hamon <[email protected]>
It took me a long time to figure some of this stuff out, so it would be great to include it in the guide, assuming it is correct enough!