this post was submitted on 20 Nov 2023
1 points (66.7% liked)

Hardware

33 readers
1 users here now

A place for quality hardware news, reviews, and intelligent discussion.

founded 11 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 1 points 10 months ago (6 children)

I wish more tech outlets knew about benchmarking developer workloads, Chromium compile time is such an irrelevant benchmark. Benchmarking the time to make a clean release build of an incredibly large C++ code base, especially one with tons of time dedicated to making the build as parallel as possible, isn't at all representative of what 99% of programmers do in their day to day. I work on a large cpp codebase every day and it's been months since I've done a clean release build on my local machine.

A substantially better test methodology would be to checkout to a commit 30 or so back, do a clean build and running of the test suite to populate caches, and then time the total duration it takes to run the test suite until you land back on the latest commit. Most programmers don't do clean builds unless they absolutely have to and they'll have build caches populated. Do this for an array of languages with projects of varying sizes and then you'll have a benchmark actually worth looking at.

[โ€“] [email protected] 1 points 10 months ago

The Chromium compile times are actually perfect for our gamedev workload since we have our build machines compile binaries without fastbuild or other caching when producing builds to submit to partners. And we can reasonably expect the performance scaling they see to apply to our general compile times too, though they're fast enough on developer machines that you can barely feel differences lol

load more comments (5 replies)