Then that really doesn’t look like noise to me, especially since it’s skewed onto one specific side.
I think the testing we’ve done on real applications is more instructive. The CTMark tests are very small, and that magnifies the impact of lengthening the pipeline. We’ve seen very little difference in compile/run time performance in our internal usage, and you can see the same results in the Webkit build we posted here.
Would it be possible to test a larger application, such as building the Clang itself?
Yes, we can do that. We’ve run that test internally several times. I’ll run it again and post the results here.