RFC: Display true result for AArch64 pre-commit CI

LLVM Project
1

Hi,

We have been running the AArch64 CI for over a month now, and so far we have the CI job configured to always report a passing result no matter what happens in the build. I would like to propose that we change the job to report the actual pass/fail result of the build while still keeping it a non-mandatory test for now.

I believe we have resolved most of the infrastructure issues with the aarch64 CI jobs now, and in the last week we only have 1 of the 3106 jobs fail due to infrastructure issues. The grafana dashboard has run times and other stats over the last month.

As for cost, we’ve spent $6,126.42 on the ec2 instances in the last month and about $850.00 on overhead so overall it cost roughly $7,000 last month to run the CI.

If all goes well with the CI in the next few weeks, my plan is to submit another RFC for making the AArch64 tests mandatory.

Let me know what you think.

7 Likes
2

I think AArch64 is in a good enough state to do this now. The infrastructure reliability is there, and I’m not too concerned given Depot is handling most of the details that actually impact reliability. The AArch64 Linux jobs are slower than x86 Linux/Windows, but only marginally, and that would really only be something we need to discuss once we look at requiring the AArch64 job, and I don’t think that should really be a big deal given the increase isn’t very large.

3

It seems like there is consensus on this based on the hearts and the lack of objections, so I’m planning to enable this later today.

1 Like
4

Change has been merged now: [CI] Report real results for aarch64 (#170535) · llvm/llvm-project@0c31da1 · GitHub

1 Like