Regression tests


I have just built LLVM with CMake by following these instructions and I am trying to run the regression tests using “make check-all” but there are some unexpected failures in libcxx and libcxxabi. Here’s the test log:

Expected Passes : 40745
Expected Failures : 258
Unsupported Tests : 1594
Unexpected Failures: 1000

Are these failures really “unexpected”, because I haven’t made any changes to LLVM?

Thank you for your help!

Hi Son Tuan,

have you been able to resolve the unexpected failures? I imagine this is something unique to your environment since the build bots don’t have those failures. In any case, if you still have issues with unmodified LLVM causing lit failures, you should provide more information as to what is failing and what the error messages are, etc.

Re-adding the dev list. It’s best to always keep the discussions on the list.

Don’t worry about the length of the message, you need to communicate the information that is important to describe your problem.

So I am not the best person to answer this question since I don’t build/test libcxx or libcxxabi, but I’m sure there are plenty of people on the list that are quite knowledgeable in this regard.

This appears to me like some kind of an issue with how you configured things with CMake. But I don’t know what is required for these libraries.

On the question of whether it makes sense that lit uses gcc for these tests, I think that makes sense. After all, you’re trying to test the libraries in these tests, so you want to build the tests with a stable [system] compiler. Tests for clang will use the clang you just built. Just like opt/llc tests will use the opt/llc you just built respectively.

Sorry I couldn’t be of more help and I hope someone chimes in with the correct solution soon.