Help run benchmark test for arm

Project Infrastructure LLVM Dev List Archives
#1

Hello,

I am trying to run benchmark test for llvm with llvm-test-suite, but failed. I do not have an arm-linux board, but an android userdebug phone. So I planned to run on PC with qemu-arm.

My step (on ubuntu 18.04)

  1. git clone https://github.com/llvm/llvm-test-suite
  2. apt-get install qemu arm-linux-gnueabihf-gcc -y
  3. cd llvm-test-suite
  4. mkdir build & cd build
  5. cmake -DCMAKE_C_COMPILER=/home/llvm-dev-3/build/bin/clang -DCMAKE_C_FLAGS=" -O2 --target=arm-linux-gnueabihf -I/usr/arm-linux-gnueabihf/include/ " -DCMAKE_BUILD_TYPE=Release -DTEST_SUITE_RUN_UNDER=qemu-arm -DTEST_SUITE_BENCHMARKING_ONLY=On -DTEST_SUITE_RUN_BENCHMARKS=On -DCMAKE_INCLUDE_PATH=/usr/arm-linux-gnueabihf/include …/

But got errors like,
CMake Error at /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:137 (message):
Could NOT find Threads (missing: Threads_FOUND)
Call Stack (most recent call first):
/usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE)
/usr/share/cmake-3.10/Modules/FindThreads.cmake:205 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
MicroBenchmarks/libs/benchmark-1.3.0/CMakeLists.txt:189 (find_package)
– Configuring incomplete, errors occurred!

The pthread.h does exist in /usr/arm-linux-gnueabihf/include/, why cmake still can not find it?

Or any other suggestion to run benchmark on arm? Do I need to by a raspberry-pi board? Or qemu and anrdoird dev phone are OK enough?

Ben

#2

Hi Ben,

I didn’t quite understand this:

I do not have an arm-linux board, but an android userdebug phone. So I planned to run on PC with qemu-arm.

But it looks like you want to benchmark on qemu, but I don’t think qemu will give you representative performance numbers. So yeah, for benchmarking I think a dev board would be best. A phone could work too, but then you need to be really careful in setting up the environment (frequency scaling etc.), but then I’m guessing running the llvm-suite might be tricky. Alternatively, there are a few cloud services available that you can use to generate numbers, but I don’t have any experience in setting that up, so don’t know how easy/convenient that is. But I think I know which phab diff your query is related to, so will leave a comment there too.

Cheers,
Sjoerd.