Running test suite with LNT failed

Hi all,

  I am running LNT with LLVM/Clang 3.0 Release binary and test suite, here is my
flow (most of them are the same as http://llvm.org/docs/lnt/quickstart.html).

Hi all,

I am running LNT with LLVM/Clang 3.0 Release binary and test suite, here is my
flow (most of them are the same as http://llvm.org/docs/lnt/quickstart.html).

---
$ svn co http://llvm.org/svn/llvm-project/lnt/trunk ~/lnt
$ ~/mysandbox/bin/python ~/lnt/setup.py develop
$ cd mysandbox; source bin/activate
$ $ lnt runtest nt \
--sandbox SANDBOX \
--cc ~/install/clang+llvm-3.0-i386-linux-Ubuntu-11_04/bin/clang \
--test-suite ~/test-suite-3.0.src/
---

But I got the error message below,

---
2012-04-12 02:39:48: executing test modules
2012-04-12 02:39:49: loading nightly test data...
nt.py:737: fatal error: nightly test failed, no report generated
---

Any idea on how I can figure out what the fatal error is? Thanks!

Inside the sandbox there will be a timestamped directory than contains
various .log files. In particular, the test.log file should give some
clues as to what went wrong.

- Daniel

> But I got the error message below,
>
> ---
> 2012-04-12 02:39:48: executing test modules
> 2012-04-12 02:39:49: loading nightly test data...
> nt.py:737: fatal error: nightly test failed, no report generated
> ---
>
> Any idea on how I can figure out what the fatal error is? Thanks!

Inside the sandbox there will be a timestamped directory than contains
various .log files. In particular, the test.log file should give some
clues as to what went wrong.

  Thanks for the tip, Daniel.

  I realize lnt will search for release build not debug build binary. But I
still cannot run lnt without problem. Here is the snip of test.log.

  Thanks for the tip, Daniel.

  I realize lnt will search for release build not debug build binary. But I
still cannot run lnt without problem. Here is the snip of test.log.

---
../llvm-3.0.obj/Release/bin/clang++ -o Output/build2.simple Output/build2.llvm.o
make[4]: ../llvm-3.0.obj/Release/bin/clang++: Command not found
make[4]: [Output/build2.simple] Error 127 (ignored)
/nfs_home/chenwj/llvm-3.1/test-suite-3.0.src/RunSafely.sh 500 0 /dev/null Output/build2.out-simple Output/build2.simple

   ......

/nfs_home/chenwj/llvm-3.1/test-suite-3.0.src/RunToolSafely.sh 60 /nfs_home/chenwj/llvm-3.1/test-suite-3.0.src/DiffOutput.sh
"\"/nfs_home/chenwj/llvm-3.1/llvm-3.0.obj/Release/bin/fpcmp \"" simple build2
******************** TEST (simple) 'build2' FAILED! ********************
Execution Context Diff:
/nfs_home/chenwj/llvm-3.1/llvm-3.0.obj/Release/bin/fpcmp: Files differ without tolerance allowance
---

  O.K., I think I figure out what's going wrong. Seems lnt doesn't eat relative
path, right? You need give it something like "~/llvm-3.0.obj/Release/bin/clang++"
not "../llvm-3.0.obj/Release/bin/clang++". Does this be documented?

Regards,
chenwj