New Test Suite For LNT

Project Infrastructure
1

We are looking to add results from our new CI to lnt.llvm.org. We want to place our data on the front page under the Test Suites.

Background

Our CI’s purpose is designed to test LLVM Clang Offloading as a build bot. We use OpenMP Offloading Code from multiple benchmarks to check commits.

Our Benchmarks Added & Going to Add:

SOLLVE V&V
HeCBench
Kokkos
llvm-test-suite
OpenMPApps
omptests
BNL openmp-benchmarks
Smoke

Our current build bot is stable and has been running for the past month collecting results.

What We Know

Our CI Script currently produces a json file and we have made scripts to convert the format to lnt acceptable jsons. We have tested this on our local system and a local server and it works.

How Do We?

  1. How do we get our test suite up onto the page? Is there a place for us to make a PR? What’s the process?

  2. What is the process for us to add our json to the lnt.llvm.org website once a day?

Any help is appreciated with this last step. Thanks in advance.

2 Likes
2

I’m not sure who the contact person is, but we’d really benefit from extra performance tracking.

Tag: @kbeyls @akorobeynikov @tonic @chris_matthews

3

It’s been many years since I actively worked on/with LNT hands-on myself…

If I remember correctly, submitting test and benchmark results to lnt.llvm.org is done most easily by using the lnt submit command, see the documentation for the lnt tool at The lnt Tool — LNT 0.4.2.dev0 documentation.

It may be best to set up a server locally to test result submissions before starting to submit to the public server at lnt.llvm.org.

Hopefully this helps you get unblocked…