InstrItin and SchedWriteRes

Project Infrastructure LLVM Dev List Archives
#1

Hi,

From what I can understand from analyzing several *.td files, there are two ways of specifying scheduling information for a specific target, either using SchedWriteRes and InstrItinClass/Data.

Specifically looking at ARMScheduleA9.td, I can find both representations and a comment (in the beggining of the file):

// This section contains legacy support for itineraries. This is
// required until SD and PostRA schedulers are replaced by MachineScheduler.

This poses several question as to:

  1. which representation gives the better cost estimation?

  2. AFAIK, MachineScheduler can also take advantage from InstrItineraries with the ScoreboardHazardRecognizer for better cost estimation and scheduling.

What is the reasoning for having scheduling information distributed in two distinct representations? Is it the lack of micro-architectural details or was it a design decision?

Another question is if one could opt, which representation should me used to represent scheduling information for new targets?

Best Regards,

Tiago

#2

Hi,

From what I can understand from analyzing several *.td files, there are two ways of specifying scheduling information for a specific target, either using SchedWriteRes and InstrItinClass/Data.

Specifically looking at ARMScheduleA9.td, I can find both representations and a comment (in the beggining of the file):

// This section contains legacy support for itineraries. This is
// required until SD and PostRA schedulers are replaced by MachineScheduler.

This poses several question as to:
1) which representation gives the better cost estimation?
2) AFAIK, MachineScheduler can also take advantage from InstrItineraries with the ScoreboardHazardRecognizer for better cost estimation and scheduling.

As the comment indicates, this was done for legacy reasons, to allow targets that already defined itineraries to migrate away from SelectionDAG scheduling, without defining a new machine model. What makes you think it was done "for better cost estimation and scheduling”?

What is the reasoning for having scheduling information distributed in two distinct representations? Is it the lack of micro-architectural details or was it a design decision?

Itineraries classes already existed for ARM, but provided no way to express microarchitectural details, like some vector operations and dependencies on immediate values. (This was compensated for by totally out-of-band logic in the backend to completely override scheduling decisions. That logic is both difficult to maintain, and incompatible with the goal of defining a self-contained machine model.) It also made simple concepts like register bypass very difficult to express and poorly communicated the machine model. The implementation of itineraries (ScoreboardHazardChecker) also needlessly wastes compile time for all but a rare class of VLIW cpus.

Another question is if one could opt, which representation should me used to represent scheduling information for new targets?

I can’t imagine why someone want to use itineraries for a new target. Maybe you have a reason?

-Andy

#3

Hello Andy,

I want to use the existing scheduling models to estimate performance on a subtarget. For that, I am looking at the new llvm-mca tool where they only use SchedReadWrite and state that not supporting Instruction Itineraries is a limitation.

I have also read that the Instruction Itineraries allow to model certain things which cannot be represented in the SchedReadWrite however, I am still trying to find out what and I cannot find any information on this subject.

I was under the impression that, in some cases, Instruction Itineraries could provide me with better static performance estimations. From what you tell me, maybe not? Are Instruction Itineraries somewhat legacy?

  • Tiago
#4

Hello Andy,

I want to use the existing scheduling models to estimate performance on a subtarget. For that, I am looking at the new llvm-mca tool where they only use SchedReadWrite and state that not supporting Instruction Itineraries is a limitation.

llvm-mca tool won’t be able to use the new machine model as intended until some of the TargetInstrInfo hooks are moved to the MC layer. That shouldn’t be too difficult to do for someone who cares about ARM. Until that’s done, the machine model is effectively limited in the same way that itineraries were always limited.

I have also read that the Instruction Itineraries allow to model certain things which cannot be represented in the SchedReadWrite however, I am still trying to find out what and I cannot find any information on this subject.

I was under the impression that, in some cases, Instruction Itineraries could provide me with better static performance estimations. From what you tell me, maybe not? Are Instruction Itineraries somewhat legacy?

  • Tiago

The intention was that itineraries are completely legacy, but there isn’t much incentive to migrate targets that already used them. I don’t think they make any sense for out-of-order targets.

For in-order targets, they currently can provide more precision. Itineraries model the resources used at each cycle of instruction execution.

Say InstructionA uses resource X for 2 cycles, then resource Y for 1 cycle (delayed by 2 cycles after instruction issue).
While InstructionB uses resource Y for 2 cycles the first cycle after issue.

Cycle0 IssueA
Cycle1 X IssueB
Cycle2 X Y
Cycle3 Y Y <========= conflict

The new machine model will not report this as a conflict. Itineraries will report the conflict because it always uses a scoreboard even when it isn’t needed.

A subtarget scheduling strategy can usually be augmented with logic to handle these special cases. But that defeats the llvm-mca goal of having a complete, self-contained machine model. The new machine model could be extended to model these cases simply by introducing an optional delay cycles attribute for each resource used. I would prefer to see that addition rather than continuing to support LLVM multiple machine models indefinitely.

-Andy

1 Like
#5

Hi, Andy

For in-order targets, they currently can provide more precision. Itineraries model the resources used at each cycle of instruction execution.

Is this still true for LLVM13?

A dumb question, how can enable both MachineScheduler and the legacy one that uses Itineraries?

Thanks,

-Peter