grahamc/hydra - Change MMUBEIGVTTY7OESMGVEOL7EC7HNTSGFIIOC5C3UHKVFYHJ75EMVAC

hydra-queue-runner: Tweaked the selection method

Pick the jobset that has used the smallest fraction of its share, rather than the jobset furthest below its share in absolute terms. This gives jobsets with a small share a quicker start (but they will also run out of their share quicker).

Created by Eelco Dolstra on September 21, 2013

MMUBEIGVTTY7OESMGVEOL7EC7HNTSGFIIOC5C3UHKVFYHJ75EMVAC

Dependencies

In channels

main

upstream

Change contents

Replacement in src/script/hydra-queue-runner at line 148 [3.7823]

B:BD[2.4973] → [2.4973:5122]

                    my $share = $jobset->schedulingshares;
                    my $delta = ($share / $totalShares) - ($duration / $totalWindowSize);

[2.4973]

[2.5122]

                    my $share = $jobset->schedulingshares || 1; # prevent division by zero
                    my $used = $timeSpent / ($totalWindowSize * ($share / $totalShares));

Replacement in src/script/hydra-queue-runner at line 151 [3.7823]

B:BD[2.5123] → [2.5123:5299]

                    #printf STDERR "%s:%s: %d s, %.3f%%, allowance = %.3f%%\n", $jobset->get_column('project'), $jobset->name, $duration, $duration / $totalWindowSize, $delta;

[2.5123]

[2.5299]

                    #printf STDERR "%s:%s: %d s, total used = %.2f%%, share used = %.2f%%\n", $jobset->get_column('project'), $jobset->name, $timeSpent, $timeSpent / $totalWindowSize * 100, $used * 100;

Replacement in src/script/hydra-queue-runner at line 153 [3.7823]

B:BD[2.5300] → [2.5300:5371]

                    push @res, { jobset => $jobset, delta => $delta };

[2.5300]

[4.864]

                    push @res, { jobset => $jobset, used => $used };

Replacement in src/script/hydra-queue-runner at line 156 [3.7823]

B:BD[2.5373] → [2.5373:5449]

                foreach my $r (sort { $b->{delta} <=> $a->{delta} } @res) {

[2.5373]

[2.5449]

                foreach my $r (sort { $a->{used} <=> $b->{used} } @res) {

Replacement in src/script/hydra-queue-runner at line 176 [3.7823]

B:BD[2.6510] → [2.6510:6750]

                        printf STDERR "starting build %d (%s:%s:%s) on %s (jobset allowance = %.3f%%)\n", 
                            $build->id, $build->project->name, $build->jobset->name, $build->job->name, $build->system, $r->{delta};

[2.6510]

[5.110]

                        printf STDERR "starting build %d (%s:%s:%s) on %s; jobset at %.2f%% of its share\n", 
                            $build->id, $build->project->name, $build->jobset->name, $build->job->name, $build->system, $r->{used} * 100;