KQS7DSKJHTEHALCPTXMWRX2IBOVC5BWU7RWJ4GP5A2JJSBR7HPKAC WWUOQ7V4KWGGHG22G22G6FWRHZEDLP3UZHA2C2FOMNT3UU4PFT4AC RFE6T5LGBFFNEPHZOPF4UNMFC2L4CGD5TPAMOXDLRPH3TZJ43UBAC OOQ2D3KCLFPYNAN253PHWLBQMB6OMO2KYQWQXLTP65SQAYZWQ5LAC JTRG7RDQXKPSO4ESGDLSVAT5WIFGKDL424MN6YYCVTKCOR2FTXRQC YFPZ46YK4BOI6VH2H3F757UEGEYONURUAEDAYEIBLRY33PLSSO4AC BK24VA6QHPE6XLXUXPLJMOT75WEXHZ6PPOFLYFUP4U4NYS5FVGWAC # Some simple caching: don't check a path more than once every N seconds.(my $cachedInput) = $db->resultset('CachedPathInputs')->search({srcpath => $uri, lastseen => {">", $timestamp - 30}},{rows => 1, order_by => "lastseen DESC"});
# Some simple caching: don't check a path more than once every N seconds.(my $cachedInput) = $db->resultset('CachedPathInputs')->search({srcpath => $uri, lastseen => {">", $timestamp - 30}},{rows => 1, order_by => "lastseen DESC"});
if (defined $cachedInput && isValidPath($cachedInput->storepath)) {$storePath = $cachedInput->storepath;$sha256 = $cachedInput->sha256hash;$timestamp = $cachedInput->timestamp;} else {
if (defined $cachedInput && isValidPath($cachedInput->storepath)) {$storePath = $cachedInput->storepath;$sha256 = $cachedInput->sha256hash;$timestamp = $cachedInput->timestamp;} else {
print STDERR "copying input ", $name, " from $uri\n";$storePath = `nix-store --add "$uri"`or die "Cannot copy path $uri to the Nix store.\n";chomp $storePath;
print STDERR "copying input ", $name, " from $uri\n";$storePath = `nix-store --add "$uri"`or die "Cannot copy path $uri to the Nix store.\n";chomp $storePath;
# Path inputs don't have a natural notion of a "revision",# so we simulate it by using the timestamp that we first# saw this path have this SHA-256 hash. So if the# contents of the path changes, we get a new "revision",# but if it doesn't change (or changes back), we don't get# a new "revision".if (!defined $cachedInput) {txn_do($db, sub {$db->resultset('CachedPathInputs')->create({ srcpath => $uri, timestamp => $timestamp, lastseen => $timestamp, sha256hash => $sha256, storepath => $storePath});
# Path inputs don't have a natural notion of a "revision", so# we simulate it by using the timestamp that we first saw this# path have this SHA-256 hash. So if the contents of the path# changes, we get a new "revision", but if it doesn't change# (or changes back), we don't get a new "revision".if (!defined $cachedInput) {txn_do($db, sub {$db->resultset('CachedPathInputs')->create({ srcpath => $uri, timestamp => $timestamp, lastseen => $timestamp, sha256hash => $sha256, storepath => $storePath});
return{ type => $type, uri => $uri, storePath => $storePath, sha256hash => $sha256, revision => strftime "%Y%m%d%H%M%S", gmtime($timestamp)};
return{ type => $type, uri => $uri, storePath => $storePath, sha256hash => $sha256, revision => strftime "%Y%m%d%H%M%S", gmtime($timestamp)};
# First figure out the last-modified revision of the URI.my @cmd = (["svn", "ls", "-v", "--depth", "empty", $uri],"|", ["sed", 's/^ *\([0-9]*\).*/\1/']);my $stdout; my $stderr;die "Cannot get head revision of Subversion repository at `$uri':\n$stderr"unless IPC::Run::run(@cmd, \$stdout, \$stderr);my $revision = $stdout; chomp $revision;die unless $revision =~ /^\d+$/;
# First figure out the last-modified revision of the URI.my @cmd = (["svn", "ls", "-v", "--depth", "empty", $uri],"|", ["sed", 's/^ *\([0-9]*\).*/\1/']);my $stdout; my $stderr;die "Cannot get head revision of Subversion repository at `$uri':\n$stderr"unless IPC::Run::run(@cmd, \$stdout, \$stderr);my $revision = $stdout; chomp $revision;die unless $revision =~ /^\d+$/;
if (defined $cachedInput && isValidPath($cachedInput->storepath)) {$storePath = $cachedInput->storepath;$sha256 = $cachedInput->sha256hash;} else {
if (defined $cachedInput && isValidPath($cachedInput->storepath)) {$storePath = $cachedInput->storepath;$sha256 = $cachedInput->sha256hash;} else {
# Then download this revision into the store.print STDERR "checking out Subversion input ", $name, " from $uri revision $revision\n";$ENV{"NIX_HASH_ALGO"} = "sha256";$ENV{"PRINT_PATH"} = "1";(my $res, $stdout, $stderr) = captureStdoutStderr("nix-prefetch-svn", $uri, $revision);die "Cannot check out Subversion repository `$uri':\n$stderr" unless $res;
# Then download this revision into the store.print STDERR "checking out Subversion input ", $name, " from $uri revision $revision\n";$ENV{"NIX_HASH_ALGO"} = "sha256";$ENV{"PRINT_PATH"} = "1";(my $res, $stdout, $stderr) = captureStdoutStderr("nix-prefetch-svn", $uri, $revision);die "Cannot check out Subversion repository `$uri':\n$stderr" unless $res;
txn_do($db, sub {$db->resultset('CachedSubversionInputs')->create({ uri => $uri, revision => $revision, sha256hash => $sha256, storepath => $storePath});
txn_do($db, sub {$db->resultset('CachedSubversionInputs')->create({ uri => $uri, revision => $revision, sha256hash => $sha256, storepath => $storePath});
my ($projectName, $jobsetName, $jobName, $attrs) = parseJobName($value);$projectName ||= $project->name;$jobsetName ||= $jobset->name;
my ($projectName, $jobsetName, $jobName, $attrs) = parseJobName($value);$projectName ||= $project->name;$jobsetName ||= $jobset->name;
# Pick the most recent successful build of the specified job.(my $prevBuild) = $db->resultset('Builds')->search({ finished => 1, project => $projectName, jobset => $jobsetName, job => $jobName, buildStatus => 0 },{ join => 'resultInfo', order_by => "me.id DESC", rows => 1, where => \ attrsToSQL($attrs, "me.id") });
# Pick the most recent successful build of the specified job.(my $prevBuild) = $db->resultset('Builds')->search({ finished => 1, project => $projectName, jobset => $jobsetName, job => $jobName, buildStatus => 0 },{ join => 'resultInfo', order_by => "me.id DESC", rows => 1, where => \ attrsToSQL($attrs, "me.id") });
if (!defined $prevBuild || !isValidPath($prevBuild->outpath)) {print STDERR "input `", $name, "': no previous build available\n";return undef;}
if (!defined $prevBuild || !isValidPath($prevBuild->outpath)) {print STDERR "input `", $name, "': no previous build available\n";return undef;}
my $relName = ($prevBuild->resultInfo->releasename or $prevBuild->nixname);my $version = $2 if $relName =~ /^($pkgNameRE)-($versionRE)$/;
my $relName = ($prevBuild->resultInfo->releasename or $prevBuild->nixname);my $version = $2 if $relName =~ /^($pkgNameRE)-($versionRE)$/;
my ($projectName, $jobsetName, $jobName, $attrs) = parseJobName($value);$projectName ||= $project->name;$jobsetName ||= $jobset->name;
my ($projectName, $jobsetName, $jobName, $attrs) = parseJobName($value);$projectName ||= $project->name;$jobsetName ||= $jobset->name;
my @validBuilds = ();foreach my $build (@latestBuilds) {if(isValidPath($build->outpath)) {push(@validBuilds,$build);}}
my @validBuilds = ();foreach my $build (@latestBuilds) {push(@validBuilds, $build) if isValidPath($build->outpath);}if (scalar(@validBuilds) == 0) {print STDERR "input `", $name, "': no previous build available\n";return undef;}my @inputs = ();foreach my $prevBuild (@validBuilds) {my $pkgNameRE = "(?:(?:[A-Za-z0-9]|(?:-[^0-9]))+)";my $versionRE = "(?:[A-Za-z0-9\.\-]+)";
if (scalar(@validBuilds) == 0) {print STDERR "input `", $name, "': no previous build available\n";return undef;}
my $relName = ($prevBuild->resultInfo->releasename or $prevBuild->nixname);my $version = $2 if $relName =~ /^($pkgNameRE)-($versionRE)$/;my $input ={ type => "sysbuild", storePath => $prevBuild->outpath, id => $prevBuild->id, version => $version, system => $prevBuild->system};push(@inputs, $input);}return @inputs;}
my @inputs = ();foreach my $prevBuild (@validBuilds) {my $pkgNameRE = "(?:(?:[A-Za-z0-9]|(?:-[^0-9]))+)";my $versionRE = "(?:[A-Za-z0-9\.\-]+)";my $relName = ($prevBuild->resultInfo->releasename or $prevBuild->nixname);my $version = $2 if $relName =~ /^($pkgNameRE)-($versionRE)$/;my $input ={ type => "sysbuild", storePath => $prevBuild->outpath, id => $prevBuild->id, version => $version, system => $prevBuild->system};push(@inputs, $input);}return @inputs;}
($cachedInput) = $db->resultset('CachedGitInputs')->search({uri => $uri, branch => $branch, lastseen => {">", $timestamp - 3600}},{rows => 1, order_by => "lastseen DESC"});
($cachedInput) = $db->resultset('CachedGitInputs')->search({uri => $uri, branch => $branch, lastseen => {">", $timestamp - 3600}},{rows => 1, order_by => "lastseen DESC"});
# Then download this revision into the store.print STDERR "checking out Git input from $uri";$ENV{"NIX_HASH_ALGO"} = "sha256";$ENV{"PRINT_PATH"} = "1";
# Then download this revision into the store.print STDERR "checking out Git input from $uri";$ENV{"NIX_HASH_ALGO"} = "sha256";$ENV{"PRINT_PATH"} = "1";
# Checked out code often wants to be able to run `git# describe', e.g., code that uses Gnulib's `git-version-gen'# script. Thus, we leave `.git' in there. Same for# Subversion (e.g., libgcrypt's build system uses that.)$ENV{"NIX_PREFETCH_GIT_LEAVE_DOT_GIT"} = "1";$ENV{"NIX_PREFETCH_SVN_LEAVE_DOT_SVN"} = "1";
# Checked out code often wants to be able to run `git# describe', e.g., code that uses Gnulib's `git-version-gen'# script. Thus, we leave `.git' in there. Same for# Subversion (e.g., libgcrypt's build system uses that.)$ENV{"NIX_PREFETCH_GIT_LEAVE_DOT_GIT"} = "1";$ENV{"NIX_PREFETCH_SVN_LEAVE_DOT_SVN"} = "1";
# Ask for a "deep clone" to allow "git describe" and similar# tools to work. See# http://thread.gmane.org/gmane.linux.distributions.nixos/3569# for a discussion.$ENV{"NIX_PREFETCH_GIT_DEEP_CLONE"} = "1";
# Ask for a "deep clone" to allow "git describe" and similar# tools to work. See# http://thread.gmane.org/gmane.linux.distributions.nixos/3569# for a discussion.$ENV{"NIX_PREFETCH_GIT_DEEP_CLONE"} = "1";
(my $res, $stdout, $stderr) = captureStdoutStderr("nix-prefetch-git", $uri, $revision);die "Cannot check out Git repository branch '$branch' at `$uri':\n$stderr" unless $res;
(my $res, $stdout, $stderr) = captureStdoutStderr("nix-prefetch-git", $uri, $revision);die "Cannot check out Git repository branch '$branch' at `$uri':\n$stderr" unless $res;
($sha256, $storePath) = split ' ', $stdout;($cachedInput) = $db->resultset('CachedGitInputs')->search({uri => $uri, branch => $branch, sha256hash => $sha256});
($sha256, $storePath) = split ' ', $stdout;($cachedInput) = $db->resultset('CachedGitInputs')->search({uri => $uri, branch => $branch, sha256hash => $sha256});
if (!defined $cachedInput) {txn_do($db, sub {$db->resultset('CachedGitInputs')->update_or_create({ uri => $uri, branch => $branch, revision => $revision, timestamp => $timestamp, lastseen => $timestamp, sha256hash => $sha256, storepath => $storePath});});} else {$timestamp = $cachedInput->timestamp;txn_do($db, sub {
if (!defined $cachedInput) {txn_do($db, sub {$db->resultset('CachedGitInputs')->update_or_create({ uri => $uri, branch => $branch, revision => $revision, timestamp => $timestamp, lastseen => $timestamp, sha256hash => $sha256, storepath => $storePath});});} else {$timestamp = $cachedInput->timestamp;txn_do($db, sub {
{ type => $type, uri => $uri, storePath => $storePath, sha256hash => $sha256, revision => $revision};
{ type => $type, uri => $uri, storePath => $storePath, sha256hash => $sha256, revision => $revision};}
my $validJob = 1;foreach my $arg (@{$job->{arg}}) {my $input = $inputInfo->{$arg->{name}}->[$arg->{altnr}] ;if($input->{type} eq "sysbuild" && ! ($input->{system} eq $job->{system}) ) {$validJob = 0 ;}}if($validJob) {push(@filteredJobs, $job);}
my $validJob = 1;foreach my $arg (@{$job->{arg}}) {my $input = $inputInfo->{$arg->{name}}->[$arg->{altnr}] ;if ($input->{type} eq "sysbuild" && $input->{system} ne $job->{system}) {$validJob = 0;}}if ($validJob) {push(@filteredJobs, $job);}