Merge remote-tracking branch 'origin/master' into flake

[?]
Feb 10, 2020, 4:58 PM
BQHDSG6OTHRD3WP25GX2N46ZUFRDH4E6L7URATJWXN5TKIKAPQFAC

Dependencies

  • [2] 444WMU3Q TODO
  • [3] SW7STLQ7 Cache flake-based jobset evaluations
  • [4] 6CBZ4DRY Doh
  • [5] MWXDVTS3 Copy the flake migration from the flake branch
  • [6] UNVMKJV5 Unify build and step status codes
  • [7] PHJF4FUT Add missing files
  • [8] SIDK2E7V Jobs: add a nullable jobset_id foreign key to Jobsets.
  • [9] FTPCV25M Store aggregate members in the database
  • [10] LLAJKVGI Fix syntax error
  • [11] KN3VYE5P * Cleaned up the foreign key constraints.
  • [12] 4HPT4SDD Revert "Remove now-unused SystemTypes table"
  • [13] TX7Q4RAS Add page showing latest build steps
  • [14] EPWEMRI2 Allow determinism checking for entire jobsets
  • [15] S2NXJOJE Fix a race that can cause hydra-queue-runner to ignore newly added builds
  • [16] G2T4WAHI Store the inputs of each evaluation in the database
  • [17] KQAQ4FIF Update Schema classes
  • [18] CHJANKMM IndexJobsetEvalsOnJobsetId: Only index jobsets with new builds
  • [19] APURLT2Q Revert "Apply IndexBuildsOnJobFinishedId to unfinished builds only"
  • [20] CCIORPJ5 When manually scheduling an eval, force re-instantiation of store derivations
  • [21] IGR322YP sql: Generate models from postgresql
  • [22] K3HODXGH Check all inputs for blame but only email selected inputs
  • [23] X27GNHDV * Basic job info in the database.
  • [24] KSBB33RE Add a dashboard
  • [25] IWXLV4OB Add DB columns for when to notify responsible committers and which inputs should be checked
  • [26] T5BIOVJE Add support for tracking custom metrics
  • [27] 53IMJNBB Add isChannel column and meta attribute.
  • [28] JM3DPYOM generated schema with new dbix class schema loader, grrrrrr
  • [29] PCKLFRT5 Support push notification of repository changes
  • [30] 5SHCWE7X * Prevent repeated evaluation of a jobset with the same inputs. This
  • [31] QMW24O5S Add support for Guile & Guix.
  • [32] ACBS7C6Q hydra-queue-runner: Detect changes to the scheduling shares
  • [33] KGGQD6CO Fix the Darcs schema upgrade
  • [34] E7FID72S Remove the BuildMachines and BuildMachinesSystemTypes tables
  • [35] 2JGYLIEC Speed up the listing of jobset evals by caching some info in the DB
  • [36] RXVJFQ5A Evaluator cleanups
  • [37] W5OAZWPD Drop the errorMsg column in the Jobs table
  • [38] PLOZBRTR Add command ‘hydra-queue-runner --status’ to show current status
  • [39] W4G5MZZS hydra-evaluator improvements
  • [40] MOX7XJ2E Merge the BuildSchedulingInfo table into the Builds table
  • [41] YF3HTIPF Use partial indexes
  • [42] VCG6KNUX Remove the "clone build" feature
  • [43] WONFWQWS Merge remote-tracking branch 'origin/master' into flake
  • [44] QNDXPVCI * Store the jobset's nixExprPath and nixExprInput fields in a build to
  • [45] Q5HZWFCY Add support for darcs repositories.
  • [46] RJNMYHJF Add missing file
  • [47] URHBNFTI Add forgotten file
  • [48] SS4TZXNU Distinguish between permanent evaluation errors and transient input errors
  • [49] FGQPXZIX hydra: make nr of build to keep configurable per jobset
  • [50] D5QIOJGP * Move everything up one directory.
  • [51] DH3KNBAV Merge remote-tracking branch 'upstream/who-broke-builds' into upstream-master
  • [52] RVHBV3B3 Notify the queue runner when a build is deleted
  • [53] Y6AHH4TH Remove the logfile and logSize columns from the database
  • [54] H7HGWODE * Remove an empty file.
  • [55] B7ENVLRS hydra-queue-runner: Make build notification more reliable
  • [56] GEADFVZ5 hydra-queue-runner: Improved scheduling
  • [57] QLOLZHRX Allow a per-jobset check interval
  • [58] K2WAI5SO Apply IndexBuildsOnJobFinishedId to unfinished builds only
  • [59] G7KWXSFM Distinguish build step states
  • [60] TPNHTE5V Remove obsolete Builds columns and provide accurate "Running builds"
  • [61] JD7AWXQG Remove now-unused SystemTypes table
  • [62] LTQMSMYO Get rid of some obsolete indexes
  • [63] 2FR3LTL2 Update flake.lock
  • [64] 4S5JF5JP Use latest DBIx::Class::Schema::Loader
  • [65] FZR7ET5D Jobsets: add a SERIAL, unique, non-null id column
  • [66] FANTYCR7 Materialize the number of finished builds
  • [67] BXHG3HYL When renaming a jobset, add a redirect from the old name
  • [68] PCD3ZH6Z Partially revert 1c20cfdf2403feb78cef515faf15c04d5c9f17bd
  • [69] H7CNGK4O * Log evaluation errors etc. in the DB.
  • [70] CCPSI3TP Add flake.nix
  • [71] QUMWPGCU Add flake configuration to the web interface
  • [72] TM6C352U Ensure that stoptime and starttime are set for finished builds
  • [73] FV2M6MOT hydra: use autoconf/-make
  • [74] 2NGV7NYN Drop unused "tag" column
  • [75] YTIDBFGU Drop unused "disabled" columns
  • [76] LZVO64YG Merge in the first bits of the API work
  • [77] 4CELXP7P Remove the longDescription field
  • [78] 6COLDXKS Create a pg_trgm index on builds.drvpath
  • [79] P57OYJ4P Index builds on stop time
  • [80] YU6CND7C Remove support for views
  • [81] SJPEC375 Builds: add a nullable jobset_id foreign key to Jobsets.
  • [82] WE5Q2NVI Allow build to be bumped to the front of the queue via the web interface
  • [83] 625P4XPS Update flake.lock
  • [84] 4YCF3KBG Concurrent hydra-evaluator
  • [85] BKMQXGBO Allow public dashboards
  • [86] FITVNQ2S Keep track of the time we spend copying to/from build machines
  • [87] AZCCANUB Missing part of aaacf9eda36f5cdcc77cec20d6f49fbb6f925105
  • [88] RFE6T5LG * Store jobset evaluations in the database explicitly. This includes
  • [89] D44B24QC Store the account type ("hydra" or "persona") explicitly in the database
  • [90] KPZNJ33U * In views, support selecting a job that doesn't depend on the
  • [91] E7M2WP7A Remove unused Jobs columns
  • [92] SB2V735V Keep track of the database schema version
  • [93] UJOSXBZI Record which build a failed build step was propagated from
  • [94] KDBWLKRP Index BuildSteps on propagatedFrom
  • [95] AHTEIK7G * Added a maintainers field to the Builds table.
  • [96] 26PYNDXV Remove the errorMsg column from the Builds table
  • [97] RUTFLXFQ Drop unused BuildProducts.description column
  • [98] 6WRGCITD Enable declarative projects.
  • [99] EJ7C77C3 Allow searching for store and drv paths. Only does a complete match to reduce load on database.
  • [100] KJQWSRCC Speed up hydra-update-gc-roots
  • [*] N22GPKYT * Put info about logs / build products in the DB.

Change contents

  • replacement in flake.lock at line 5
    [6.43][6.43:79](),[6.79][4.0:73]()
    "lastModified": 1580749449,
    "narHash": "sha256-wEPYfs8ULx0dK6R4hrsXC/r8omxJLc86OhQg39eCo0c="
    [6.43]
    [6.178]
    "lastModified": 1581081721,
    "narHash": "sha256-Axhas6uySMqevQrjdLaIfFQZgyCueBngzUV7CEYhbWI="
  • replacement in flake.lock at line 11
    [6.226][6.226:303]()
    "narHash": "sha256-V4jz8Hbt+mZkXhH+3KmUQcRGETOFd8mVPhgQlS4Lu5E="
    [6.226]
    [6.303]
    "lastModified": 1580555706,
    "narHash": "sha256-ly5Gxl9yZgW2w1F3aDU5bvg34Ct+juUaOg8vue+Mkbo="
  • replacement in flake.lock at line 18
    [6.426][6.426:489]()
    "rev": "dd45a16733f4469a0dded6ad0bf9a662ea39bdea",
    [6.426]
    [6.489]
    "rev": "43e283790fbe330b723ac44b584824cf6d85c1ee",
  • replacement in flake.lock at line 31
    [4.123][6.714:773](),[6.714][6.714:773]()
    "rev": "0a4e911cf478d0d38082a8840a5acc8f57d00086",
    [4.123]
    [4.124]
    "rev": "d2032edb2f86e955a8a7724a27c0c3225f386500",
  • replacement in flake.lock at line 41
    [6.990][6.990:1099]()
    "lastModified": 1580555706,
    "narHash": "sha256-ly5Gxl9yZgW2w1F3aDU5bvg34Ct+juUaOg8vue+Mkbo="
    [6.990]
    [6.1099]
    "lastModified": 1581348815,
    "narHash": "sha256-ZYGphR59gsdFhtZYDoeuCtULm8ym/qJSHIslih9b1s8="
  • replacement in flake.lock at line 48
    [6.1202][6.1202:1261]()
    "rev": "43e283790fbe330b723ac44b584824cf6d85c1ee",
    [6.1202]
    [6.1261]
    "rev": "d959778e0934c4c93896d509a65de798909c7cdd",
  • resolve order conflict in src/lib/Hydra/Schema/JobsetEvals.pm at line 95
    [3.52]
    [5.0]
  • edit in src/lib/Hydra/Schema/JobsetEvals.pm at line 97
    [5.18][5.18:52](),[5.52][6.614:631](),[3.52][6.614:631](),[6.614][6.614:631](),[6.631][6.16463:16464](),[6.16463][6.16463:16464]()
    =head2 flake
    data_type: 'text'
    is_nullable: 1
  • edit in src/lib/Hydra/Schema/JobsetEvals.pm at line 127
    [6.759][5.53:109]()
    "flake",
    { data_type => "text", is_nullable => 1 },
  • resolve order conflict in src/lib/Hydra/Schema/JobsetEvals.pm at line 127
    [3.109]
    [6.867]
  • edit in src/lib/Hydra/Schema/JobsetEvals.pm at line 204
    [6.18354][3.110:252]()
    # Created by DBIx::Class::Schema::Loader v0.07049 @ 2019-05-11 00:16:10
    # DO NOT MODIFY THIS OR ANYTHING ABOVE! md5sum:XwlJFCJiS0LHsLg2fFqfUg
  • resurrect zombie in src/lib/Hydra/Schema/Jobsets.pm at line 64
    [6.18314][6.1656:1673](),[6.18314][6.1656:1673]()
    is_nullable: 1
  • edit in src/lib/Hydra/Schema/Jobsets.pm at line 65
    [6.20586][5.253:270]()
    is_nullable: 1
  • resolve order conflict in src/lib/Hydra/Schema/Jobsets.pm at line 65
    [6.1673]
    [6.18345]
  • edit in src/lib/Hydra/Schema/Jobsets.pm at line 70
    [6.20607][5.271:288]()
    is_nullable: 1
  • resolve order conflict in src/lib/Hydra/Schema/Jobsets.pm at line 70
    [6.1691]
    [6.18438]
  • edit in src/lib/Hydra/Schema/Jobsets.pm at line 146
    [6.148][5.289:362]()
    =head2 type
    data_type: 'integer'
    default_value: 0
    is_nullable: 0
  • edit in src/lib/Hydra/Schema/Jobsets.pm at line 158
    [6.288][5.363:415]()
    =head2 flake
    data_type: 'text'
    is_nullable: 1
  • resolve order conflict in src/lib/Hydra/Schema/Jobsets.pm at line 158
    [6.1817]
    [6.18998]
  • edit in src/lib/Hydra/Schema/Jobsets.pm at line 175
    [6.2387][6.1818:1884]()
    { data_type => "text", is_foreign_key => 1, is_nullable => 1 },
  • edit in src/lib/Hydra/Schema/Jobsets.pm at line 178
    [6.2464][5.462:507]()
    { data_type => "text", is_nullable => 1 },
  • resolve order conflict in src/lib/Hydra/Schema/Jobsets.pm at line 178
    [6.1930]
    [6.1457]
  • edit in src/lib/Hydra/Schema/Jobsets.pm at line 210
    [6.4341][5.508:642]()
    "type",
    { data_type => "integer", default_value => 0, is_nullable => 0 },
    "flake",
    { data_type => "text", is_nullable => 1 },
  • resolve order conflict in src/lib/Hydra/Schema/Jobsets.pm at line 210
    [6.2065]
    [6.2524]
  • edit in src/lib/Hydra/Schema/Jobsets.pm at line 344
    [6.22170][6.2066:2196](),[6.22170][6.2066:2196]()
    {
    is_deferrable => 0,
    join_type => "LEFT",
    on_delete => "NO ACTION",
    on_update => "NO ACTION",
    },
  • edit in src/lib/Hydra/Schema/Jobsets.pm at line 411
    [6.22628][6.2197:2339]()
    # Created by DBIx::Class::Schema::Loader v0.07049 @ 2019-05-11 00:03:52
    # DO NOT MODIFY THIS OR ANYTHING ABOVE! md5sum:UVG1D59bXaQ1TUEF237tXQ
  • file deletion: upgrade-58.sql (----------)
    [6.3004][5.1761:1799](),[5.1799][5.1326:1326]()
    alter table Jobsets alter column nixExprInput drop not null;
    alter table Jobsets alter column nixExprPath drop not null;
    alter table Jobsets add column type integer default 0;
    alter table Jobsets add column flake text;
    alter table Jobsets add check ((type = 0) = (nixExprInput is not null and nixExprPath is not null));
    alter table Jobsets add check ((type = 1) = (flake is not null));
    alter table JobsetEvals add column flake text;
  • edit in src/sql/hydra.sql at line 58
    [6.5039][6.3781:3941]()
    nixExprInput text, -- name of the jobsetInput containing the Nix or Guix expression
    nixExprPath text, -- relative path of the Nix or Guix expression
  • edit in src/sql/hydra.sql at line 76
    [6.4843][5.947:1044]()
    type integer not null default 0, -- 0 == legacy, 1 == flake
    flake text,
  • resolve order conflict in src/sql/hydra.sql at line 76
    [6.4039]
    [6.0]
  • edit in src/sql/hydra.sql at line 77
    [6.34][6.4040:4167]()
    check ((type = 0) = (nixExprInput is not null and nixExprPath is not null)),
    check ((type = 1) = (flake is not null)),
  • edit in src/sql/hydra.sql at line 195
    [6.69][5.1173:1269]()
    -- build. FIXME: this should be stored in JobsetEvals, storing it
    -- here is denormal.
  • resolve order conflict in src/sql/hydra.sql at line 195
    [2.96]
    [6.743]
  • edit in src/sql/hydra.sql at line 538
    [6.7668][5.1270:1324]()
    flake text, -- immutable flake reference