{"header":{"message":"Support testing build determinism","description":"Builds can now specify the attribute \"isDeterministic = true\" to tell\nHydra to build with build-repeat > 0. If there is a mismatch between\nrounds, the step / build fails with a suitable status.\n\nMaybe this should be a meta attribute, but that makes it invisible to\nhydra-queue-runner, and it seems reasonable to make a claim of\nmandatory determinism part of the derivation (since e.g. enabling this\nflag should trigger a rebuild).","timestamp":"2016-12-06T16:46:06Z","authors":[{"email":"edolstra@gmail.com","name":"Eelco Dolstra"}]},"hash":"EFWDY2V7ILJBFQ6NADBESYZTPHQBXKNO5N4DPNABL7X4XMNNTNYAC","authors":[],"deps":{"hashes":[["EFWDY2V7ILJBFQ6NADBESYZTPHQBXKNO5N4DPNABL7X4XMNNTNYAC","Support testing build determinism"],["AA",null],["BYVRA54QBKHLFOPIRBJKZZI7JYBYHSOK7MIA3TUZTALZQJGG3G7QC","Temporarily disable machines on any exception, not just connection failures"],["LRU7K5MWFSFBPVBLXSQI6W4CN4BJ6Y64JMTGIUHH34IG7OF4EXKQC","Update build images to be more friendly to users with color blindness."],["VZKB5CIEW7Z5YBRYFKIFBQODBCG2NPGGXU3F3VQ3BNKGP5WYCPBQC","Workaround for RemoteStore not supporting cmdBuildDerivation yet"],["5AIYUMTBY6TFQTBRP3MJ2PYWUMRF57I77NIVWYE74UMEVQMBWZVQC","Basic remote building"],["MHVIT4JYWUYD4UCGB2AHLXWLX6B5SYE22BREERNGANT7RGGDUFOAC","Split hydra-queue-runner.cc more"],["DKJFD6JNNK5LJMRGQABMJZKMFZLGY3ADKJWF6J4BBHEUPY3NB67QC","Process Nix API changes"],["EJJCY263UXP4F2NAHOARQRBV2V2Z7MK7474RFNOD6LDYTCPMWIPQC","Account steps with preferLocalBuild as a separate system type"],["HJOEIMLRDVQ2KZI5HGL2HKGBM3AHP7YIKGKDAGFUNKRUXVRB24NAC","Refactor"],["BG6PEOB2M2Y56QPVMELU7VNNCGNMSQ2K6ATBUCPJLKPLTDWNJQ5AC","Make the output size limit configurable"],["UNVMKJV5VX74A2MLS42AP3SY25HKQSH4S27Y44QFKRQRKPU2MV6QC","Unify build and step status codes"],["5N7LVAJNE4LN6H7HLPOHTROMDHT3DYJIO6GE4CVSAWZZIDNN66NAC","Keep track of requiredSystemFeatures in the machine stats"],["J5UVLXOK6EDIL5I7VKWH4V2QDS4DPD7FHRK6XBWSXFRQS4JKXFZQC","* Start of a basic Catalyst web interface."],["24BMQDZAWDQ7VNIA7TIROXSOYLOJBNZ2E4264WHWNJAEN6ZB3UOAC","Start of single-process hydra-queue-runner"],["IK53RV4VGOHLCZGQCCIKPB45M3C7M7YMNBOJFBGZJ4LWIZNU4QNQC",""],["6KIJX24R5RRDR2UQMUAWHF3N6V6DKKL5URYSLB7IT4J5C3RO4G2AC","Get rid of unnecessary [%- and -%] tags"],["T6KISLR63EHMQ4QQI3Z46PSVQITCYNZL32K3AR2LKQ3K6ESOW3QQC","Fix indentation"],["N22GPKYTOLZLBGTGDATQDVZ4R5APZEAOIA7L32X4UXBH4XNI7MWAC","* Put info about logs / build products in the DB."],["BD3GRK4BQUGRQGTAILUITIH3RRSVUH6AKINVMMKYLBAAHAAUSB4AC","* Get rid of \"positive failures\" and separate log phases."]],"deps":["BYVRA54QBKHLFOPIRBJKZZI7JYBYHSOK7MIA3TUZTALZQJGG3G7QC","LRU7K5MWFSFBPVBLXSQI6W4CN4BJ6Y64JMTGIUHH34IG7OF4EXKQC"],"known":["5AIYUMTBY6TFQTBRP3MJ2PYWUMRF57I77NIVWYE74UMEVQMBWZVQC","VZKB5CIEW7Z5YBRYFKIFBQODBCG2NPGGXU3F3VQ3BNKGP5WYCPBQC"]},"hunks":[{"Replacement":{"inode":{"change":4,"pos":85},"path":"src/hydra-queue-runner/build-remote.cc","line":172,"ins":{"up_context":[{"change":2,"pos":415}],"down_context":[{"change":2,"pos":457}],"flag":"BLOCK","start":0,"end":42,"inode":{"change":4,"pos":85}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":2,"pos":415},"to":{"change":2,"start":415,"end":457},"introduced_by":2}],"inode":{"change":4,"pos":85}},"ins_contents":[{"Add":" to << SERVE_MAGIC_1 << 0x203;"}],"del_contents":[{"Del":" to << SERVE_MAGIC_1 << 0x202;\n"}]}},{"Edit":{"inode":{"change":4,"pos":85},"path":"src/hydra-queue-runner/build-remote.cc","line":183,"atom":{"NewVertex":{"up_context":[{"change":2,"pos":1013}],"down_context":[{"change":4,"pos":91}],"flag":"BLOCK","start":43,"end":260,"inode":{"change":4,"pos":85}}},"contents":[{"Add":" if (GET_PROTOCOL_MINOR(remoteVersion) < 3 && step->isDeterministic)"},{"Add":" throw Error(\"machine ‘%1%’ does not support deterministic builds; please upgrade it to Nix 1.12\", machine->sshName);"}]}},{"Edit":{"inode":{"change":4,"pos":85},"path":"src/hydra-queue-runner/build-remote.cc","line":266,"atom":{"NewVertex":{"up_context":[{"change":2,"pos":3765}],"down_context":[{"change":2,"pos":3765}],"flag":"BLOCK","start":261,"end":427,"inode":{"change":4,"pos":85}}},"contents":[{"Add":" if (GET_PROTOCOL_MINOR(remoteVersion) >= 3)"},{"Add":" // FIXME: make the number of repeats configurable."},{"Add":" to << (step->isDeterministic ? 1 : 0);"}]}},{"Edit":{"inode":{"change":4,"pos":85},"path":"src/hydra-queue-runner/build-remote.cc","line":332,"atom":{"NewVertex":{"up_context":[{"change":2,"pos":6391}],"down_context":[{"change":2,"pos":6391}],"flag":"BLOCK","start":428,"end":656,"inode":{"change":4,"pos":85}}},"contents":[{"Add":" break;"},{"Add":" case BuildResult::NotDeterministic:"},{"Add":" result.stepStatus = bsNotDeterministic;"},{"Add":" result.canRetry = false;"},{"Add":" result.canCache = true;"}]}},{"Edit":{"inode":{"change":7,"pos":20067},"path":"src/hydra-queue-runner/queue-monitor.cc","line":421,"atom":{"NewVertex":{"up_context":[{"change":8,"pos":1009}],"down_context":[{"change":9,"pos":197}],"flag":"BLOCK","start":657,"end":734,"inode":{"change":7,"pos":20067}}},"contents":[{"Add":" step->isDeterministic = get(step->drv.env, \"isDetermistic\", \"0\") == \"1\";"}]}},{"Edit":{"inode":{"change":10,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":38,"atom":{"NewVertex":{"up_context":[{"change":11,"pos":3973}],"down_context":[{"change":12,"pos":996}],"flag":"BLOCK","start":735,"end":764,"inode":{"change":10,"pos":1128}}},"contents":[{"Add":" bsNotDeterministic = 12,"}]}},{"Edit":{"inode":{"change":10,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":143,"atom":{"NewVertex":{"up_context":[{"change":10,"pos":2488}],"down_context":[{"change":13,"pos":514}],"flag":"BLOCK","start":765,"end":791,"inode":{"change":10,"pos":1128}}},"contents":[{"Add":" bool isDeterministic;"}]}},{"Edit":{"inode":{"change":14,"pos":7350},"path":"src/root/build.tt","line":72,"atom":{"NewVertex":{"up_context":[{"change":11,"pos":4463}],"down_context":[{"change":15,"pos":20001}],"flag":"BLOCK","start":792,"end":903,"inode":{"change":14,"pos":7350}}},"contents":[{"Add":" [% ELSIF step.status == 12 %]"},{"Add":" Non-deterministic build"}]}},{"Edit":{"inode":{"change":16,"pos":2803},"path":"src/root/common.tt","line":212,"atom":{"NewVertex":{"up_context":[{"change":3,"pos":1704}],"down_context":[{"change":17,"pos":4181}],"flag":"BLOCK","start":904,"end":1138,"inode":{"change":16,"pos":2803}}},"contents":[{"Add":" [% ELSIF buildstatus == 12 %]"},{"Add":" $\"Non-deterministic$ "}]}},{"Edit":{"inode":{"change":16,"pos":2803},"path":"src/root/common.tt","line":245,"atom":{"NewVertex":{"up_context":[{"change":11,"pos":4716}],"down_context":[{"change":18,"pos":2353}],"flag":"BLOCK","start":1139,"end":1230,"inode":{"change":16,"pos":2803}}},"contents":[{"Add":" [% ELSIF buildstatus == 12 %]"},{"Add":" Non-deterministic build"}]}},{"Edit":{"inode":{"change":19,"pos":1},"path":"src/sql/hydra.sql","line":214,"atom":{"NewVertex":{"up_context":[{"change":11,"pos":4754}],"down_context":[{"change":20,"pos":4847}],"flag":"BLOCK","start":1231,"end":1280,"inode":{"change":19,"pos":1}}},"contents":[{"Add":" -- 12 = build or step was not deterministic"}]}}],"owner":"grahamc","repo":"hydra2","token":"mSwc0Ho5buDowCrpdZPDKqk7Kg6Spq3GGLmKMIGiYXU=","login":null}

…

Dependencies

Change contents