{"header":{"message":"Get data needed by getBuildOutput() from the incoming NAR in a streaming fashion","description":null,"timestamp":"2020-07-27T18:38:59Z","authors":[{"email":"edolstra@gmail.com","name":"Eelco Dolstra"}]},"hash":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC","authors":[],"deps":{"hashes":[["N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC","Get data needed by getBuildOutput() from the incoming NAR in a streaming fashion"],["AA",null],["ZMICO7M6COWUZLYQ5MV374BQJLWROSTEORLTOINSU4UGB7TJKJTAC","Remove TokenServer in preparation of making NAR copying O(1) memory"],["5JMO43B45WLRDAZJ4QIDFHSI7BVESV7CJ4BYXPJ5Q3MILZ23SECAC","buildRemote(): Copy paths to the destination store in O(1) memory"],["N4IROACVZ4MU73J5SM6WXJMKQSFR3VN5SOKENNNZNEGMTGB2Q3HAC","Move buildRemote() into State"],["XCDTFZUYSOYEARMJCV4ORVQWG2VWZQ43HU2U63RBECP53OSCM2GQC","hydra-queue-runner: Fix build"],["DKJFD6JNNK5LJMRGQABMJZKMFZLGY3ADKJWF6J4BBHEUPY3NB67QC","Process Nix API changes"],["FITVNQ2SVM6KSOF5P3HHWJYQ3WMQYDJGAONCBIZ7OF7CPXGMA36QC","Keep track of the time we spend copying to/from build machines"],["NAYQT2GTCJPBFRSK7CBFX655F2NGTBPICJSCYG2CSCQ5NRDHZG6QC","hydra-queue-runner: Use cmdBuildDerivation"],["2GRQJZT6YNH32ZAXX3OALH7Z3XU3YTPH4SBTMG5ZZ373KHYFXZ7AC","hydra-queue-runner: Support running in a NixOS container"],["73YR46NJNYZQKHA3QDJCAZYAKC2CGEF5LIS44NOIPDZU6FX6BDPQC","hydra-queue-runner: Write directly to a binary cache"],["LVQXQIYA7QMLVYOANYEFHDBTFAOSE3D2IYAVOG2DXURTASRCUNYQC","Kill active build steps when builds are cancelled"],["BG6PEOB2M2Y56QPVMELU7VNNCGNMSQ2K6ATBUCPJLKPLTDWNJQ5AC","Make the output size limit configurable"],["U55WNIDPCBAADLBSZXWUV6C3LVCILRWNDFJ7S3OJKL2WAWK2FLZAC","Abort unsupported build steps"],["EPWEMRI23UN6C777AL2GWEOXYZRTPEPFC2SZVZ4JTWUGYVFDL5XAC","Allow determinism checking for entire jobsets"],["YHP5DSOOKAXAYHUDMYO6EKX2YAN7DLDQPJX5K52TCP7EXQVP6JAAC","Improve parsing of hydra-build-products"],["BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC","Support hydra-build-products on binary cache stores"],["T5BIOVJEMBIASP7EKQVV2N3VD6I56UXH6LCD5I33BDQEVHJAMGKQC","Add support for tracking custom metrics"],["EBJP3MNAC4CRYGMJJHMKUYWTXP3N4WMMORRLDSDHQVF5ZLOTIENQC","Build against nix-master"],["YNO7CQ6P56YQP7UMGQFL4AZED7DBXE32U7TI6OMOKT6GMWZDMWWQC","hydra-queue-runner: More accurate memory accounting"],["3YSJ3LYKWE7ZXYGXLJI56CN6CGXXC4QO2ZDDA5VYGDSVXJ5QSIDQC","Remove finally.hh"],["BYVRA54QBKHLFOPIRBJKZZI7JYBYHSOK7MIA3TUZTALZQJGG3G7QC","Temporarily disable machines on any exception, not just connection failures"],["G7KWXSFMFPFSCJ7ZD4Z6RNZSDHMHTOUDO3G6R6GYO6VDUDPMIKDQC","Distinguish build step states"],["ACBS7C6QGXAMPLQ336WAQMMGLZXBDNNYPE26ZBPUQ24GL4BF643AC","hydra-queue-runner: Detect changes to the scheduling shares"],["UVNTWTWGQOFKDAJ2ROJYT4U2N4EUXKNWZWPHOM42WPLUL4ALXRJQC","Prevent download of NARs we just uploaded"],["WHULPA6SJJVCXISPL3GAQIRIKQN2DTUSMWGP2ECITWYMLHOON3SQC","Handle failure with output"],["WDGARQ76X6RLSFPJTW52BZYFKBC7DPSTABI7HHIKNYHBYXSUNTHQC","Reuse build products / metrics stored in the database"],["2DNPZFPNI2OM5FKYTC2KE5NKKKAP45AQ2VDDYLZZHCJ35X3EBJRQC","Step cancellation: Don't use pthread_cancel()"],["5AIYUMTBY6TFQTBRP3MJ2PYWUMRF57I77NIVWYE74UMEVQMBWZVQC","Basic remote building"],["24BMQDZAWDQ7VNIA7TIROXSOYLOJBNZ2E4264WHWNJAEN6ZB3UOAC","Start of single-process hydra-queue-runner"],["V6H6BWMKUGENVYLLCT56NWU7YYPADYI65Q4KSGPOJIZF2LWQRN2QC","Sync with Nix"],["HPXFXHFSOC4CR5CQYY67EY57DUPMQA2JAR4MLIL5YN64W4PFQQZQC","Remove SHA-1 hash from BuildProducts"],["MHVIT4JYWUYD4UCGB2AHLXWLX6B5SYE22BREERNGANT7RGGDUFOAC","Split hydra-queue-runner.cc more"],["NJJ7H64SZOX5EGACDCQAUQ7R6UEWD5IIC35A2MWFOOJV55DJYPHAC","Very basic multi-threaded queue runner"],["WV4SSAIYM4SVBQ2VISDTAXQJCPKRGTLSVFH44CQFEMC4COWG5OKQC","Build against nix-master"],["YSZQ3ORRQ6ELPGEQMXO4IEVD5BT2JRXUPJ44K52DLDFTAJLHKQVAC","Fix build"],["HJOEIMLRDVQ2KZI5HGL2HKGBM3AHP7YIKGKDAGFUNKRUXVRB24NAC","Refactor"],["SL3WSRACCX2IMJHHLTRAUQT7QDLCOKYLVO2FEHWIHXM5GPKSRJTQC","hydra-queue-runner: Limit memory usage"]],"deps":["ZMICO7M6COWUZLYQ5MV374BQJLWROSTEORLTOINSU4UGB7TJKJTAC","5JMO43B45WLRDAZJ4QIDFHSI7BVESV7CJ4BYXPJ5Q3MILZ23SECAC"],"known":["24BMQDZAWDQ7VNIA7TIROXSOYLOJBNZ2E4264WHWNJAEN6ZB3UOAC","NJJ7H64SZOX5EGACDCQAUQ7R6UEWD5IIC35A2MWFOOJV55DJYPHAC","5AIYUMTBY6TFQTBRP3MJ2PYWUMRF57I77NIVWYE74UMEVQMBWZVQC","WHULPA6SJJVCXISPL3GAQIRIKQN2DTUSMWGP2ECITWYMLHOON3SQC","YHP5DSOOKAXAYHUDMYO6EKX2YAN7DLDQPJX5K52TCP7EXQVP6JAAC","N4IROACVZ4MU73J5SM6WXJMKQSFR3VN5SOKENNNZNEGMTGB2Q3HAC","NAYQT2GTCJPBFRSK7CBFX655F2NGTBPICJSCYG2CSCQ5NRDHZG6QC","MHVIT4JYWUYD4UCGB2AHLXWLX6B5SYE22BREERNGANT7RGGDUFOAC","T5BIOVJEMBIASP7EKQVV2N3VD6I56UXH6LCD5I33BDQEVHJAMGKQC","ACBS7C6QGXAMPLQ336WAQMMGLZXBDNNYPE26ZBPUQ24GL4BF643AC","DKJFD6JNNK5LJMRGQABMJZKMFZLGY3ADKJWF6J4BBHEUPY3NB67QC","FITVNQ2SVM6KSOF5P3HHWJYQ3WMQYDJGAONCBIZ7OF7CPXGMA36QC","73YR46NJNYZQKHA3QDJCAZYAKC2CGEF5LIS44NOIPDZU6FX6BDPQC","V6H6BWMKUGENVYLLCT56NWU7YYPADYI65Q4KSGPOJIZF2LWQRN2QC","BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC","UVNTWTWGQOFKDAJ2ROJYT4U2N4EUXKNWZWPHOM42WPLUL4ALXRJQC","BG6PEOB2M2Y56QPVMELU7VNNCGNMSQ2K6ATBUCPJLKPLTDWNJQ5AC","BYVRA54QBKHLFOPIRBJKZZI7JYBYHSOK7MIA3TUZTALZQJGG3G7QC","WDGARQ76X6RLSFPJTW52BZYFKBC7DPSTABI7HHIKNYHBYXSUNTHQC","XCDTFZUYSOYEARMJCV4ORVQWG2VWZQ43HU2U63RBECP53OSCM2GQC","3YSJ3LYKWE7ZXYGXLJI56CN6CGXXC4QO2ZDDA5VYGDSVXJ5QSIDQC","LVQXQIYA7QMLVYOANYEFHDBTFAOSE3D2IYAVOG2DXURTASRCUNYQC","2DNPZFPNI2OM5FKYTC2KE5NKKKAP45AQ2VDDYLZZHCJ35X3EBJRQC","YNO7CQ6P56YQP7UMGQFL4AZED7DBXE32U7TI6OMOKT6GMWZDMWWQC","EPWEMRI23UN6C777AL2GWEOXYZRTPEPFC2SZVZ4JTWUGYVFDL5XAC","G7KWXSFMFPFSCJ7ZD4Z6RNZSDHMHTOUDO3G6R6GYO6VDUDPMIKDQC","2GRQJZT6YNH32ZAXX3OALH7Z3XU3YTPH4SBTMG5ZZ373KHYFXZ7AC","WV4SSAIYM4SVBQ2VISDTAXQJCPKRGTLSVFH44CQFEMC4COWG5OKQC","EBJP3MNAC4CRYGMJJHMKUYWTXP3N4WMMORRLDSDHQVF5ZLOTIENQC","U55WNIDPCBAADLBSZXWUV6C3LVCILRWNDFJ7S3OJKL2WAWK2FLZAC","YSZQ3ORRQ6ELPGEQMXO4IEVD5BT2JRXUPJ44K52DLDFTAJLHKQVAC","HPXFXHFSOC4CR5CQYY67EY57DUPMQA2JAR4MLIL5YN64W4PFQQZQC"]},"hunks":[{"Replacement":{"inode":{"change":4,"pos":219},"path":"src/hydra-queue-runner/Makefile.am","line":4,"ins":{"up_context":[{"change":4,"pos":84}],"down_context":[{"change":4,"pos":299}],"flag":"BLOCK","start":0,"end":126,"inode":{"change":4,"pos":219}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":84},"to":{"change":4,"start":84,"end":131},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":131},"to":{"change":2,"start":0,"end":43},"introduced_by":2}],"inode":{"change":4,"pos":219}},"ins_contents":[{"Add":{"text":" builder.cc build-result.cc build-remote.cc \\","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:45"}},{"Add":{"text":" build-result.hh counter.hh state.hh db.hh \\","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:90"}},{"Add":{"text":" nar-extractor.cc nar-extractor.hh","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:125"}}],"del_contents":[{"Del":{"text":" builder.cc build-result.cc build-remote.cc \\","pos":"MHVIT4JYWUYD4UCGB2AHLXWLX6B5SYE22BREERNGANT7RGGDUFOAC:130"}},{"Del":{"text":" build-result.hh counter.hh state.hh db.hh","pos":"ZMICO7M6COWUZLYQ5MV374BQJLWROSTEORLTOINSU4UGB7TJKJTAC:42"}}]}},{"Replacement":{"inode":{"change":4,"pos":85},"path":"src/hydra-queue-runner/build-remote.cc","line":163,"ins":{"up_context":[{"change":4,"pos":199}],"down_context":[{"change":4,"pos":2925}],"flag":"BLOCK","start":127,"end":207,"inode":{"change":4,"pos":85}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":199},"to":{"change":4,"start":199,"end":246},"introduced_by":4}],"inode":{"change":4,"pos":85}},"ins_contents":[{"Add":{"text":" std::function updateStep,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:173"}},{"Add":{"text":" NarMemberDatas & narMembers)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:206"}}],"del_contents":[{"Del":{"text":" std::function updateStep)","pos":"G7KWXSFMFPFSCJ7ZD4Z6RNZSDHMHTOUDO3G6R6GYO6VDUDPMIKDQC:245"}}]}},{"Edit":{"inode":{"change":4,"pos":85},"path":"src/hydra-queue-runner/build-remote.cc","line":431,"atom":{"EdgeMap":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":7000},"to":{"change":4,"start":559,"end":614},"introduced_by":4}],"inode":{"change":4,"pos":85}}},"contents":[{"Del":{"text":" result.accessor = destStore->getFSAccessor();","pos":"2GRQJZT6YNH32ZAXX3OALH7Z3XU3YTPH4SBTMG5ZZ373KHYFXZ7AC:612"}},{"Del":{"text":"","pos":"2GRQJZT6YNH32ZAXX3OALH7Z3XU3YTPH4SBTMG5ZZ373KHYFXZ7AC:613"}}]}},{"Replacement":{"inode":{"change":4,"pos":85},"path":"src/hydra-queue-runner/build-remote.cc","line":477,"ins":{"up_context":[{"change":3,"pos":2000}],"down_context":[{"change":3,"pos":2051}],"flag":"BLOCK","start":208,"end":701,"inode":{"change":4,"pos":85}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":3,"pos":2000},"to":{"change":3,"start":2000,"end":2051},"introduced_by":3}],"inode":{"change":4,"pos":85}},"ins_contents":[{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:208"}},{"Add":{"text":" /* Receive the NAR from the remote and add it to the","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:277"}},{"Add":{"text":" destination store. Meanwhile, extract all the info from the","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:356"}},{"Add":{"text":" NAR that getBuildOutput() needs. */","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:411"}},{"Add":{"text":" auto source2 = sinkToSource([&](Sink & sink)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:472"}},{"Add":{"text":" {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:490"}},{"Add":{"text":" TeeSource tee(from, sink);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:537"}},{"Add":{"text":" extractNarData(tee, localStore->printStorePath(path), narMembers);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:624"}},{"Add":{"text":" });","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:644"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:645"}},{"Add":{"text":" destStore->addToStore(info, *source2);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:700"}}],"del_contents":[{"Del":{"text":" destStore->addToStore(info, from);","pos":"5JMO43B45WLRDAZJ4QIDFHSI7BVESV7CJ4BYXPJ5Q3MILZ23SECAC:2050"}}]}},{"Replacement":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":11,"ins":{"up_context":[{"change":4,"pos":555}],"down_context":[{"change":4,"pos":606}],"flag":"BLOCK","start":702,"end":818,"inode":{"change":4,"pos":441}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":555},"to":{"change":4,"start":27,"end":141},"introduced_by":4}],"inode":{"change":4,"pos":441}},"ins_contents":[{"Add":{"text":"BuildOutput getBuildOutput(","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:729"}},{"Add":{"text":" nix::ref store,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:756"}},{"Add":{"text":" NarMemberDatas & narMembers,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:789"}},{"Add":{"text":" const Derivation & drv)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:817"}}],"del_contents":[{"Del":{"text":"BuildOutput getBuildOutput(nix::ref store,","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:76"}},{"Del":{"text":" nix::ref accessor, const Derivation & drv)","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:140"}}]}},{"Edit":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":27,"atom":{"NewVertex":{"up_context":[{"change":4,"pos":2930}],"down_context":[{"change":4,"pos":1073}],"flag":"BLOCK","start":819,"end":1343,"inode":{"change":4,"pos":441}}},"contents":[{"Add":{"text":" }","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:824"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:825"}},{"Add":{"text":" /* Fetch missing data. Usually buildRemote() will have extracted","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:894"}},{"Add":{"text":" this data from the incoming NARs. */","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:938"}},{"Add":{"text":" for (auto & output : outputs) {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:974"}},{"Add":{"text":" auto outputS = store->printStorePath(output);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1028"}},{"Add":{"text":" if (!narMembers.count(outputS)) {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1070"}},{"Add":{"text":" printInfo(\"fetching NAR contents of '%s'...\", outputS);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1138"}},{"Add":{"text":" auto source = sinkToSource([&](Sink & sink)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1194"}},{"Add":{"text":" {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1208"}},{"Add":{"text":" store->narFromPath(output, sink);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1258"}},{"Add":{"text":" });","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1274"}},{"Add":{"text":" extractNarData(*source, outputS, narMembers);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1332"}},{"Add":{"text":" }","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1342"}}]}},{"Replacement":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":58,"ins":{"up_context":[{"change":4,"pos":3493}],"down_context":[{"change":4,"pos":217}],"flag":"BLOCK","start":1344,"end":1407,"inode":{"change":4,"pos":441}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":3493},"to":{"change":4,"start":3493,"end":3552},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":3045},"to":{"change":4,"start":142,"end":217},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":3552},"to":{"change":4,"start":142,"end":217},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":58},"to":{"change":4,"start":142,"end":217},"introduced_by":4}],"inode":{"change":4,"pos":441}},"ins_contents":[{"Add":{"text":" if (narMembers.count(outputS + \"/nix-support/failed\"))","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1406"}}],"del_contents":[{"Del":{"text":" Path failedFile = outputS + \"/nix-support/failed\";","pos":"EBJP3MNAC4CRYGMJJHMKUYWTXP3N4WMMORRLDSDHQVF5ZLOTIENQC:3551"}},{"Del":{"text":" if (accessor->stat(failedFile).type == FSAccessor::Type::tRegular)","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:216"}}]}},{"Replacement":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":61,"ins":{"up_context":[{"change":4,"pos":114}],"down_context":[{"change":4,"pos":400}],"flag":"BLOCK","start":1408,"end":1617,"inode":{"change":4,"pos":441}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":114},"to":{"change":4,"start":3553,"end":3628},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":3121},"to":{"change":4,"start":323,"end":400},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":3628},"to":{"change":4,"start":323,"end":400},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":323},"to":{"change":4,"start":323,"end":400},"introduced_by":4}],"inode":{"change":4,"pos":441}},"ins_contents":[{"Add":{"text":" auto productsFile = narMembers.find(outputS + \"/nix-support/hydra-build-products\");","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1499"}},{"Add":{"text":" if (productsFile == narMembers.end() ||","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1547"}},{"Add":{"text":" productsFile->second.type != FSAccessor::Type::tRegular)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1616"}}],"del_contents":[{"Del":{"text":" Path productsFile = outputS + \"/nix-support/hydra-build-products\";","pos":"EBJP3MNAC4CRYGMJJHMKUYWTXP3N4WMMORRLDSDHQVF5ZLOTIENQC:3627"}},{"Del":{"text":" if (accessor->stat(productsFile).type != FSAccessor::Type::tRegular)","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:399"}}]}},{"Edit":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":65,"atom":{"NewVertex":{"up_context":[{"change":4,"pos":422}],"down_context":[{"change":4,"pos":523}],"flag":"BLOCK","start":1618,"end":1665,"inode":{"change":4,"pos":441}}},"contents":[{"Add":{"text":" assert(productsFile->second.contents);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1664"}}]}},{"Replacement":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":69,"ins":{"up_context":[{"change":4,"pos":1339}],"down_context":[{"change":4,"pos":640}],"flag":"BLOCK","start":1666,"end":1765,"inode":{"change":4,"pos":441}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":1339},"to":{"change":4,"start":423,"end":517},"introduced_by":4}],"inode":{"change":4,"pos":441}},"ins_contents":[{"Add":{"text":" for (auto & line : tokenizeString(productsFile->second.contents.value(), \"\\n\")) {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1764"}}],"del_contents":[{"Del":{"text":" for (auto & line : tokenizeString(accessor->readFile(productsFile), \"\\n\")) {","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:516"}}]}},{"Replacement":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":89,"ins":{"up_context":[{"change":4,"pos":2528}],"down_context":[{"change":4,"pos":2628}],"flag":"BLOCK","start":1766,"end":1873,"inode":{"change":4,"pos":441}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":2528},"to":{"change":4,"start":760,"end":877},"introduced_by":4}],"inode":{"change":4,"pos":441}},"ins_contents":[{"Add":{"text":" auto file = narMembers.find(product.path);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1820"}},{"Add":{"text":" if (file == narMembers.end()) continue;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1872"}}],"del_contents":[{"Del":{"text":" auto st = accessor->stat(product.path);","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:811"}},{"Del":{"text":" if (st.type == FSAccessor::Type::tMissing) continue;","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:876"}}]}},{"Replacement":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":94,"ins":{"up_context":[{"change":4,"pos":2877}],"down_context":[{"change":4,"pos":2916}],"flag":"BLOCK","start":1874,"end":1941,"inode":{"change":4,"pos":441}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":2877},"to":{"change":4,"start":878,"end":935},"introduced_by":4}],"inode":{"change":4,"pos":441}},"ins_contents":[{"Add":{"text":" if (file->second.type == FSAccessor::Type::tRegular) {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:1940"}}],"del_contents":[{"Del":{"text":" if (st.type == FSAccessor::Type::tRegular) {","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:934"}}]}},{"Replacement":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":96,"ins":{"up_context":[{"change":4,"pos":2958}],"down_context":[{"change":4,"pos":3143}],"flag":"BLOCK","start":1942,"end":2074,"inode":{"change":4,"pos":441}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":2958},"to":{"change":4,"start":936,"end":1050},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":1115},"to":{"change":4,"start":1115,"end":1184},"introduced_by":4}],"inode":{"change":4,"pos":441}},"ins_contents":[{"Add":{"text":" product.fileSize = file->second.fileSize.value();","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2007"}},{"Add":{"text":" product.sha256hash = file->second.sha256.value();","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2073"}}],"del_contents":[{"Del":{"text":" product.fileSize = st.fileSize;","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:983"}},{"Del":{"text":" auto contents = accessor->readFile(product.path);","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1049"}},{"Del":{"text":" product.sha256hash = hashString(htSHA256, contents);","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1183"}}]}},{"Replacement":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":114,"ins":{"up_context":[{"change":4,"pos":3665}],"down_context":[{"change":4,"pos":3865}],"flag":"BLOCK","start":2075,"end":2243,"inode":{"change":4,"pos":441}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":3665},"to":{"change":4,"start":1185,"end":1292},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":1292},"to":{"change":4,"start":3862,"end":3935},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":3428},"to":{"change":4,"start":1375,"end":1432},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":3935},"to":{"change":4,"start":1375,"end":1432},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":1375},"to":{"change":4,"start":1375,"end":1432},"introduced_by":4}],"inode":{"change":4,"pos":441}},"ins_contents":[{"Add":{"text":" auto file = narMembers.find(product.path);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2129"}},{"Add":{"text":" assert(file != narMembers.end());","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2175"}},{"Add":{"text":" if (file->second.type == FSAccessor::Type::tDirectory)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2242"}}],"del_contents":[{"Del":{"text":" auto st = accessor->stat(product.path);","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1236"}},{"Del":{"text":" if (st.type == FSAccessor::Type::tMissing)","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1291"}},{"Del":{"text":" throw Error(\"getting status of ‘%s’\", product.path);","pos":"EBJP3MNAC4CRYGMJJHMKUYWTXP3N4WMMORRLDSDHQVF5ZLOTIENQC:3934"}},{"Del":{"text":" if (st.type == FSAccessor::Type::tDirectory)","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1431"}}]}},{"Replacement":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":123,"ins":{"up_context":[{"change":4,"pos":4043}],"down_context":[{"change":4,"pos":4222}],"flag":"BLOCK","start":2244,"end":2534,"inode":{"change":4,"pos":441}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":4043},"to":{"change":4,"start":3936,"end":4020},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":3513},"to":{"change":4,"start":1433,"end":1509},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":4020},"to":{"change":4,"start":1433,"end":1509},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":4104},"to":{"change":4,"start":1433,"end":1509},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":1509},"to":{"change":4,"start":1103,"end":1117},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":4142},"to":{"change":4,"start":1103,"end":1117},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":1117},"to":{"change":4,"start":1510,"end":1569},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":1569},"to":{"change":4,"start":1166,"end":1208},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":1166},"to":{"change":4,"start":1166,"end":1208},"introduced_by":4}],"inode":{"change":4,"pos":441}},"ins_contents":[{"Add":{"text":" auto file = narMembers.find(store->printStorePath(output) + \"/nix-support/hydra-release-name\");","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2347"}},{"Add":{"text":" if (file == narMembers.end() ||","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2387"}},{"Add":{"text":" file->second.type != FSAccessor::Type::tRegular)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2448"}},{"Add":{"text":" continue;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2470"}},{"Add":{"text":" res.releaseName = trim(file->second.contents.value());","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2533"}}],"del_contents":[{"Del":{"text":" auto p = store->printStorePath(output) + \"/nix-support/hydra-release-name\";","pos":"EBJP3MNAC4CRYGMJJHMKUYWTXP3N4WMMORRLDSDHQVF5ZLOTIENQC:4019"}},{"Del":{"text":" if (accessor->stat(p).type != FSAccessor::Type::tRegular) continue;","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1508"}},{"Del":{"text":" try {","pos":"YHP5DSOOKAXAYHUDMYO6EKX2YAN7DLDQPJX5K52TCP7EXQVP6JAAC:1116"}},{"Del":{"text":" res.releaseName = trim(accessor->readFile(p));","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1568"}},{"Del":{"text":" } catch (Error & e) { continue; }","pos":"YHP5DSOOKAXAYHUDMYO6EKX2YAN7DLDQPJX5K52TCP7EXQVP6JAAC:1207"}}]}},{"Replacement":{"inode":{"change":4,"pos":441},"path":"src/hydra-queue-runner/build-result.cc","line":133,"ins":{"up_context":[{"change":4,"pos":664}],"down_context":[{"change":4,"pos":814}],"flag":"BLOCK","start":2535,"end":2848,"inode":{"change":4,"pos":441}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":664},"to":{"change":4,"start":4021,"end":4110},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":3603},"to":{"change":4,"start":1636,"end":1815},"introduced_by":4},{"previous":"","flag":"DELETED","from":{"change":4,"pos":4110},"to":{"change":4,"start":1636,"end":1815},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":1636},"to":{"change":4,"start":1636,"end":1815},"introduced_by":4}],"inode":{"change":4,"pos":441}},"ins_contents":[{"Add":{"text":" auto file = narMembers.find(store->printStorePath(output) + \"/nix-support/hydra-metrics\");","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2633"}},{"Add":{"text":" if (file == narMembers.end() ||","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2673"}},{"Add":{"text":" file->second.type != FSAccessor::Type::tRegular)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2734"}},{"Add":{"text":" continue;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2756"}},{"Add":{"text":" for (auto & line : tokenizeString(file->second.contents.value(), \"\\n\")) {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2847"}}],"del_contents":[{"Del":{"text":" auto metricsFile = store->printStorePath(output) + \"/nix-support/hydra-metrics\";","pos":"EBJP3MNAC4CRYGMJJHMKUYWTXP3N4WMMORRLDSDHQVF5ZLOTIENQC:4109"}},{"Del":{"text":" if (accessor->stat(metricsFile).type != FSAccessor::Type::tRegular) continue;","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1721"}},{"Del":{"text":" for (auto & line : tokenizeString(accessor->readFile(metricsFile), \"\\n\")) {","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1814"}}]}},{"Edit":{"inode":{"change":4,"pos":4329},"path":"src/hydra-queue-runner/build-result.hh","line":8,"atom":{"NewVertex":{"up_context":[{"change":4,"pos":1840}],"down_context":[{"change":4,"pos":4389}],"flag":"BLOCK","start":2849,"end":2877,"inode":{"change":4,"pos":4329}}},"contents":[{"Add":{"text":"#include \"nar-extractor.hh\"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2876"}}]}},{"Replacement":{"inode":{"change":4,"pos":4329},"path":"src/hydra-queue-runner/build-result.hh","line":42,"ins":{"up_context":[{"change":4,"pos":4741}],"down_context":[],"flag":"BLOCK","start":2878,"end":3005,"inode":{"change":4,"pos":4329}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":4741},"to":{"change":4,"start":1841,"end":1966},"introduced_by":4}],"inode":{"change":4,"pos":4329}},"ins_contents":[{"Add":{"text":"BuildOutput getBuildOutput(","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2905"}},{"Add":{"text":" nix::ref store,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2937"}},{"Add":{"text":" NarMemberDatas & narMembers,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:2970"}},{"Add":{"text":" const nix::Derivation & drv);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3004"}}],"del_contents":[{"Del":{"text":"BuildOutput getBuildOutput(nix::ref store,","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1895"}},{"Del":{"text":" nix::ref accessor, const nix::Derivation & drv);","pos":"BAFICF73XUYNAYT6T6X7GQIFHG6CLGPYYNFBMC6ON6SVPNOXO6RAC:1965"}}]}},{"Edit":{"inode":{"change":4,"pos":133},"path":"src/hydra-queue-runner/builder.cc","line":204,"atom":{"NewVertex":{"up_context":[{"change":4,"pos":4289}],"down_context":[{"change":4,"pos":4289}],"flag":"BLOCK","start":3006,"end":3042,"inode":{"change":4,"pos":133}}},"contents":[{"Add":{"text":" NarMemberDatas narMembers;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3040"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3041"}}]}},{"Replacement":{"inode":{"change":4,"pos":133},"path":"src/hydra-queue-runner/builder.cc","line":208,"ins":{"up_context":[{"change":4,"pos":4376}],"down_context":[{"change":4,"pos":4474}],"flag":"BLOCK","start":3043,"end":3176,"inode":{"change":4,"pos":133}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":4376},"to":{"change":4,"start":591,"end":712},"introduced_by":4}],"inode":{"change":4,"pos":133}},"ins_contents":[{"Add":{"text":" buildRemote(destStore, machine, step, maxSilentTime, buildTimeout, repeats, result, activeStep, updateStep, narMembers);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3175"}}],"del_contents":[{"Del":{"text":" buildRemote(destStore, machine, step, maxSilentTime, buildTimeout, repeats, result, activeStep, updateStep);","pos":"G7KWXSFMFPFSCJ7ZD4Z6RNZSDHMHTOUDO3G6R6GYO6VDUDPMIKDQC:711"}}]}},{"Replacement":{"inode":{"change":4,"pos":133},"path":"src/hydra-queue-runner/builder.cc","line":223,"ins":{"up_context":[{"change":4,"pos":801}],"down_context":[{"change":4,"pos":802}],"flag":"BLOCK","start":3177,"end":3246,"inode":{"change":4,"pos":133}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":801},"to":{"change":4,"start":4580,"end":4671},"introduced_by":4}],"inode":{"change":4,"pos":133}},"ins_contents":[{"Add":{"text":" res = getBuildOutput(destStore, narMembers, *step->drv);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3245"}}],"del_contents":[{"Del":{"text":" res = getBuildOutput(destStore, ref(result.accessor), *step->drv);","pos":"WV4SSAIYM4SVBQ2VISDTAXQJCPKRGTLSVFH44CQFEMC4COWG5OKQC:4670"}}]}},{"Edit":{"inode":{"change":4,"pos":133},"path":"src/hydra-queue-runner/builder.cc","line":225,"atom":{"EdgeMap":{"edges":[{"previous":"","flag":"DELETED","from":{"change":4,"pos":812},"to":{"change":4,"start":669,"end":699},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":441},"to":{"change":4,"start":669,"end":699},"introduced_by":4}],"inode":{"change":4,"pos":133}}},"contents":[{"Del":{"text":"","pos":"YNO7CQ6P56YQP7UMGQFL4AZED7DBXE32U7TI6OMOKT6GMWZDMWWQC:669"}},{"Del":{"text":" result.accessor = 0;","pos":"YNO7CQ6P56YQP7UMGQFL4AZED7DBXE32U7TI6OMOKT6GMWZDMWWQC:698"}}]}},{"FileAdd":{"meta":{"basename":"nar-extractor.cc","metadata":0},"context":[{"change":4,"pos":187}],"contents":[{"Add":{"text":"#include \"nar-extractor.hh\"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3276"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3277"}},{"Add":{"text":"#include \"archive.hh\"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3299"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3300"}},{"Add":{"text":"#include ","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3325"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3326"}},{"Add":{"text":"using namespace nix;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3347"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3348"}},{"Add":{"text":"struct Extractor : ParseSink","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3377"}},{"Add":{"text":"{","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3379"}},{"Add":{"text":" std::unordered_set filesToKeep {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3422"}},{"Add":{"text":" \"/nix-support/hydra-build-products\",","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3467"}},{"Add":{"text":" \"/nix-support/hydra-release-name\",","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3510"}},{"Add":{"text":" \"/nix-support/hydra-metrics\",","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3548"}},{"Add":{"text":" };","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3555"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3556"}},{"Add":{"text":" NarMemberDatas & members;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3586"}},{"Add":{"text":" NarMemberData * curMember = nullptr;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3627"}},{"Add":{"text":" Path prefix;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3644"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3645"}},{"Add":{"text":" Extractor(NarMemberDatas & members, const Path & prefix)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3706"}},{"Add":{"text":" : members(members), prefix(prefix)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3749"}},{"Add":{"text":" { }","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3757"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3758"}},{"Add":{"text":" void createDirectory(const Path & path) override","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3811"}},{"Add":{"text":" {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3817"}},{"Add":{"text":" members.insert_or_assign(prefix + path, NarMemberData { .type = FSAccessor::Type::tDirectory });","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3922"}},{"Add":{"text":" }","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3928"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3929"}},{"Add":{"text":" void createRegularFile(const Path & path) override","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3984"}},{"Add":{"text":" {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:3990"}},{"Add":{"text":" curMember = &members.insert_or_assign(prefix + path, NarMemberData {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4067"}},{"Add":{"text":" .type = FSAccessor::Type::tRegular,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4115"}},{"Add":{"text":" .fileSize = 0,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4142"}},{"Add":{"text":" .contents = filesToKeep.count(path) ? std::optional(\"\") : std::nullopt,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4226"}},{"Add":{"text":" }).first->second;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4252"}},{"Add":{"text":" }","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4258"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4259"}},{"Add":{"text":" std::optional expectedSize;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4311"}},{"Add":{"text":" std::unique_ptr hashSink;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4351"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4352"}},{"Add":{"text":" void preallocateContents(unsigned long long size) override","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4415"}},{"Add":{"text":" {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4421"}},{"Add":{"text":" expectedSize = size;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4450"}},{"Add":{"text":" hashSink = std::make_unique(htSHA256);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4507"}},{"Add":{"text":" }","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4513"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4514"}},{"Add":{"text":" void receiveContents(unsigned char * data, unsigned int len) override","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4588"}},{"Add":{"text":" {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4594"}},{"Add":{"text":" assert(expectedSize);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4624"}},{"Add":{"text":" assert(curMember);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4651"}},{"Add":{"text":" assert(hashSink);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4677"}},{"Add":{"text":" *curMember->fileSize += len;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4714"}},{"Add":{"text":" (*hashSink)(data, len);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4746"}},{"Add":{"text":" if (curMember->contents) {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4781"}},{"Add":{"text":" curMember->contents->append((char *) data, len);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4842"}},{"Add":{"text":" }","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4852"}},{"Add":{"text":" assert(curMember->fileSize <= expectedSize);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4905"}},{"Add":{"text":" if (curMember->fileSize == expectedSize) {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:4956"}},{"Add":{"text":" auto [hash, len] = hashSink->finish();","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5007"}},{"Add":{"text":" assert(curMember->fileSize == len);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5055"}},{"Add":{"text":" curMember->sha256 = hash;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5093"}},{"Add":{"text":" hashSink.reset();","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5123"}},{"Add":{"text":" }","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5133"}},{"Add":{"text":" }","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5139"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5140"}},{"Add":{"text":" void createSymlink(const Path & path, const string & target) override","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5214"}},{"Add":{"text":" {","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5220"}},{"Add":{"text":" members.insert_or_assign(prefix + path, NarMemberData { .type = FSAccessor::Type::tSymlink });","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5323"}},{"Add":{"text":" }","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5329"}},{"Add":{"text":"};","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5332"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5333"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5334"}},{"Add":{"text":"void extractNarData(","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5355"}},{"Add":{"text":" Source & source,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5376"}},{"Add":{"text":" const Path & prefix,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5401"}},{"Add":{"text":" NarMemberDatas & members)","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5431"}},{"Add":{"text":"{","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5433"}},{"Add":{"text":" Extractor extractor(members, prefix);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5475"}},{"Add":{"text":" parseDump(extractor, source);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5509"}},{"Add":{"text":" // Note: this point may not be reached if we're in a coroutine.","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5577"}},{"Add":{"text":"}","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5579"}}]}},{"FileAdd":{"meta":{"basename":"nar-extractor.hh","metadata":0},"context":[{"change":4,"pos":187}],"contents":[{"Add":{"text":"#pragma once","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5636"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5637"}},{"Add":{"text":"#include \"fs-accessor.hh\"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5663"}},{"Add":{"text":"#include \"types.hh\"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5683"}},{"Add":{"text":"#include \"serialise.hh\"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5707"}},{"Add":{"text":"#include \"hash.hh\"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5726"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5727"}},{"Add":{"text":"struct NarMemberData","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5748"}},{"Add":{"text":"{","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5750"}},{"Add":{"text":" nix::FSAccessor::Type type;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5782"}},{"Add":{"text":" std::optional fileSize;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5830"}},{"Add":{"text":" std::optional contents;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5871"}},{"Add":{"text":" std::optional sha256;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5908"}},{"Add":{"text":"};","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5911"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5912"}},{"Add":{"text":"typedef std::map NarMemberDatas;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5971"}},{"Add":{"text":"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:5972"}},{"Add":{"text":"/* Read a NAR from a source and get to some info about every file","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6038"}},{"Add":{"text":" inside the NAR. */","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6060"}},{"Add":{"text":"void extractNarData(","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6081"}},{"Add":{"text":" nix::Source & source,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6107"}},{"Add":{"text":" const nix::Path & prefix,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6137"}},{"Add":{"text":" NarMemberDatas & members);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6168"}}]}},{"Replacement":{"inode":{"change":4,"pos":20067},"path":"src/hydra-queue-runner/queue-monitor.cc","line":675,"ins":{"up_context":[{"change":4,"pos":2684}],"down_context":[{"change":4,"pos":1123}],"flag":"BLOCK","start":6211,"end":6297,"inode":{"change":4,"pos":20067}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":2684},"to":{"change":4,"start":2684,"end":2755},"introduced_by":4}],"inode":{"change":4,"pos":20067}},"ins_contents":[{"Add":{"text":" NarMemberDatas narMembers;","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6241"}},{"Add":{"text":" return getBuildOutput(destStore, narMembers, drv);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6296"}}],"del_contents":[{"Del":{"text":" return getBuildOutput(destStore, destStore->getFSAccessor(), drv);","pos":"WDGARQ76X6RLSFPJTW52BZYFKBC7DPSTABI7HHIKNYHBYXSUNTHQC:2754"}}]}},{"Edit":{"inode":{"change":37,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":17,"atom":{"NewVertex":{"up_context":[{"change":38,"pos":1567}],"down_context":[{"change":37,"pos":1461}],"flag":"BLOCK","start":6298,"end":6326,"inode":{"change":37,"pos":1128}}},"contents":[{"Add":{"text":"#include \"nar-extractor.hh\"","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6325"}}]}},{"Edit":{"inode":{"change":37,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":68,"atom":{"EdgeMap":{"edges":[{"previous":"","flag":"DELETED","from":{"change":4,"pos":780},"to":{"change":4,"start":442,"end":489},"introduced_by":4},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":1810},"to":{"change":4,"start":442,"end":489},"introduced_by":4}],"inode":{"change":37,"pos":1128}}},"contents":[{"Del":{"text":" std::shared_ptr accessor;","pos":"UVNTWTWGQOFKDAJ2ROJYT4U2N4EUXKNWZWPHOM42WPLUL4ALXRJQC:488"}}]}},{"Replacement":{"inode":{"change":37,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":521,"ins":{"up_context":[{"change":4,"pos":1809}],"down_context":[{"change":4,"pos":2016}],"flag":"BLOCK","start":6327,"end":6416,"inode":{"change":37,"pos":1128}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":4,"pos":1809},"to":{"change":4,"start":1809,"end":1861},"introduced_by":4}],"inode":{"change":37,"pos":1128}},"ins_contents":[{"Add":{"text":" std::function updateStep,","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6377"}},{"Add":{"text":" NarMemberDatas & narMembers);","pos":"N3G7LLGEYREJGGZFBFN4W3LPXQO4LPLTEATUFMUSNA3HXXH5KKKAC:6415"}}],"del_contents":[{"Del":{"text":" std::function updateStep);","pos":"G7KWXSFMFPFSCJ7ZD4Z6RNZSDHMHTOUDO3G6R6GYO6VDUDPMIKDQC:1860"}}]}}],"owner":"grahamc","repo":"hydra","token":"UJpZ7qOfHOJWlvVnHgkHkPNr+Dpojv7TmqDVEqZq9S4=","login":null}

…

Dependencies

Change contents

Review