{"header":{"message":"Add hydra.conf option \"nar_buffer_size\" to configure memoryTokens limit","description":"It defaults to half the physical RAM.","timestamp":"2017-03-03T11:37:27Z","authors":[{"email":"edolstra@gmail.com","name":"Eelco Dolstra"}]},"hash":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC","authors":[],"deps":{"hashes":[["NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC","Add hydra.conf option \"nar_buffer_size\" to configure memoryTokens limit"],["AA",null],["74WP3O3FMHZUATYGVH7ZFVS3MZPEAN7J4HQTMLSO2PSK5B3KWOYAC","max-output-size -> max_output_size"],["A4A5KO5QKTTTLOD3UKEJZZ6MIOA54G4FXCDOJG7D3W3AYLJSCOAAC","Add error/warnings for deprecated store specification"],["5CNQUQ77EWOYWMW6VXQCSDITIO55UEKBI6CBV72NR7DPUBFLMWDAC","Bump Nix"],["EPWEMRI23UN6C777AL2GWEOXYZRTPEPFC2SZVZ4JTWUGYVFDL5XAC","Allow determinism checking for entire jobsets"],["UUN5WH4DROFHVK7JXS2ICAR2WTZDNVDEVFAXKVO6RJ3D5OLKE5ZAC","Decrease memoryTokens"],["5AIYUMTBY6TFQTBRP3MJ2PYWUMRF57I77NIVWYE74UMEVQMBWZVQC","Basic remote building"],["ENXUSMSVOU3AZFMH2ZXR4ZVPV2LRRQYQJ6IFX33YN6IH2ORSNSAAC","Make concurrency more robust"],["SOB276BAWH23OUKJUXGDWCLDIM2OISD5NKF743NTQ3L572L4BS3QC","Keep some statistics for the binary cache stores"],["CNLNT3T4IXU42GAC64CU5CEDTDLM2SHSJZEVHTMOCWYFXSQNC76QC","Allow only 1 thread to send a closure to a given machine at the same time"],["SL3WSRACCX2IMJHHLTRAUQT7QDLCOKYLVO2FEHWIHXM5GPKSRJTQC","hydra-queue-runner: Limit memory usage"],["7VQ4ALFYKJBFR46T3WZDMGOXNRR3QNJEJQVBYJM4HSJUOOUD6WBQC","Update \"make check\" for the new queue runner"],["SJQC2I3NWRUIGLQGRZ2X6C2QGKLL5DLWFNOAJ6J774P2LOAOJP5QC","Bump memory limit a bit"],["BRAESISHTN4IIWUBVDMPDMY7QLMJDKX7GQ7K6NSJN66L5VPWSX3QC","Warn if PostgreSQL appears stalled"],["XCHAKH4D4JH7FZKX4BSOBRRC5O23MSCDHU3XCQLPLJS3LFKW5YQQC","hydra-queue-runner: Bump memory limit to reflect more accurate accounting"],["24BMQDZAWDQ7VNIA7TIROXSOYLOJBNZ2E4264WHWNJAEN6ZB3UOAC","Start of single-process hydra-queue-runner"],["RQUAATWBGEP3YT4F555XLJYRRRGHDTEILHFORES7AM2XAOVMVJSAC","Add status dump facility"],["OCZ4LSGGSCMSLGC3C32D5JUYYHS5CIPOKOAMADEFAFZOFXJ3YY3AC","Automatically retry aborted builds"],["B2L4T3X63XVYJQXEDU4WT5Y4R6PMDXGC6WN2KGOMHRQILSABNQOAC","Sync with Nix"],["HJOEIMLRDVQ2KZI5HGL2HKGBM3AHP7YIKGKDAGFUNKRUXVRB24NAC","Refactor"],["BG6PEOB2M2Y56QPVMELU7VNNCGNMSQ2K6ATBUCPJLKPLTDWNJQ5AC","Make the output size limit configurable"],["V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC","hydra-queue-runner: Get store mode configuration from hydra.conf"],["PDI5YPBYHMU4EQM3D45JEUYI4PBU5KGDIWK5O5YEOCM6R3IEAXUQC","Use store-api for binary cache instantiation"],["IKJBYIGY3JABFXD2KOAQNA52ULE6VR4PBFKHWAHHBITXX5KC76MAC","Update to reflect BinaryCacheStore changes"],["EOO4EFWD2BJCGF3ZKS2QR3XDW4WHUGH2EHSOFVK6GMI5BUBZW6QQC","Use a single BinaryCacheStore for all threads"],["RGCPOSHYTIIRIUSUZ7ABXJHHSAYRUVQXAAEGFKIWKKIGLJERFMSQC","hydra-queue-runner: Ensure regular status dumps"],["PQFOMNTLFY4HINJFAQYIFTBTSDRST6W2WNCVKE5ITR2IDF4SWWXQC","hydra-queue-runner: More stats"],["OG3Z3QGCG2FNDGF4VQYWOXLZCF7LGTZCUMGKUCBNAPAQ5FRFHQ2AC","Namespace cleanup"],["GJV2J5HXFKVF7BXNFMTI6ZZMYADXIKTFIQJ3FONJ7DPVCUJZ2L4AC","Pool local store connections"],["NJJ7H64SZOX5EGACDCQAUQ7R6UEWD5IIC35A2MWFOOJV55DJYPHAC","Very basic multi-threaded queue runner"],["PLOZBRTR6USSGJX7GR2RZKNPVYG2Q6QM7LW6IA35MKL63ZTQVD7QC","Add command ‘hydra-queue-runner --status’ to show current status"],["MHVIT4JYWUYD4UCGB2AHLXWLX6B5SYE22BREERNGANT7RGGDUFOAC","Split hydra-queue-runner.cc more"],["MB3TISH2KYBIGY6XJKMN4HO2S6TCN2GORJENMECCKLXGGIRS2O2AC","Rate-limit the number of threads copying closures at the same time"]],"deps":["74WP3O3FMHZUATYGVH7ZFVS3MZPEAN7J4HQTMLSO2PSK5B3KWOYAC","A4A5KO5QKTTTLOD3UKEJZZ6MIOA54G4FXCDOJG7D3W3AYLJSCOAAC","5CNQUQ77EWOYWMW6VXQCSDITIO55UEKBI6CBV72NR7DPUBFLMWDAC","EPWEMRI23UN6C777AL2GWEOXYZRTPEPFC2SZVZ4JTWUGYVFDL5XAC","UUN5WH4DROFHVK7JXS2ICAR2WTZDNVDEVFAXKVO6RJ3D5OLKE5ZAC"],"known":["24BMQDZAWDQ7VNIA7TIROXSOYLOJBNZ2E4264WHWNJAEN6ZB3UOAC","NJJ7H64SZOX5EGACDCQAUQ7R6UEWD5IIC35A2MWFOOJV55DJYPHAC","ENXUSMSVOU3AZFMH2ZXR4ZVPV2LRRQYQJ6IFX33YN6IH2ORSNSAAC","5AIYUMTBY6TFQTBRP3MJ2PYWUMRF57I77NIVWYE74UMEVQMBWZVQC","RQUAATWBGEP3YT4F555XLJYRRRGHDTEILHFORES7AM2XAOVMVJSAC","OCZ4LSGGSCMSLGC3C32D5JUYYHS5CIPOKOAMADEFAFZOFXJ3YY3AC","PQFOMNTLFY4HINJFAQYIFTBTSDRST6W2WNCVKE5ITR2IDF4SWWXQC","PLOZBRTR6USSGJX7GR2RZKNPVYG2Q6QM7LW6IA35MKL63ZTQVD7QC","7VQ4ALFYKJBFR46T3WZDMGOXNRR3QNJEJQVBYJM4HSJUOOUD6WBQC","HJOEIMLRDVQ2KZI5HGL2HKGBM3AHP7YIKGKDAGFUNKRUXVRB24NAC","OG3Z3QGCG2FNDGF4VQYWOXLZCF7LGTZCUMGKUCBNAPAQ5FRFHQ2AC","CNLNT3T4IXU42GAC64CU5CEDTDLM2SHSJZEVHTMOCWYFXSQNC76QC","EOO4EFWD2BJCGF3ZKS2QR3XDW4WHUGH2EHSOFVK6GMI5BUBZW6QQC","SOB276BAWH23OUKJUXGDWCLDIM2OISD5NKF743NTQ3L572L4BS3QC","GJV2J5HXFKVF7BXNFMTI6ZZMYADXIKTFIQJ3FONJ7DPVCUJZ2L4AC","V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC","B2L4T3X63XVYJQXEDU4WT5Y4R6PMDXGC6WN2KGOMHRQILSABNQOAC","BRAESISHTN4IIWUBVDMPDMY7QLMJDKX7GQ7K6NSJN66L5VPWSX3QC","SL3WSRACCX2IMJHHLTRAUQT7QDLCOKYLVO2FEHWIHXM5GPKSRJTQC","BG6PEOB2M2Y56QPVMELU7VNNCGNMSQ2K6ATBUCPJLKPLTDWNJQ5AC","RGCPOSHYTIIRIUSUZ7ABXJHHSAYRUVQXAAEGFKIWKKIGLJERFMSQC","SJQC2I3NWRUIGLQGRZ2X6C2QGKLL5DLWFNOAJ6J774P2LOAOJP5QC","PDI5YPBYHMU4EQM3D45JEUYI4PBU5KGDIWK5O5YEOCM6R3IEAXUQC","IKJBYIGY3JABFXD2KOAQNA52ULE6VR4PBFKHWAHHBITXX5KC76MAC","XCHAKH4D4JH7FZKX4BSOBRRC5O23MSCDHU3XCQLPLJS3LFKW5YQQC"]},"hunks":[{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":20,"ins":{"up_context":[{"change":7,"pos":22}],"down_context":[{"change":7,"pos":7501}],"flag":"BLOCK","start":0,"end":14,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":7486},"to":{"change":7,"start":7486,"end":7501},"introduced_by":7},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":7501},"to":{"change":6,"start":0,"end":65},"introduced_by":6}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":"struct Config","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:13"}}],"del_contents":[{"Del":{"text":"State::State()","pos":"24BMQDZAWDQ7VNIA7TIROXSOYLOJBNZ2E4264WHWNJAEN6ZB3UOAC:7500"}},{"Del":{"text":" : memoryTokens(12ULL << 30) // FIXME: make this configurable","pos":"UUN5WH4DROFHVK7JXS2ICAR2WTZDNVDEVFAXKVO6RJ3D5OLKE5ZAC:64"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":22,"ins":{"up_context":[{"change":7,"pos":7503}],"down_context":[{"change":7,"pos":0}],"flag":"BLOCK","start":15,"end":63,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"","flag":"DELETED","from":{"change":7,"pos":115},"to":{"change":7,"start":7737,"end":7840},"introduced_by":7},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":7503},"to":{"change":7,"start":7737,"end":7840},"introduced_by":7}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" std::map options;","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:62"}}],"del_contents":[{"Del":{"text":" hydraData = getEnv(\"HYDRA_DATA\");","pos":"5AIYUMTBY6TFQTBRP3MJ2PYWUMRF57I77NIVWYE74UMEVQMBWZVQC:7774"}},{"Del":{"text":" if (hydraData == \"\") throw Error(\"$HYDRA_DATA must be set\");","pos":"5AIYUMTBY6TFQTBRP3MJ2PYWUMRF57I77NIVWYE74UMEVQMBWZVQC:7839"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":24,"ins":{"up_context":[{"change":7,"pos":1}],"down_context":[{"change":7,"pos":118}],"flag":"BLOCK","start":64,"end":212,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":1},"to":{"change":7,"start":1,"end":118},"introduced_by":7}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" Config()","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:76"}},{"Add":{"text":" {","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:82"}},{"Add":{"text":" /* Read hydra.conf. */","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:113"}},{"Add":{"text":" auto hydraConfigFile = getEnv(\"HYDRA_CONFIG\");","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:168"}},{"Add":{"text":" if (pathExists(hydraConfigFile)) {","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:211"}}],"del_contents":[{"Del":{"text":" /* Read hydra.conf. */","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:27"}},{"Del":{"text":" auto hydraConfigFile = getEnv(\"HYDRA_CONFIG\");","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:78"}},{"Del":{"text":" if (pathExists(hydraConfigFile)) {","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:117"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":30,"ins":{"up_context":[{"change":7,"pos":119}],"down_context":[{"change":7,"pos":262}],"flag":"BLOCK","start":213,"end":364,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":119},"to":{"change":7,"start":119,"end":262},"introduced_by":7}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" for (auto line : tokenizeString(readFile(hydraConfigFile), \"\\n\")) {","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:301"}},{"Add":{"text":" line = trim(string(line, 0, line.find('#')));","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:363"}}],"del_contents":[{"Del":{"text":" for (auto line : tokenizeString(readFile(hydraConfigFile), \"\\n\")) {","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:203"}},{"Del":{"text":" line = trim(string(line, 0, line.find('#')));","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:261"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":33,"ins":{"up_context":[{"change":7,"pos":263}],"down_context":[{"change":7,"pos":352}],"flag":"BLOCK","start":365,"end":462,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":263},"to":{"change":7,"start":263,"end":352},"introduced_by":7}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" auto eq = line.find('=');","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:406"}},{"Add":{"text":" if (eq == std::string::npos) continue;","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:461"}}],"del_contents":[{"Del":{"text":" auto eq = line.find('=');","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:300"}},{"Del":{"text":" if (eq == std::string::npos) continue;","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:351"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":36,"ins":{"up_context":[{"change":7,"pos":353}],"down_context":[{"change":7,"pos":466}],"flag":"BLOCK","start":463,"end":584,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":353},"to":{"change":7,"start":353,"end":466},"introduced_by":7}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" auto key = trim(std::string(line, 0, eq));","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:521"}},{"Add":{"text":" auto value = trim(std::string(line, eq + 1));","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:583"}}],"del_contents":[{"Del":{"text":" auto key = trim(std::string(line, 0, eq));","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:407"}},{"Del":{"text":" auto value = trim(std::string(line, eq + 1));","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:465"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":39,"ins":{"up_context":[{"change":7,"pos":467}],"down_context":[{"change":7,"pos":7840}],"flag":"BLOCK","start":585,"end":626,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":467},"to":{"change":7,"start":467,"end":504},"introduced_by":7}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" if (key == \"\") continue;","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:625"}}],"del_contents":[{"Del":{"text":" if (key == \"\") continue;","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:503"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":41,"ins":{"up_context":[{"change":7,"pos":7841}],"down_context":[{"change":7,"pos":543}],"flag":"BLOCK","start":627,"end":679,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":7841},"to":{"change":7,"start":505,"end":543},"introduced_by":7}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" options[key] = value;","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:664"}},{"Add":{"text":" }","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:678"}}],"del_contents":[{"Del":{"text":" hydraConfig[key] = value;","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:542"}}]}},{"Edit":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":46,"atom":{"NewVertex":{"up_context":[{"change":7,"pos":560}],"down_context":[{"change":7,"pos":3819}],"flag":"BLOCK","start":680,"end":764,"inode":{"change":7,"pos":4840}}},"contents":[{"Add":{"text":" std::string getStrOption(const std::string & key, const std::string & def = \"\")","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:763"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":48,"ins":{"up_context":[{"change":7,"pos":3825}],"down_context":[{"change":7,"pos":3932}],"flag":"BLOCK","start":765,"end":1214,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":3825},"to":{"change":2,"start":0,"end":56},"introduced_by":2},{"previous":"","flag":"DELETED","from":{"change":2,"pos":56},"to":{"change":7,"start":3881,"end":3932},"introduced_by":2},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":3881},"to":{"change":7,"start":3881,"end":3932},"introduced_by":7}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" auto i = options.find(key);","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:800"}},{"Add":{"text":" return i == options.end() ? def : i->second;","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:853"}},{"Add":{"text":" }","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:859"}},{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:860"}},{"Add":{"text":" uint64_t getIntOption(const std::string & key, uint64_t def = 0)","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:929"}},{"Add":{"text":" {","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:935"}},{"Add":{"text":" auto i = options.find(key);","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:971"}},{"Add":{"text":" return i == options.end() ? def : std::stoi(i->second);","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1035"}},{"Add":{"text":" }","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1041"}},{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1042"}},{"Add":{"text":" bool getBoolOption(const std::string & key, bool def = false)","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1108"}},{"Add":{"text":" {","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1114"}},{"Add":{"text":" auto i = options.find(key);","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1150"}},{"Add":{"text":" return i == options.end() ? def : i->second == \"true\";","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1213"}}],"del_contents":[{"Del":{"text":" std::string s = hydraConfig[\"max_output_size\"];","pos":"74WP3O3FMHZUATYGVH7ZFVS3MZPEAN7J4HQTMLSO2PSK5B3KWOYAC:55"}},{"Del":{"text":" if (s != \"\") string2Int(s, maxOutputSize);","pos":"BG6PEOB2M2Y56QPVMELU7VNNCGNMSQ2K6ATBUCPJLKPLTDWNJQ5AC:3931"}}]}},{"Edit":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":63,"atom":{"NewVertex":{"up_context":[{"change":7,"pos":3938}],"down_context":[{"change":7,"pos":3938}],"flag":"BLOCK","start":1215,"end":1755,"inode":{"change":7,"pos":4840}}},"contents":[{"Add":{"text":"};","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1217"}},{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1218"}},{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1219"}},{"Add":{"text":"static uint64_t getMemSize()","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1248"}},{"Add":{"text":"{","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1250"}},{"Add":{"text":" auto pages = sysconf(_SC_PHYS_PAGES);","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1292"}},{"Add":{"text":" return pages >= 0 ? pages * sysconf(_SC_PAGESIZE) : 4ULL << 30;","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1360"}},{"Add":{"text":"}","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1362"}},{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1363"}},{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1364"}},{"Add":{"text":"State::State()","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1379"}},{"Add":{"text":" : config(std::make_unique())","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1420"}},{"Add":{"text":" , memoryTokens(config->getIntOption(\"nar_buffer_size\", getMemSize() / 2))","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1498"}},{"Add":{"text":" , maxOutputSize(config->getIntOption(\"max_output_size\", 2ULL << 30))","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1571"}},{"Add":{"text":"{","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1573"}},{"Add":{"text":" printInfo(\"using %d bytes for the NAR buffer\", memoryTokens.capacity());","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1650"}},{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1651"}},{"Add":{"text":" hydraData = getEnv(\"HYDRA_DATA\");","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1689"}},{"Add":{"text":" if (hydraData == \"\") throw Error(\"$HYDRA_DATA must be set\");","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1754"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":86,"ins":{"up_context":[{"change":3,"pos":49}],"down_context":[{"change":3,"pos":90}],"flag":"BLOCK","start":1756,"end":1806,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":3,"pos":49},"to":{"change":3,"start":49,"end":90},"introduced_by":3}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" if (config->getStrOption(\"store_mode\") != \"\")","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1805"}}],"del_contents":[{"Del":{"text":" if (hydraConfig[\"store_mode\"] != \"\")","pos":"A4A5KO5QKTTTLOD3UKEJZZ6MIOA54G4FXCDOJG7D3W3AYLJSCOAAC:89"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":88,"ins":{"up_context":[{"change":3,"pos":175}],"down_context":[{"change":3,"pos":222}],"flag":"BLOCK","start":1807,"end":1863,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":3,"pos":175},"to":{"change":3,"start":175,"end":222},"introduced_by":3}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" if (config->getStrOption(\"binary_cache_dir\") != \"\")","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1862"}}],"del_contents":[{"Del":{"text":" if (hydraConfig[\"binary_cache_dir\"] != \"\")","pos":"A4A5KO5QKTTTLOD3UKEJZZ6MIOA54G4FXCDOJG7D3W3AYLJSCOAAC:221"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":90,"ins":{"up_context":[{"change":3,"pos":339}],"down_context":[{"change":3,"pos":392}],"flag":"BLOCK","start":1864,"end":1926,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":3,"pos":339},"to":{"change":3,"start":339,"end":392},"introduced_by":3}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" if (config->getStrOption(\"binary_cache_s3_bucket\") != \"\")","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1925"}}],"del_contents":[{"Del":{"text":" if (hydraConfig[\"binary_cache_s3_bucket\"] != \"\")","pos":"A4A5KO5QKTTTLOD3UKEJZZ6MIOA54G4FXCDOJG7D3W3AYLJSCOAAC:391"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":92,"ins":{"up_context":[{"change":3,"pos":513}],"down_context":[{"change":3,"pos":572}],"flag":"BLOCK","start":1927,"end":1995,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":3,"pos":513},"to":{"change":3,"start":513,"end":572},"introduced_by":3}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" if (config->getStrOption(\"binary_cache_secret_key_file\") != \"\")","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:1994"}}],"del_contents":[{"Del":{"text":" if (hydraConfig[\"binary_cache_secret_key_file\"] != \"\")","pos":"A4A5KO5QKTTTLOD3UKEJZZ6MIOA54G4FXCDOJG7D3W3AYLJSCOAAC:571"}}]}},{"Edit":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":835,"atom":{"EdgeMap":{"edges":[{"previous":"","flag":"DELETED","from":{"change":7,"pos":264},"to":{"change":7,"start":4619,"end":4620},"introduced_by":7},{"previous":"","flag":"DELETED","from":{"change":7,"pos":609},"to":{"change":7,"start":4619,"end":4620},"introduced_by":7},{"previous":"","flag":"DELETED","from":{"change":7,"pos":859},"to":{"change":7,"start":4619,"end":4620},"introduced_by":7},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":4619},"to":{"change":7,"start":4619,"end":4620},"introduced_by":7},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":4620},"to":{"change":4,"start":293,"end":409},"introduced_by":4}],"inode":{"change":7,"pos":4840}}},"contents":[{"Del":{"text":"","pos":"SOB276BAWH23OUKJUXGDWCLDIM2OISD5NKF743NTQ3L572L4BS3QC:4619"}},{"Del":{"text":" _destStore = hydraConfig[\"store_uri\"] == \"\"","pos":"5CNQUQ77EWOYWMW6VXQCSDITIO55UEKBI6CBV72NR7DPUBFLMWDAC:340"}},{"Del":{"text":" ? localStore","pos":"5CNQUQ77EWOYWMW6VXQCSDITIO55UEKBI6CBV72NR7DPUBFLMWDAC:361"}},{"Del":{"text":" : openStore(hydraConfig[\"store_uri\"]);","pos":"5CNQUQ77EWOYWMW6VXQCSDITIO55UEKBI6CBV72NR7DPUBFLMWDAC:408"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":836,"ins":{"up_context":[{"change":7,"pos":300}],"down_context":[{"change":7,"pos":393}],"flag":"BLOCK","start":1996,"end":2119,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":300},"to":{"change":7,"start":300,"end":393},"introduced_by":7}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" auto storeUri = config->getStrOption(\"store_uri\");","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2050"}},{"Add":{"text":" _destStore = storeUri == \"\" ? localStore : openStore(storeUri);","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2118"}}],"del_contents":[{"Del":{"text":" auto isTrue = [](const std::string & s) {","pos":"IKJBYIGY3JABFXD2KOAQNA52ULE6VR4PBFKHWAHHBITXX5KC76MAC:345"}},{"Del":{"text":" return s == \"1\" || s == \"true\";","pos":"IKJBYIGY3JABFXD2KOAQNA52ULE6VR4PBFKHWAHHBITXX5KC76MAC:385"}},{"Del":{"text":" };","pos":"IKJBYIGY3JABFXD2KOAQNA52ULE6VR4PBFKHWAHHBITXX5KC76MAC:392"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":839,"ins":{"up_context":[{"change":7,"pos":394}],"down_context":[{"change":7,"pos":1249}],"flag":"BLOCK","start":2120,"end":2190,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":394},"to":{"change":7,"start":394,"end":455},"introduced_by":7}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" useSubstitutes = config->getBoolOption(\"use-substitutes\", false);","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2189"}}],"del_contents":[{"Del":{"text":" useSubstitutes = isTrue(hydraConfig[\"use-substitutes\"]);","pos":"IKJBYIGY3JABFXD2KOAQNA52ULE6VR4PBFKHWAHHBITXX5KC76MAC:454"}}]}},{"Replacement":{"inode":{"change":7,"pos":4840},"path":"src/hydra-queue-runner/hydra-queue-runner.cc","line":842,"ins":{"up_context":[{"change":5,"pos":2091}],"down_context":[{"change":5,"pos":2173}],"flag":"BLOCK","start":2191,"end":2282,"inode":{"change":7,"pos":4840}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":2091},"to":{"change":5,"start":2091,"end":2173},"introduced_by":5}],"inode":{"change":7,"pos":4840}},"ins_contents":[{"Add":{"text":" for (auto & s : tokenizeString(config->getStrOption(\"xxx-jobset-repeats\"))) {","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2281"}}],"del_contents":[{"Del":{"text":" for (auto & s : tokenizeString(hydraConfig[\"xxx-jobset-repeats\"])) {","pos":"EPWEMRI23UN6C777AL2GWEOXYZRTPEPFC2SZVZ4JTWUGYVFDL5XAC:2172"}}]}},{"Edit":{"inode":{"change":7,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":251,"atom":{"NewVertex":{"up_context":[{"change":7,"pos":4331}],"down_context":[{"change":7,"pos":4331}],"flag":"BLOCK","start":2283,"end":2284,"inode":{"change":7,"pos":1128}}},"contents":[{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2283"}}]}},{"Edit":{"inode":{"change":7,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":253,"atom":{"NewVertex":{"up_context":[{"change":7,"pos":4332}],"down_context":[{"change":7,"pos":4332}],"flag":"BLOCK","start":2285,"end":2299,"inode":{"change":7,"pos":1128}}},"contents":[{"Add":{"text":"class Config;","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2298"}}]}},{"Edit":{"inode":{"change":7,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":255,"atom":{"NewVertex":{"up_context":[{"change":7,"pos":4333}],"down_context":[{"change":7,"pos":4333}],"flag":"BLOCK","start":2300,"end":2301,"inode":{"change":7,"pos":1128}}},"contents":[{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2300"}}]}},{"Edit":{"inode":{"change":7,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":260,"atom":{"NewVertex":{"up_context":[{"change":33,"pos":33065}],"down_context":[{"change":33,"pos":33065}],"flag":"BLOCK","start":2302,"end":2339,"inode":{"change":7,"pos":1128}}},"contents":[{"Add":{"text":" std::unique_ptr config;","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2337"}},{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2338"}}]}},{"Edit":{"inode":{"change":7,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":270,"atom":{"EdgeMap":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":1818},"to":{"change":7,"start":1818,"end":1870},"introduced_by":7},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":1870},"to":{"change":7,"start":1915,"end":1916},"introduced_by":7}],"inode":{"change":7,"pos":1128}}},"contents":[{"Del":{"text":" std::map hydraConfig;","pos":"V2UCCYN3B6266BDKGSXQDRSW4HKY673GINM3VI3MORXZ7OYDJBXAC:1869"}},{"Del":{"text":"","pos":"IKJBYIGY3JABFXD2KOAQNA52ULE6VR4PBFKHWAHHBITXX5KC76MAC:1915"}}]}},{"Replacement":{"inode":{"change":7,"pos":1128},"path":"src/hydra-queue-runner/state.hh","line":413,"ins":{"up_context":[{"change":7,"pos":1503}],"down_context":[{"change":7,"pos":4352}],"flag":"BLOCK","start":2340,"end":2366,"inode":{"change":7,"pos":1128}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":7,"pos":1503},"to":{"change":7,"start":4313,"end":4352},"introduced_by":7}],"inode":{"change":7,"pos":1128}},"ins_contents":[{"Add":{"text":" size_t maxOutputSize;","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2365"}}],"del_contents":[{"Del":{"text":" size_t maxOutputSize = 2ULL << 30;","pos":"BG6PEOB2M2Y56QPVMELU7VNNCGNMSQ2K6ATBUCPJLKPLTDWNJQ5AC:4351"}}]}},{"Edit":{"inode":{"change":34,"pos":1640},"path":"src/hydra-queue-runner/token-server.hh","line":102,"atom":{"NewVertex":{"up_context":[{"change":34,"pos":3312}],"down_context":[{"change":34,"pos":3312}],"flag":"BLOCK","start":2367,"end":2428,"inode":{"change":34,"pos":1640}}},"contents":[{"Add":{"text":"","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2367"}},{"Add":{"text":" size_t capacity()","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2389"}},{"Add":{"text":" {","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2395"}},{"Add":{"text":" return maxTokens;","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2421"}},{"Add":{"text":" }","pos":"NSBNNM77LKRFLORJOW4NB2WXDWHC3MKRNLGRCLUKKZZXWZK7TJFAC:2427"}}]}}],"owner":"grahamc","repo":"hydra2","token":"A2a8j7iW03S3YXz3pVhQmzH/CCUsZ5AxARPw3bATCjc=","login":null}

…

Dependencies

Change contents

Review