{"header":{"message":"Replacing the temporary copy of chardetng with the published version","description":null,"timestamp":"2023-12-25T16:50:09.281007028Z","authors":[{}]},"hash":"HWYGVLP5M3H46XDLLUPXI5H2K35LHJPILMR3SPD7QKOULN5OSAKQC","authors":[{"login":"pmeunier","key":"AmpY6gpyUtVCgna89khErZX2VaKzQzx7cUu2tvYtp78F"}],"deps":{"hashes":[["HWYGVLP5M3H46XDLLUPXI5H2K35LHJPILMR3SPD7QKOULN5OSAKQC","Replacing the temporary copy of chardetng with the published version"],["AA",null],["I3HDN5CSJMZKLRDGNFCT64UK3ATHL45M3STDVH4LYN7VI6UVJORQC","More correct detection of binary files"],["IPU65ECUBBYBCAFUAOFZVL25IVBWEMHBZ6Q5XXLYTD5FZT6HNQOAC","Avoid using \"t\" to distinguish tags and changes in the editor"],["RVAH6PXA7H7NUDTF7Q52I7EXGXVJVMGI2LTNN6L3MVEDEMAXVH4AC","Getting libpijul to compile to WASM32"],["NYOF5766GLBTWQV2KTVRAJMGVJNJ37Z5BLJMFPZA3HG7X2Q2RXPAC","track file encoding in the record, including change text for file adds"],["FXEDPLRI7PXLDXV634ZA6D5Q3ZWG3ESTKJTMRPJ4MAHI7PKU3M6AC","Resurrecting tests, and type cleanup (no need for Arc> anymore)"],["I24UEJQLCH2SOXA4UHIYWTRDCHSOPU7AFTRUOTX7HZIAV4AZKYEQC","Various post-fire fixes"],["6XDVUSBMBXM4LKKKR7YPJ5PF4ISOZNT465GSOFR2GF7NTL5SNLZAC","Version bump"],["OXZVZDQZEVP7NV3HS6HK5QA7RUD35ODVQ3LL7PWJHTS7DEFM3XTAC","Simplification of missing context repairs"],["NWYJJHDFVCDR34NC6VYI4S2ZT4Q6KV4JWIBJDHOZEFZVEGO2J72AC","Version bump"],["HDGRZISM2SS4TK5BMNGDIYG22SOXAZRTTC6YFIOPY4LSO53QDWZQC","Version updates"],["IACED7RWM2ZQIPN3YZATA6SXTRO2C6OUGT3HSOU3LIDZ7YRMLRXAC","text_encoding module"],["SXEYMYF7P4RZMZ46WPL4IZUTSQ2ATBWYZX7QNVMS3SGOYXYOHAGQC","Fixing the bad changes in history (unfortunately, by rebooting)."],["TNN56XYKX4QRHA4FWCF5F3JVG52FIAC76EEYYANDKEE4IAWQKPEQC","libpijul alpha.43"],["4DNDMC7IUZNYLDEQQYYF5K3G2QWWXGQENTEWPNTM6XKQEFPW7L3QC","Fixing a number of bugs related to encodings (extra newlines + misdetection in linux2x)"],["YTQS4ES362EJ27OE45CE5HLY7ZU57YLVKRMDRJ2OXT623VM5WOBQC","Fixing a parsing problem (related to permissions), and the associated permissions"],["LV34DUJYQNSHJSNFALRRS3FFQWUU57HIJU26TTKNXDFWD6UWD4QAC","Formatting"],["5FI6SBEZ6RERERUAIWQJVAY66BEZ7YQOYOUNK2DPOLRGS2X326RAC","Re-implement change printing and parsing"],["QQZNSB26UHFC4EFFREJX2J7SWAKCB3UAI6OKKIOZ4BLXBK6M54VAC","Permission update (after #X243)"],["SGXOEWHUET7RVS5HANSYE7QRQAG56NIKTC56MLPZ5XBCXODEWUXQC","Adding a patched chardetng (temporarily)"],["W4NSLQNGQVQBB4BEXLFW5OTCBD5XQ4E2BGH3WIFGKSJBCODSUIGQC","make text_encoding available to all of libpijul"],["EEBKW7VTILH6AGGV57ZIJ3DJGYHDSYBWGU3C7Q4WWAKSVNUGIYMQC","Keys and identities"],["QL6K2ZM35B3NIXEMMCJWUSFXOBQHAGXRDMO7ID5DCKTJH4QJVY7QC","Tags"],["N3X5YP7PV2XVQKRRWSRCGJG34HZPLV4BGBLZGJG55KGIB7ORJ77QC","Adding tag/txn.rs, now that the parser allows it"],["SMMRGKCXLDFNI7RAACOTGRGUPZLWY5MKVBL6WB2ZPEUCKDQ4PLIAC","Recursive file deletions: show the correct paths"],["246V5TYIUL7CFN7G5Y7A35EEM6IJPN532ROEYVSM7Q4HCQSWPDBQC","decode existing files"],["6CZYYOG7C7ULY5Q4WSRVVC3QVSYACV3KFEYXDCH63OXXX2QFFFBAC","Faster guessing of encoding"],["IYJZVLETBAQDDELENH3FX7ZTOC3HY4UJ3AMC3MACW6O7ZCWZTR6AC","Cleaning up the literate programming bits"],["X243Z3Y54ULINQMMRIKLHRV5T237B7VUOAHVJ7DMPOQ6A6GQXY2AC","Recording only the required metadata (can even be changed later!)"],["FGIVSUFHH7DN65DYQHDGGDDCHHIB5Z7KKQWI4I3WMERE3BY6IMRQC","Fixing conflicts with the new patch parsing code, and introducing AddRoot"],["S7MAMMFWLEBKCZZ2ZUU743Z2X7XRB2IBB7LPXZVYN37RNPGN4ATAC","Formatting"],["EJ7TFFOWLM5EXYX57NJZZX3NLPBLLMRX7CGJYC75DJZ5LYXOQPJAC","Re-adding Cargo.lock"]],"deps":["I3HDN5CSJMZKLRDGNFCT64UK3ATHL45M3STDVH4LYN7VI6UVJORQC","IPU65ECUBBYBCAFUAOFZVL25IVBWEMHBZ6Q5XXLYTD5FZT6HNQOAC","RVAH6PXA7H7NUDTF7Q52I7EXGXVJVMGI2LTNN6L3MVEDEMAXVH4AC"],"known":["SXEYMYF7P4RZMZ46WPL4IZUTSQ2ATBWYZX7QNVMS3SGOYXYOHAGQC","IYJZVLETBAQDDELENH3FX7ZTOC3HY4UJ3AMC3MACW6O7ZCWZTR6AC","X243Z3Y54ULINQMMRIKLHRV5T237B7VUOAHVJ7DMPOQ6A6GQXY2AC","QQZNSB26UHFC4EFFREJX2J7SWAKCB3UAI6OKKIOZ4BLXBK6M54VAC","HDGRZISM2SS4TK5BMNGDIYG22SOXAZRTTC6YFIOPY4LSO53QDWZQC","YTQS4ES362EJ27OE45CE5HLY7ZU57YLVKRMDRJ2OXT623VM5WOBQC","I24UEJQLCH2SOXA4UHIYWTRDCHSOPU7AFTRUOTX7HZIAV4AZKYEQC","QL6K2ZM35B3NIXEMMCJWUSFXOBQHAGXRDMO7ID5DCKTJH4QJVY7QC","246V5TYIUL7CFN7G5Y7A35EEM6IJPN532ROEYVSM7Q4HCQSWPDBQC","NYOF5766GLBTWQV2KTVRAJMGVJNJ37Z5BLJMFPZA3HG7X2Q2RXPAC","W4NSLQNGQVQBB4BEXLFW5OTCBD5XQ4E2BGH3WIFGKSJBCODSUIGQC","IACED7RWM2ZQIPN3YZATA6SXTRO2C6OUGT3HSOU3LIDZ7YRMLRXAC","EEBKW7VTILH6AGGV57ZIJ3DJGYHDSYBWGU3C7Q4WWAKSVNUGIYMQC","6CZYYOG7C7ULY5Q4WSRVVC3QVSYACV3KFEYXDCH63OXXX2QFFFBAC","SGXOEWHUET7RVS5HANSYE7QRQAG56NIKTC56MLPZ5XBCXODEWUXQC","LV34DUJYQNSHJSNFALRRS3FFQWUU57HIJU26TTKNXDFWD6UWD4QAC","4DNDMC7IUZNYLDEQQYYF5K3G2QWWXGQENTEWPNTM6XKQEFPW7L3QC","S7MAMMFWLEBKCZZ2ZUU743Z2X7XRB2IBB7LPXZVYN37RNPGN4ATAC","TNN56XYKX4QRHA4FWCF5F3JVG52FIAC76EEYYANDKEE4IAWQKPEQC","FXEDPLRI7PXLDXV634ZA6D5Q3ZWG3ESTKJTMRPJ4MAHI7PKU3M6AC","NWYJJHDFVCDR34NC6VYI4S2ZT4Q6KV4JWIBJDHOZEFZVEGO2J72AC","6XDVUSBMBXM4LKKKR7YPJ5PF4ISOZNT465GSOFR2GF7NTL5SNLZAC","5FI6SBEZ6RERERUAIWQJVAY66BEZ7YQOYOUNK2DPOLRGS2X326RAC","FGIVSUFHH7DN65DYQHDGGDDCHHIB5Z7KKQWI4I3WMERE3BY6IMRQC","SMMRGKCXLDFNI7RAACOTGRGUPZLWY5MKVBL6WB2ZPEUCKDQ4PLIAC","N3X5YP7PV2XVQKRRWSRCGJG34HZPLV4BGBLZGJG55KGIB7ORJ77QC","OXZVZDQZEVP7NV3HS6HK5QA7RUD35ODVQ3LL7PWJHTS7DEFM3XTAC"]},"hunks":[{"FileDel":{"deleted_names":[{"basename":"chardetng","metadata":576},{"basename":"src","metadata":576}],"del":{"EdgeMap":{"edges":[{"previous":"BLOCK | FOLDER","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":198146},"to":{"change":5,"start":58,"end":78},"introduced_by":5},{"previous":"BLOCK | FOLDER","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":78},"to":{"change":5,"start":257,"end":257},"introduced_by":5},{"previous":"BLOCK | FOLDER | DELETED","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":241},"to":{"change":5,"start":242,"end":256},"introduced_by":5},{"previous":"BLOCK | FOLDER","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":256},"to":{"change":5,"start":257,"end":257},"introduced_by":5}],"inode":{"change":5,"pos":257}}},"content_edges":null,"content":[]}},{"FileDel":{"deleted_names":[{"basename":"data.rs","metadata":0}],"del":{"EdgeMap":{"edges":[{"previous":"BLOCK | FOLDER","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":257},"to":{"change":5,"start":154468,"end":154499},"introduced_by":5},{"previous":"BLOCK | FOLDER","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":154499},"to":{"change":5,"start":154500,"end":154500},"introduced_by":5}],"inode":{"change":5,"pos":154500}}},"content_edges":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":154500},"to":{"change":5,"start":154501,"end":315045},"introduced_by":5}],"inode":{"change":5,"pos":154500}},"content":[{"Del":"/* Any copyright is dedicated to the Public Domain.\n * https://creativecommons.org/publicdomain/zero/1.0/ */\n\nuse super::IMPLAUSIBILITY_PENALTY;\nuse encoding_rs::Encoding;\nuse encoding_rs::IBM866_INIT;\nuse encoding_rs::ISO_8859_13_INIT;\nuse encoding_rs::ISO_8859_2_INIT;\nuse encoding_rs::ISO_8859_4_INIT;\nuse encoding_rs::ISO_8859_5_INIT;\nuse encoding_rs::ISO_8859_6_INIT;\nuse encoding_rs::ISO_8859_7_INIT;\nuse encoding_rs::ISO_8859_8_INIT;\nuse encoding_rs::KOI8_U_INIT;\nuse encoding_rs::WINDOWS_1250_INIT;\nuse encoding_rs::WINDOWS_1251_INIT;\nuse encoding_rs::WINDOWS_1252_INIT;\nuse encoding_rs::WINDOWS_1253_INIT;\nuse encoding_rs::WINDOWS_1254_INIT;\nuse encoding_rs::WINDOWS_1255_INIT;\nuse encoding_rs::WINDOWS_1256_INIT;\nuse encoding_rs::WINDOWS_1257_INIT;\nuse encoding_rs::WINDOWS_1258_INIT;\nuse encoding_rs::WINDOWS_874_INIT;\n\nconst PLAUSIBLE_NEXT_TO_ALPHABETIC_ON_EITHER_SIDE: usize = 0;\n\nconst IMPLAUSIBLE_NEXT_TO_ALPHABETIC_ON_EITHER_SIDE: usize = 1;\n\nconst IMPLAUSIBLE_BEFORE_ALPHABETIC: usize = 2;\n\nconst IMPLAUSIBLE_AFTER_ALPHABETIC: usize = 3;\n\nconst PLAUSIBLE_NEXT_TO_NON_ASCII_ALPHABETIC_ON_EITHER_SIDE: usize = 4;\n\nconst PLAUSIBLE_NEXT_TO_ASCII_ALPHABETIC_ON_EITHER_SIDE: usize = 5;\n\nconst WINDOWS_1256_ZWNJ: usize = 2;\n\npub const ASCII_DIGIT: usize = 100;\n\n#[repr(align(64))] // Align to cache lines\npub struct DetectorData {\n pub frequent_simplified: [u16; 128],\n pub frequent_kanji: [u16; 128],\n pub frequent_hangul: [u16; 128],\n latin_ascii: [u8; 128],\n non_latin_ascii: [u8; 128],\n turkish_ascii: [u8; 128],\n windows_1258: [u8; 128],\n windows_1250: [u8; 128],\n iso_8859_2: [u8; 128],\n windows_1251: [u8; 128],\n koi8_u: [u8; 128],\n iso_8859_5: [u8; 128],\n ibm866: [u8; 128],\n windows_1252: [u8; 128],\n windows_1252_icelandic: [u8; 128],\n windows_1253: [u8; 128],\n iso_8859_7: [u8; 128],\n windows_1254: [u8; 128],\n windows_1255: [u8; 128],\n iso_8859_8: [u8; 128],\n windows_1256: [u8; 128],\n iso_8859_6: [u8; 128],\n windows_1257: [u8; 128],\n iso_8859_13: [u8; 128],\n iso_8859_4: [u8; 128],\n windows_874: [u8; 128],\n vietnamese: [u8; 1975],\n central: [u8; 3895],\n cyrillic: [u8; 2112],\n western: [u8; 2752],\n icelandic: [u8; 871],\n greek: [u8; 1365],\n turkish: [u8; 845],\n hebrew: [u8; 1292],\n arabic: [u8; 2805],\n baltic: [u8; 1387],\n thai: [u8; 5180],\n}\n\n#[rustfmt::skip]\npub static DETECTOR_DATA: DetectorData = DetectorData {\n frequent_simplified: [\n 0x7684, 0x5E74, 0x56FD, 0x65E5, 0x6708, 0x4E2D, 0x4EBA, 0x4E00, 0x5927, 0x4E3A, 0x5728, 0x662F, 0x5B66, 0x6709, 0x884C, 0x4F1A, \n 0x65AF, 0x4E8E, 0x5730, 0x533A, 0x6587, 0x548C, 0x5C14, 0x540D, 0x7B2C, 0x516C, 0x65F6, 0x5C0F, 0x90E8, 0x4E0D, 0x5E02, 0x53F0, \n 0x4EE5, 0x4E0A, 0x540E, 0x52A8, 0x51FA, 0x4E2A, 0x672C, 0x4F5C, 0x5BB6, 0x65B0, 0x6210, 0x897F, 0x5B9A, 0x91CD, 0x751F, 0x4E4B, \n 0x7535, 0x4E3B, 0x5B50, 0x7528, 0x7279, 0x5206, 0x6C11, 0x4E86, 0x4E9A, 0x5458, 0x514B, 0x5357, 0x653F, 0x7AD9, 0x5FB7, 0x4E0E, \n 0x7403, 0x4E1C, 0x79D1, 0x91CC, 0x9053, 0x5C71, 0x6CD5, 0x65B9, 0x5317, 0x5411, 0x5929, 0x53D1, 0x7269, 0x6765, 0x5230, 0x673A, \n 0x661F, 0x8DEF, 0x76EE, 0x7F8E, 0x6751, 0x9AD8, 0x957F, 0x519B, 0x5229, 0x4E09, 0x62C9, 0x8F66, 0x5DDE, 0x57FA, 0x6D77, 0x81EA, \n 0x4E0B, 0x8D5B, 0x9762, 0x52A0, 0x4ED6, 0x9A6C, 0x5176, 0x53C2, 0x53BF, 0x4EE3, 0x5185, 0x7406, 0x4E16, 0x4E8C, 0x7EBF, 0x53CA, \n 0x5EFA, 0x8868, 0x4F4D, 0x7F57, 0x7531, 0x7ACB, 0x591A, 0x53EF, 0x534E, 0x6797, 0x7EF4, 0x5EA6, 0x4E8B, 0x5E73, 0x5916, 0x4F53, \n ],\n frequent_kanji: [\n 0x5E74, 0x65E5, 0x6708, 0x5927, 0x672C, 0x5B66, 0x4EBA, 0x56FD, 0x4F1A, 0x4E2D, 0x51FA, 0x4E00, 0x8005, 0x5E02, 0x4F5C, 0x540D, \n 0x90E8, 0x7528, 0x5730, 0x884C, 0x5834, 0x7530, 0x7B2C, 0x751F, 0x5408, 0x5B50, 0x9053, 0x4E0A, 0x6771, 0x6642, 0x770C, 0x4EE3, \n 0x5C71, 0x793E, 0x4E8B, 0x753B, 0x65B0, 0x624B, 0x9AD8, 0x6210, 0x6226, 0x7269, 0x5F8C, 0x767A, 0x9577, 0x7ACB, 0x5206, 0x5DDD, \n 0x8A18, 0x6821, 0x9593, 0x696D, 0x95A2, 0x6240, 0x5B9A, 0x9078, 0x5C0F, 0x76EE, 0x52D5, 0x548C, 0x6587, 0x91CE, 0x540C, 0x524D, \n 0x5185, 0x958B, 0x7DDA, 0x81EA, 0x53F7, 0x516C, 0x99C5, 0x9001, 0x56DE, 0x753A, 0x9664, 0x4E3B, 0x5BB6, 0x5229, 0x8ECA, 0x901A, \n 0x4EAC, 0x8868, 0x5CF6, 0x4E0B, 0x4E16, 0x65B9, 0x6751, 0x66F8, 0x5168, 0x660E, 0x9023, 0x5E73, 0x653E, 0x4F53, 0x7684, 0x5F0F, \n 0x756A, 0x5EA6, 0x5317, 0x5165, 0x5916, 0x983C, 0x8A9E, 0x5973, 0x8A71, 0x6A5F, 0x8A2D, 0x539F, 0x4E09, 0x524A, 0x533A, 0x6D77, \n 0x4F9D, 0x5F53, 0x73FE, 0x5BFE, 0x4F4D, 0x6570, 0x5316, 0x795E, 0x66F2, 0x7406, 0x6559, 0x7279, 0x7248, 0x5728, 0x6CD5, 0x898B, \n ],\n frequent_hangul: [\n 0xC774, 0xC758, 0xB2E4, 0xAE30, 0xC5D0, 0xB85C, 0xC0AC, 0xB144, 0xC2A4, 0xB9AC, 0xB294, 0xC77C, 0xD558, 0xAC00, 0xC2DC, 0xC9C0, \n 0xB300, 0xC11C, 0xBD84, 0xAD6D, 0xD55C, 0xB3C4, 0xC778, 0xACE0, 0xB958, 0xC790, 0xC8FC, 0xC544, 0xC744, 0xB77C, 0xC218, 0xC81C, \n 0xC815, 0xC6D4, 0xB098, 0xAD6C, 0xC804, 0xC5B4, 0xC740, 0xADF8, 0xBD80, 0xB97C, 0xB3D9, 0xC120, 0xC73C, 0xBB38, 0xD2B8, 0xC6A9, \n 0xBCF4, 0xC704, 0xB4DC, 0xACFC, 0xAD50, 0xC0C1, 0xB9C8, 0xC7A5, 0xD559, 0xC6D0, 0xC131, 0xD654, 0xC5ED, 0xB2C8, 0xBBF8, 0xACF5, \n 0xACBD, 0xD574, 0xC624, 0xC6B0, 0xBA85, 0xC788, 0xD06C, 0xC601, 0xC18C, 0xC870, 0xD68C, 0xC5EC, 0xBBFC, 0xD1A0, 0xBE44, 0xC138, \n 0xB974, 0xC720, 0xC2E0, 0xD0A4, 0xC911, 0xACC4, 0xD0C0, 0xC5F0, 0xD504, 0xAD00, 0xB418, 0xC801, 0xCE58, 0xB808, 0xCE74, 0xC9C4, \n 0xC640, 0xD130, 0xB4E4, 0xBAA9, 0xACA8, 0xAC8C, 0xAC1C, 0xBC29, 0xD30C, 0xC0B0, 0xD638, 0xCD9C, 0xC74C, 0xB9BC, 0xBA74, 0xC791, \n 0xB9CC, 0xB2E8, 0xB118, 0xBAA8, 0xC694, 0xC5C8, 0xC0DD, 0xB0A8, 0xC7AC, 0xBB34, 0xD6C4, 0xD45C, 0xAD70, 0xD3EC, 0xB2F9, 0xB178, \n ],\n latin_ascii: [\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n 100,100,100,100,100,100,100,100,100,100, 0, 0, 0, 0, 0, 0,\n 0,129,130,131,132,133,134,135,136,137,138,139,140,141,142,143,\n 144,145,146,147,148,149,150,151,152,153,154, 0, 0, 0, 0, 0,\n 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15,\n 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 0, 0, 0, 0, 0,\n ],\n non_latin_ascii: [\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n 100,100,100,100,100,100,100,100,100,100, 0, 0, 0, 0, 0, 0,\n 0,129,129,129,129,129,129,129,129,129,129,129,129,129,129,129,\n 129,129,129,129,129,129,129,129,129,129,129, 0, 0, 0, 0, 0,\n 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,\n 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 0,\n ],\n turkish_ascii: [\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n 100,100,100,100,100,100,100,100,100,100, 0, 0, 0, 0, 0, 0,\n 0,129,130,131,132,133,134,135,136,154,137,138,139,140,141,142,\n 143,144,145,146,147,148,149,150,151,152,153, 0, 0, 0, 0, 0,\n 0, 1, 2, 3, 4, 5, 6, 7, 8, 27, 9, 10, 11, 12, 13, 14,\n 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 0, 0, 0, 0, 0,\n ],\n windows_1258: [\n 0,255, 0, 53, 0, 0, 0, 0, 0, 0,255, 0,155,255,255,255,\n 255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 27,255,255,179,\n 0, 55, 53, 53, 53, 53, 52, 53, 53, 55, 53, 53, 56, 52, 54, 53,\n 55, 56, 54, 54, 53, 55, 54, 52, 53, 54, 53, 53, 55, 55, 55, 55,\n 159,160,161,162,155,155,155,155,163,164,165,155, 28,167,168,169,\n 170,155, 29,172,173,174,155, 56,155,175,176,177,155,178, 30, 27,\n 31, 32, 33, 34, 27, 27, 27, 27, 35, 36, 37, 27, 38, 39, 40, 41,\n 42, 27, 43, 44, 45, 46, 27, 56, 27, 47, 48, 49, 27, 50, 53, 51,\n ],\n windows_1250: [\n 0,255, 0,255, 0, 0, 0, 0,255, 0,156, 0,157,158,159,160,\n 255, 0, 0, 0, 0, 0, 0, 0,255, 0, 28, 0, 29, 30, 31, 32,\n 0, 69, 69,161, 69,162, 68, 69, 69, 71,163, 68, 69, 68, 70,165,\n 71, 69, 69, 33, 69, 71, 70, 68, 69, 34, 35, 68,164, 0, 36, 37,\n 166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,\n 182,183,184,185,186,187,188, 72,189,190,191,192,193,194,195, 27,\n 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53,\n 54, 55, 56, 57, 58, 59, 60, 72, 61, 62, 63, 64, 65, 66, 67, 69,\n ],\n iso_8859_2: [\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 0,162, 69,161, 69,164,157, 69, 69,156,163,158,160, 68,159,165,\n 71, 34, 69, 33, 69, 36, 29, 69, 69, 28, 35, 30, 32, 0, 31, 37,\n 166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,\n 182,183,184,185,186,187,188, 72,189,190,191,192,193,194,195, 27,\n 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53,\n 54, 55, 56, 57, 58, 59, 60, 72, 61, 62, 63, 64, 65, 66, 67, 69,\n ],\n windows_1251: [\n 131,130, 0, 2, 0, 0, 0, 0, 0, 0,132, 0,133,130,134,135,\n 3, 0, 0, 0, 0, 0, 0, 0,255, 0, 4, 0, 5, 2, 6, 7,\n 0,136, 8,140, 47,130, 46, 47,138, 49,139, 49, 50, 46, 48,141,\n 49, 50,137, 9, 2, 49, 48, 46, 10, 47, 11, 48, 12,130, 2, 13,\n 142,143,144,145,146,147,148,149,150,151,152,153,154,155,156,157,\n 158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,\n 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29,\n 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45,\n ],\n koi8_u: [\n 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47,\n 47, 47, 47, 47, 47, 46, 0, 50, 50, 50, 0, 47, 49, 48, 46, 50,\n 47, 47, 47, 10, 11, 47, 9, 13, 47, 47, 47, 47, 47, 2, 8, 47,\n 47, 47, 47,138,139, 47,137,141, 47, 47, 47, 47, 47,130,136, 49,\n 44, 14, 15, 36, 18, 19, 34, 17, 35, 22, 23, 24, 25, 26, 27, 28,\n 29, 45, 30, 31, 32, 33, 20, 16, 42, 41, 21, 38, 43, 39, 37, 40,\n 172,142,143,164,146,147,162,145,163,150,151,152,153,154,155,156,\n 157,173,158,159,160,161,148,144,170,169,149,166,171,167,165,168,\n ],\n iso_8859_5: [\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 0,138,131,130,139,130,137,141,140,132,133,134,130, 46,136,135,\n 142,143,144,145,146,147,148,149,150,151,152,153,154,155,156,157,\n 158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,\n 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29,\n 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45,\n 47, 10, 3, 2, 11, 2, 9, 13, 12, 4, 5, 6, 2, 47, 8, 7,\n ],\n ibm866: [\n 142,143,144,145,146,147,148,149,150,151,152,153,154,155,156,157,\n 158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,\n 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29,\n 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47,\n 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47,\n 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47, 47,\n 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45,\n 138, 10,139, 11,141, 13,136, 8, 49, 46, 46, 0, 47, 47, 47, 3,\n ],\n windows_1252: [\n 0,255, 0, 60, 0, 0, 0, 0, 0, 0,156, 0,157,255,185,255,\n 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 28, 0, 29,255, 57,186,\n 0, 62, 60, 60, 60, 60, 59, 60, 60, 62, 60, 59, 63, 59, 61, 60,\n 62, 63, 61, 61, 60, 62, 61, 59, 60, 61, 60, 59, 62, 62, 62, 62,\n 158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,\n 188,174,175,176,177,178,179, 63,180,181,182,183,184,188,188, 27,\n 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45,\n 60, 46, 47, 48, 49, 50, 51, 63, 52, 53, 54, 55, 56, 60, 60, 58,\n ],\n windows_1252_icelandic: [\n 0,255, 0, 41, 0, 0, 0, 0, 0, 0,155, 0,155,255,155,255,\n 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 27, 0, 27,255, 27,155,\n 0, 43, 41, 41, 41, 41, 40, 41, 41, 43, 41, 41, 44, 40, 42, 41,\n 43, 44, 42, 42, 41, 43, 42, 40, 41, 42, 41, 41, 43, 43, 43, 43,\n 155,156,155,155,157,155,158,155,155,159,155,155,155,160,155,155,\n 161,155,155,162,155,155,163, 44,164,155,165,155,155,166,167, 27,\n 27, 28, 27, 27, 29, 27, 30, 27, 27, 31, 27, 27, 27, 32, 27, 27,\n 33, 27, 27, 34, 27, 27, 35, 44, 36, 27, 37, 27, 27, 38, 39, 27,\n ],\n windows_1253: [\n 38,255, 0, 38, 0, 0, 0, 0,255, 0,255, 0,255,255,255,255,\n 255, 0, 0, 0, 0, 0, 0, 0,255, 0,255, 0,255,255,255,255,\n 0, 38,131, 38, 38, 38, 37, 38, 38, 40,255, 40, 37, 37, 39, 37,\n 40, 37, 39, 39, 0, 40, 39, 37,132,133,134, 39,162, 40,163,164,\n 2,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,\n 150,151,255,153,154,155,156,157,158,159,160,161, 3, 4, 5, 6,\n 2, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21,\n 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36,255,\n ],\n iso_8859_7: [\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 0, 40, 39, 38, 38, 38, 37, 38, 38, 40, 38, 40, 37, 37,255, 37,\n 40, 37, 39, 39, 0, 38,131, 37,132,133,134, 39,162, 40,163,164,\n 2,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,\n 150,151,255,153,154,155,156,157,158,159,160,161, 3, 4, 5, 6,\n 2, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21,\n 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36,255,\n ],\n windows_1254: [\n 0,255, 0, 40, 0, 0, 0, 0, 0, 0,156, 0,156,255,255,255,\n 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 28, 0, 28,255,255,156,\n 0, 42, 40, 40, 40, 40, 39, 40, 40, 42, 40, 42, 43, 39, 41, 40,\n 42, 43, 41, 41, 40, 42, 41, 39, 40, 41, 40, 41, 42, 42, 42, 42,\n 156,156,158,156,157,156,156,159,156,156,160,156,156,156,161,156,\n 162,156,156,156,156,156,163, 43,156,156,156,164,165,155,166, 28,\n 28, 28, 30, 28, 29, 28, 28, 31, 28, 28, 32, 28, 28, 28, 33, 28,\n 34, 28, 28, 28, 28, 28, 35, 43, 28, 28, 28, 36, 37, 26, 38, 28,\n ],\n windows_1255: [\n 0,255, 0, 37, 0, 0, 0, 0, 0, 0,255, 0,255,255,255,255,\n 255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255,255,255,255,\n 0, 39, 37, 37, 37, 37, 36, 37, 37, 39, 40, 40, 40, 36, 38, 37,\n 39, 40, 38, 38, 37, 39, 38, 36, 37, 38, 40, 40, 39, 39, 39, 39,\n 2, 2, 2, 2, 2, 2, 2, 3, 4, 2, 2, 2, 5, 2, 36, 37,\n 36, 2, 2, 0, 6, 7, 8, 41, 41,255,255,255,255,255,255,255,\n 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24,\n 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35,255,255, 37, 37,255,\n ],\n iso_8859_8: [\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 0,255, 37, 37, 37, 37, 36, 37, 37, 39, 40, 40, 40, 36, 38, 37,\n 39, 40, 38, 38, 37, 39, 38, 36, 37, 38, 40, 40, 39, 39, 39,255,\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255, 36,\n 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24,\n 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35,255,255, 37, 37,255,\n ],\n windows_1256: [\n 0, 3, 0, 54, 0, 0, 0, 0, 0, 0, 4, 0,129, 5, 6, 7,\n 8, 0, 0, 0, 0, 0, 0, 0, 9, 0, 10, 0, 1, 2, 53, 11,\n 0, 58, 54, 54, 54, 54, 53, 54, 54, 56, 12, 56, 57, 53, 55, 54,\n 56, 57, 55, 55, 54, 56, 55, 53, 54, 55, 58, 55, 56, 56, 56, 58,\n 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28,\n 29, 30, 31, 32, 33, 34, 35, 57, 36, 37, 38, 39, 40, 41, 42, 43,\n 1, 44, 1, 45, 46, 47, 48, 1, 1, 1, 1, 1, 49, 50, 1, 1,\n 51, 51, 51, 51, 1, 51, 51, 57, 51, 1, 51, 1, 1, 54, 54, 52,\n ],\n iso_8859_6: [\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 0,255,255,255, 54,255,255,255,255,255,255,255, 58, 53,255,255,\n 255,255,255,255,255,255,255,255,255,255,255, 58,255,255,255, 58,\n 255, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28,\n 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39,255,255,255,255,255,\n 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 51, 51, 51, 51,\n 51, 51, 51,255,255,255,255,255,255,255,255,255,255,255,255,255,\n ],\n windows_1257: [\n 0,255, 0,255, 0, 0, 0, 0,255, 0,255, 0,255, 47, 47, 47,\n 255, 0, 0, 0, 0, 0, 0, 0,255, 0,255, 0,255, 47, 47,255,\n 0,255, 47, 47, 47,255, 46, 47,155, 49,156, 49, 50, 46, 48,155,\n 49, 50, 48, 48, 47, 49, 48, 46, 27, 48, 28, 48, 49, 49, 49, 27,\n 157,158,159,155,155,155,160,161,162,155,155,163,164,165,166,167,\n 168,155,169,155,170,155,155, 50,171,155,155,172,155,155,173, 27,\n 29, 30, 31, 27, 27, 27, 32, 33, 34, 27, 27, 35, 36, 37, 38, 39,\n 40, 27, 41, 27, 42, 27, 27, 50, 43, 27, 27, 44, 27, 27, 45, 47,\n ],\n iso_8859_13: [\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 0, 48, 47, 47, 47, 49, 46, 47,155, 49,156, 49, 50, 46, 48,155,\n 49, 50, 48, 48, 46, 49, 48, 46, 27, 48, 28, 48, 49, 49, 49, 27,\n 157,158,159,155,155,155,160,161,162,155,155,163,164,165,166,167,\n 168,155,169,155,170,155,155, 50,171,155,155,172,155,155,173, 27,\n 29, 30, 31, 27, 27, 27, 32, 33, 34, 27, 27, 35, 36, 37, 38, 39,\n 40, 27, 41, 27, 42, 27, 27, 50, 43, 27, 27, 44, 27, 27, 45, 46,\n ],\n iso_8859_4: [\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,\n 0,157, 27,156, 47,155,167, 47, 47,168,161,164,155, 46,173, 47,\n 49, 29, 47, 28, 47, 27, 39, 47, 47, 40, 33, 36, 27,155, 45, 27,\n 159,155,155,155,155,155,155,158,162,155,160,155,163,155,155,166,\n 155,169,170,165,155,155,155, 50,155,171,155,155,155,155,172, 27,\n 31, 27, 27, 27, 27, 27, 27, 30, 34, 27, 32, 27, 35, 27, 27, 38,\n 27, 41, 42, 37, 27, 27, 27, 50, 27, 43, 27, 27, 27, 27, 44, 47,\n ],\n windows_874: [\n 77,255,255,255,255, 0,255,255,255,255,255,255,255,255,255,255,\n 255, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255,255,255,\n 0, 2, 3, 71, 4, 71, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14,\n 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30,\n 31, 32, 33, 34, 35, 36, 71, 37, 38, 39, 40, 41, 42, 43, 44, 45,\n 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56,255,255,255,255, 77,\n 57, 58, 59, 60, 61, 71, 62, 63, 64, 65, 66, 67, 68, 69, 70, 77,\n 77, 77, 77, 77, 77, 77, 77, 77, 77, 77, 77, 77,255,255,255,255,\n ],\n vietnamese: [\n 0, 58, 58, 22, 33, 7, 0, 0, 0, 0, 1, 57, 3, 0, 0, 0, 39, 14, 8, 3, 0, 11, 0, 5, 0, // ,\n 0, 3, 16, 2, 0, 0, 0, 0, 0, 0, 0, 3, 1,255, 0, 17, 2, 1, 0, 0, 1, 0, 0, 1,255, // a,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, // b,\n 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 51, 12, 0, 0, 0, 48, 0, 0, 0, 0, 2, 0, 0, 0, // c,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, // d,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, // e,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255, // f,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, // g,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, // h,\n 0, 27, 11, 1, 16, 3, 0, 0, 0, 0, 0, 16, 0, 0,255, 10, 34, 0, 2, 1, 0, 0, 0, 0,255, // i,\n 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0,255, 0, 0, 0, 0,255, // j,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, // k,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, // l,\n 0, 6, 3, 0, 2, 0, 2, 22, 0, 0, 2, 4, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0,255, // m,\n 0, 59, 23, 10, 19, 22, 18, 5, 0, 0, 28, 61, 6, 0, 0, 0, 39, 4, 20, 9, 6, 1, 0, 1,255, // n,\n 0, 5, 13, 0, 5, 3, 0, 0, 0, 0, 0, 3, 0,255, 0, 4, 2, 0, 0,255,255, 0,255, 0,255, // o,\n 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 13, 0, 0,255, 0, 10, 0, 0, 0, 0, 0, 0, 0,255, // p,\n 0, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0,255, 0, 0,255, 0, 0,255, 0, 0,255, 0,255, // q,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, // r,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, // s,\n 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 25, 0, 0, 0, 0, 40, 0, 0, 0, 0, 0, 0, 0,255, // t,\n 0, 12, 3, 1, 1, 0, 4, 0, 0, 0, 6, 4, 0,255,255, 0, 4, 0, 0, 0, 0, 0,255, 1, 0, // u,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255, 0,255, // v,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0,255, 0,255, // w,\n 0, 0,255, 0, 0, 0,255,255, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255, // x,\n 0, 18, 2, 0, 18, 1, 4, 0, 0, 0, 0, 2, 0, 0, 0, 0, 1, 0, 0,255, 0, 0,255, 0,255, // y,\n 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255, // z,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0,255,255, 0, 0, 0, 0, 0,255,255,255,255, 0,255,255,255, 0, 0,255,255, // ß,\n 0, 95,255,255,255, 1,255,255,255, 11,255,255,255,255,255, 6,255,255,255,255,255, 8,255,255,255, 4,255,255,255,255,255,255,255, 14, 2,255,255, 17,255,255,255,255,255,255,255, 8, 16,255,255,255, 5,255, // ̀,\n 0, 39,255,255,255, 0,255,255,255, 5,255,255,255,255,255, 3,255,255,255,255,255, 20,255,255,255, 1,255,255,255,255,255,255,255, 3, 0,255,255, 31,255,255,255,255,255,255,255, 10, 10,255,255,255, 5,255, // ̉,\n 0, 12,255,255,255, 1,255,255,255, 5,255,255,255,255,255, 0,255,255,255,255,255, 3,255,255,255, 1,255,255,255,255,255,255,255, 2, 0,255,255, 3,255,255,255,255,255,255,255, 1, 0,255,255,255, 7,255, // ̃,\n 0, 0, 3, 0, 0, 0, 0, 12, 15, 0, 0, 0, 17, 1, 6, 15, 0,255, 0, 0, 1, 0, 16, 0, 0, 0, 0, 0, 0,255,255, 0, 0,255,255,255,255,255,255, 0,255,255, 1, 0,255,255, 0,255,255,255, 0,255, // à,\n 2, 0, 2, 13, 0, 0, 0, 0, 26, 3, 0, 0, 1, 1, 0, 1, 0, 0, 0, 3, 2, 0, 0, 0, 0, 0, 0, 0,255,255,255, 0, 0,255,255,255,255,255,255, 0,255,255, 3,255,255,255,255,255,255,255,255,255, // á,\n 3, 0, 1, 7, 5, 0, 0, 1, 23, 0, 0, 0, 3, 3, 0, 0, 0, 0, 3, 1, 7, 13, 16, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0,255, 0, 0, 0,255,255,255, 8, 0,255,255, 0,255, 0,255, 0,255, // â,\n 0, 0, 3, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 1, 23, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0,255, 0, 0, 0,255,255, 0, 0,255,255,255, 0,255,255,255, 1, 0,255,255, 0,255,255,255,255,255, // ă,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255,255, 0, 0,255,255, 0,255,255, 0,255,255,255,255,255,255,255,255,255, // è,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255, 0,255,255,255,255, 0,255,255,255,255,255, 0,255,255,255,255,255,255,255,255,255, // é,\n 0, 0, 1, 0, 0, 0, 0, 0, 28, 66, 0, 6, 2, 0, 1, 0, 0, 0, 2, 0, 4, 0, 3, 0, 0, 12, 0,255, 0, 0, 0,255,255,255,255, 0, 0, 0, 0, 0,255,255, 13, 0,255, 0,255,255,255,255, 0,255, // ê,\n 0, 63,255,255,255, 5,255,255,255, 24,255,255,255,255,255, 22,255,255,255,255,255, 18,255,255,255, 3,255,255,255,255,255,255,255, 17, 6,255,255, 30,255,255,255,255,255,255,255, 23, 20,255,255,255, 10,255, // ́,\n 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0,255,255,255,255, 0, 0, 0,255,255, 0,255,255, 0, 0,255,255,255,255,255, // í,\n 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255, // î,\n 0, 0,255,255, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255, 0,255, 0, 0,255,255, 0, 0, 0,255,255,255,255,255,255,255,255,255, 0,255, 0,255,255,255,255,255,255,255,255,255,255,255,255,255, // ï,\n 97, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0,255,255,255,255,255, 0, 0,255,255,255, 0, 0, 0, 0, 0,255,255,255,255,255, // đ,\n 0, 42,255,255,255, 0,255,255,255, 15,255,255,255,255,255, 18,255,255,255,255,255, 8,255,255,255, 0,255,255,255,255,255,255,255, 34, 4,255,255, 24,255,255,255,255,255,255,255, 41, 17,255,255,255, 17,255, // ̣,\n 0, 0, 2, 10, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255,255,255,255,255,255, 0,255,255, 2,255, 0,255,255,255,255,255, 0,255, // ó,\n 2, 0, 7, 8, 0, 0, 0, 2, 18, 0, 0, 0, 1, 17, 2, 0, 0, 0, 1, 6, 5, 15, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255, 0, 0,255,255,255, 22, 0,255, 0, 0,255,255,255, 0,255, // ô,\n 5, 0, 1, 1, 0, 0, 0, 0, 8, 2, 0, 0, 2, 1, 0, 0, 0,255, 1, 2, 0, 0, 4, 0, 0, 0, 0,255, 0, 0, 0,255,255,255, 0,255,255,255, 0,255,255,255, 2, 0,255, 0, 0,255,255,255, 42,255, // ơ,\n 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0,255, 0,255,255,255,255, 0,255,255,255,255,255,255,255,255, 0,255,255,255,255, 0,255,255,255,255, // ù,\n 0, 0, 0, 1, 0, 0, 0, 0, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255,255,255,255, 0,255,255,255,255, 0,255, 0,255,255,255, 0,255,255,255, // ú,\n 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0,255,255, 0,255, 0, 0, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255, // û,\n 1, 0, 1, 4, 4,255, 0, 7, 28, 1, 0, 0, 4, 0, 3, 0, 0, 0, 4, 7, 9, 0, 2, 0, 0, 0, 0,255, 0, 0, 0,255,255, 0, 0,255,255,255, 0,255,255,255, 15, 0,255,255, 0,255,255,255, 0,255, // ư,\n 0, 0,255,255,255,255,255,255,255,255,255,255, 0,255,255, 0,255,255, 0,255,255, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255, // ÿ,\n // , a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z, ß, ̀, ̉, ̃, à, á, â, ă, è, é, ê, ́, í, î, ï, đ, ̣, ó, ô, ơ, ù, ú, û, ư, ÿ,\n ],\n central: [\n 0, 42, 11, 51, 30, 3,154, 77, 18, 20, 23, 0,139, 0,254, 1, 0, 79, 0, 70,132,121, 0, 52,241, 14, 5, 7, 17, 8, 74, 0, 58, 0, 8, 33, 36, 9, 1,105, 8, // ,\n 0, 70, 0, 11,146, 0,115, 0, 11, 23, 12, 0, 0, 0, 2, 0, 0, 66, 0,107, 1, 0, 0, 0, 10, 0, 10, 25, 0, 8, 1, 0, 1, 0, 9, 0, 0, 0, 0, 0, 48, // a,\n 0, 0, 0, 0, 18, 0, 1, 1, 0, 4, 2, 0, 32, 0, 1, 0, 0, 0, 0, 2, 11, 5, 0, 0, 2, 0, 0, 0, 0, 0, 8, 0, 4, 6, 1, 0, 10, 0, 0, 1, 0, // b,\n 0, 2, 62, 0, 0, 0, 9, 45, 9, 0, 5, 0, 47, 0, 8, 0, 0, 0, 0, 0, 5, 31, 0, 3, 33, 3, 0,255, 14, 0, 8, 0, 0, 0, 0, 0, 13, 0, 1, 48, 0, // c,\n 0, 0, 0, 0, 10, 6, 1, 19, 0, 0, 2, 0, 23, 0, 6, 0,255, 0, 0, 0, 11, 28, 0, 5, 8, 0, 0, 0, 0, 0, 33, 0, 4, 2, 0, 1, 10, 0, 1, 0, 0, // d,\n 0, 70, 0, 0,111, 0, 16, 0, 27, 0, 36, 0, 0, 0, 0, 0,255, 61, 0,145, 5, 0, 0, 0, 0, 0, 0,133, 0, 0, 0, 0, 2, 0, 64, 0, 0, 1, 0, 0, 34, // e,\n 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0,255, 1, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 2, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, // f,\n 0, 0, 0, 0, 2, 0, 2, 5, 0, 0, 0,255, 64, 0, 2, 0, 0, 0, 0, 0, 61, 9, 0, 0, 4, 0, 0,255, 0, 0, 7, 0, 1, 2, 0, 0, 13, 0, 4, 0, 0, // g,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 38, 0, 0, 4, 11, 2, 0, 0, 0, 0, 1, 0, 1, 0, 0, 0, 4, 0, 0, 5, 0, // h,\n 0,110, 0, 0,103, 0, 0, 0,157, 0, 0, 0, 2, 1, 7, 0, 0,225, 0,177, 0, 0, 0, 0, 0, 7, 0, 6, 0, 0, 6, 0, 5, 0, 24, 0, 0, 0, 0, 0,242, // i,\n 0, 7, 0, 0, 11, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0,255, 0,255, 27, 1, 0, 0, 10, 9, 0, 0, 0, 0, 0, 6, 0, 3, 0, 0, 0, 8, 0, 0, 0, 0, // j,\n 0,193, 0, 0,210, 0, 21, 0, 1, 12, 8, 0, 21, 0, 0, 0, 0, 1, 0,186, 42, 8, 0, 8, 19, 5, 0, 0, 0, 0, 13, 0, 9, 10, 2, 0, 1, 2, 5, 2, 2, // k,\n 0, 10, 15, 0, 1, 0, 0, 0, 0, 0, 2, 0, 92, 3, 12, 0, 0, 0, 0, 31, 48, 0, 0, 15, 9, 4, 0, 0, 0, 0, 24, 1, 13, 16, 0, 1, 7, 1, 56, 2, 0, // l,\n 0, 2, 9, 0, 1, 0, 1, 0, 0, 2, 0, 0, 22, 4, 16, 0, 0, 0, 0, 0, 15, 0, 0, 7, 27, 10, 0, 0, 0, 0, 4, 0, 1, 2, 0, 4, 4, 0, 0, 22, 0, // m,\n 0, 37, 15, 0, 39, 6, 14, 0, 1, 5, 20, 0, 76, 90, 10, 0, 0, 6, 0,121, 54, 0, 0, 16, 20,238, 0, 0, 0, 0, 37, 2, 2, 17, 1, 0, 4, 1, 4, 1, 0, // n,\n 0, 16, 0, 3, 7, 0, 93, 0, 7, 21, 12, 0, 0, 0, 0, 0, 0, 2, 1, 11, 4, 0, 0, 0, 5, 0, 0, 1, 0, 4, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, // o,\n 0, 23, 1, 0, 0, 0, 1, 3, 0, 0, 0, 0, 9, 0, 3, 0, 1, 0, 0, 0, 44, 38, 0, 3, 2, 0,255, 0, 0, 0, 6, 0, 2, 0, 0, 0, 6, 0, 0, 0, 0, // p,\n 255, 0,255,255, 0, 0, 0,255, 0,255,255,255, 0, 0, 0, 0,255,255,255, 0, 0, 0, 0,255, 0, 0,255,255,255,255, 0, 0,255, 0,255,255, 0,255, 0,255,255, // q,\n 0, 1, 11, 0, 1, 5, 4, 0, 0, 0, 0, 0, 96, 14, 70, 1, 0, 0, 0, 15, 68, 0, 0, 8, 20, 4, 0, 0, 0, 0, 58, 3, 5, 27, 0, 0, 14, 4, 3, 3, 0, // r,\n 0, 1, 0, 0, 10, 0, 0, 6, 0, 9, 4, 0,133, 0, 15, 0, 0, 0, 0, 1,147, 9, 0, 11, 27, 2, 0, 0, 66, 0, 11, 5, 13, 12, 3, 4, 9, 6, 2, 5, 0, // s,\n 0,254, 0, 0, 0, 0, 3, 10, 74, 0, 0, 0, 63, 7, 46, 5, 0, 0, 0, 6, 30, 23, 0, 22, 45, 3, 0, 0, 0, 0, 6, 1, 5, 13, 0, 0, 7, 0, 3, 2, 0, // t,\n 0, 7, 0, 0, 35, 0, 35, 0, 10, 6, 4,255, 1, 9, 17, 0, 0, 16, 0, 22, 0, 0, 0, 0, 0, 0, 0, 42, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18, // u,\n 0, 15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 24, 0, 1, 0, 0, 0, 0, 8, 38, 0, 0, 2, 12, 1, 0, 0,255, 0, 2, 9, 6, 14, 0, 6, 2, 6, 0, 8, 0, // v,\n 0, 0, 33, 0, 0, 1, 0, 0, 0,255, 0,255, 0, 0, 0, 0,255, 0,255, 0, 0, 0, 0, 0, 0, 0,255,255, 0,255,113, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, // w,\n 255, 0,255,255, 0,255, 0,255,255,255,255,255, 0,255, 0, 0,255, 0,255, 0, 3,255, 0, 0, 0,255,255,255,255,255, 0, 0, 0, 0, 0,255, 0, 0, 0, 0,255, // x,\n 255, 0, 0, 0, 0, 0, 37, 0, 0, 0, 37,255, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, // y,\n 0, 0, 0, 0, 0, 0, 0, 12, 0, 0, 0, 0, 46, 0, 9, 2, 0, 0,255, 0, 8, 29, 0, 4, 5, 0, 0,255, 0,255, 4, 1, 8, 31, 0, 1, 42, 1, 3, 3, 0, // z,\n 0, 0,255,255,255, 0,255,255, 0, 0,255, 0, 0, 0, 0, 1,255,255, 0, 0, 0, 0,255, 0,255, 0,255, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255, 0,255,255,255,255, 0,255,255, // ß,\n 180, 89, 2, 0, 5, 92, 0, 23, 0,166, 40, 4, 4, 15, 12,133,125, 0, 60, 0, 3, 37, 10, 0, 0, 13, 5,255, 9,255, 0, 8,255,255, 0,255, 0,255, 0, 4, 0, 0, 0, 0, 0,255, 3, 0, 0, 0, 1, 3, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1,255, 0, 3,255, // š,\n 53, 6, 0, 0, 0, 25, 0, 0, 0, 6, 4, 0, 0, 1, 0, 89, 0, 0, 0, 0, 0, 1, 0, 1,255, 5, 0,255,255, 0,255,255, 0, 0, 0,255,255, 0,255, 0,255,255,255,255, 0,255,255,255, 6,255, 0,255,255,255,255, 0,255, 0, 0,255,255,255,255, 0,255,255,255,255, // ś,\n 1, 13, 0, 0, 0, 1, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0,255, 1, 28, 0, 0, 0,255,255, 3, 0,255, 2,255, 0, 0,255,255,255,255,255,255,255, 0,255,255, 1,255,255,255, 0, 0, 0,255, 0, 3,255, 0,255,255, 0, 0, 0,255,255,255, 0, 2,255,255, 0,255, // ť,\n 96, 34, 0, 0, 21, 89, 0, 0, 0, 28, 0, 0, 5, 1, 3,221, 0, 0,127, 0, 0, 77, 1, 0, 0, 2, 0,255, 0,255, 0, 0,255,255, 0,255, 0,255, 0, 3,255, 0, 0, 5, 0,255, 0, 1, 0,255, 5, 5,255, 0, 0,255, 0, 0, 4,255,255, 0, 2, 1,255, 0, 1,255, // ž,\n 4, 7, 0,255, 3, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0,255, 0,255, 0,255, 0, 0,255,255, 0,255,255, 0, 0, 0,255,255, 0,255,255,255, 0,255,255,255,255,255,255, 0,255, 0,255,255,255,255,255,255, 3, 0,255,255,255,255,255,255,255,255,255, // ź,\n 18,129, 4, 3, 21, 21, 0, 23, 1, 42, 0, 15, 0, 3, 0, 40, 11, 0, 2, 40, 2, 56, 0, 19,255, 32, 15,255, 0, 0,255, 0, 0, 0, 4,255,255, 0,255, 0,255, 0, 0,255, 0,255, 0, 0, 2, 0, 0, 0,255,255,255,255,255, 30, 0,255, 0,255, 0,255,255,255,255,255, // ł,\n 0, 0, 2, 5, 3, 0, 0, 2, 0, 38, 44, 9, 8, 1, 16, 0, 0, 0, 7, 9, 5, 0, 0, 7, 0, 0, 28,255, 0, 0,255, 0, 0, 7, 0, 0,255, 2,255,255,255,255,255,255, 0, 0, 0, 0, 0,255,255, 0,255,255,255,255, 0, 0,255,255,255,255,255,255,255,255, 0, 0, // ą,\n 140, 48, 0, 1, 0, 50, 0, 0, 0, 33, 0, 0, 0, 0, 1, 19, 0, 0, 4, 0, 0, 12, 0, 0, 0, 0, 0,255,255,255,255,255,255,255,255, 0,255,255,255, 0, 2, 3, 0,255,255,255,255, 0, 0,255,255, 0, 4,255,255,255,255,255,255,255, 0,255,255, 0,255, 0,255, 0, // ş,\n 8, 3, 0, 0, 7, 56, 0, 0, 4, 1, 0, 0, 0, 0, 0, 13, 0,255, 0, 0, 0, 2, 0,255,255, 0, 0,255, 0,255,255, 0,255,255,255,255, 0,255,255, 5,255, 0,255, 0,255,255, 0,255,255,255, 0, 0,255,255,255,255,255,255, 0,255,255,255,255, 0,255,255, 0,255, // ľ,\n 30, 16, 0, 0, 3, 26,255, 0, 0, 5, 0, 5, 0, 0, 1, 27, 0,255, 1, 0, 0, 24, 0, 0, 0, 10, 0,255,255, 0,255,255, 0, 1, 11,255,255, 0,255,255,255,255, 0,255, 0,255,255, 0, 9, 0,255,255,255, 0,255, 0,255, 5, 0,255,255,255,255,255,255,255,255,255, // ż,\n 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0,255, 0,255, 0, 0,255, 0, 0, 0,255, 0,255,255,255, 0,255,255,255,255, 0,255,255,255,255,255,255, 0, 0,255,255,255,255,255,255, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255, // ŕ,\n 37, 0, 10, 9, 29, 2, 7, 20, 20, 13, 34, 45, 62, 52,115, 0, 15, 0, 97, 50, 87, 8, 57, 0, 0, 14, 82,255, 0, 0, 0, 3, 0, 0,255, 0, 0, 0, 0, 0,255,255,255,255, 0, 0, 7, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 3,255, 0, 0, 0, 0, 0, // á,\n 0, 0, 1, 19, 2, 0, 5, 2, 5, 0, 0, 0, 1, 48, 1, 0, 8, 0, 17, 2, 12, 0, 9, 0, 0, 0, 1,255, 0,255,255, 0,255,255,255, 0,255,255,255,255, 0, 0,255,255, 0, 0, 0, 0,255,255,255,255, 0,255, 0,255, 0,255,255,255,255,255,255,255,255, 0,255, 0, // â,\n 0, 0, 14,106, 14, 0, 9, 21, 1, 0, 0, 0, 51, 27, 62, 0, 36, 0, 72, 66,133, 7, 12, 0, 1, 0, 28,255, 0,255,255, 0,255,255,255, 0,255,255,255,255, 0, 0,255,255,255, 0, 0,255,255,255,255,255, 0,255, 0, 0,255,255,255,255,255,255,255,255,255,255,255, 35, // ă,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 2, 0, 0, 0, 0, 0, 10, 0, 0, 0, 0,255, 0,255,255, 0, 0, 0,255, 0,255, 0,255,255,255,255, 0,255,255, 0, 0,255,255,255,255,255,255, 0,255,255, 0,255,255,255, 0,255,255,255,255, 0, 0,255, // ä,\n 0, 0, 0,255, 5, 0,255, 0, 0, 0,255, 0,255, 0, 0, 0, 0,255, 0, 0, 1, 0, 0,255,255,255,255,255,255,255,255, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255, // ĺ,\n 15, 18, 0, 0, 0, 91, 0, 0, 0, 96, 0, 1, 0, 0, 0, 29,156,255, 1, 0, 0, 37, 0, 0, 0, 4, 0,255, 14, 40,255, 0, 0, 0, 1,255,255, 0,255, 0,255,255,255,255, 0,255, 0, 0, 1,255, 0, 0,255,255,255, 0,255, 0,255,255,255,255,255,255,255,255,255,255, // ć,\n 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0,255,255,255,255,255,255,255,255, 0,255,255,255, 0, 0,255, 0,255,255, 0,255, 0,255,255,255, 0,255,255,255,255,255,255, 0,255, 0,255,255,255,255, 0, 0,255, // ç,\n 118,219, 32, 0, 1, 87, 0, 0, 2,176, 3, 1, 3, 12, 26,106, 2, 0, 12, 4, 0, 54, 5, 0, 0, 1, 0,255, 76, 0, 0, 0,255, 0,255,255, 0,255, 0, 6, 0, 0, 3, 0, 0,255, 0, 0,255,255, 0, 3,255,255, 0,255, 0, 0, 0,255, 0, 0, 0, 10,255, 0, 0,255, // č,\n 106, 1, 6, 3, 16, 0, 11, 14, 4, 2, 5, 60, 49, 41, 86, 0, 11, 0, 28, 50, 74, 1, 32, 0, 0, 10, 33, 0, 0,255, 0, 0, 0, 0,255, 0,255, 0,255, 0,255,255,255,255, 0, 0, 0, 0,255,255,255, 0,255, 0, 0, 0, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0, // é,\n 0, 0, 4, 1, 2, 0, 0, 4, 0,101, 53, 10, 5, 7, 32, 0, 2, 0, 14, 2, 41, 0, 0, 7, 0, 0, 26,255, 0, 0,255, 0, 0, 5, 0, 0, 0, 1,255,255,255,255,255,255, 0, 0, 0, 0, 0, 0,255, 0,255,255,255, 0,255,255,255,255,255,255,255, 0,255,255, 0, 0, // ę,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255,255,255,255, 0,255,255,255, 0,255,255,255,255,255,255,255, 0, 0,255,255, 0,255,255, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255, // ë,\n 0, 0, 10, 0, 20, 0, 0, 0, 0, 0, 0, 0, 0, 36, 54, 0, 6, 0, 0, 0, 23, 0, 37, 0,255, 0, 0,255, 0,255, 0, 0, 0,255,255,255,255,255,255, 0,255,255,255,255, 0,255, 0, 0,255,255, 0, 0,255, 0,255, 0, 0,255,255,255,255, 0,255,255,255,255,255, 0, // ě,\n 11, 1, 6, 25, 14, 2, 1, 2, 5, 3, 21, 5, 12, 21,177, 0, 7, 0, 38, 11, 28, 1, 26, 0, 0, 7, 14,255, 29, 0, 0, 7, 0,255,255, 0, 0,255, 0, 4,255, 0,255,255, 0, 0, 14, 0,255,255, 0, 0, 0, 0, 0,255, 0, 0,255, 0,255, 51,255, 0, 0, 0,255, 0, // í,\n 239, 0, 1, 0, 2, 1, 0, 0, 1, 3, 2, 9, 8, 7, 7, 0, 1, 0, 7, 3, 5, 0, 4, 0, 0, 0, 0,255,255,255,255,255,255,255,255, 1,255,255,255, 0, 0, 0,255,255,255, 0, 0,255, 0, 0,255, 0, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255, 0, // î,\n 4, 4, 0,255, 0, 4,255,255,255, 0, 0,255, 0, 0, 0, 0,255,255, 0,255, 0, 0, 1,255,255, 0, 0,255,255,255,255, 0,255,255,255,255,255,255,255, 0,255,255, 0,255,255,255, 0, 0,255,255, 0, 0,255, 0,255,255, 0, 0,255,255,255,255,255, 0,255,255,255,255, // ď,\n 4, 31, 0,255, 0, 41,255, 0, 0, 1, 0, 0, 0, 0, 1, 69, 0,255, 4, 0,255, 3, 0, 0,255, 0, 0,255, 0,255,255, 63,255,255,255,255,255,255,255, 0,255,255,255,255,255,255, 0,255,255,255,255,255,255,255, 0,255,255, 0,255,255,255,255,255,255,255,255,255,255, // đ,\n 0, 48,255, 0, 0, 16,255,255, 0, 12, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 1,255, 0,255, 6, 0,255,255, 0,255,255, 0, 0, 0, 0,255, 0,255, 0,255,255,255,255,255,255,255, 0, 0, 0,255, 0,255,255, 0, 0,255, 0, 0,255,255,255, 0, 0,255,255,255,255, // ń,\n 0, 1, 0, 0, 3, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0,255, 0, 0, 0, 0, 0,255,255, 0, 0,255, 0,255, 0, 0,255,255,255,255, 0,255, 0, 0,255,255,255, 0,255,255, 0, 0,255,255, 0, 0,255, 0,255, 0, 0, 0, 0,255,255, 0, 0, 0,255, 0, 0,255, // ň,\n 3, 0, 8, 9, 10, 2, 3, 53, 3, 17, 6, 22, 42, 5, 7, 0, 26, 0, 52, 7, 32, 0, 2, 31, 0, 2, 20,255, 0, 0,255, 0, 0, 16,255,255,255, 1,255, 0,255,255, 0,255, 0, 0, 0, 0, 0,255,255, 0,255,255,255, 0, 0, 0,255, 0,255, 0,255, 0, 0, 0, 0, 0, // ó,\n 0, 0, 0, 1, 3, 0, 0, 0, 1, 0, 0, 3, 0, 4, 0, 0, 13,255, 1, 0, 0, 0, 1, 0, 0, 0, 0,255,255,255,255, 0,255, 0,255,255, 0, 0,255,255,255,255,255,255,255, 0,255, 0,255,255,255, 0,255,255, 0,255,255, 0, 0,255,255,255,255,255,255,255,255,255, // ô,\n 4, 0, 5, 0, 12, 0, 7, 1, 0, 0, 0, 5, 22, 0, 9, 0, 0,255, 9, 13, 33, 0, 2, 0, 0, 3, 23,255,255,255,255, 0,255,255,255,255,255,255,255, 0,255,255,255,255,255, 0,255, 0,255,255,255, 0,255,255,255,255,255, 0,255, 0, 0,255,255, 0, 0, 0,255,255, // ő,\n 13, 0, 2, 0, 6, 0, 5, 3, 2, 0, 1, 57, 7, 1, 5, 0, 0,255, 8, 2, 22, 0, 1, 0, 0, 2, 15,255, 0,255,255, 0,255, 0,255, 0,255,255,255, 0,255,255, 0,255,255, 0, 0, 0,255,255,255, 0,255,255,255,255,255, 0,255, 0, 0,255,255, 0, 0, 0,255,255, // ö,\n 16, 6, 5, 0, 3, 4, 0, 0, 2, 2, 0, 4, 0, 1, 0, 12, 66,255, 0, 0, 19, 2, 1, 0, 0, 2, 1,255, 0,255,255, 0,255,255,255,255,255,255, 0, 9,255,255,255,255,255,255, 0, 0,255, 0, 3, 5,255,255,255,255, 0, 0,255,255,255, 0, 0, 2,255,255, 0,255, // ř,\n 0, 0, 0, 2, 5, 0, 0, 0, 2, 0, 1, 5, 4, 3, 3, 0, 7, 0, 10, 1, 4, 0, 3, 0, 0, 0, 1, 0, 0,255, 0, 0,255, 0,255, 0,255,255,255, 0,255,255,255,255, 0,255, 0, 0,255,255,255, 0,255, 0,255,255, 0, 0,255,255, 0, 0, 0, 0,255, 0, 0,255, // ů,\n 27, 0, 0, 36, 2, 0, 0, 1, 1, 4, 26, 8, 4, 2, 8, 0, 1, 0, 14, 40, 14, 0, 2, 0, 0, 1, 4,255, 0,255, 0, 0,255,255,255,255, 0,255,255, 0,255,255,255,255, 0, 0, 0, 0,255,255, 0, 0,255, 0, 0,255, 0, 0,255, 0,255, 0, 0, 0, 0,255, 0, 0, // ú,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 17, 0, 0, 0,255, 4, 3, 3, 0, 1, 0, 0, 2, 1,255,255,255,255,255,255,255,255,255,255,255,255, 0,255,255,255,255,255,255,255, 0,255,255,255, 0,255,255,255,255,255, 0,255, 0,255,255,255, 0, 0, 0,255,255, // ű,\n 5, 0, 2, 0, 0, 0, 3, 1, 1, 0, 0, 8, 2, 2, 1, 0, 15, 0, 14, 4, 4, 0, 1, 1, 0, 3, 13,255, 0,255, 0, 0,255,255,255, 0,255, 0,255, 0,255,255, 0,255,255, 0, 0, 0,255, 0,255, 0,255,255,255,255, 0, 0,255, 0, 0,255,255, 0, 0, 0,255,255, // ü,\n 0, 0, 4, 0, 2, 0, 0, 0, 3, 0, 0, 52, 4, 1, 69, 0, 0,255, 13, 0, 11, 0, 56, 0,255, 0, 1,255, 0,255,255, 0,255,255,255,255,255,255,255, 0,255,255, 0,255,255,255, 0, 0,255,255, 0, 0,255,255,255,255, 0,255,255,255, 0, 0, 0, 0,255, 0, 0,255, // ý,\n 20,111, 1, 33, 0, 31, 0, 0, 0, 31, 0, 0, 5, 1, 78, 5, 2, 0, 10, 1, 0, 25, 2, 0, 0, 0, 0,255,255,255,255,255,255,255,255, 0,255,255,255, 0, 0, 25,255,255,255,255,255, 0,255,255,255, 0, 4,255,255,255,255, 0,255,255,255,255,255, 0,255,255,255, 0, // ţ,\n // , a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z, ß, š, ś, ť, ž, ź, ł, ą, ş, ľ, ż, ŕ, á, â, ă, ä, ĺ, ć, ç, č, é, ę, ë, ě, í, î, ď, đ, ń, ň, ó, ô, ő, ö, ř, ů, ú, ű, ü, ý, ţ,\n ],\n cyrillic: [\n 0, 0, 0, 0, 1, 0, 16, 38, 0, 2, 5, 10,121, 4, 20, 25, 26, 53, 9, 5, 61, 23, 20, 26, 15, 95, 60, 2, 26, 15, 25, 29, 0, 14, 6, 6, 25, 1, 0, 27, 25, 8, 5, 39, // ,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // a,\n 0, 0, 0,255, 0, 0,255, 0,255, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0,255, 0, 0, // ѓ,\n 0, 0,255, 0, 0, 0, 0, 0,255,255,255,255, 0,255, 2, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255,255, // ђ,\n 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255, 0,255, 0, 0, 0, 0, 0, 4, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255,255, // љ,\n 0, 0, 0, 0, 0, 0, 0, 0,255,255,255, 0, 0,255, 5, 0, 0, 0, 0, 2, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255,255, // њ,\n 0, 0,255, 0, 0, 0, 0, 0,255, 0,255,255, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 1,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255,255, // ћ,\n 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255,255, // џ,\n 7, 0, 0,255,255,255,255,255, 0, 1, 0,255,255,255, 15, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 1, 0, 0, 0, 1, // ў,\n 12, 0, 0,255,255, 0,255,255, 0, 2, 0, 0, 0, 0, 2, 3, 15, 5, 5, 0, 0, 4, 0, 0, 21, 15, 10, 17, 0, 6, 14, 4, 6, 0, 3, 1, 8, 1, 0, 0, 0, 2, 0, 0, 0, 0, // і,\n 0, 0,255,255,255,255,255,255, 0, 0, 0,255,255, 0, 4, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // ё,\n 6, 0, 0,255,255,255,255,255, 0, 0,255, 5,255, 0, 1, 7, 0, 3, 2, 0, 0, 0, 0, 0, 0, 2, 2, 2, 0, 0, 2, 2, 5, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // є,\n 12, 0, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 0, 0, 5, 1, 0, 0, 0, 2, 0, 0, 20,255, 0, 0, 0, 0, 15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0,255,255,255,255, // ј,\n 9, 0, 0,255,255,255,255,255,255, 5,255, 0, 0, 13, 3, 3, 0, 4, 1, 0, 1, 2, 0, 0, 0, 1, 0, 0, 4, 0, 0, 1, 3, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // ї,\n 32, 0, 0, 2, 2, 2, 0, 0, 0, 1, 0, 0, 28, 0, 23, 22, 26, 22, 19, 0, 3, 12, 5, 0, 44, 38, 18, 58, 1, 21, 44, 17, 54, 1, 2, 28, 5, 8, 3, 1, 9, 0, 12, 0, 0, 0, // а,\n 40, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 7, 0, 0, 0, 1, 7, 0, 1, 1, 0, 0, 7, 4, 1, 9, 0, 1, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, // б,\n 31, 0, 0, 0, 0, 0, 0, 0, 0, 11, 0, 3, 0, 0, 19, 0, 0, 1, 1, 6, 0, 2, 6, 0, 1, 0, 1, 0, 32, 0, 2, 2, 23, 9, 0, 0, 0, 1, 0, 0, 1, 1, 0, 3, 0, 2, // в,\n 23, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 7, 0, 1, 20, 0, 0, 1, 0, 9, 0, 0, 9, 7, 0, 5, 2, 18, 11, 0, 8, 3, 2, 3, 0, 0, 0, 0, 0, 0, 0, 3, 0, 13, 0, 3, // г,\n 26, 0, 0, 0, 0, 0, 0, 0, 0, 9, 0, 2, 0, 2, 19, 0, 1, 5, 0, 13, 2, 2, 3, 2, 0, 6, 1, 12, 30, 0, 4, 0, 0, 7, 0, 0, 0, 0, 0, 0, 1, 0, 0, 5, 0, 1, // д,\n 12, 0, 0, 1, 4, 5, 0, 0, 0, 0, 0, 0, 24, 1, 5, 7, 11, 3, 12, 1, 6, 6, 11, 0, 3, 15, 14, 14, 4, 8, 25, 14, 29, 0, 1, 1, 4, 8, 8, 2, 0, 3, 1, 0, 0, 0, // е,\n 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 1, 2, 2, 0, 0, 0, 0, 0, 3, 2, 1, 2, 0, 2, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, // ж,\n 19, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 1, 6, 0, 0, 0, 11, 8, 0, 0, 8, 0, 0, 0, 0, 0, 4, 0, 1, 0, 0, 3, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, // з,\n 24, 0, 0, 0, 0, 1, 5, 0, 0, 0, 0, 0, 1, 0, 1, 10, 16, 21, 22, 0, 6, 5, 6, 1, 15, 15, 8, 38, 2, 4, 27, 9, 15, 0, 3, 8, 12, 7, 6, 1, 0, 0, 0, 0, 0, 0, // и,\n 6, 0, 0, 0,255,255,255,255, 0, 7, 0, 0,255, 4, 21, 0, 0, 0, 0, 5, 0, 0, 39, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 5, 0, 3, 0, 0, // й,\n 54, 0, 0, 0, 0, 0, 0, 0, 1, 8, 0, 0, 0, 0, 10, 0, 1, 0, 1, 11, 0, 0, 12, 0, 1, 2, 0, 4, 8, 0, 2, 23, 2, 4, 0, 2, 3, 3, 8, 0, 0, 3, 16, 1, 4, 3, // к,\n 12, 0, 0, 0, 0, 0, 0, 0, 2, 6, 0, 6, 0, 4, 29, 12, 4, 5, 2, 18, 0, 0, 17, 4, 5, 11, 0, 0, 21, 2, 3, 4, 1, 15, 1, 0, 0, 0, 0, 0, 4, 3, 2, 12, 0, 2, // л,\n 23, 0, 0, 0, 0, 0, 0, 0, 0, 4, 0, 4, 0, 0, 17, 1, 0, 0, 0, 7, 0, 1, 13, 2, 0, 0, 0, 0, 13, 0, 2, 4, 0, 2, 0, 0, 0, 0, 0, 0, 1, 4, 2, 4, 1, 1, // м,\n 42, 0, 0, 0, 0, 0, 0, 0, 4, 12, 6, 7, 1, 7, 76, 0, 22, 1, 4, 27, 1, 3, 34, 30, 0, 7, 1, 13, 24, 1, 3, 5, 3, 4, 0, 1, 0, 4, 1, 0, 2, 18, 7, 16, 0, 4, // н,\n 37, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 1, 0, 1, 10, 27, 22, 15, 1, 2, 3, 7, 5, 32, 11, 7, 38, 8, 21, 24, 11, 23, 0, 2, 10, 2, 2, 3, 2, 0, 0, 1, 0, 0, 0, // о,\n 47, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4, 0, 1, 0, 0, 2, 0, 1, 2, 4, 0, 0, 2, 0, 6, 0, 0, 5, 0, 2, 0, 0, 0, 0, 1, 0, 0, 1, 0, 0, 0, 0, // п,\n 19, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 8, 0, 5, 47, 4, 6, 6, 5, 23, 0, 0, 5, 2, 6, 0, 0, 0, 23, 22, 0, 1, 14, 9, 1, 0, 1, 0, 0, 0, 7, 2, 8, 16, 0, 3, // р,\n 53, 0, 0, 0, 0, 0, 0, 0, 4, 9, 2, 0, 1, 2, 21, 1, 4, 1, 2, 11, 0, 0, 12, 2, 4, 7, 1, 13, 15, 1, 4, 6, 3, 6, 0, 0, 0, 0, 0, 0, 1, 2, 3, 5, 0, 1, // с,\n 28, 0, 0, 0, 0, 0, 0, 0, 1, 6, 0, 1, 0, 1, 32, 0, 1, 3, 0, 12, 0, 1, 22, 1, 4, 7, 1, 6, 23, 0, 14, 41, 14, 3, 0, 1, 1, 1, 21, 0, 2, 2, 6, 2, 1, 4, // т,\n 15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 2, 4, 2, 4, 6, 3, 0, 2, 0, 0, 6, 5, 6, 3, 0, 3, 7, 4, 7, 18, 1, 6, 0, 2, 0, 0, 0, 0, 0, 0, 1, 0, // у,\n 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 1, 0, 0, 1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // ф,\n 41, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 1, 0, 2, 30, 0, 2, 0, 0, 11, 0, 0, 5, 1, 14, 3, 0, 3, 6, 0, 7, 0, 0, 1, 0, 1, 0, 2, 0, 0, 0, 4, 3, 5, 0, 0, // х,\n 8, 0, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 7, 0, 0, 0, 0, 4, 0, 0, 7, 1, 0, 1, 0, 2, 1, 0, 0, 9, 0, 0, 0, 0, 2, 0, 0, 0, 0, 1, 0, 0, 1, 1, // ц,\n 6, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 5, 0, 1, 5, 0, 2, 0, 0, 6, 0, 0, 1, 0, 0, 3, 0, 2, 0, 0, 2, 0, 1, 0, 0, 3, 0, 0, 2, 0, 0, 0, 0, // ч,\n 12, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 17, 0, 0, 1, 0, 2, 0, 0, 26, 0, 0, 0, 0, 0, 22, 2, 6, 0, 0, 5, 0, 0, 0, 0, 2, 0, 0, 1, 0, 0, 0, 0, // ш,\n 2, 0,255, 0,255,255,255,255,255, 0, 0, 0,255, 0, 1, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, // щ,\n 0, 0,255,255,255,255, 0,255, 0, 0, 0,255,255,255, 0, 3, 4, 0, 2, 0, 0, 0, 0, 0, 11, 0, 1, 0, 0, 2, 2, 5, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // ъ,\n 1, 0, 0,255,255,255,255,255, 0, 0, 0, 0, 0,255, 0, 3, 11, 0, 4, 0, 2, 1, 0, 0, 0, 3, 1, 16, 0, 0, 22, 2, 10, 0, 0, 0, 8, 6, 3, 0, 0, 0, 0, 0, 0, 0, // ы,\n 0, 0, 0,255,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 5, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 15, 0, 7, 3, 0, 1, 13, 7, 7, 0, 35, 6, 0, 0, 0, 0, 0, 0, 0, 6, 0, // ь,\n 10, 0, 0,255,255,255,255,255, 0, 0, 0, 0,255, 0, 0, 1, 1, 10, 11, 0, 2, 2, 0, 0, 0, 9, 3, 9, 0, 0, 7, 6, 9, 0, 0, 8, 3, 2, 1, 0, 0, 0, 0, 17, 0, 0, // э,\n 14, 0, 0, 0,255,255,255,255, 0, 0, 0, 0,255, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 2, 0, 0, 2, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // ю,\n 5, 0, 0,255,255,255,255,255, 0, 9, 0, 0,255, 0, 11, 0, 3, 0, 0, 0, 0, 2, 24, 0, 0, 5, 2, 14, 1, 0, 2, 3, 1, 0, 0, 1, 3, 0, 0, 0, 0, 16, 1, 0, 0, 0, // я,\n // , a, ѓ, ђ, љ, њ, ћ, џ, ў, і, ё, є, ј, ї, а, б, в, г, д, е, ж, з, и, й, к, л, м, н, о, п, р, с, т, у, ф, х, ц, ч, ш, щ, ъ, ы, ь, э, ю, я,\n ],\n western: [\n 18, 3, 0,254, 74, 0, 5,254,254, 2, 25,254,149, 4,254, 66,148,254, 0,254,122,238, 8, 1, 20, 13,254, 35, 20, 3, 1, 0, // ,\n 0, 3, 0, 0, 0, 0, 0, 5, 2, 0, 86, 9, 76, 0, 0, 0,241, 0, 0, 49, 0, 0, 0, 0, 11, 2, 0, 34, 0, 1, 2, 0, // a,\n 19, 0, 0, 5, 5, 0, 0, 8, 13, 5, 0, 34, 22, 0, 0, 0, 4, 0, 0, 0, 6, 1, 3, 3, 42, 37, 8, 8, 0, 67, 0, 0, // b,\n 0, 0, 0, 9, 6, 1, 0, 22, 10, 1, 0, 19, 54, 1, 0, 1, 18, 3, 1, 2, 40, 7, 0, 0, 6, 0, 3, 5, 1, 34, 0, 0, // c,\n 0, 0, 0, 5, 5, 0, 0, 12, 45, 16, 1, 6, 42, 0, 13, 3, 10, 0, 2, 0, 66, 11, 5, 8, 33,104, 3, 4, 0, 19, 0, 0, // d,\n 63, 5, 0, 0, 0, 0, 2, 33, 15, 1, 3, 0, 87, 0, 0, 0, 0, 0, 1, 21, 0, 0, 0, 49, 1, 11, 0, 3, 0, 9, 1, 0, // e,\n 0, 0, 0, 8, 8, 0, 0, 10, 2, 7, 0,162, 23, 0, 13, 0, 4, 0, 0, 0, 1, 3, 0, 0, 15, 4, 0, 0, 0, 4, 0, 0, // f,\n 1, 0, 0, 14, 16, 24, 0, 29, 11, 41, 0, 13, 86, 0, 14, 9, 3, 0, 0, 0, 20, 8, 7, 7, 13, 37, 14, 0, 0, 12, 0, 0, // g,\n 1, 0, 0, 0, 0, 0, 0, 47, 2, 0, 0, 0, 1, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 29, 20, 0, 0, 0, 0, 45, 0, 0, // h,\n 5, 4, 0,166,120, 0, 0,144, 0, 2, 3, 88,254, 0, 0, 0, 0, 0, 0, 3, 28,107, 0,112, 8, 2, 44, 32, 0, 3, 3, 0, // i,\n 0, 0, 0, 0, 0, 0, 0, 39, 9, 0, 0, 2, 1, 0, 2, 0, 0, 0, 0, 4, 0, 0, 0, 16, 18, 44, 0, 0, 0, 0, 0,255, // j,\n 0, 2, 0, 0, 1, 0, 0, 48, 31, 32, 1, 60, 1, 0, 4, 0, 1, 0, 0, 0, 1, 3, 0, 2, 20, 47, 0, 0, 0, 20, 0, 0, // k,\n 4, 0, 0, 12, 16, 0, 0, 54, 40, 48, 0, 64, 36, 0, 39, 6, 12, 3, 0, 0, 27, 9, 3, 24, 42, 33, 2, 9, 7, 77, 0, 0, // l,\n 0, 0, 0, 14, 5, 4, 0, 60, 11, 4, 3, 48, 30, 7, 28, 1, 10, 1, 0, 0, 24, 41, 3, 3, 19, 24, 1, 8, 2, 36, 0, 0, // m,\n 1, 1, 0, 24, 91, 16, 0,132, 62, 73, 1, 56, 71, 33, 78, 7, 35, 2, 3, 0, 94,254, 10, 21, 33, 38, 24, 21, 1, 61, 0, 0, // n,\n 0, 1, 0, 0, 0, 0,254, 6, 0, 1, 27, 0, 13, 0, 0, 84,127, 0, 0, 62, 0, 1, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, // o,\n 0, 0, 0, 5, 2, 0, 0, 9, 15, 0, 0, 4, 34, 0, 6, 0, 6, 0, 0, 0, 20, 12, 9, 28, 10, 22, 0, 3, 0, 7, 0, 0, // p,\n 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 33, 1, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0,255,255, // q,\n 0, 0, 0, 83, 62, 1, 0,198,139,125, 0,229, 94, 54,190, 38, 18, 1, 0, 0,176, 24, 16, 29,193,181, 13, 13, 2,131, 0, 0, // r,\n 1, 0, 0, 41, 34, 0, 0, 41, 24, 42, 0, 68,113, 15,159, 6, 43, 19, 4, 58, 14, 18, 1, 4, 48, 42, 4, 12, 9, 20, 0, 0, // s,\n 7, 1, 0, 14, 20, 8, 0, 56, 37, 31, 0,104, 67, 14,113, 3, 50, 9, 5, 0, 89, 7, 19, 22, 13, 14, 40, 12, 15, 18, 0, 0, // t,\n 0, 1, 5, 1, 2, 0, 0, 30, 0, 0, 1, 15, 2, 0, 1, 0, 1, 0, 0, 2, 4, 0, 0, 36, 0, 0, 0, 0, 0, 0, 0, 0, // u,\n 0, 2, 0, 1, 6, 0, 0, 29, 33, 13, 0, 19, 46, 0, 15, 0, 7, 0, 1, 31, 2, 2, 3, 1, 32, 27, 0, 0, 1, 1, 0, 0, // v,\n 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 3, 0, 0, 4, 0, 0, 0, 0, 0, 0, 2, 0, 0, 1, 0, 0, 0, 0, 0, 0,255, // w,\n 0, 0, 0, 1, 16, 0, 0, 23, 0, 0, 0, 3, 14, 0, 0, 0, 2, 3, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, // x,\n 0, 0, 0, 0, 0, 0, 0, 58, 8, 0, 0, 1, 1, 62, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 6, 82, 0, 0, 0, 0, 0,255, // y,\n 0, 0, 0, 0, 2, 0, 0, 0, 14, 0, 0, 7, 3, 0, 6, 0, 3, 5, 0, 0, 0, 0, 4, 0, 1, 0, 0, 0, 0, 0, 0, 0, // z,\n 0, 29, 0, 0, 0, 15, 0, 0, 0, 11, 0, 0, 0, 0, 0, 20, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0, 0, 0,255,255, 0, 0,255,255, 4, 0, 0,255,255, 0,255, 0,255, 0, 0,255,255,255, 0, 0, 0, 8, 0,255, 0, 0, 2, 0, 0, // ß,\n 6, 2, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 10, 1, 0, 0, 0, 0, 0, 0, 0,255, 0, 1, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // š,\n 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0,255,255,255, 0, 0, 0,255,255,255, 0,255,255,255,255, 0, 0,255,255,255,255,255,255, 0,255,255,255, 0,255,255, // œ,\n 107, 0, 22, 16, 18, 14, 6, 24, 46, 15, 2, 0, 42, 18, 17, 0, 36, 0, 34, 4,254, 1, 2, 0, 0, 1, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0,255,255,255,255,255, 0, 0,255, 0, 0, 0, // à,\n 41, 0, 10, 8, 21, 34, 5, 5, 60, 18, 5, 1, 29, 42, 26, 2, 16, 0, 27, 9, 43, 28, 7, 0, 0, 1, 4, 0, 0,255, 0, 0,255,255,255, 0,255, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255, 0, 0, 0, 0, 0,255, // á,\n 24, 0, 1, 2, 0, 0, 0, 0, 7, 0, 0, 0, 3, 1, 0, 0, 0, 0, 2, 0, 5, 0, 1, 0, 0, 0, 0,255, 0,255, 0, 0, 0,255, 0,255, 0, 0, 0, 2, 0,255, 0,255, 0, 0, 0, 0,255, 0,255,255,255,255,255, 0,255, 0,255, // â,\n 0, 0, 0, 1, 2, 3, 0, 1, 2, 12, 0, 0, 1, 7, 29, 4, 1,255, 11, 66, 11, 0, 1, 0, 0, 0, 0,255, 0,255,255,255, 0, 0, 0,255,255,127,255,255,255,255,255, 0, 0,255, 0, 0,255,255, 0,255,255,255,255,255,255,255,255, // ã,\n 134, 1, 11, 0, 25, 6, 15, 11, 61, 24,123, 95,114, 68, 53, 1, 49, 0, 60, 98,198, 0, 88, 29, 0, 6, 12, 0, 0,255, 0,255, 0, 0,118, 0,255, 0,255, 0,255, 0,255, 0,255,255, 0,255,255, 0,255, 2,255,255,255, 0, 0, 0,255, // ä,\n 156, 0, 12, 14, 19, 3, 12, 47, 17, 3, 12, 5, 30, 47, 22, 0,205, 0,184, 70, 19, 0, 22, 8, 0, 6, 1,255, 0,255,255, 0,255, 0, 0, 0, 0, 0,255, 0,255, 0,255, 0, 0,255,255,255,255,255,255, 0, 0,255,255,255,255,255,255, // å,\n 26, 0, 7, 0, 4, 0, 23, 8, 15, 0, 18, 19, 56, 23, 24, 0, 9, 0, 82, 37, 24, 0, 71, 0, 0, 0, 0,255, 0,255,255, 0,255,255, 0, 0, 0, 0,255, 0,255,255,255, 0,255,255, 0,255,255,255,255, 0, 0,255,255,255,255, 0,255, // æ,\n 17,112, 0, 2, 0, 15, 0, 0, 0, 35, 0, 0, 2, 0, 59, 9, 1, 0, 36, 0, 0, 8, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, // ç,\n 254, 0, 9, 14, 20, 0, 15, 6, 70,144, 14, 45, 47, 92, 16, 3,123, 0, 38, 23,115, 52, 22, 42, 2, 80, 19,255, 0,255, 0, 0,255,255, 0,255,255, 0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255,255,255, 0, 0, 0, 1,255,255, // è,\n 152, 2, 19, 24, 85, 0, 29, 23, 26, 25, 2, 9, 43, 60, 62, 1, 32, 0,122, 45,169, 15, 13, 30, 7, 4, 8, 0, 0,255, 0, 0, 0, 0, 0,255, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 1,255, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, // é,\n 5, 0, 0, 3, 7, 0, 0, 10, 2, 3, 0, 26, 6, 6, 20, 1, 2, 0, 20, 1, 11, 5, 5, 2, 0, 0, 1,255, 0,255,255,255, 0,255,255,255,255, 0, 0, 0, 0, 0,255, 0, 0, 0, 0,255, 0, 0,255,255,255, 0,255, 0, 0, 0,255, // ê,\n 36, 2, 23, 15, 36,143, 5, 23, 52, 52, 66, 48, 92, 57,216, 10,125, 35, 89, 58,254, 9, 24, 14, 0, 0, 8,255, 0,255, 0,255,255,255, 0, 0,255, 1, 0, 0, 0, 0, 0,255, 0, 0, 0,255,255,255, 0, 0, 0, 0,255, 0, 0, 0,255, // ë,\n 12, 0, 1, 4, 6, 0, 3, 21, 10, 0, 0, 0, 18, 8, 4, 0, 1, 0, 65, 35, 8, 3, 0, 0, 0, 0, 0,255, 0,255, 0, 0,255,255,255,255,255,255, 0, 0, 0,255, 0, 0, 0,255, 0, 0,255, 0,255,255,255, 0,255,255, 0, 0,255, // ì,\n 40, 72, 7, 10, 16, 2, 23, 10, 34, 0, 0, 1, 34, 15, 21, 1, 3, 0,203, 28, 58, 23, 11, 0, 10, 0, 2, 0, 0, 0, 0, 0, 0,255, 0,255,255, 0, 0, 0, 0,255, 0, 0,255,255, 1,255, 0,255,255, 0,255,255, 0,255, 2, 0,255, // í,\n 6, 5, 1, 9, 5, 0, 0, 0, 22, 0, 9, 8, 8, 6, 9, 1, 10, 0, 20, 6,182, 0, 13, 0, 0, 24, 1,255, 0,255,255,255, 0, 0,255, 0,255, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255,255,255,255,255, 0,255,255,255, // î,\n 0, 6, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0,255, 0,255, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0,255, 0, 0, 0, 0,255,255, 0, 0, 0,255,255, // ï,\n 0,254, 0, 0, 0, 26, 0, 0, 0, 61, 0, 0, 0, 0, 0, 14, 0, 0, 0, 0, 0, 25, 0, 0, 0, 0, 0,255,255,255, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0,255, 0, 1, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0,255, 0,255,255, // ñ,\n 20, 0, 56, 43, 8,162, 14, 3, 23, 19, 2,118, 31, 26, 46, 0, 20, 0, 23, 6, 24, 19, 6, 21, 5, 27, 63,255, 0,255, 0, 0,255,255,255,255,255, 3, 0,255,255,255, 0, 0,255, 0, 0, 0, 0,255, 0,255,255, 0,255,255, 0,255,255, // ò,\n 67, 0, 12, 15, 9, 7, 8, 66, 13,254, 3, 23, 14, 16, 16, 0, 8, 0, 29, 11, 26, 0, 5, 5, 1, 10, 13,255, 0,255,255, 0,255, 0, 0,255,255, 1,255, 0,255,255, 0, 0,255, 0, 1, 0, 0, 0, 0,255,255,255, 0,255,255, 0,255, // ó,\n 18, 3, 3, 12, 1, 0, 2, 0, 7, 0, 1, 0, 2, 2, 8, 0, 6, 0, 6, 7, 4, 0, 2, 0, 0, 0, 1,255, 0, 0,255, 0, 0,255,255,255, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0,255,255,255,255, 0, 0,255,255,255, // ô,\n 29, 2, 0, 0, 0, 0, 0, 0, 5, 2, 22, 30, 25, 38, 19, 0, 33,255, 4, 39, 24, 0, 88, 0, 0, 0, 0,255, 0,255,255, 0,255, 0,255,255,255, 36,255,255,255,255,255, 0,255,255, 0,255, 0, 0, 6, 0,255,255,255, 0, 0, 0,255, // õ,\n 44, 0, 33, 0, 25, 0,142, 5, 46, 10, 25, 32, 26, 13, 6, 0, 3, 0, 30, 8, 35, 0, 25, 5, 0, 44, 7, 0, 0,255,255, 0,255,255, 73, 0,255, 0, 0, 0,255,255,255,255,255, 0, 0,255, 0, 0, 0, 39, 0,255,255,255, 0, 0, 0, // ö,\n 52, 0, 21, 0, 57, 0,119, 12, 47, 3, 59, 33, 45, 15, 12, 0, 3, 0, 52, 82, 49, 1, 11, 0, 0, 0, 0, 0,255, 0,255,255,255,255,255, 0, 0, 0,255, 0,255,255,255, 0,255,255, 0,255,255,255,255, 0, 0,255,255,255,255,255, 0, // ø,\n 25, 0, 4, 3, 53, 0, 0, 2, 12, 72, 0, 0, 30, 0, 0,254, 0, 0, 6, 3, 3, 0, 0, 0, 0, 0, 0,255, 0,255, 0,255, 0,255,255,255,255, 0, 0, 0, 0,255, 0,255,255,255,255, 0,255, 0, 0,255,255, 0, 0, 0, 0, 0, 0, // ù,\n 19, 2, 1, 7, 9, 1, 12, 5, 9, 41, 1, 0, 10, 7, 9, 0, 8, 0, 12, 28, 8, 0, 0, 0, 0, 1, 0,255, 0,255,255, 0,255,255,255,255, 0, 0,255, 0,255,255,255, 0,255,255, 0, 0, 0,255, 0,255,255, 0, 0,255,255, 0,255, // ú,\n 0, 0, 0, 0, 1, 5, 0, 0, 1, 0, 0, 0, 0, 0, 0, 45, 0, 0, 3, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255, 0,255,255,255,255, 0,255, 0,255,255,255, 0, 0,255,255,255,255, 0,255,255,255, 0,255, 0, 0,255, 0, // û,\n 95, 2, 19, 0, 6, 2,121, 9, 15, 1, 5, 44, 18, 26, 7, 0, 11, 2, 68, 49, 20, 0, 2, 17, 0, 0, 6, 0, 0,255, 0,255,255,255, 0,255,255, 0,255, 0,255, 0,255,255,255, 0, 0,255,255,255, 0, 0,255, 0, 0, 0, 31, 0, 0, // ü,\n 1, 1, 0, 0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0,255,255, 0, 0,255, 0,255, 0,255,255,255,255, 0, 0, 0, 0,255, 0, 0, 0, 0, 0,255, // ž,\n 0, 0, 0, 0, 0, 0,255, 0, 0,255, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255,255, 0,255,255,255,255,255,255, 0,255, 0,255,255,255,255,255,255,255,255,255,255,255,255,255, 0, 0,255, 0,255,255,255, 0, 0, 0, // ÿ,\n // , a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z, ß, š, œ, à, á, â, ã, ä, å, æ, ç, è, é, ê, ë, ì, í, î, ï, ñ, ò, ó, ô, õ, ö, ø, ù, ú, û, ü, ž, ÿ,\n ],\n icelandic: [\n 0, 68, 0, 0, 2,122,156, 5, 1, 1, 5, 1, 0, // ,\n 0, 2,255, 0, 0, 6, 51, 2, 0, 0, 5, 0, 19, // a,\n 0, 1, 0, 0, 0, 4, 2, 2, 0, 0, 0, 0, 0, // b,\n 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0,255, // c,\n 0, 0, 0, 2, 0, 2, 0, 0, 0, 5, 0, 1,255, // d,\n 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 22, // e,\n 0, 4, 0, 1, 0, 5, 3, 3, 13, 0, 0, 0, 0, // f,\n 0, 4, 0, 3, 1, 7, 2, 10, 12, 19, 7, 3, 0, // g,\n 0, 2, 0, 0, 0, 0, 3, 1, 0, 0, 0, 0, 0, // h,\n 0, 1, 0, 0, 0, 0, 69, 0, 0, 0, 1, 2, 4, // i,\n 0, 0, 0, 1, 0, 0, 2, 0, 0, 0, 0, 1, 8, // j,\n 0, 3, 0, 5, 1, 21, 1, 10, 4, 10, 11, 0,255, // k,\n 0, 30, 0, 8, 9, 4, 6, 78, 20, 18, 4, 1, 0, // l,\n 0, 2, 0, 5, 0, 8, 2, 9, 1, 3, 1, 1, 0, // m,\n 0, 9, 4, 4, 0, 11, 2, 18, 11, 6, 13, 3, 0, // n,\n 0, 0,255, 0, 0, 0, 0, 0,255,255, 0, 0, 3, // o,\n 0, 1, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0,255, // p,\n 0,255,255,255, 0, 0,255,255,255,255,255,255,255, // q,\n 0, 45, 1, 13, 7, 2, 7, 25, 17, 59, 9, 8, 7, // r,\n 0, 8, 1, 2, 1, 37, 13, 5, 0, 1, 9, 9, 0, // s,\n 0, 17, 0, 14, 7, 6, 1, 17, 3, 3, 14, 5, 0, // t,\n 0, 0, 0, 0, 0, 7, 61, 0, 0, 0, 0, 3, 1, // u,\n 0, 5, 0, 2, 0, 3, 4, 3, 0, 9, 0, 0, 6, // v,\n 0, 0,255,255,255,255,255, 0, 0, 0,255,255,255, // w,\n 0, 0, 0, 0, 0, 0,255, 0, 0,255, 0,255,255, // x,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, // y,\n 0, 0,255, 0, 0, 0,255, 0, 0,255, 0, 0,255, // z,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0,255,255, 0,255, 0,255, 0, // ß,\n 83, 0, 2, 0, 4, 0, 2, 3, 6, 0, 16, 3, 9, 23, 5, 0, 2,255, 24, 3, 7, 0, 5, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 0, 0,255,255, 0, 0, 8, // á,\n 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0,255, 0,255, 0, 0, 0,255, 1, 0,255,255, 0,255,255, 0,255,255,255,255,255,255,255,255,255,255, // ä,\n 4, 0, 7, 0, 3, 0, 8, 1, 4, 0, 0, 0, 5, 2, 3, 0, 4,255, 18, 5, 8, 0, 8, 0, 0, 0,255,255, 0,255, 0,255, 0, 0, 0,255,255, 0, 0, 2, // æ,\n 1, 0, 0, 0, 0, 0, 8, 0, 3, 0, 0, 0, 2, 0, 0, 0, 0,255, 6, 6, 0, 0, 1, 0, 0, 0, 0, 0,255,255,255, 0,255,255,255,255,255,255,255, 0, // é,\n 126, 2, 2, 0, 1, 0, 1, 2, 0, 0, 0, 3, 16, 2, 5, 0, 1, 0, 25, 28, 19, 0, 29, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 0, 0,255,255, 0,255, 0, // í,\n 0, 95, 0,255, 0, 24, 5, 5, 0,122, 0, 0, 0, 0, 0, 7, 0,255, 46, 0, 0, 20, 2,255,255, 6,255, 0, 8,255, 23, 0, 36, 0, 13, 7, 21, 1, 2,255, // ð,\n 8, 0, 63, 0, 7, 0, 22, 2, 3, 4, 39, 9, 5, 4, 5, 0, 1,255, 13, 8, 21, 0, 5, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 0, 0, 0,255, 0, 0, 5, // ó,\n 9, 0, 1, 0, 0, 0, 1, 2, 8, 0, 18, 2, 10, 4, 3, 0, 0,255, 4, 6, 11, 0, 5, 0, 0, 0, 0,255, 0,255, 0,255, 0, 0, 0, 0,255, 0, 0, 0, // ö,\n 17, 0, 3,255, 3, 0, 40, 1, 11, 0, 14, 1, 13, 2, 2, 0, 0,255, 14, 9, 12, 0, 12,255,255, 0,255,255,255,255,255,255, 0, 0, 0,255,255, 0,255,255, // ø,\n 20, 0, 9, 0, 0, 0, 0, 2, 7, 0, 6, 3, 1, 1, 10, 0, 0,255, 12, 3, 3, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 0, 0, 0, 0,255,255, 0, 0, 1, // ú,\n 1, 0, 9, 0, 2,255, 0, 0, 0,255, 0, 1, 6, 0, 7,255, 0,255, 1, 4, 9,255, 0,255, 0, 0, 0,255,255,255,255,255,255, 0, 0,255,255, 0,255, 4, // ý,\n 87, 1,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255, 0,255,255, 0,255, 0, 0, 2, 0, 0, 0,255, 0, 0, 0, // þ,\n // , a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z, ß, á, ä, æ, é, í, ð, ó, ö, ø, ú, ý, þ,\n ],\n greek: [\n 0, 12, 0, 16, 6, 69, 1, 0, 0, 24, 0, 33, 0, 41, 2, 2, 1, 50, 0, 44, 1, 2,105, 1, 2, 33, 0, 0, 0, 2, 0, 0, 15, 5, 1, // ,\n 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // a,\n 0, 0,255, 0, 0,255,255, 0,255,255, 0, 0,255, 0,255, 0,255,255,255,255,255, 0,255,255,255, 0,255, 0,255,255,255, 0,255,255,255,255,255, // ΐ,\n 4, 0, 0, 0, 0,255, 0, 0, 1, 1, 0, 0, 0, 0, 0, 4, 7, 4, 3, 3, 0, 0, 3, 6,255, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, // ά,\n 9, 0,255,255, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 2, 1, 3, 2, 6, 2, 0, 0, 2, 2,255, 0, 5, 0, 1, 1, 0, 0, 0, 0, 0,255,255, // έ,\n 3, 0,255,255,255,255, 0, 0, 0, 1, 1, 0, 0, 0, 1, 0, 10, 3, 1, 2, 0, 0, 0, 2,255, 0, 4, 0, 1, 1, 0, 0, 0,255,255,255,255, // ή,\n 0, 0,255, 0, 0,255, 0, 5, 1, 2, 2, 15, 0, 0, 0, 0, 1, 4, 1, 5, 0, 5, 2, 14,255, 3, 4, 0, 1, 1, 0, 0, 0, 0, 0,255,255, // ί,\n 46, 0, 0, 0, 1, 0, 22, 0, 4, 3, 4, 0, 1, 0, 2, 20, 34, 8, 15, 23, 1, 0, 13, 18,255, 5, 30, 1, 4, 3, 0, 0, 0, 0, 0, 0, 0, // α,\n 10, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 2, 0, 0, 1, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // β,\n 15, 0, 0, 1, 1, 0, 0, 7, 0, 1, 0, 2, 0, 6, 0, 1, 0, 0, 0, 0, 0, 5, 0, 5,255, 0, 0, 2, 0, 0, 0, 1, 0, 0, 1, 0, 0, // γ,\n 19, 0, 0, 3, 0, 0, 4, 2, 0, 0, 0, 1, 0, 0, 0, 3, 0, 0, 0, 3, 0, 4, 0, 0,255, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, // δ,\n 33, 0, 0, 0, 0, 0, 2, 0, 2, 4, 7, 0, 2, 0, 5, 2, 9, 9, 16, 8, 1, 0, 10, 7,255, 15, 15, 0, 1, 5, 0, 0, 0, 0, 0, 0, 0, // ε,\n 1, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, // ζ,\n 10, 0, 0, 0, 0, 0, 0, 0, 0, 1, 3, 0, 0, 0, 4, 0, 2, 8, 3, 6, 1, 0, 1, 3,255, 14, 41, 0, 0, 1, 0, 0, 0,255, 0, 0, 0, // η,\n 5, 0, 0, 1, 0, 1, 0, 5, 0, 0, 0, 2, 0, 1, 0, 1, 0, 0, 0, 1, 0, 1, 0, 1,255, 0, 0, 1, 0, 0, 0, 0, 0,255, 0, 0, 0, // θ,\n 6, 0, 0, 0, 0, 0, 0, 28, 2, 8, 12, 19, 0, 0, 0, 0, 3, 9, 5, 10, 0, 12, 6, 19,255, 6, 19, 0, 2, 1, 0, 0, 0, 0, 0, 0, 0, // ι,\n 44, 0, 0, 1, 1, 0, 2, 8, 0, 5, 0, 5, 0, 4, 0, 33, 0, 0, 0, 0, 0, 3, 0, 2,255, 4, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, // κ,\n 7, 0, 0, 5, 3, 0, 1, 10, 1, 1, 0, 9, 0, 2, 1, 3, 3, 9, 0, 0, 0, 10, 4, 0,255, 0, 0, 3, 0, 0, 0, 0, 0, 0, 3, 1, 0, // λ,\n 20, 0, 0, 1, 1, 3, 0, 5, 0, 1, 0, 3, 0, 8, 1, 3, 0, 0, 2, 0, 0, 8, 0, 2,255, 5, 0, 4, 0, 0, 0, 2, 0, 0, 3, 1, 0, // μ,\n 12, 0, 0, 6, 8, 1, 7, 30, 0, 1, 0, 10, 0, 14, 1, 8, 0, 0, 0, 1, 0, 16, 0, 1,255, 0, 0, 8, 0, 1, 0, 13, 0, 0, 5, 3, 9, // ν,\n 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, // ξ,\n 20, 0, 0, 0, 0, 0, 9, 0, 3, 9, 6, 0, 1, 0, 2, 14, 12, 13, 10, 14, 0, 0, 26, 21,255, 4, 54, 0, 4, 3, 0, 0, 0, 0, 0, 0, 0, // ο,\n 45, 0, 0, 1, 0, 0, 0, 13, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 5, 0, 0, 6, 0, 0,255, 2, 0, 5, 0, 0, 0, 1, 0, 0, 2, 1, 0, // π,\n 3, 0, 0, 5, 5, 1, 2, 17, 3, 4, 4, 19, 0, 3, 1, 4, 5, 0, 0, 0, 0, 14, 12, 0,255, 0, 9, 5, 1, 4, 0, 2, 0, 0, 3, 2, 1, // ρ,\n 0, 0, 0, 1, 6, 6, 0, 14, 0, 0, 0, 9, 0, 21, 0, 6, 0, 0, 0, 0, 0, 17, 0, 0,255, 0, 0, 5, 0, 0, 0, 4, 0, 0, 7, 1, 0, // ς,\n 43, 0, 0, 3, 2, 3, 4, 10, 0, 0, 0, 4, 0, 6, 0, 13, 0, 0, 0, 1, 0, 7, 0, 0,255, 2, 2, 5, 0, 0, 0, 3, 0, 0, 3, 2, 1, // σ,\n 73, 0, 0, 4, 2, 3, 3, 21, 0, 0, 0, 10, 0, 5, 0, 4, 4, 0, 0, 16, 0, 3, 2, 2,255, 35, 0, 5, 0, 0, 0, 3, 0, 0, 7, 1, 1, // τ,\n 4, 0,255, 0, 0, 0, 0, 4, 0, 0, 1, 5, 0, 0, 1, 0, 2, 1, 0, 0, 0, 53, 0, 1,255, 7, 1, 0, 1, 0, 0, 0,255,255, 0, 0, 0, // υ,\n 6, 0, 0, 1, 0, 0, 0, 5, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 2, 0, 0,255, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // φ,\n 9, 0, 0, 0, 3, 0, 1, 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 2, 0, 4,255, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // χ,\n 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, // ψ,\n 2, 0, 0, 0, 0, 0, 1, 0, 0, 1, 0, 1, 0, 0, 0, 1, 1, 1, 0, 3, 0, 0, 1, 4,255, 1, 6, 0, 1, 1, 0, 0, 0,255, 0, 0, 0, // ω,\n 0, 0,255, 0, 0, 0, 0, 1, 0,255,255, 0,255, 0,255, 0, 0, 0, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0,255, 0, 0,255, 0, 0, 0, // ϊ,\n 0, 0,255, 0, 0,255, 0, 0,255,255, 0, 0,255,255,255, 0,255, 0,255,255,255, 0,255, 0,255, 0, 0, 0,255,255,255, 0,255,255, 0,255,255, // ϋ,\n 6, 0, 0,255, 0,255, 0, 0, 0, 1, 1, 0, 0, 0, 0, 2, 11, 1, 4, 3, 0, 0, 9, 5,255, 1, 4, 0, 0, 0, 0, 0, 0,255, 0,255,255, // ό,\n 0, 0,255,255, 0,255,255, 0, 0, 0, 0, 2, 0, 0, 0, 0, 1, 1, 0, 0, 0, 13, 0, 0,255, 2, 0, 0, 0, 0, 0, 0,255,255, 0,255,255, // ύ,\n 0, 0,255,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 2, 1, 0, 2, 0, 0, 0, 3,255, 0, 1, 0, 0, 1, 0, 0, 0,255,255,255,255, // ώ,\n // , a, ΐ, ά, έ, ή, ί, α, β, γ, δ, ε, ζ, η, θ, ι, κ, λ, μ, ν, ξ, ο, π, ρ, ς, σ, τ, υ, φ, χ, ψ, ω, ϊ, ϋ, ό, ύ, ώ,\n ],\n turkish: [\n 195,254, 0,140, 0, 12,220,165, 2, 1, 58, 25, 27, // ,\n 1, 23, 0, 2, 0, 19, 0, 0, 4, 0, 0, 1, 26, // a,\n 2, 53, 0, 12, 0, 0, 3, 5, 0, 0, 1, 1, 0, // b,\n 13, 31, 0, 4, 0, 0, 0, 0, 0, 0, 0, 2, 0, // c,\n 7,161, 0, 22, 0, 0, 11, 4, 1, 3, 1, 2, 16, // d,\n 0, 18, 0, 0, 0, 22, 0, 0, 6, 0, 1, 0, 14, // e,\n 3, 19, 0, 12, 0, 0, 0, 1, 0, 0, 0, 8, 1, // f,\n 0, 45, 0, 0, 0, 0, 1, 2, 0, 0, 2, 0, 0, // g,\n 0, 27, 0, 21, 0, 0, 1, 2, 0, 0, 0, 2, 0, // h,\n 0, 7, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, // j,\n 37,114, 0, 30, 0, 1, 8, 25, 0, 2, 4, 14, 6, // k,\n 60,157, 0, 45, 0, 4, 3, 9, 13, 19, 1, 21, 18, // l,\n 39,105, 0, 19, 0, 2, 6, 5, 0, 1, 2, 22, 10, // m,\n 105,198, 0, 63, 0, 0, 89, 46, 0, 28, 13, 36, 0, // n,\n 1, 54, 0, 0, 0, 7, 0, 0, 0, 0,255, 0, 1, // o,\n 2, 22, 0, 0, 0, 0, 0, 3, 0, 0, 3, 6, 0, // p,\n 8, 12, 0, 6, 0, 0, 0, 0, 0, 0, 0, 1, 1, // q,\n 44,125, 0,124, 0, 0, 21, 23, 6, 22, 10, 42, 1, // r,\n 18,123, 0, 48, 0, 0, 0, 17, 0, 2, 3, 7, 0, // s,\n 5,117, 0, 35, 0, 1, 2, 7, 0, 1, 1, 4, 25, // t,\n 0, 3, 0, 0, 0, 1, 0, 0, 23, 0, 0, 0, 7, // u,\n 1, 30, 0, 4, 0, 0, 2, 2, 0, 11, 0, 1, 0, // v,\n 0, 2, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, // w,\n 3, 9, 0, 3, 0, 0, 3, 0, 0, 0, 0, 1, 0, // x,\n 8, 73, 0, 14, 0, 0, 1, 5, 0, 8, 5, 7, 0, // y,\n 12, 34, 0, 10, 0, 0, 10, 5, 0, 10, 0, 26, 0, // z,\n 25, 0, 2, 22, 54, 0, 8, 2, 4, 0, 38, 68, 26, 55, 0, 10, 7, 67, 64, 38, 0, 0, 0, 4, 44, 9, 3, 0, 0, 0, 0, 15,255,255, 28, 0,255, 0, 17, // ı,\n 228, 15, 82, 26,125, 8, 28, 37, 54, 38,120,164, 71, 79, 6, 17, 7,254,151,193, 4, 68, 61, 9, 15, 20, 0, 2, 0, 0, 0, 26, 0, 0, 22, 0, 0, 0, 36, // i,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, // ß,\n 36, 0, 20, 12, 81, 0, 14, 9, 24, 0, 17,101, 55, 24, 0, 1, 12, 35, 31, 42, 0, 36, 0, 7, 21, 21, 0, 1, 0, 0,255, 4,255,255, 0, 0,255, 3, 24, // ä,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0,255, 0, 0,255, 0,255, 0, // â,\n 31, 17, 0, 0, 0, 11, 0, 0, 2, 0, 10, 8, 1, 2, 1, 0, 0, 4, 0, 4, 3, 7, 0, 1, 0, 0, 1, 19, 0, 3, 0, 0, 0, 0, 0, 0, 0, 5, 1, // ç,\n 23, 0, 9, 1, 20, 0, 1, 6, 13, 7, 17, 18, 15, 48, 0, 12, 0, 57, 7, 23, 0, 20, 23, 2, 57, 5,255, 0, 0,255,255, 3, 0, 0, 0,255, 0,255, 6, // ê,\n 20, 0, 6, 5, 24, 0, 4, 2, 6, 16, 25, 21, 15, 33, 0, 4, 1, 52, 12, 20, 0, 13, 17, 0, 16, 10,255, 0, 0,255, 0, 2, 0, 0, 0,255, 0,255, 7, // î,\n 0, 35, 0, 0, 0, 12, 0, 0, 0,255, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 10, 0, 0, 0, 0, 0, 13, 16, 0, 0, 0, 0,255, 0, 0, 2, 0, 2, 0, // ğ,\n 30, 0, 11, 0, 6, 0, 0, 22, 1, 0, 10, 0, 2, 4, 0, 0, 0, 0, 3, 3, 0, 0, 0, 0, 14, 1, 0, 0, 0, 0,255, 1,255,255, 0, 0,255, 0, 0, // ö,\n 45, 0, 20, 0, 4, 0, 0, 0, 1, 0, 2, 1, 4, 5, 0, 1, 0, 10, 2, 5, 0, 0, 0, 0, 1, 0,255, 0, 0,255,255, 3, 0, 0, 0,255, 0, 0, 3, // û,\n 20, 0, 11, 5, 26, 0, 0, 15, 3, 0, 11, 26, 21, 17, 0, 0, 1, 15, 8, 34, 0, 2, 0, 1, 17, 2, 0, 0, 0, 0, 0, 6,255, 0, 2, 0,255, 0, 3, // ü,\n 33, 45, 1, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 14, 0, 0, 12, 0, 1, 5, 0, 0, 28, 33, 0, 11, 0, 0, 6, 5, 0, 0, 2, 6, 0, // ş,\n // , a, b, c, d, e, f, g, h, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z, ı, i, ß, ä, â, ç, ê, î, ğ, ö, û, ü, ş,\n ],\n hebrew: [\n 0, 1, 0, 0, 0, 0, 0, 28, 29, 17, 24,144, 46, 26, 7, 88, 68, 22, 2, 71,106, 3,200, 0, 35, 69, 10, 2, 9, 2, 13,104, 19,138, // ,\n 0,255,255, 0,255,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, // a,\n 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, // ְ,\n 0, 0, 0, 0,255,255, 0,255, 1, 20, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, // ַ,\n 0,255, 0, 0, 0,255, 0,255,255, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 0, 0, 0, 0, // ָ,\n 0,255, 0, 0, 0, 0,255,255,255, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0,255, 0,255, 0, 0,255, 0, 3,255, 0, 0, 0, 0, 0, // ּ,\n 1,255, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0,255,255,255,255, 0, 0,255, 0, 0,255,255,255, 0, 0, 0,255,255,255, 0, 0, 0, 0, 0, // װ,\n 0,255,255,255,255, 0, 0,255,255, 0, 0,255, 0, 0, 0, 0,255, 0,255,255,255, 0,255, 0,255, 0,255,255,255, 0,255, 0, 0, 0, 0,255, // ױ,\n 0,255, 0, 0,255, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0,255, 0,255, 0, 0, 0,255, 0,255, 0, 0, 0, 0, 0, // ײ,\n 171, 0, 0, 0, 0, 0, 0,255, 0, 0, 20, 14, 15, 21, 22, 5, 0, 22, 15, 0, 2, 17, 0, 16, 0, 16, 6, 2, 0, 27, 0, 3, 25, 30, 5, 3, // א,\n 101, 0, 0, 0, 0, 0,255, 0, 0, 11, 2, 2, 2, 7, 22, 0, 4, 1, 15, 0, 3, 6, 0, 5, 0, 2, 1, 7, 0, 0, 0, 3, 5, 16, 6, 4, // ב,\n 44, 0, 0, 0, 0, 0,255, 0, 0, 7, 1, 0, 2, 5, 9, 0, 0, 6, 12, 0, 0, 3, 0, 2, 0, 17, 1, 15, 0, 1, 0, 0, 0, 7, 1, 1, // ג,\n 70, 0, 0, 0, 0, 0,255, 0, 0, 9, 4, 4, 0, 4, 16, 0, 5, 0, 15, 0, 3, 5, 0, 8, 0, 20, 3, 7, 0, 2,255, 1, 2, 4, 0, 0, // ד,\n 158, 0, 0, 0, 0, 0, 0,255,255, 5, 8, 2, 6, 3, 8, 5, 4, 2, 36, 0, 4, 17, 0, 11, 0, 16, 1, 4, 0, 4, 0, 2, 5, 16, 9, 5, // ה,\n 42, 0, 0, 0, 0, 0, 0,255,255, 48, 21, 16, 18, 19, 73, 5, 13, 12, 38, 0, 11, 22, 0, 30, 0, 25, 10, 13, 0, 32, 0, 18, 22, 34, 19, 17, // ו,\n 32, 0, 0, 0, 0, 0,255, 0, 0, 8, 0, 0, 2, 1, 6, 0, 2, 0, 25,255, 1, 0, 0, 2, 0, 1, 0, 4, 0, 0,255, 0, 0, 0, 0, 0, // ז,\n 18, 0, 0, 0, 0, 0,255,255,255, 8, 4, 0, 0, 6, 7, 0, 0, 1, 10, 0, 1, 5, 0, 6, 0, 2, 0, 0, 0, 1, 0, 1, 0, 4, 4, 5, // ח,\n 22, 0, 0, 7, 1, 0,255, 0, 0, 28, 1, 4, 0, 2, 6, 0, 0, 0, 30, 0, 5, 9, 0, 4, 0, 20, 21, 12, 0, 7, 0, 1, 10, 16, 20, 0, // ט,\n 31, 0, 0, 0, 0, 0, 0,255,255, 65, 31, 9, 45, 19, 60, 22, 12, 19, 78, 0, 9, 37, 0, 25, 0, 45, 15, 12, 0, 15, 0, 15, 17, 50, 25, 13, // י,\n 0,255, 0, 0, 0, 0,255, 0, 0, 5, 0, 0, 0, 0, 2, 0, 0, 0, 10, 0, 1, 1, 0, 0, 0, 0, 0, 1, 0, 0,255, 0, 0, 4, 0, 0, // ך,\n 29, 0, 0, 0, 0, 0,255, 0, 0, 5, 2, 0, 0, 4, 7, 2, 0, 0, 5, 0, 0, 4, 0, 4, 0, 1, 1, 3, 0, 0,255, 0, 0, 6, 2, 1, // כ,\n 64, 0, 0, 1, 0, 0, 0, 0, 0, 35, 7, 8, 2, 5, 29, 1, 6, 4, 20, 0, 8, 4, 0, 7, 0, 1, 2, 18, 0, 4, 0, 2, 6, 2, 29, 2, // ל,\n 0, 0, 0, 0, 0, 0,255, 0, 0, 2, 0, 3, 1, 3, 9, 0, 0, 0, 65, 0, 0, 2, 0, 0, 0, 0, 0, 11,255, 0,255, 0, 0, 0, 5, 1, // ם,\n 89, 0, 0, 0, 0, 0,255, 0, 0, 12, 11, 1, 2, 21, 15, 2, 3, 1, 10, 0, 2, 8, 0, 5, 0, 1, 2, 7, 0, 0, 0, 2, 1, 5, 7, 10, // מ,\n 1,255, 0, 0, 0, 0, 0, 0, 0, 13, 8, 3, 3, 1, 48, 1, 0, 12, 37, 0, 3, 3, 0, 3, 0, 0, 2, 31, 0, 3,255, 1, 1, 15, 5, 1, // ן,\n 24, 0, 0, 2, 0, 0, 0, 0, 0, 35, 8, 2, 1, 5, 26, 0, 1, 1, 35, 0, 4, 4, 0, 8, 0, 0, 1, 30, 0, 5, 0, 0, 2, 3, 13, 2, // נ,\n 22, 0, 0, 0, 0, 0, 0, 0, 0, 16, 4, 0, 0, 6, 14, 0, 2, 1, 17, 0, 1, 2, 0, 6, 0, 5, 0, 12, 0, 2,255, 0, 3, 5, 0, 0, // ס,\n 33, 0, 0, 0, 0, 1, 0, 0, 0, 0, 16, 44, 38, 14, 25, 8, 0, 46, 36, 0, 5, 20, 0, 25, 0, 25, 5, 1, 0, 11, 0, 5, 15, 19, 18, 1, // ע,\n 0,255, 0, 0, 0, 0,255, 0,255, 0, 0, 0, 1, 0, 2, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0,255, 0, 0, 0, 0, 0, // ף,\n 76, 0, 0, 0, 0, 0,255, 0, 0, 13, 2, 0, 0, 8, 12, 0, 0, 0, 9, 0, 1, 4, 0, 5, 0, 2, 10, 8, 0, 0,255, 1, 1, 4, 5, 3, // פ,\n 0, 0, 0, 0, 0, 0,255,255,255, 0, 2, 0, 0, 0, 1, 0, 0, 0, 1,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, // ץ,\n 24, 0, 0, 0, 0, 0,255,255, 0, 4, 1, 0, 0, 5, 7, 0, 0, 0, 7, 0, 0, 1, 0, 5, 0, 5, 0, 2, 0, 0,255, 0, 2, 3, 0, 0, // צ,\n 39, 0, 0, 0, 0, 0, 0, 0, 0, 7, 3, 0, 1, 6, 9, 0, 4, 0, 17, 0, 0, 5, 0, 7, 0, 5, 3, 9,255, 3,255, 0, 0, 5, 1, 4, // ק,\n 27, 0, 0, 3, 7, 0,255, 0, 0, 60, 25, 8, 9, 10, 49, 3, 9, 9, 22, 0, 3, 2, 0, 11, 0, 2, 4,118, 0, 18, 0, 5, 10, 0, 11, 9, // ר,\n 75, 0, 0, 0, 0, 0,255, 0, 0, 8, 7, 0, 2, 10, 9, 4, 2, 7, 32, 0, 1, 4, 0, 26, 0, 3, 0, 6, 0, 2, 0, 0, 2, 7, 0, 2, // ש,\n 21, 0, 0, 0, 0, 0,255,255, 0, 17, 8, 1, 2, 9, 65, 0, 6, 1, 34, 0, 5, 5, 0, 8, 0, 8, 2, 4,255, 5, 0, 1, 1, 10, 11, 1, // ת,\n // , a, ְ, ַ, ָ, ּ, װ, ױ, ײ, א, ב, ג, ד, ה, ו, ז, ח, ט, י, ך, כ, ל, ם, מ, ן, נ, ס, ע, ף, פ, ץ, צ, ק, ר, ש, ת,\n ],\n arabic: [\n 0, 8, 11, 2, 0, 9, 7, 40, 0, 34, 6, 74, 8, 1, 0, 0, 0, 10, 74, 21, 87, 40, 2, 3, 3, 5, 50, 0, 78, 23, 29, 9, 3, 2, 5, 5, 13, 7, 0, 22, 7, 4, 35, 42, 69, 85, 37, 11, 44, 0, 49, // ,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // a,\n 12, 0, 0, 0, 0, 0, 0,255, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 1, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 3, 4, 9, 0, 0, 0, 0, 0, // ‌,\n 20, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, // پ,\n 8, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0,255, 0,255, 0,255, 0, 0, 0, 0, 0, 2, 0,255,255,255, 0, 0, 0,255, 0,255, 0, 0, 0, 5, 0, 1,255, 0, 0, 0, // ٹ,\n 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0,255, 0, 0, 0, // چ,\n 2, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255,255, 0,255, 0,255, 0, 0, 0, 0, 0,255, 0,255, 0,255, 0, 0, 0, 0, 0, 0, 0,255,255, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, // ژ,\n 8, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0,255, 0,255, 0,255, 0, 1, 0,255, 0,255, 0,255, 0, 0,255, 0, 0, 0, 0,255,255,255,255, 0, 0, 0, 0,255, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, // ڈ,\n 9, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0,255, 1, 0, 0, 0, 0, 3, 0, 3, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 7, 0, 0, 0, 0, 0, 0, // گ,\n 79, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 2, 0, 4, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 4, 7, 1, 0, 1, 0, 0, 0, 0, // ک,\n 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0,255, 0, 0,255, 0,255, 0,255, 0, 0, 0,255, 0,255, 0,255,255, 0,255, 0, 0, 0, 0,255,255, 0, 0,255, 0,255, 0,255, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, // ڑ,\n 27,255,255,255, 0,255,255, 0,255, 0,255,255, 0, 0, 0, 0,255, 0,255, 0, 2,255,255, 0,255, 0,255,255, 0,255, 0, 0, 0, 0,255,255,255,255,255,255, 0,255,255,255,255, 0, 0, 0, 4, 0, 0, 0, 0, // ں,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0,255, 0, 0,255, 0, 0, 0,255, 0, 0, 3,255, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 0,255, // ھ,\n 27, 0, 0, 0, 0, 1, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 3, 2, 0, 3, 0, 0, 0, 0, 5, 0, 25, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 3, 1, 0, 9, 1, 2, 0, 2,255, 0, 0, 0, // ہ,\n 7, 0, 0, 0, 0,255,255,255, 0,255,255,255,255, 0, 0, 0, 0, 0,255, 0, 4, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0,255,255, 0,255, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0,255, // ء,\n 14, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // آ,\n 24, 0, 0,255,255, 0,255, 0, 0, 0,255,255,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0,255, // أ,\n 0,255, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0,255, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, // ؤ,\n 11, 0, 0,255,255,255,255,255,255,255,255,255,255,255, 0, 0, 0,255, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0,255, // إ,\n 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 17, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, // ئ,\n 124, 0, 5, 6, 5, 0, 0, 1, 7, 17, 0, 0, 3, 7, 0, 0, 0, 0, 0, 0, 0, 24, 0, 18, 2, 9, 6, 2, 13, 1, 23, 4, 11, 4, 2, 2, 2, 1, 7, 1, 0, 5, 7, 7, 19, 13, 14, 21, 18, 0, 15, 0, 0, // ا,\n 50, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 1, 0, 0, 0, 11, 0, 0, 3, 0, 0, 0, 0, 0, 0, 9, 2, 4, 0, 0, 0, 1, 0, 3, 0, 0, 0, 1, 1, 6, 2, 1, 0, 7, 0, 3, 0, 0, // ب,\n 0, 0, 0, 0,255, 0, 0,255, 0, 0,255,255, 0,255, 0, 0, 0, 0,255, 0, 1, 3, 0, 0, 0, 1, 1, 0, 4, 0, 10, 0, 1, 0, 0, 0, 1, 0, 3, 1, 0, 2, 3, 1, 8, 4, 4, 0, 0, 0, 22, 0,255, // ة,\n 38, 0, 1, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20, 1, 0, 0, 0, 0, 1, 2, 0, 0, 3, 0, 24, 3, 0, 0, 0, 0, 1, 0, 0, 2, 1, 2, 9, 7, 5, 0, 5, 0, 4, 0, 0, // ت,\n 1, 0, 0, 0, 0, 0,255, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 1, 0, 0, // ث,\n 22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 1, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4, 1, 1, 0, 3, 0, 1, 0, 0, // ج,\n 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, 1, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 5, 3, 0, 0, 1, 0, 1, 0, 0, // ح,\n 11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 1, 0, 2, 0, 0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 4, 0, 0, // خ,\n 42, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 17, 2, 0, 0, 0, 1, 4, 1, 2, 0, 27, 1, 1, 5, 1, 0, 0, 0, 4, 0, 0, 0, 4, 0, 5, 4, 15, 1, 8, 0, 6, 0, 0, // د,\n 1, 0, 0, 0, 0, 0, 0, 0, 1, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 1, 0, 0, 0, 0, 0, // ذ,\n 61, 0, 0, 6, 2, 0, 0, 0, 5, 9, 0, 0, 0, 6, 0, 1, 2, 0, 0, 1, 32, 12, 0, 7, 0, 1, 1, 2, 18, 1, 4, 0, 2, 4, 1, 0, 1, 0, 3, 2, 0, 5, 2, 4, 3, 27, 1, 8, 15, 0, 8, 0, 0, // ر,\n 30, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 2, 0, 1, 0, 0, // ز,\n 31, 0, 1, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 3, 0, 1, 0, 17, 1, 0, 1, 0, 0, 1, 0, 1, 0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 6, 9, 3, 1, 5, 0, 4, 0, 0, // س,\n 22, 0, 2, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 2, 0, 0, 0, 1, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 2, 3, 0, 1, 0, 0, 0, 0, // ش,\n 8, 0, 0, 0, 0, 0,255,255, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 14, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 2, 2, 1, 0, 2, 0, 0, 0, 0, // ص,\n 1, 0, 0, 0,255,255,255,255, 0, 0,255,255, 0, 0,255, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, // ض,\n 2, 0, 0, 0, 0, 0,255,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 2, 3, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 2, 0, 1, 0, 3, 0, 0, // ط,\n 0, 0, 0, 0,255, 0,255,255, 0, 0,255, 0,255, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0,255, 0, 0,255, // ظ,\n 18, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255,255, 0, 0, 0, 2, 0, 0, 0, 5, 2, 0, 3, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 1, 0, 0, 0, 0, 0, 1, 0, 9, 6, 0, 0, 5, 0, 1, 0, 0, // ع,\n 2, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 1, 0, 0, 0, 0, 0, 0, 0, // غ,\n 0, 0, 0, 0, 0, 0,255,255, 0, 0,255, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // ـ,\n 23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 1, 0, 0, 0, 5, 0, 0, 1, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 1, 0, 3, 0, 16, 0, 0, // ف,\n 9, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4, 1, 0, 3, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 5, 2, 1, 0, 4, 0, 3, 0, 0, // ق,\n 13, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6, 1, 0, 0, 1, 0, 4, 0, 0, // ك,\n 17, 0, 0, 0, 0, 0, 0, 0, 2, 1, 0,255, 0, 0, 0, 1, 1, 0, 3, 0,123, 6, 0, 1, 1, 1, 1, 2, 1, 0, 0, 0, 3, 0, 2, 1, 1, 0, 10, 0, 0, 1, 3, 2, 5, 8, 0, 2, 12, 0, 10, 0, 0, // ل,\n 76, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 3, 3, 0, 0, 0, 16, 0, 0, 2, 0, 3, 2, 0, 4, 0, 8, 22, 6, 2, 0, 0, 0, 0, 2, 0, 0, 0, 0, 1, 27, 1, 1, 4, 6, 0, 5, 0, 0, // م,\n 38, 0, 1, 1, 0, 0, 0, 0, 1, 4, 0, 0, 0, 1, 0, 2, 3, 4, 3, 1, 55, 2, 0, 2, 0, 2, 0, 0, 2, 0, 2, 2, 3, 2, 14, 0, 1, 0, 3, 0, 0, 0, 0, 2, 4, 14, 1, 2, 10, 0, 11, 0, 0, // ن,\n 16, 0, 11, 0, 0, 0, 0, 0, 0, 4, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 10, 13, 0, 4, 0, 1, 0, 0, 30, 0, 6, 2, 1, 5, 0, 0, 0, 0, 1, 0, 0, 2, 1, 0, 4, 3, 4, 0, 1, 0, 1, 0, 0, // ه,\n 36, 0, 0, 1, 0, 0, 0, 0, 2, 6, 0, 0, 1, 6, 0, 0, 4, 0, 0, 0, 10, 9, 0, 5, 0, 9, 4, 4, 5, 0, 13, 1, 3, 3, 3, 0, 1, 0, 1, 0, 0, 2, 1, 4, 9, 6, 10, 3, 1, 0, 8, 0, 0, // و,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0,255, // ى,\n 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 1, 0, 1, 2, 5, 8, 0, 5, 0, 2, 2, 1, 12, 1, 22, 2, 8, 2, 2, 1, 1, 0, 2, 1, 0, 19, 3, 4, 14, 7, 24, 2, 10, 0, 1, 0, 0, // ي,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // ً,\n 2, 0,255, 0, 0, 1, 0, 0, 0, 12, 0, 0, 0, 6, 0, 0,255, 0,255, 5, 0, 0,255, 1, 0, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 4, 0, 0,255, 0, 0, 0, // ے,\n // , a, ‌, پ, ٹ, چ, ژ, ڈ, گ, ک, ڑ, ں, ھ, ہ, ء, آ, أ, ؤ, إ, ئ, ا, ب, ة, ت, ث, ج, ح, خ, د, ذ, ر, ز, س, ش, ص, ض, ط, ظ, ع, غ, ـ, ف, ق, ك, ل, م, ن, ه, و, ى, ي, ً, ے,\n ],\n baltic: [\n 0, 0, 57, 42,135, 14, 20, 3,119, 0, 0, 18, 1, 18, 0, 0,205, 1, 4, // ,\n 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 1, 0, 16, 39, 14, 0, 0, 0, 16, // a,\n 0,255, 0, 0, 3, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0, 0, 0, 0, // b,\n 0,255, 0, 0, 19, 0, 9, 0, 0,255, 0, 6, 0, 0, 0, 0, 0, 1, 0, // c,\n 0,255, 0, 0, 17, 0, 6, 0, 6,255, 0, 14, 0, 0, 0, 0, 0, 6, 3, // d,\n 0, 0, 0, 0, 0, 0, 0, 9, 0, 5, 3, 0, 1, 7, 3, 0, 0, 0, 21, // e,\n 0,255, 0, 0, 4, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, // f,\n 0,255, 0, 1, 1, 0, 1, 0, 3, 0, 0, 27, 0, 0, 0, 0, 0, 1, 0, // g,\n 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, // h,\n 0, 0, 0, 0, 0, 0, 0, 72, 0, 13, 9, 0, 5, 41, 7, 0, 0, 0, 56, // i,\n 0,255, 6, 0, 30, 0, 32, 0, 41, 0,255, 12, 0, 0, 0, 0, 3, 0, 0, // j,\n 0, 0, 0, 4, 32, 0, 8, 0, 2, 0, 0, 3, 0, 36, 0, 0, 0, 6, 1, // k,\n 0,255, 0, 0, 29, 0, 36, 1, 24, 0, 0, 4, 0, 5, 0, 0, 0, 2, 0, // l,\n 0, 0, 0, 1, 16, 0, 11, 0, 6, 0, 0, 15, 0, 2, 0, 0, 0, 1, 6, // m,\n 0,255, 0, 0, 19, 0, 7, 0, 10, 0, 0, 12, 0, 8, 0, 0, 0, 16, 6, // n,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 10, 2,255, 0, 0, 6, // o,\n 0,255, 0, 0, 3, 0, 0, 0, 0, 0, 0, 2, 0, 1, 0, 0, 0, 1, 0, // p,\n 0,255, 0, 0, 0, 0,255, 0, 0,255,255, 0,255, 0,255,255, 0, 0, 0, // q,\n 0,255, 2, 2, 59, 0, 23, 0, 2, 0, 0, 6, 0, 3, 0, 0, 0, 23, 0, // r,\n 0,255, 2, 7, 50, 7, 9, 1, 88, 0, 0, 7, 0, 4, 0, 0, 0, 5, 1, // s,\n 0,255, 0, 2, 33, 0, 31, 0, 10, 0, 0, 21, 0, 22, 0, 0, 0, 6, 1, // t,\n 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 1, 0, 13, 11, 12, 0, 0, 0, 7, // u,\n 0,255, 0, 5, 10, 0, 2, 0, 3, 0, 0, 21, 0, 12, 0, 0, 0, 1, 3, // v,\n 0,255, 0, 0, 0, 0, 0, 0, 0,255,255, 0,255, 0,255, 0, 0, 0, 0, // w,\n 0,255, 0, 0, 0, 0, 0, 0, 0,255,255, 0,255, 0,255,255, 0, 0, 0, // x,\n 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 5,255, 0, 0, 0, 7, // y,\n 0,255, 0, 0, 4, 0, 2, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 3, 0, // z,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0,255,255,255, 0, 0, 0, 0,255,255, 0, 0, // ß,\n 0, 0, 0,255,255, 0,255, 0,255, 0,255, 0,255,255,255, 0, 0,255,255,255, 0, 0,255,255,255,255,255,255, 0,255,255, 0,255, 0,255,255,255,255,255,255,255,255,255,255, 0,255, // ŗ,\n 1, 0, 1, 0, 1, 0, 0, 1, 0, 4, 9, 4, 3, 10, 5, 0, 0, 0, 5, 9, 9, 0, 1, 0, 0, 0, 0, 0,255, 0, 0,255, 0,255, 0, 0,255,255,255,255, 0,255,255, 0, 0, 0, // ą,\n 50, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 2, 0, 5, 0, 0, 0, 3, 1, 2, 0, 0, 0, 0, 0, 0, 0,255, 0, 0,255, 0,255, 0, 0,255,255,255,255, 0,255,255, 0, 0, 0, // į,\n 9, 0, 10, 2, 28, 3, 0, 13, 1, 6, 45, 45, 27, 28, 50, 0, 30, 0, 40, 13, 73, 2, 28, 0, 0, 0, 5, 0, 0,255,255, 0,255,255, 0,255, 0, 0, 0, 2, 4, 1,255,255,255, 3, // ā,\n 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 2, 1, 0, 4, 0, 0, 0, 1, 0, 2, 0, 2, 0, 0, 0, 0, 0,255, 0, 0,255, 0,255, 0, 0,255,255,255,255, 0,255,255, 0, 0, 0, // ę,\n 4, 0, 3, 6, 12, 0, 0, 0, 0, 0, 2, 0, 20, 16, 8, 0, 35,255, 15, 19, 28, 0, 26, 0,255, 0, 5,255, 0,255,255, 0,255, 0, 0,255, 0, 1,255, 0, 1, 3,255,255, 0, 0, // ē,\n 12, 9, 0, 0, 0, 9, 0, 0, 0, 15, 0, 0, 1, 0, 8, 2, 0, 0, 4, 7, 0, 3, 0, 0, 0, 6, 0, 0,255, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 7, 0, 0, 0, 1, 0, // č,\n 1, 0, 20, 0, 27, 0, 0, 9, 0, 0, 3, 27, 33, 22, 68, 0, 12, 0, 25, 12, 29, 0, 20, 0, 0, 0, 1,255,255, 0, 0,255, 0,255, 0, 0,255,255,255,255, 2,255,255, 0, 0, 4, // ė,\n 6, 1,255, 0, 0, 2,255, 0,255, 1,255, 0, 0, 0, 0, 3, 0,255, 1, 0, 0, 1, 0,255,255,255, 0,255,255,255,255, 0,255, 1,255,255, 0,255, 0, 0, 0, 0,255,255, 0, 0, // ģ,\n 4, 1, 0, 0, 0, 1,255, 0,255, 3, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255, 0, 0,255, 0,255,255, 0,255, 0, 0,255,255, 0, 0, 0, 5, 2,255,255, 0, 0, // ķ,\n 4, 0, 5, 11, 17, 0, 0, 0, 0, 0, 0, 0, 32, 4, 17, 0, 2, 0, 44, 6, 35, 0, 7, 0, 0, 0, 25, 0, 0,255,255, 0,255, 0, 0,255, 0, 2, 0, 0, 3, 0,255,255, 0, 0, // ī,\n 2, 11, 0,255, 0, 10, 0, 2, 0, 3,255, 11, 0, 0,255, 2, 0,255, 0, 0, 0, 2, 0,255,255,255, 0,255,255,255,255, 1,255, 2,255,255, 0, 0, 0, 0, 0,255, 0,255, 0, 0, // ļ,\n 75, 31, 0, 0, 0, 15, 0, 1, 0, 71, 0, 18, 1, 1, 1, 13, 2, 0, 7, 0, 1, 10, 0, 0, 0, 1, 0, 0, 0, 0, 0, 2, 0, 4, 0, 0,255, 0, 3, 1, 0, 5, 0, 0, 3, 0, // š,\n 1, 5, 0, 0, 0, 6,255, 0, 0, 24, 0, 0, 0, 0, 0, 2, 0,255, 1, 0, 0, 1, 0,255,255,255, 2,255,255,255,255, 3,255, 0, 0,255,255,255, 1, 0, 0, 0, 0,255, 0, 0, // ņ,\n 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255, 0,255,255,255,255,255, 0,255, 0,255,255, 0, // ō,\n 0, 0, 3, 0, 4, 0, 0, 4, 0, 76, 18, 13, 8, 11, 19, 0, 0, 0, 9, 4, 28, 0, 3, 0, 0, 0, 0,255,255, 0, 0,255, 0,255, 0, 0,255,255,255,255, 0,255,255, 0, 0, 1, // ų,\n 2, 0, 9, 3, 1, 0, 0, 1, 0, 12, 8, 8, 3, 5, 0, 0, 1, 0, 9, 1, 12, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 0, 0, 0,255, 1, 0, 0,255, 0, 0, 0, // ū,\n 46, 17, 0, 0, 30, 11, 0, 1, 0, 3, 0, 0, 1, 3, 1, 2, 0, 0, 8, 0, 0, 16, 0, 0, 0, 2, 0, 0,255, 1, 1, 0, 0, 0, 0, 3,255,255, 0, 0, 0, 0,255, 0, 0, 0, // ž,\n // , a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z, ß, ŗ, ą, į, ā, ę, ē, č, ė, ģ, ķ, ī, ļ, š, ņ, ō, ų, ū, ž,\n ],\n thai: [\n 6, 0, 2, 0, 14, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 1, 4, 2, 0, 1, 0, 21, 3, 1, 0, 0, 5, 0, 0, 9, 9, 4, 0, 4, 2, 6, 0, 2, 0, 0, 4, 0, 0, 4, 0, 11, 0, 2, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 10, 3, 0, 0, 16, 0, 0, 0, // ,\n 0, 0, 0,255, 0, 0,255, 0,255,255, 0,255,255, 0,255,255, 0, 0, 0, 0, 0,255, 0, 0, 0,255,255, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255, 0,255,255, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255,255,255, 0, 0, 0, 0, 0, 0, 0, 0,255,255, // a,\n 8, 0, 6, 0, 4, 0, 91, 3, 0, 13, 1, 0, 1, 0, 0, 0, 0, 0, 0, 3, 3, 0, 0, 0, 17, 6, 3, 0, 0, 0, 0, 0, 8, 13, 10, 0, 6, 5, 0, 0, 4, 1, 0, 28, 0, 0, 13, 40, 50, 4, 26, 13, 9, 0, 23, 33, 0, 80, 28, 16, 2, 3, 0, 17, 12, 13, 3, 0, 19, 0,255, 0, // ก,\n 1, 0, 8, 0, 1, 0,119, 2, 0, 0, 0,255, 3, 0, 0, 0, 0, 0, 0, 7, 1, 0, 0, 0, 14, 3, 0, 0, 0, 1, 0, 0, 6, 4, 4,255, 5, 4, 0, 0, 0, 0, 0, 5, 0, 0, 3, 0, 17, 2, 5, 6, 0, 0, 16, 1, 0,137, 33, 4, 0, 12, 0, 0, 12, 9, 0, 0, 15, 0,255, 0, // ข,\n 7, 0, 23, 0, 61, 0,254, 2, 0, 9, 3,255, 2, 0, 0, 0, 0,255, 1, 10, 1, 0, 16, 0, 51, 21, 1, 0, 0, 1, 0, 1, 14, 13, 32, 0, 5, 5, 0, 0, 4, 0, 0, 16, 0, 0, 31, 11,120, 11, 16, 21, 0, 0, 61, 5, 0,173, 54,110, 7, 6, 0, 14, 29, 37, 2, 0, 42, 0,255, 0, // ค,\n 0,255, 0,255, 2, 0, 8, 0,255, 0, 0, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0,255,255, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 5,255, 0,255, 0, 0, 0,255,255, 0, 0,255,255, // ฆ,\n 0, 0, 6, 1, 20, 0, 24, 6, 0, 1, 3, 0, 0, 0, 0, 0,255,255, 0, 22, 0, 0, 0, 5, 4, 2, 0, 0, 0, 6, 0, 0, 7, 39, 53, 0, 41, 56, 0, 0, 20, 4, 0,254, 0,255, 1,167,254, 4,100, 0, 46, 0, 55, 34, 0, 26, 1, 2,255, 1, 0, 20,254,254, 2, 1, 1, 0,255, 0, // ง,\n 4, 0, 9, 1, 3, 0, 74, 23, 0, 1, 0,255, 9, 0, 0, 0, 0, 0, 0, 4, 1, 0, 0, 0, 14, 2, 1, 0, 0, 2, 0, 0, 5, 3, 7, 0, 4, 5, 4, 0, 1, 0, 0, 4, 0, 0, 14, 9, 32, 1, 17, 3, 0, 0, 5, 4, 0,137, 10, 15, 31, 0, 0, 44, 24, 23, 0, 0, 15, 0,255, 0, // จ,\n 0,255, 1, 0, 0, 0, 5, 4, 0, 0, 0,255, 0,255, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0,255,255, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0,255,255, 0, 0, 1, 0, 0, 0,255,255, 0, 0, 0, 47, 1, 3,255, 0, 0, 0, 1, 0, 0, 0, 1,255,255,255, // ฉ,\n 3, 0, 8, 0, 11, 0,139, 1, 0, 17, 1, 0, 32, 0, 0, 0, 0, 0, 0, 8, 3, 0, 1, 0, 31, 5, 1, 0, 0, 7, 0, 0, 18, 22, 8, 0, 7, 7, 0, 0, 1, 0, 0, 10, 0, 0, 31, 16,141, 2, 33, 15, 0, 3, 11, 13, 0,208, 45, 22,170, 11, 0, 2, 21, 32, 0, 0, 29, 0,255, 0, // ช,\n 2, 0, 16, 0, 6, 0, 47, 0, 0, 3, 5, 0, 0, 0, 0, 0,255, 0, 0, 2, 2, 0, 1, 0, 13, 2, 2,255,255, 0, 2,255, 3, 2, 4,255, 3, 2, 0, 0, 6, 0,255, 5, 0, 0, 4, 0, 16, 10, 7, 9, 0, 0, 4, 9, 0,178, 19, 44, 0, 40, 0, 0, 14, 4, 0, 0, 19,255,255,255, // ซ,\n 0,255, 0,255, 0,255, 0, 0,255, 2,255,255, 0,255,255, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0,255, 0, 0,255,255, 0,255,255, 0,255,255, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 1, 0, 0,255, 0,255,255, 0, 0,255,255, 0,255,255,255, // ฌ,\n 0,255, 0, 0, 0,255, 3, 1,255, 13, 0, 0, 83,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0,255, 1, 0, 0, 0, 4, 0, 0, 0, 0, 1, 0, 0, 37, 0, 1,255,255, 0, 48, 7, 0, 16, 0, 0, 0, 44, 11, 0, 0, 0, 1, 0, 0,255, 3, 1, 0, 0, 0, 2, 0,255,255, // ญ,\n 0,255, 11,255, 0, 0, 0,255,255, 0,255,255,255, 0,255, 0,255,255, 0,255, 0,255, 0, 0, 0, 0, 0,255,255,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 11, 0, 0,255, 0, 0,255, 0, 0, 0, 0, 0, 0,255,255, 7, 0, 0, 0,255, 0,255,255,255,255, 0, 0,255,255, 0, 0,255,255, // ฎ,\n 0,255, 4,255, 0, 0, 0, 0,255, 0,255,255, 0,255, 0, 0,255,255, 0,255, 0,255, 0,255, 0, 0, 9, 0,255, 0,255, 0, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255, 0,255,255, 0, 2, 1,255, 0, 0,255,255, 2, 0, 0, 0,255, 0,255,255,255,255, 0,255,255,255, 0,255,255,255, // ฏ,\n 0,255, 0, 0, 0,255, 0, 0,255, 0,255,255, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0, 0, 0,255,255, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0,255, 0,255,255, 0, 11, 0, 0, 0, 0,255,255, 0, 0, 0, 0,255, 0,255,255,255, 0, 0, 0,255,255, 0, 0,255,255, // ฐ,\n 0,255, 0,255, 0,255, 0, 0,255, 0,255,255, 0,255,255, 0, 0, 0, 2, 0, 0,255, 0,255, 0, 0,255,255,255, 0,255, 0, 0, 0, 0,255, 0, 0,255, 0,255,255,255, 0,255,255, 0, 0, 0,255, 0, 0,255,255, 0, 0, 0, 0,255, 0,255,255,255,255,255,255,255,255, 0,255,255,255, // ฑ,\n 0,255,255,255, 0,255,255,255,255,255,255,255,255,255,255,255, 0,255,255,255,255,255, 0, 0,255,255,255,255,255, 0,255,255,255,255, 0, 0, 0, 0,255,255,255,255,255,255,255,255,255, 4, 0,255, 0, 0,255,255, 2, 0, 0, 0,255, 0,255,255,255,255,255,255,255,255, 0, 0,255,255, // ฒ,\n 0,255, 0, 2, 16, 0, 0, 0,255, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 1, 0, 10, 0, 0, 1, 0, 3, 0, 0,255, 0,255,255, 0, 2, 6, 0, 0, 0,255,255, 11, 0, 0, 0,255, 0,255,255,255,255, 0, 0,255,255, 0, 0,255,255, // ณ,\n 2, 0, 3, 0, 4, 0, 15, 1, 0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 12, 2, 1, 0, 0, 0, 0, 0, 3, 2, 5, 3, 3, 17, 0, 0, 7, 0, 0, 11, 0, 0, 5, 26, 11, 1, 21, 2, 0, 0, 32, 7, 0, 75, 9, 54, 2, 75, 0, 8, 4, 5, 0, 0, 10, 0,255, 0, // ด,\n 4, 0, 6, 7, 8, 0, 32, 1, 0, 2, 7, 0, 0, 0, 1, 0, 0, 0, 0, 2, 2, 0, 0, 0, 19, 1, 1, 0, 0, 0, 0, 0, 4, 2, 4, 0, 2, 1, 1, 0, 14, 4, 0, 7, 0, 0, 4, 16, 17, 1, 18, 3, 0, 0, 27, 6, 0, 36, 34, 12, 9, 5, 0, 5, 11, 6, 0, 0, 14, 0,255, 0, // ต,\n 1, 0, 0, 0, 0,255, 7, 0, 0, 0, 0,255, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 1, 0, 0,255,255, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 1, 0, 1, 0, 2, 0, 0, 0, 0, 0, 0, 1, 3, 0,255, 0, 0, 0, 3, 3, 0, 0, 0,255,255,255, // ถ,\n 4, 0, 4, 1, 3, 0, 50, 1, 0, 5, 0, 0, 2, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 32, 8, 2, 0, 0, 2, 0, 1, 5, 4, 6, 0, 3, 2, 0, 1, 1, 0, 0, 3, 0, 0, 8, 3, 13, 1, 16, 3, 0, 0, 18, 2, 0, 83, 12, 15, 0, 37, 0, 1, 13, 9, 0, 0, 23, 0,255, 0, // ท,\n 1,255, 0, 0, 0, 0, 2, 0,255, 1, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 6, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 3, 0,255, 2, 0, 5, 0, 3, 0, 0, 0, 4, 0, 0, 11, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 2, 0,255,255, // ธ,\n 4, 0, 4, 7, 41, 0, 24, 11, 0, 43, 9, 0, 0, 0, 0, 0, 0, 3, 0, 6, 3, 1, 3, 1, 10, 3, 1, 1, 0, 1, 0, 0, 9, 30, 3, 0, 5, 14, 2, 0, 10, 32, 0, 41, 0, 0, 5, 69, 60, 8, 35, 9, 0, 2, 20, 10, 0, 38, 13, 14,150, 5, 0,124, 80, 92, 0, 0, 10, 0,255, 0, // น,\n 3, 0, 1, 1, 2, 0, 15, 2, 5, 5, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 1, 0, 5, 10, 0, 0, 0, 2, 0, 0, 2, 2, 4, 0, 4, 1, 1, 0, 1, 0, 0, 15, 0, 0, 7, 48, 8, 5, 7, 2, 0, 1, 12, 1, 0, 30, 33, 8, 3, 1, 0, 10, 5, 4, 0, 0, 9, 0,255, 0, // บ,\n 5, 0, 1, 0, 3, 0, 29, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 10, 2, 0, 0,255, 0, 0, 0, 5, 1, 5, 0, 2, 0, 0, 0, 1, 0, 0, 3, 0, 0, 3, 1, 4, 1, 3, 2, 0, 0, 6, 11, 0,163, 8, 11, 0, 45, 0, 0, 15, 6, 0, 0, 6, 0,255,255, // ป,\n 2, 0, 0, 0, 0,255, 7, 0, 0, 0, 0,255, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 2, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 1, 0, 1, 0, 0, 1, 0,255, 2, 0, 0, 4, 8, 0, 0, 0, 0, 0, 3, 2, 0, 0, 0,255,255,255, // ผ,\n 0, 0, 0, 0, 0, 0, 2, 0,255, 0, 0,255, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255, 0,255, 0, 0,255, 0, 0, 0, 0,255,255, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0,255,255,255, // ฝ,\n 9, 0, 1, 0, 1, 0, 23, 7, 5, 2, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 2, 0, 6, 1, 0,255,255, 0, 0, 0, 6, 2, 4, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 4, 4, 20, 1, 5, 4, 0, 0, 3, 1, 0, 63, 11, 4, 0, 3, 0, 0, 6, 4, 0, 0, 4, 0,255, 0, // พ,\n 1, 0, 0, 0, 0, 0, 2, 0, 0, 0, 1, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 1, 0, 0,255,255, 0, 1,255, 0, 0, 2,255, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 2, 0, 7, 4, 1, 0, 29, 0, 0, 0, 0, 0, 0, 3,255,255, 0, // ฟ,\n 2, 0, 0, 0, 0, 0, 5, 0,255, 1, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0,255,255, 0, 0, 0, 2, 1, 0, 0, 0, 0, 0, 1, 3, 0, 0, 1,255, 0, 0, 0, 3, 0, 1, 0,255, 0, 2, 0, 0, 15, 0, 0, 0, 0, 0, 0, 1, 2,255,255, 1,255,255, 0, // ภ,\n 5, 0, 5, 1, 63, 0, 29, 3, 0, 17, 3, 0, 1, 0, 0, 2, 0, 0, 0, 2, 0, 0, 0, 0, 7, 1, 0, 0, 0, 1, 0, 0, 4, 7, 17, 0, 2, 7, 0, 0, 18, 59, 0, 21, 0, 0, 8, 6, 52, 1, 12, 6, 0, 0, 22, 9, 0, 82, 27, 21, 0, 43, 0, 8, 59, 21, 0, 0, 10, 0, 0, 0, // ม,\n 1, 0, 1, 1, 6, 0, 10, 0, 0, 6, 1, 0, 1, 0, 0, 0, 0, 0, 0, 13, 2, 0, 18, 1, 5, 0, 1, 0, 0, 5, 0, 0, 1, 1, 3,255, 4, 13, 0, 1, 1, 2, 0, 27, 0, 0, 4, 16, 74, 0, 7, 61, 0, 0, 6, 0, 0, 16, 5, 8, 0, 0, 0, 1, 50, 8, 0, 0, 3, 0, 0, 0, // ย,\n 6, 0, 35, 0,148, 0, 29, 9, 0, 7, 1, 0, 1, 5, 0, 0, 0, 0, 1, 4, 27, 0, 14, 5, 8, 14, 42, 0, 1, 32, 2, 1, 8, 5, 23, 0, 1, 8, 4, 1, 16, 14, 0, 33, 0, 0, 8, 0,121, 3, 8, 5, 0, 0, 20, 14, 0, 85, 17, 40, 0, 8, 0, 0, 8, 18, 0, 0, 7, 0, 0, 0, // ร,\n 0,255, 3, 0, 0, 0, 0, 0,255, 0,255,255, 0,255,255, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 3, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0,255,255, 0,255, 0, 0, 0, 0,255,255, 0, 0, 0,255,255,255,255,255,255,255, 0, 0,255,255, 0,255,255,255, // ฤ,\n 2, 0, 19, 1, 40, 0, 15, 1, 5, 5, 6, 0, 3, 0, 0, 0, 0, 0, 0, 2, 1, 0, 0, 0, 3, 6, 14, 5, 0, 10, 6, 0, 2, 2, 1,255, 3, 5, 0, 0, 2, 26, 0, 19, 0, 0, 2, 9, 20, 2, 12, 2, 0, 0, 17, 25, 0, 73,127, 25, 0, 5, 0, 0, 4, 2, 0, 0, 7, 0, 0, 0, // ล,\n 4, 0, 8, 4, 80, 0, 23, 1, 0, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 2, 0, 1, 0, 12, 2, 0, 0, 0, 1, 0, 0, 18, 8, 9, 0, 4, 0, 1, 0, 5, 12, 0, 5, 0, 0, 8, 16, 32, 1, 8, 7, 0, 0, 4, 1, 0, 48, 3, 1, 0, 8, 0, 2, 60, 50, 0, 1, 4, 0, 0, 0, // ว,\n 6, 0, 0, 0, 0, 0, 23, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 1, 3, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 9, 0, 5, 0, 0, 0, 1, 0, 0, 12,255, 0,255, 0, 0, 0, 0, 0, 0,255, 3, 0,255,255, // ศ,\n 0,255, 16, 0, 0, 1, 4, 0,255, 0,255,255, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0,255, 0, 1, 0, 3, 5, 0, 0, 1, 0, 0, 0,255, 0,255,255, 0, 0, 9,255, 4, 0, 0,255, 6, 0, 0, 1,255, 0,255, 0,255,255, 0, 0,255,255, 0, 0,255, 0, // ษ,\n 9, 0, 8, 4, 4, 0, 75, 3, 0, 12, 1, 0, 1, 0, 0, 0, 0, 0, 1, 5, 2, 0, 1, 0, 19, 5, 1, 0, 0, 0, 0, 0, 12, 6, 9, 0, 3, 2, 2, 0, 1, 0, 0, 13, 0, 0, 11, 9, 26, 1, 16, 7, 0, 0, 8, 2, 0, 55, 26, 2, 3, 0, 0, 1, 29, 16, 0, 0, 19, 0,255, 0, // ส,\n 7, 0, 2, 0, 1, 0, 77, 2, 0, 0, 0,255, 4, 4, 0, 0, 0, 0, 0, 21, 0, 0, 2, 0, 9, 2, 0, 0,255, 0, 0, 0, 13, 3, 2, 0, 1, 2, 0, 0, 5, 0, 0, 4, 0, 0, 8, 0, 12, 7, 3, 1, 0, 0, 2, 4, 0, 62, 60, 4, 82, 6, 0, 0, 11, 10, 0, 0, 3, 0, 0, 0, // ห,\n 0,255, 0, 0,255,255,255, 0, 0, 0,255,255,255,255,255,255,255,255, 0,255,255,255,255,255, 0,255,255,255,255,255,255,255, 0, 0, 0,255,255, 0,255,255, 0, 0,255, 0,255,255,255, 0, 0,255, 0, 5,255,255, 2, 0,255, 0,255, 0,255,255,255,255, 0,255, 0,255,255,255,255,255, // ฬ,\n 8, 0, 13, 98, 32, 0, 68, 12, 0, 23, 18, 0, 1, 0, 0, 1, 0, 0, 0, 10, 10, 0, 6, 4, 20, 17, 3, 0, 0, 2, 2, 4, 9, 9, 21,255, 11, 8, 1, 0, 7, 1, 0, 21, 2, 0, 9, 0, 10, 4, 2, 5, 0, 57, 0, 2, 0, 84, 22, 36, 0, 8, 0, 19,254,144, 1, 1, 11, 0,255, 0, // อ,\n 0, 0, 0, 0, 0,255, 2, 0,255, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0, 0,255, 0, 0, 1, 0, 0, 0, 0,255, 0, 0, 0, 8, 3, 4,255, 3, 0, 0, 0, 0, 0, 0, 1,255,255,255, // ฮ,\n 0, 0, 0, 0, 0,255, 0, 0,255, 0, 0,255, 0, 0, 0, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0,255, 0, 0,255, 0, 0, 0, 0,255,255, 0, 0, 0,255,255, 0,255,255,255, 0, 0, 0,255,255, 0, 0,255,255, // ฯ,\n 0,255, 3, 0, 8, 0, 2, 33, 1, 2, 3, 0, 0, 0, 0, 0, 0, 0, 7, 0, 5, 0, 2, 0, 7, 0, 1, 0,255, 0, 0, 0, 3, 3, 93,255, 44, 1, 0, 0, 3, 0, 0, 5, 0, 0, 0, 0, 8, 0, 0, 0,255,255, 0,255,255, 0,255, 0,255,255,255, 0, 0, 0, 1, 0, 0,255,255,255, // ะ,\n 0,255, 33, 13, 29, 0, 0, 54, 5, 48, 13, 0, 3, 0, 0, 0, 0, 0, 0, 12, 23, 1, 18, 2, 29, 17, 7, 0, 1, 11, 1, 3, 12, 8, 50,255, 26, 39, 4, 4, 21, 6, 0, 22, 2,255, 0, 0, 0, 0, 0, 0, 0,255, 0, 0,255,255,255,255,255,255,255,255, 0, 0,255,255,255,255,255, 0, // ั,\n 0, 0, 97, 28, 43, 1, 47, 62, 8,139, 31, 0, 33, 9, 0, 3, 0, 0, 3, 11, 15, 8, 23, 5, 41, 17, 5, 0, 0, 6, 1, 34, 49, 29, 63, 0, 28, 30, 10, 18, 31, 30, 6, 33, 3,255, 0, 0, 0, 0, 0, 0,255,255, 0,255,255, 0,255,255,255,255,255, 0,224,254, 1, 0, 0, 0,255, 0, // า,\n 0,255, 5, 0, 35,255, 0, 21, 0, 1, 0,255,255,255,255,255,255,255, 0, 2, 8, 0, 10, 0, 4, 0, 0, 0,255, 0, 0,255, 0, 0, 0,255, 3, 0,255,255, 10, 0,255, 7, 0,255, 0, 0, 0, 0,255,255,255,255,255, 0,255, 0,255,255,255, 0,255,255, 3, 33, 0, 0, 0,255,255, 0, // ำ,\n 0,255, 20, 0, 22, 0, 8, 20, 2, 65, 34, 0, 17, 0, 12, 0, 1, 0, 1, 15, 28, 1, 5, 14, 18, 6, 7, 1, 0, 14, 2, 1, 14, 3, 35, 0, 18, 32, 4, 0, 20, 2, 0, 23, 2,255, 0, 0, 0,255, 0, 0,255, 0,255, 0, 0, 0,255,255,255,255,255, 0, 0, 0,255,255, 0,255,255, 0, // ิ,\n 0,255, 10, 7, 9, 0, 0, 12, 4, 56, 51, 0, 15, 3, 0, 0, 0, 0, 1, 19, 4, 0, 86, 2, 23, 5, 18, 0, 0, 6, 1, 0, 34, 3, 37,255, 23, 7, 0, 0, 16, 0, 0, 9, 0,255, 0, 0, 0,255, 0, 0, 0, 0, 0,255, 0, 0,255,255,255,255,255,255, 0, 0,255,255, 0,255,255, 0, // ี,\n 0,255, 0, 17, 0,255, 0, 9, 0, 0, 44, 0, 0, 0, 0,255,255,255, 0, 0, 0, 6, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 5,255, 1, 0,255, 0, 0,255,255,255,255,255, 0, 0, 0,255, 0,255,255,255,255,255,255,255,255,255, 0, 0,255,255,255,255,255,255, // ึ,\n 0,255, 0, 0, 29,255, 0, 0, 0, 66, 3, 0, 0,255, 0,255,255, 0, 0, 2, 0, 1, 0, 0, 6, 0, 0, 0, 0, 9, 0,255, 18, 1, 19,255, 7, 0, 0, 0, 6, 0, 0, 6, 0,255,255,255, 0,255, 0,255,255, 0,255,255,255, 0,255,255,255,255,255,255, 0, 0,255,255, 0,255,255, 0, // ื,\n 0,255, 20, 9, 88, 0, 1, 45, 1, 55, 17, 0, 0, 0, 0, 0, 0,255, 1, 4, 25, 6, 11, 7, 22, 29, 10, 0, 0, 8, 19, 0, 12, 28, 29,255, 17, 4, 1, 0, 53, 3, 0, 22, 1,255,255, 0, 0,255,255, 0, 0,255, 0, 0, 0,255,255,255,255,255,255,255,255,255,255,255, 0,255,255, 0, // ุ,\n 0,255, 6, 0, 37, 0, 3, 9, 0, 15, 28, 1, 1, 0, 0, 0, 0,255, 0, 26, 8, 15, 3, 0, 4, 7, 2, 48, 0, 7, 2, 10, 77, 38, 26, 0, 13, 1, 3, 0, 26, 1,255, 4, 0,255,255,255,255,255,255,255,255,255, 0, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255, 0, // ู,\n 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255,255,255,255,255,255,255,255,255,255, 0,255,255,255,255,255,255,255,255,255,255,255, 0,255,255,255, // ฺ,\n 20, 0, 41, 1, 31, 0,254, 12, 0, 16, 23, 0, 12, 1, 1, 1, 0, 0, 1, 30, 10, 2, 7, 1,110, 23, 9, 0, 0, 4, 4, 0, 52, 35, 41, 0, 29, 20, 5, 0, 30, 0, 0, 67, 2, 0,130, 0, 84, 35, 40, 50, 0, 0, 20, 56, 0, 0, 0, 0, 0, 0, 0, 8,138,119, 0, 0,142, 0,255, 0, // เ,\n 10, 0, 19, 0, 9, 0,170, 5, 0, 3, 2, 0, 4, 0, 0, 0, 0, 0, 0, 9, 3, 0, 2, 0, 36, 8, 6, 0, 0, 1, 0, 0, 12, 13, 20,255, 6, 5, 1, 0, 6, 0, 0, 9, 0, 0, 16, 0, 26, 16, 4, 13, 0, 0, 2, 11, 0, 0, 0, 0,255, 0, 0, 1, 52, 49, 0, 0, 68, 0,255, 0, // แ,\n 6, 0, 7, 0, 29, 0, 72, 3, 0, 9, 11, 0, 2, 0, 0, 0, 0, 0, 0, 4, 3, 0, 2, 0, 27, 5, 2, 0,255, 1, 0, 0, 9, 8, 8, 0, 8, 6, 1, 0, 20, 0, 0, 8, 1, 0, 12, 0, 22, 2, 21, 13, 0, 0, 26, 14, 1, 0, 0, 0,255, 0, 0, 0, 11, 10, 0, 0, 33, 0,255, 0, // โ,\n 3, 0, 9, 0, 4, 0,114, 4, 0, 1, 0, 0, 6, 0, 2, 0, 0, 0, 0, 10, 3, 1, 0, 0, 27, 5, 2, 0,255, 1, 0, 0, 7, 16, 10,255, 6, 5, 2, 0, 1, 0, 0, 9, 0, 0, 8, 0, 22, 14, 3, 7, 0, 0, 2, 3, 0, 0,255,255, 0, 0, 0, 1, 55, 53, 0, 0, 24,255,255, 0, // ใ,\n 5, 0, 8, 0, 4, 0,116, 3, 0, 3, 1, 0, 1, 1, 0, 0, 0, 0, 0, 5, 1, 4, 0, 0, 28, 10, 3, 0,255, 0, 0, 0, 6, 9, 5,255, 3, 9, 8, 0, 3, 0, 0, 10, 0, 0, 15, 0, 23, 5, 5, 4, 0, 0, 9, 15, 0, 0,255,255,255, 0, 0, 12, 51, 30, 0, 0, 34, 0,255, 0, // ไ,\n 0,255, 0,255, 0,255, 12,255,255,255,255,255, 0,255,255,255,255,255, 0, 0, 0, 0, 0, 0, 2, 0, 0,255,255, 0,255,255, 0, 0, 0,255, 0, 0,255, 0, 0,255,255, 0,255,255, 0,255, 0, 0, 0, 0,255,255, 0, 0,255,255,255,255,255,255, 0,255, 0, 0, 0, 0, 0,255,255,255, // ๆ,\n 0,255, 25, 6, 4, 0, 0, 7, 0, 7, 21, 0, 0, 0, 0,255,255,255, 0, 16, 5, 0, 2, 0, 2, 1,112, 0, 0, 1, 0, 0, 3, 2, 11,255, 12, 6, 0,255, 0, 7,255, 13, 0,255,255,255,255,255, 0,255,255,255,255, 0, 0, 0,255,255,255,255,255, 0,255,255,255,255,255,255,255,255, // ็,\n 0, 0, 28, 36, 44, 5, 7, 4, 0,166, 14,255, 53,255,255,255,255, 0, 0, 3, 64, 4, 15, 0, 19, 8, 5, 12, 4, 4, 1, 0, 69, 28, 23,255, 45, 56, 0,255, 35, 40, 0, 6, 1,255, 0, 35, 0, 0, 43,254, 46,156,119,254, 0, 0, 0,255, 0, 0,255, 0, 0, 0, 0,255, 0, 0,255, 0, // ่,\n 0, 0, 17,126, 42, 0, 0, 91, 0,177, 69, 0, 2,255,255,255,255,255,255,105, 38, 4, 11, 0, 56, 12, 6, 1, 0, 3, 8, 0, 10, 7, 40,255, 32, 11, 0, 0, 7, 61,255, 26, 0,255, 0,125, 0, 0, 14, 49, 25, 28, 16,211,255, 0, 0, 0, 0, 0,255, 0, 0, 0,255,255,255, 0,255, 0, // ้,\n 0,255, 2, 0, 0,255, 0, 2,255, 0, 0,255, 0, 0,255,255,255,255, 0, 0, 0,255, 0, 0, 0, 0, 0,255,255, 0, 0,255, 0, 0, 0,255, 0, 0,255,255, 0, 0,255, 0, 0,255,255, 0,255,255, 1, 0, 0, 0, 6, 1,255,255,255,255,255,255,255,255,255,255, 0,255,255,255,255,255, // ๊,\n 0,255, 0, 0, 0, 0,255, 1,255, 0, 0,255, 0,255,255,255,255,255,255, 0, 0,255,255,255, 0, 0, 0, 0,255,255,255,255, 0, 0, 0,255, 0, 0,255,255, 0, 0,255, 0, 0,255,255, 0,255,255, 0, 1, 0, 0, 0, 1, 0,255,255,255,255,255,255, 0, 0,255,255,255,255,255,255,255, // ๋,\n 0, 0, 6, 1,105, 5, 0, 2, 0, 9, 44, 0, 3, 0, 0, 1, 2, 0, 24, 19, 28, 1, 11, 12, 24, 0, 8,255,255, 4, 1, 0, 2, 46,168,255, 28, 8, 13, 10, 39, 14,255, 0, 1,255, 0,255,255,255, 21, 0,255, 0, 14, 0, 0,255,255,255,255,255,255,255,255,255,255,255, 0,255,255,255, // ์,\n 0,255, 0, 0, 0,255,255, 0,255, 0, 0,255, 0, 0,255, 0,255,255, 0, 0, 0, 0, 0, 0, 0, 0, 0,255,255, 0,255,255, 0, 0, 0,255, 0, 0, 0, 0, 0, 0,255, 0,255,255,255,255,255,255, 0,255,255,255, 0,255,255,255,255,255,255,255,255,255,255, 0,255,255,255,255,255,255, // ํ,\n 0,255, 0,255,255,255,255,255,255,255,255,255, 0,255,255,255,255,255,255,255, 0,255,255,255,255,255, 0,255,255, 0,255,255,255,255,255,255, 0,255,255,255, 0, 0,255, 0,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255, // ๎,\n 0, 0, 0, 0, 0,255, 0,255,255,255,255,255,255,255,255,255,255,255,255, 0,255,255, 0,255, 0, 0,255,255,255, 0,255,255, 0, 0, 0, 0, 0, 0, 0,255, 0, 0,255, 0,255,255, 0, 0, 0, 0, 0, 0,255,255,255, 0,255, 0, 0, 0, 0,255,255,255, 0, 0,255,255, 0,255,255, 0, // ๅ,\n // , a, ก, ข, ค, ฆ, ง, จ, ฉ, ช, ซ, ฌ, ญ, ฎ, ฏ, ฐ, ฑ, ฒ, ณ, ด, ต, ถ, ท, ธ, น, บ, ป, ผ, ฝ, พ, ฟ, ภ, ม, ย, ร, ฤ, ล, ว, ศ, ษ, ส, ห, ฬ, อ, ฮ, ฯ, ะ, ั, า, ำ, ิ, ี, ึ, ื, ุ, ู, ฺ, เ, แ, โ, ใ, ไ, ๆ, ็, ่, ้, ๊, ๋, ์, ํ, ๎, ๅ,\n ],\n};\n\nconst VIETNAMESE_ASCII: usize = 27;\nconst VIETNAMESE_NON_ASCII: usize = 25;\nconst CENTRAL_ASCII: usize = 27;\nconst CENTRAL_NON_ASCII: usize = 41;\nconst CYRILLIC_ASCII: usize = 2;\nconst CYRILLIC_NON_ASCII: usize = 44;\nconst WESTERN_ASCII: usize = 27;\nconst WESTERN_NON_ASCII: usize = 32;\nconst ICELANDIC_ASCII: usize = 27;\nconst ICELANDIC_NON_ASCII: usize = 13;\nconst GREEK_ASCII: usize = 2;\nconst GREEK_NON_ASCII: usize = 35;\nconst TURKISH_ASCII: usize = 26;\nconst TURKISH_NON_ASCII: usize = 13;\nconst HEBREW_ASCII: usize = 2;\nconst HEBREW_NON_ASCII: usize = 34;\nconst ARABIC_ASCII: usize = 2;\nconst ARABIC_NON_ASCII: usize = 51;\nconst BALTIC_ASCII: usize = 27;\nconst BALTIC_NON_ASCII: usize = 19;\nconst THAI_ASCII: usize = 2;\nconst THAI_NON_ASCII: usize = 70;\n#[inline(always)]\nfn compute_index(\n x: usize,\n y: usize,\n ascii_classes: usize,\n non_ascii_classes: usize,\n) -> Option {\n if x == 0 && y == 0 {\n return None;\n }\n if x < ascii_classes && y < ascii_classes {\n return None;\n }\n if y >= ascii_classes {\n return Some(\n (ascii_classes * non_ascii_classes)\n + (ascii_classes + non_ascii_classes) * (y - ascii_classes)\n + x,\n );\n }\n Some(y * non_ascii_classes + x - ascii_classes)\n}\n\npub struct SingleByteData {\n pub encoding: &'static Encoding,\n lower: &'static [u8; 128],\n upper: &'static [u8; 128],\n probabilities: &'static [u8],\n ascii: usize,\n non_ascii: usize,\n}\n\nimpl SingleByteData {\n #[inline(always)]\n pub fn classify(&'static self, byte: u8) -> u8 {\n let high = byte >> 7;\n let low = byte & 0x7F;\n if high == 0u8 {\n self.lower[usize::from(low)]\n } else {\n self.upper[usize::from(low)]\n }\n }\n\n #[inline(always)]\n pub fn is_latin_alphabetic(&'static self, caseless_class: u8) -> bool {\n let caseless_class_usize = usize::from(caseless_class);\n caseless_class_usize > 0 && caseless_class_usize < (self.ascii + self.non_ascii)\n }\n\n #[inline(always)]\n pub fn is_non_latin_alphabetic(\n &'static self,\n caseless_class: u8,\n is_windows_1256: bool,\n ) -> bool {\n let caseless_class_usize = usize::from(caseless_class);\n let lower_bound = if is_windows_1256 {\n WINDOWS_1256_ZWNJ\n } else {\n 1\n };\n caseless_class_usize > lower_bound && caseless_class_usize < (self.ascii + self.non_ascii)\n }\n\n #[inline(always)]\n pub fn score(\n &'static self,\n current_class: u8,\n previous_class: u8,\n is_windows_1256: bool,\n ) -> i64 {\n let current_usize = usize::from(current_class);\n let previous_usize = usize::from(previous_class);\n let stored_boundary = self.ascii + self.non_ascii;\n if current_usize < stored_boundary {\n if previous_usize < stored_boundary {\n // Both below\n if let Some(index) =\n compute_index(previous_usize, current_usize, self.ascii, self.non_ascii)\n {\n let b = self.probabilities[index];\n if b == 255 {\n IMPLAUSIBILITY_PENALTY\n } else {\n i64::from(b)\n }\n } else {\n 0\n }\n } else {\n // I tried factoring the tail of this function out into an\n // #[inline(never)] function, but it had no binary size effect\n // in a Rust toy app and made the binary size larger in Firefox\n // in Linux x86_64 shippable config.\n\n // Current below stored, prev above\n if current_usize == 0\n || current_usize == ASCII_DIGIT\n || (is_windows_1256 && current_usize == WINDOWS_1256_ZWNJ)\n {\n // Current is space-like\n 0\n } else {\n // Current is alphabetic\n let previous_unstored = previous_usize - stored_boundary;\n match previous_unstored {\n PLAUSIBLE_NEXT_TO_ALPHABETIC_ON_EITHER_SIDE => 0,\n IMPLAUSIBLE_NEXT_TO_ALPHABETIC_ON_EITHER_SIDE => IMPLAUSIBILITY_PENALTY,\n IMPLAUSIBLE_BEFORE_ALPHABETIC => IMPLAUSIBILITY_PENALTY,\n IMPLAUSIBLE_AFTER_ALPHABETIC => 0,\n PLAUSIBLE_NEXT_TO_NON_ASCII_ALPHABETIC_ON_EITHER_SIDE => {\n if current_usize < self.ascii {\n IMPLAUSIBILITY_PENALTY\n } else {\n 0\n }\n }\n PLAUSIBLE_NEXT_TO_ASCII_ALPHABETIC_ON_EITHER_SIDE => {\n if current_usize < self.ascii {\n 0\n } else {\n IMPLAUSIBILITY_PENALTY\n }\n }\n _ => {\n debug_assert_eq!(previous_usize, ASCII_DIGIT);\n 0\n }\n }\n }\n }\n } else {\n if previous_usize < stored_boundary {\n // Current above, prev below\n if previous_usize == 0\n || previous_usize == ASCII_DIGIT\n || (is_windows_1256 && previous_usize == WINDOWS_1256_ZWNJ)\n {\n // Previous is space-like\n 0\n } else {\n // Current is alphabetic\n let current_unstored = current_usize - stored_boundary;\n match current_unstored {\n PLAUSIBLE_NEXT_TO_ALPHABETIC_ON_EITHER_SIDE => 0,\n IMPLAUSIBLE_NEXT_TO_ALPHABETIC_ON_EITHER_SIDE => IMPLAUSIBILITY_PENALTY,\n IMPLAUSIBLE_BEFORE_ALPHABETIC => 0,\n IMPLAUSIBLE_AFTER_ALPHABETIC => IMPLAUSIBILITY_PENALTY,\n PLAUSIBLE_NEXT_TO_NON_ASCII_ALPHABETIC_ON_EITHER_SIDE => {\n if previous_usize < self.ascii {\n IMPLAUSIBILITY_PENALTY\n } else {\n 0\n }\n }\n PLAUSIBLE_NEXT_TO_ASCII_ALPHABETIC_ON_EITHER_SIDE => {\n if previous_usize < self.ascii {\n 0\n } else {\n IMPLAUSIBILITY_PENALTY\n }\n }\n _ => {\n debug_assert_eq!(current_usize, ASCII_DIGIT);\n 0\n }\n }\n }\n } else if current_usize == ASCII_DIGIT || previous_usize == ASCII_DIGIT {\n 0\n } else {\n // Both above\n IMPLAUSIBILITY_PENALTY\n }\n }\n }\n}\n\nimpl PartialEq for SingleByteData {\n #[inline]\n fn eq(&self, other: &SingleByteData) -> bool {\n (self as *const SingleByteData) == (other as *const SingleByteData)\n }\n}\n\npub static SINGLE_BYTE_DATA: [SingleByteData; 20] = [\n SingleByteData {\n encoding: &WINDOWS_1258_INIT,\n lower: &DETECTOR_DATA.latin_ascii,\n upper: &DETECTOR_DATA.windows_1258,\n probabilities: &DETECTOR_DATA.vietnamese,\n ascii: VIETNAMESE_ASCII,\n non_ascii: VIETNAMESE_NON_ASCII,\n },\n SingleByteData {\n encoding: &WINDOWS_1250_INIT,\n lower: &DETECTOR_DATA.latin_ascii,\n upper: &DETECTOR_DATA.windows_1250,\n probabilities: &DETECTOR_DATA.central,\n ascii: CENTRAL_ASCII,\n non_ascii: CENTRAL_NON_ASCII,\n },\n SingleByteData {\n encoding: &ISO_8859_2_INIT,\n lower: &DETECTOR_DATA.latin_ascii,\n upper: &DETECTOR_DATA.iso_8859_2,\n probabilities: &DETECTOR_DATA.central,\n ascii: CENTRAL_ASCII,\n non_ascii: CENTRAL_NON_ASCII,\n },\n SingleByteData {\n encoding: &WINDOWS_1251_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.windows_1251,\n probabilities: &DETECTOR_DATA.cyrillic,\n ascii: CYRILLIC_ASCII,\n non_ascii: CYRILLIC_NON_ASCII,\n },\n SingleByteData {\n encoding: &KOI8_U_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.koi8_u,\n probabilities: &DETECTOR_DATA.cyrillic,\n ascii: CYRILLIC_ASCII,\n non_ascii: CYRILLIC_NON_ASCII,\n },\n SingleByteData {\n encoding: &ISO_8859_5_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.iso_8859_5,\n probabilities: &DETECTOR_DATA.cyrillic,\n ascii: CYRILLIC_ASCII,\n non_ascii: CYRILLIC_NON_ASCII,\n },\n SingleByteData {\n encoding: &IBM866_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.ibm866,\n probabilities: &DETECTOR_DATA.cyrillic,\n ascii: CYRILLIC_ASCII,\n non_ascii: CYRILLIC_NON_ASCII,\n },\n SingleByteData {\n encoding: &WINDOWS_1252_INIT,\n lower: &DETECTOR_DATA.latin_ascii,\n upper: &DETECTOR_DATA.windows_1252,\n probabilities: &DETECTOR_DATA.western,\n ascii: WESTERN_ASCII,\n non_ascii: WESTERN_NON_ASCII,\n },\n SingleByteData {\n encoding: &WINDOWS_1252_INIT,\n lower: &DETECTOR_DATA.latin_ascii,\n upper: &DETECTOR_DATA.windows_1252_icelandic,\n probabilities: &DETECTOR_DATA.icelandic,\n ascii: ICELANDIC_ASCII,\n non_ascii: ICELANDIC_NON_ASCII,\n },\n SingleByteData {\n encoding: &WINDOWS_1253_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.windows_1253,\n probabilities: &DETECTOR_DATA.greek,\n ascii: GREEK_ASCII,\n non_ascii: GREEK_NON_ASCII,\n },\n SingleByteData {\n encoding: &ISO_8859_7_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.iso_8859_7,\n probabilities: &DETECTOR_DATA.greek,\n ascii: GREEK_ASCII,\n non_ascii: GREEK_NON_ASCII,\n },\n SingleByteData {\n encoding: &WINDOWS_1254_INIT,\n lower: &DETECTOR_DATA.turkish_ascii,\n upper: &DETECTOR_DATA.windows_1254,\n probabilities: &DETECTOR_DATA.turkish,\n ascii: TURKISH_ASCII,\n non_ascii: TURKISH_NON_ASCII,\n },\n SingleByteData {\n encoding: &WINDOWS_1255_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.windows_1255,\n probabilities: &DETECTOR_DATA.hebrew,\n ascii: HEBREW_ASCII,\n non_ascii: HEBREW_NON_ASCII,\n },\n SingleByteData {\n encoding: &ISO_8859_8_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.iso_8859_8,\n probabilities: &DETECTOR_DATA.hebrew,\n ascii: HEBREW_ASCII,\n non_ascii: HEBREW_NON_ASCII,\n },\n SingleByteData {\n encoding: &WINDOWS_1256_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.windows_1256,\n probabilities: &DETECTOR_DATA.arabic,\n ascii: ARABIC_ASCII,\n non_ascii: ARABIC_NON_ASCII,\n },\n SingleByteData {\n encoding: &ISO_8859_6_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.iso_8859_6,\n probabilities: &DETECTOR_DATA.arabic,\n ascii: ARABIC_ASCII,\n non_ascii: ARABIC_NON_ASCII,\n },\n SingleByteData {\n encoding: &WINDOWS_1257_INIT,\n lower: &DETECTOR_DATA.latin_ascii,\n upper: &DETECTOR_DATA.windows_1257,\n probabilities: &DETECTOR_DATA.baltic,\n ascii: BALTIC_ASCII,\n non_ascii: BALTIC_NON_ASCII,\n },\n SingleByteData {\n encoding: &ISO_8859_13_INIT,\n lower: &DETECTOR_DATA.latin_ascii,\n upper: &DETECTOR_DATA.iso_8859_13,\n probabilities: &DETECTOR_DATA.baltic,\n ascii: BALTIC_ASCII,\n non_ascii: BALTIC_NON_ASCII,\n },\n SingleByteData {\n encoding: &ISO_8859_4_INIT,\n lower: &DETECTOR_DATA.latin_ascii,\n upper: &DETECTOR_DATA.iso_8859_4,\n probabilities: &DETECTOR_DATA.baltic,\n ascii: BALTIC_ASCII,\n non_ascii: BALTIC_NON_ASCII,\n },\n SingleByteData {\n encoding: &WINDOWS_874_INIT,\n lower: &DETECTOR_DATA.non_latin_ascii,\n upper: &DETECTOR_DATA.windows_874,\n probabilities: &DETECTOR_DATA.thai,\n ascii: THAI_ASCII,\n non_ascii: THAI_NON_ASCII,\n },\n];\n\npub const WINDOWS_1258_INDEX: usize = 0;\npub const WINDOWS_1250_INDEX: usize = 1;\npub const ISO_8859_2_INDEX: usize = 2;\npub const WINDOWS_1251_INDEX: usize = 3;\npub const KOI8_U_INDEX: usize = 4;\npub const ISO_8859_5_INDEX: usize = 5;\npub const IBM866_INDEX: usize = 6;\npub const WINDOWS_1252_INDEX: usize = 7;\npub const WINDOWS_1252_ICELANDIC_INDEX: usize = 8;\npub const WINDOWS_1253_INDEX: usize = 9;\npub const ISO_8859_7_INDEX: usize = 10;\npub const WINDOWS_1254_INDEX: usize = 11;\npub const WINDOWS_1255_INDEX: usize = 12;\npub const ISO_8859_8_INDEX: usize = 13;\npub const WINDOWS_1256_INDEX: usize = 14;\npub const ISO_8859_6_INDEX: usize = 15;\npub const WINDOWS_1257_INDEX: usize = 16;\npub const ISO_8859_13_INDEX: usize = 17;\npub const ISO_8859_4_INDEX: usize = 18;\npub const WINDOWS_874_INDEX: usize = 19;\n"}]}},{"FileDel":{"deleted_names":[{"basename":"tld.rs","metadata":0}],"del":{"EdgeMap":{"edges":[{"previous":"BLOCK | FOLDER","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":257},"to":{"change":5,"start":258,"end":288},"introduced_by":5},{"previous":"BLOCK | FOLDER","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":288},"to":{"change":5,"start":289,"end":289},"introduced_by":5}],"inode":{"change":5,"pos":289}}},"content_edges":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":289},"to":{"change":5,"start":290,"end":11994},"introduced_by":5}],"inode":{"change":5,"pos":289}},"content":[{"Del":"/* Any copyright is dedicated to the Public Domain.\n * https://creativecommons.org/publicdomain/zero/1.0/ */\n\n#[derive(Clone, Copy, Debug, PartialEq)]\npub enum Tld {\n CentralWindows,\n Cyrillic,\n Western,\n Greek,\n TurkishAzeri,\n Hebrew,\n Arabic,\n Baltic,\n Vietnamese,\n Thai,\n Simplified,\n Traditional,\n Japanese,\n Korean,\n SimplifiedTraditional,\n TraditionalSimplified,\n CentralIso,\n IcelandicFaroese,\n WesternCyrillic,\n CentralCyrillic,\n WesternArabic,\n Generic,\n Eu,\n}\n\npub fn classify_tld(tld: &[u8]) -> Tld {\n if tld.len() == 2 {\n let key = [tld[0], tld[1]];\n if let Ok(i) = TWO_LETTER_KEYS.binary_search(&key) {\n TWO_LETTER_VALUES[i]\n } else {\n Tld::Western\n }\n } else if tld.len() == 3 {\n match tld {\n b\"edu\" | b\"gov\" | b\"mil\" => Tld::Western,\n _ => Tld::Generic,\n }\n } else if tld.starts_with(b\"xn--\") && tld.len() >= 8 {\n // It's unclear is including the IDNs here is a good idea.\n // Clearly, they are an anachronism relative to the era\n // of legacy encodings. The idea, consistent with previous\n // approach in Firefox is to address the case where one\n // of these TLDs is configured as an alternative name for\n // a server that also serves the same content from a\n // two-ASCII-letter TLD. This makes the detection result\n // the same either way even though otherwise this thing\n // does not make much sense.\n if let Ok(i) = PUNYCODE_KEYS.binary_search(&&tld[4..]) {\n PUNYCODE_VALUES[i]\n } else {\n Tld::Generic\n }\n } else {\n Tld::Generic\n }\n}\n\nstatic TWO_LETTER_VALUES: [Tld; 87] = [\n Tld::Generic, // ac\n Tld::Arabic, // ae\n Tld::Arabic, // af\n Tld::Generic, // ai\n Tld::WesternCyrillic, // am\n Tld::TurkishAzeri, // az\n Tld::CentralCyrillic, // ba\n Tld::Cyrillic, // bg\n Tld::Arabic, // bh\n Tld::Cyrillic, // by\n Tld::Generic, // bz\n Tld::Generic, // cb\n Tld::Generic, // cc\n Tld::Generic, // cd\n Tld::Simplified, // cn\n Tld::Generic, // cx\n Tld::Greek, // cy\n Tld::CentralWindows, // cz\n Tld::Generic, // dj\n Tld::Arabic, // dz\n Tld::Arabic, // eg\n Tld::Eu, // eu\n Tld::Generic, // fm\n Tld::IcelandicFaroese, // fo\n Tld::WesternCyrillic, // ge\n Tld::Greek, // gr\n Tld::TraditionalSimplified, // hk\n Tld::CentralWindows, // hr\n Tld::CentralIso, // hu\n Tld::Hebrew, // il\n Tld::Generic, // in\n Tld::Arabic, // iq\n Tld::Arabic, // ir\n Tld::IcelandicFaroese, // is\n Tld::Arabic, // jo\n Tld::Japanese, // jp\n Tld::Cyrillic, // kg\n Tld::Korean, // kp\n Tld::Korean, // kr\n Tld::Arabic, // kw\n Tld::Cyrillic, // kz\n Tld::Generic, // la\n Tld::Arabic, // lb\n Tld::Baltic, // lt\n Tld::Baltic, // lv\n Tld::Arabic, // ly\n Tld::Arabic, // ma\n Tld::Cyrillic, // md\n Tld::Generic, // me\n Tld::Cyrillic, // mk\n Tld::Cyrillic, // mn\n Tld::TraditionalSimplified, // mo\n Tld::Arabic, // mr\n Tld::Generic, // ms\n Tld::WesternArabic, // my\n Tld::Generic, // nu\n Tld::Arabic, // om\n Tld::Arabic, // pk\n Tld::CentralIso, // pl\n Tld::Arabic, // ps\n Tld::Arabic, // qa\n Tld::CentralWindows, // ro\n Tld::Cyrillic, // rs\n Tld::Cyrillic, // ru\n Tld::Arabic, // sa\n Tld::Arabic, // sd\n Tld::SimplifiedTraditional, // sg\n Tld::CentralIso, // si\n Tld::CentralWindows, // sk\n Tld::Generic, // st\n Tld::Cyrillic, // su\n Tld::Arabic, // sy\n Tld::Thai, // th\n Tld::Cyrillic, // tj\n Tld::Generic, // tk\n Tld::Cyrillic, // tm\n Tld::Arabic, // tn\n Tld::Generic, // to\n Tld::TurkishAzeri, // tr\n Tld::Generic, // tv\n Tld::Traditional, // tw\n Tld::Cyrillic, // ua\n Tld::Cyrillic, // uz\n Tld::Generic, // vc\n Tld::Vietnamese, // vn\n Tld::Generic, // vu\n Tld::Arabic, // ye\n];\n\nstatic TWO_LETTER_KEYS: [[u8; 2]; 87] = [\n [b'a', b'c'], // Generic\n [b'a', b'e'], // Arabic\n [b'a', b'f'], // Arabic\n [b'a', b'i'], // Generic\n [b'a', b'm'], // WesternCyrillic\n [b'a', b'z'], // TurkishAzeri\n [b'b', b'a'], // CentralCyrillic\n [b'b', b'g'], // Cyrillic\n [b'b', b'h'], // Arabic\n [b'b', b'y'], // Cyrillic\n [b'b', b'z'], // Generic\n [b'c', b'b'], // Generic\n [b'c', b'c'], // Generic\n [b'c', b'd'], // Generic\n [b'c', b'n'], // Simplified\n [b'c', b'x'], // Generic\n [b'c', b'y'], // Greek\n [b'c', b'z'], // CentralWindows\n [b'd', b'j'], // Generic\n [b'd', b'z'], // Arabic\n [b'e', b'g'], // Arabic\n [b'e', b'u'], // Eu\n [b'f', b'm'], // Generic\n [b'f', b'o'], // IcelandicFaroese\n [b'g', b'e'], // WesternCyrillic\n [b'g', b'r'], // Greek\n [b'h', b'k'], // TraditionalSimplified\n [b'h', b'r'], // CentralWindows\n [b'h', b'u'], // CentralIso\n [b'i', b'l'], // Hebrew\n [b'i', b'n'], // Generic\n [b'i', b'q'], // Arabic\n [b'i', b'r'], // Arabic\n [b'i', b's'], // IcelandicFaroese\n [b'j', b'o'], // Arabic\n [b'j', b'p'], // Japanese\n [b'k', b'g'], // Cyrillic\n [b'k', b'p'], // Korean\n [b'k', b'r'], // Korean\n [b'k', b'w'], // Arabic\n [b'k', b'z'], // Cyrillic\n [b'l', b'a'], // Generic\n [b'l', b'b'], // Arabic\n [b'l', b't'], // Baltic\n [b'l', b'v'], // Baltic\n [b'l', b'y'], // Arabic\n [b'm', b'a'], // Arabic\n [b'm', b'd'], // Cyrillic\n [b'm', b'e'], // Generic\n [b'm', b'k'], // Cyrillic\n [b'm', b'n'], // Cyrillic\n [b'm', b'o'], // TraditionalSimplified\n [b'm', b'r'], // Arabic\n [b'm', b's'], // Generic\n [b'm', b'y'], // WesternArabic\n [b'n', b'u'], // Generic\n [b'o', b'm'], // Arabic\n [b'p', b'k'], // Arabic\n [b'p', b'l'], // CentralIso\n [b'p', b's'], // Arabic\n [b'q', b'a'], // Arabic\n [b'r', b'o'], // CentralWindows\n [b'r', b's'], // Cyrillic\n [b'r', b'u'], // Cyrillic\n [b's', b'a'], // Arabic\n [b's', b'd'], // Arabic\n [b's', b'g'], // SimplifiedTraditional\n [b's', b'i'], // CentralIso\n [b's', b'k'], // CentralWindows\n [b's', b't'], // Generic\n [b's', b'u'], // Cyrillic\n [b's', b'y'], // Arabic\n [b't', b'h'], // Thai\n [b't', b'j'], // Cyrillic\n [b't', b'k'], // Generic\n [b't', b'm'], // Cyrillic\n [b't', b'n'], // Arabic\n [b't', b'o'], // Generic\n [b't', b'r'], // TurkishAzeri\n [b't', b'v'], // Generic\n [b't', b'w'], // Traditional\n [b'u', b'a'], // Cyrillic\n [b'u', b'z'], // Cyrillic\n [b'v', b'c'], // Generic\n [b'v', b'n'], // Vietnamese\n [b'v', b'u'], // Generic\n [b'y', b'e'], // Arabic\n];\n\nstatic PUNYCODE_KEYS: [&'static [u8]; 46] = [\n b\"3e0b707e\", // Korean\n b\"54b7fta0cc\", // Western\n b\"80ao21a\", // Cyrillic\n b\"90a3ac\", // Cyrillic\n b\"90ae\", // Cyrillic\n b\"90ais\", // Cyrillic\n b\"clchc0ea0b2g2a9gcd\", // SimplifiedTraditional\n b\"d1alf\", // Cyrillic\n b\"e1a4c\", // Eu\n b\"fiqs8S\", // Simplified\n b\"fiqz9S\", // Simplified\n b\"fzc2c9e2c\", // Western\n b\"j1amh\", // Cyrillic\n b\"j6w193g\", // TraditionalSimplified\n b\"kprw13d\", // Traditional\n b\"kpry57d\", // Traditional\n b\"l1acc\", // Cyrillic\n b\"lgbbat1ad8j\", // Arabic\n b\"mgb2ddes\", // Arabic\n b\"mgb9awbf\", // Arabic\n b\"mgba3a4f16a\", // Arabic\n b\"mgbaam7a8h\", // Arabic\n b\"mgbah1a3hjkrd\", // Arabic\n b\"mgbai9azgqp6j\", // Arabic\n b\"mgbayh7gpa\", // Arabic\n b\"mgbc0a9azcg\", // Arabic\n b\"mgbcpq6gpa1a\", // Arabic\n b\"mgberp4a5d4ar\", // Arabic\n b\"mgbpl2fh\", // Arabic\n b\"mgbtx2b\", // Arabic\n b\"mgbx4cd0ab\", // WesternArabic\n b\"mix891f\", // TraditionalSimplified\n b\"node\", // WesternCyrillic\n b\"o3cw4h\", // Thai\n b\"ogbpf8fl\", // Arabic\n b\"p1ai\", // Cyrillic\n b\"pgbs0dh\", // Arabic\n b\"q7ce6a\", // Arabic\n b\"qxa6a\", // Eu\n b\"qxam\", // Greek\n b\"wgbh1c\", // Arabic\n b\"wgbl6a\", // Arabic\n b\"xkc2al3hye2a\", // Western\n b\"y9a3aq\", // WesternCyrillic\n b\"yfro4i67o\", // SimplifiedTraditional\n b\"ygbi2ammx\", // Arabic\n];\n\nstatic PUNYCODE_VALUES: [Tld; 46] = [\n Tld::Korean, // 3e0b707e\n Tld::Western, // 54b7fta0cc\n Tld::Cyrillic, // 80ao21a\n Tld::Cyrillic, // 90a3ac\n Tld::Cyrillic, // 90ae\n Tld::Cyrillic, // 90ais\n Tld::SimplifiedTraditional, // clchc0ea0b2g2a9gcd\n Tld::Cyrillic, // d1alf\n Tld::Eu, // e1a4c\n Tld::Simplified, // fiqs8S\n Tld::Simplified, // fiqz9S\n Tld::Western, // fzc2c9e2c\n Tld::Cyrillic, // j1amh\n Tld::TraditionalSimplified, // j6w193g\n Tld::Traditional, // kprw13d\n Tld::Traditional, // kpry57d\n Tld::Cyrillic, // l1acc\n Tld::Arabic, // lgbbat1ad8j\n Tld::Arabic, // mgb2ddes\n Tld::Arabic, // mgb9awbf\n Tld::Arabic, // mgba3a4f16a\n Tld::Arabic, // mgbaam7a8h\n Tld::Arabic, // mgbah1a3hjkrd\n Tld::Arabic, // mgbai9azgqp6j\n Tld::Arabic, // mgbayh7gpa\n Tld::Arabic, // mgbc0a9azcg\n Tld::Arabic, // mgbcpq6gpa1a\n Tld::Arabic, // mgberp4a5d4ar\n Tld::Arabic, // mgbpl2fh\n Tld::Arabic, // mgbtx2b\n Tld::WesternArabic, // mgbx4cd0ab\n Tld::TraditionalSimplified, // mix891f\n Tld::WesternCyrillic, // node\n Tld::Thai, // o3cw4h\n Tld::Arabic, // ogbpf8fl\n Tld::Cyrillic, // p1ai\n Tld::Arabic, // pgbs0dh\n Tld::Arabic, // q7ce6a\n Tld::Eu, // qxa6a\n Tld::Greek, // qxam\n Tld::Arabic, // wgbh1c\n Tld::Arabic, // wgbl6a\n Tld::Western, // xkc2al3hye2a\n Tld::WesternCyrillic, // y9a3aq\n Tld::SimplifiedTraditional, // yfro4i67o\n Tld::Arabic, // ygbi2ammx\n];\n"}]}},{"FileDel":{"deleted_names":[{"basename":"mod.rs","metadata":0},{"basename":"lib.rs","metadata":0}],"del":{"EdgeMap":{"edges":[{"previous":"BLOCK | FOLDER","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":257},"to":{"change":5,"start":79,"end":96},"introduced_by":5},{"previous":"BLOCK | FOLDER","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":96},"to":{"change":5,"start":12027,"end":12027},"introduced_by":5},{"previous":"BLOCK | FOLDER | DELETED","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":257},"to":{"change":5,"start":11996,"end":12026},"introduced_by":5},{"previous":"BLOCK | FOLDER","flag":"BLOCK | FOLDER | DELETED","from":{"change":5,"pos":12026},"to":{"change":5,"start":12027,"end":12027},"introduced_by":5}],"inode":{"change":5,"pos":12027}}},"content_edges":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":12027},"to":{"change":5,"start":12028,"end":126524},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":126524},"to":{"change":5,"start":9377,"end":9963},"introduced_by":5},{"previous":"","flag":"DELETED","from":{"change":5,"pos":9963},"to":{"change":5,"start":128268,"end":128274},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":128268},"to":{"change":5,"start":128268,"end":128274},"introduced_by":5},{"previous":"","flag":"DELETED","from":{"change":5,"pos":1468},"to":{"change":5,"start":128274,"end":128794},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":128274},"to":{"change":5,"start":128274,"end":128794},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":128794},"to":{"change":5,"start":177,"end":232},"introduced_by":5},{"previous":"","flag":"DELETED","from":{"change":5,"pos":232},"to":{"change":5,"start":128849,"end":128923},"introduced_by":5},{"previous":"","flag":"DELETED","from":{"change":5,"pos":1544},"to":{"change":5,"start":128849,"end":128923},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":128849},"to":{"change":5,"start":128849,"end":128923},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":128923},"to":{"change":5,"start":233,"end":277},"introduced_by":5},{"previous":"","flag":"DELETED","from":{"change":5,"pos":277},"to":{"change":5,"start":128967,"end":129583},"introduced_by":5},{"previous":"","flag":"DELETED","from":{"change":5,"pos":1588},"to":{"change":5,"start":128967,"end":129583},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":128967},"to":{"change":5,"start":128967,"end":129583},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":129583},"to":{"change":2,"start":0,"end":29},"introduced_by":2},{"previous":"","flag":"DELETED","from":{"change":2,"pos":29},"to":{"change":5,"start":129611,"end":131390},"introduced_by":2},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":129611},"to":{"change":5,"start":129611,"end":131390},"introduced_by":5},{"previous":"","flag":"DELETED","from":{"change":3,"pos":960},"to":{"change":5,"start":131390,"end":131932},"introduced_by":3},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":131390},"to":{"change":5,"start":131390,"end":131932},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":131932},"to":{"change":2,"start":30,"end":66},"introduced_by":2},{"previous":"","flag":"DELETED","from":{"change":2,"pos":66},"to":{"change":5,"start":131971,"end":132034},"introduced_by":2},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":131971},"to":{"change":5,"start":131971,"end":132034},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":132034},"to":{"change":5,"start":1589,"end":1618},"introduced_by":5},{"previous":"","flag":"DELETED","from":{"change":5,"pos":1618},"to":{"change":5,"start":132063,"end":138044},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":132063},"to":{"change":5,"start":132063,"end":138044},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":131390},"to":{"change":3,"start":905,"end":960},"introduced_by":3}],"inode":{"change":5,"pos":12027}},"content":[{"Del":"// Copyright Mozilla Foundation. See the COPYRIGHT\n// file at the top-level directory of this distribution.\n//\n// Licensed under the Apache License, Version 2.0 or the MIT license\n// , at your\n// option. This file may not be copied, modified, or distributed\n// except according to those terms.\n\n//! `chardetng` is a character encoding detector for legacy Web content.\n//!\n//! It is optimized for binary size in applications that already depend\n//! on `encoding_rs` for other reasons.\n\n#[cfg(feature = \"multithreading\")]\nuse rayon::prelude::*;\n\n#[cfg(feature = \"multithreading\")]\nuse arrayvec::ArrayVec;\n\n#[cfg(all(target_arch = \"x86\", target_feature = \"sse2\"))]\nuse core::arch::x86::__m128i;\n#[cfg(all(target_arch = \"x86\", target_feature = \"sse2\"))]\nuse core::arch::x86::_mm_movemask_epi8;\n\n#[cfg(all(target_arch = \"x86_64\", target_feature = \"sse2\"))]\nuse core::arch::x86_64::__m128i;\n#[cfg(all(target_arch = \"x86_64\", target_feature = \"sse2\"))]\nuse core::arch::x86_64::_mm_movemask_epi8;\n\nuse encoding_rs::Decoder;\nuse encoding_rs::DecoderResult;\nuse encoding_rs::Encoding;\nuse encoding_rs::BIG5;\nuse encoding_rs::EUC_JP;\nuse encoding_rs::EUC_KR;\nuse encoding_rs::GBK;\nuse encoding_rs::ISO_2022_JP;\nuse encoding_rs::ISO_8859_8;\nuse encoding_rs::SHIFT_JIS;\nuse encoding_rs::UTF_8;\nuse encoding_rs::WINDOWS_1255;\n\nmod data;\nmod tld;\nuse data::*;\nuse tld::classify_tld;\nuse tld::Tld;\n\nconst LATIN_ADJACENCY_PENALTY: i64 = -50;\n\nconst IMPLAUSIBILITY_PENALTY: i64 = -220;\n\nconst ORDINAL_BONUS: i64 = 300;\n\nconst IMPLAUSIBLE_LATIN_CASE_TRANSITION_PENALTY: i64 = -180;\n\nconst NON_LATIN_CAPITALIZATION_BONUS: i64 = 40;\n\nconst NON_LATIN_ALL_CAPS_PENALTY: i64 = -40;\n\nconst NON_LATIN_MIXED_CASE_PENALTY: i64 = -20;\n\n// Manually calibrated relative to windows-1256 Arabic\nconst CJK_BASE_SCORE: i64 = 41;\n\nconst CJK_SECONDARY_BASE_SCORE: i64 = 20; // Was 20\n\nconst SHIFT_JIS_SCORE_PER_KANA: i64 = 20;\n\nconst SHIFT_JIS_SCORE_PER_LEVEL_1_KANJI: i64 = CJK_BASE_SCORE;\n\nconst SHIFT_JIS_SCORE_PER_LEVEL_2_KANJI: i64 = CJK_SECONDARY_BASE_SCORE;\n\n// Manually calibrated relative to windows-1256 Persian and Urdu\nconst SHIFT_JIS_INITIAL_HALF_WIDTH_KATAKANA_PENALTY: i64 = -75;\n\nconst HALF_WIDTH_KATAKANA_SCORE: i64 = 1;\n\n// Unclear if this is a good idea; seems not harmful, but can't be sure.\nconst HALF_WIDTH_KATAKANA_VOICING_SCORE: i64 = 10;\n\nconst SHIFT_JIS_PUA_PENALTY: i64 = -(CJK_BASE_SCORE * 10); // Should this be larger?\n\nconst SHIFT_JIS_EXTENSION_PENALTY: i64 = SHIFT_JIS_PUA_PENALTY * 2;\n\nconst SHIFT_JIS_SINGLE_BYTE_EXTENSION_PENALTY: i64 = SHIFT_JIS_EXTENSION_PENALTY;\n\nconst EUC_JP_SCORE_PER_KANA: i64 = CJK_BASE_SCORE + (CJK_BASE_SCORE / 3); // Relative to Big5\n\nconst EUC_JP_SCORE_PER_NEAR_OBSOLETE_KANA: i64 = CJK_BASE_SCORE - 1;\n\nconst EUC_JP_SCORE_PER_LEVEL_1_KANJI: i64 = CJK_BASE_SCORE;\n\nconst EUC_JP_SCORE_PER_LEVEL_2_KANJI: i64 = CJK_SECONDARY_BASE_SCORE;\n\nconst EUC_JP_SCORE_PER_OTHER_KANJI: i64 = CJK_SECONDARY_BASE_SCORE / 4;\n\nconst EUC_JP_INITIAL_KANA_PENALTY: i64 = -((CJK_BASE_SCORE / 3) + 1);\n\nconst EUC_JP_EXTENSION_PENALTY: i64 = -(CJK_BASE_SCORE * 50); // Needs to be more severe than for Shift_JIS to avoid misdetecting EUC-KR!\n\nconst BIG5_SCORE_PER_LEVEL_1_HANZI: i64 = CJK_BASE_SCORE;\n\nconst BIG5_SCORE_PER_OTHER_HANZI: i64 = CJK_SECONDARY_BASE_SCORE;\n\nconst BIG5_PUA_PENALTY: i64 = -(CJK_BASE_SCORE * 30); // More severe than other PUA penalties to avoid misdetecting EUC-KR! (25 as the multiplier is too little)\n\nconst BIG5_SINGLE_BYTE_EXTENSION_PENALTY: i64 = -(CJK_BASE_SCORE * 40);\n\nconst EUC_KR_SCORE_PER_EUC_HANGUL: i64 = CJK_BASE_SCORE + 1;\n\nconst EUC_KR_SCORE_PER_NON_EUC_HANGUL: i64 = CJK_SECONDARY_BASE_SCORE / 5;\n\nconst EUC_KR_SCORE_PER_HANJA: i64 = CJK_SECONDARY_BASE_SCORE / 2;\n\nconst EUC_KR_HANJA_AFTER_HANGUL_PENALTY: i64 = -(CJK_BASE_SCORE * 10);\n\nconst EUC_KR_LONG_WORD_PENALTY: i64 = -6;\n\nconst EUC_KR_PUA_PENALTY: i64 = GBK_PUA_PENALTY - 1; // Break tie in favor of GBK\n\nconst EUC_KR_MAC_KOREAN_PENALTY: i64 = EUC_KR_PUA_PENALTY * 2;\n\nconst EUC_KR_SINGLE_BYTE_EXTENSION_PENALTY: i64 = EUC_KR_MAC_KOREAN_PENALTY;\n\nconst GBK_SCORE_PER_LEVEL_1: i64 = CJK_BASE_SCORE;\n\nconst GBK_SCORE_PER_LEVEL_2: i64 = CJK_SECONDARY_BASE_SCORE;\n\nconst GBK_SCORE_PER_NON_EUC: i64 = CJK_SECONDARY_BASE_SCORE / 4;\n\nconst GBK_PUA_PENALTY: i64 = -(CJK_BASE_SCORE * 10); // Factor should be at least 2, but should it be larger?\n\nconst GBK_SINGLE_BYTE_EXTENSION_PENALTY: i64 = GBK_PUA_PENALTY * 4;\n\nconst CJK_LATIN_ADJACENCY_PENALTY: i64 = -CJK_BASE_SCORE; // smaller penalty than LATIN_ADJACENCY_PENALTY\n\nconst CJ_PUNCTUATION: i64 = CJK_BASE_SCORE / 2;\n\nconst CJK_OTHER: i64 = CJK_SECONDARY_BASE_SCORE / 4;\n\n/// Latin letter caseless class\nconst LATIN_LETTER: u8 = 1;\n\nfn contains_upper_case_period_or_non_ascii(label: &[u8]) -> bool {\n for &b in label.into_iter() {\n if b >= 0x80 {\n return true;\n }\n if b == b'.' {\n return true;\n }\n if b >= b'A' && b <= b'Z' {\n return true;\n }\n }\n false\n}\n\n// For Latin, we only penalize pairwise bad transitions\n// if one participant is non-ASCII. This avoids violating\n// the principle that ASCII pairs never contribute to the\n// score. (Maybe that's a bad principle, though!)\n#[derive(PartialEq)]\nenum LatinCaseState {\n Space,\n Upper,\n Lower,\n AllCaps,\n}\n\n// Fon non-Latin, we calculate case-related penalty\n// or bonus on a per-non-Latin-word basis.\n#[derive(PartialEq)]\nenum NonLatinCaseState {\n Space,\n Upper,\n Lower,\n UpperLower,\n AllCaps,\n Mix,\n}\n\nstruct NonLatinCasedCandidate {\n data: &'static SingleByteData,\n prev: u8,\n case_state: NonLatinCaseState,\n prev_ascii: bool,\n current_word_len: u64,\n longest_word: u64,\n ibm866: bool,\n prev_was_a0: bool, // Only used with IBM866\n}\n\nimpl NonLatinCasedCandidate {\n fn new(data: &'static SingleByteData) -> Self {\n NonLatinCasedCandidate {\n data: data,\n prev: 0,\n case_state: NonLatinCaseState::Space,\n prev_ascii: true,\n current_word_len: 0,\n longest_word: 0,\n ibm866: data == &SINGLE_BYTE_DATA[IBM866_INDEX],\n prev_was_a0: false,\n }\n }\n\n fn feed(&mut self, buffer: &[u8]) -> Option {\n let mut score = 0i64;\n for &b in buffer {\n let class = self.data.classify(b);\n if class == 255 {\n return None;\n }\n let caseless_class = class & 0x7F;\n\n let ascii = b < 0x80;\n let ascii_pair = self.prev_ascii && ascii;\n\n let non_ascii_alphabetic = self.data.is_non_latin_alphabetic(caseless_class, false);\n\n // The purpose of this state machine is to avoid misdetecting Greek as\n // Cyrillic by:\n //\n // * Giving a small bonus to words that start with an upper-case letter\n // and are lower-case for the rest.\n // * Giving a large penalty to start with one lower-case letter followed\n // by all upper-case (obviously upper and lower case inverted, which\n // unfortunately is possible due to KOI8-U).\n // * Giving a small per-word penalty to all-uppercase KOI8-U (to favor\n // all-lowercase Greek over all-caps KOI8-U).\n // * Giving large penalties for mixed-case other than initial upper-case.\n // This also helps relative to non-cased encodings.\n\n // ASCII doesn't participate in non-Latin casing.\n if caseless_class == LATIN_LETTER {\n // Latin\n // Mark this word as a mess. If there end up being non-Latin\n // letters in this word, the ASCII-adjacency penalty gets\n // applied to Latin/non-Latin pairs and the mix penalty\n // to non-Latin/non-Latin pairs.\n // XXX Apply penalty here\n self.case_state = NonLatinCaseState::Mix;\n } else if !non_ascii_alphabetic {\n // Space\n match self.case_state {\n NonLatinCaseState::Space\n | NonLatinCaseState::Upper\n | NonLatinCaseState::Lower => {}\n NonLatinCaseState::UpperLower => {\n // Intentionally applied only once per word.\n score += NON_LATIN_CAPITALIZATION_BONUS;\n }\n NonLatinCaseState::AllCaps => {\n // Intentionally applied only once per word.\n if self.data == &SINGLE_BYTE_DATA[KOI8_U_INDEX] {\n // Apply only to KOI8-U.\n score += NON_LATIN_ALL_CAPS_PENALTY;\n }\n }\n NonLatinCaseState::Mix => {\n // Per letter\n score += NON_LATIN_MIXED_CASE_PENALTY * (self.current_word_len as i64);\n }\n }\n self.case_state = NonLatinCaseState::Space;\n } else if (class >> 7) == 0 {\n // Lower case\n match self.case_state {\n NonLatinCaseState::Space => {\n self.case_state = NonLatinCaseState::Lower;\n }\n NonLatinCaseState::Upper => {\n self.case_state = NonLatinCaseState::UpperLower;\n }\n NonLatinCaseState::Lower\n | NonLatinCaseState::UpperLower\n | NonLatinCaseState::Mix => {}\n NonLatinCaseState::AllCaps => {\n self.case_state = NonLatinCaseState::Mix;\n }\n }\n } else {\n // Upper case\n match self.case_state {\n NonLatinCaseState::Space => {\n self.case_state = NonLatinCaseState::Upper;\n }\n NonLatinCaseState::Upper => {\n self.case_state = NonLatinCaseState::AllCaps;\n }\n NonLatinCaseState::Lower | NonLatinCaseState::UpperLower => {\n self.case_state = NonLatinCaseState::Mix;\n }\n NonLatinCaseState::AllCaps | NonLatinCaseState::Mix => {}\n }\n }\n\n // XXX Apply penalty if > 16\n if non_ascii_alphabetic {\n self.current_word_len += 1;\n } else {\n if self.current_word_len > self.longest_word {\n self.longest_word = self.current_word_len;\n }\n self.current_word_len = 0;\n }\n\n let is_a0 = b == 0xA0;\n if !ascii_pair {\n // 0xA0 is no-break space in many other encodings, so avoid\n // assigning score to IBM866 when 0xA0 occurs next to itself\n // or a space-like byte.\n if !(self.ibm866\n && ((is_a0 && (self.prev_was_a0 || self.prev == 0))\n || caseless_class == 0 && self.prev_was_a0))\n {\n score += self.data.score(caseless_class, self.prev, false);\n }\n\n if self.prev == LATIN_LETTER && non_ascii_alphabetic {\n score += LATIN_ADJACENCY_PENALTY;\n } else if caseless_class == LATIN_LETTER\n && self.data.is_non_latin_alphabetic(self.prev, false)\n {\n score += LATIN_ADJACENCY_PENALTY;\n }\n }\n\n self.prev_ascii = ascii;\n self.prev = caseless_class;\n self.prev_was_a0 = is_a0;\n }\n Some(score)\n }\n}\n\nenum OrdinalState {\n Other,\n Space,\n PeriodAfterN,\n OrdinalExpectingSpace,\n OrdinalExpectingSpaceUndoImplausibility,\n OrdinalExpectingSpaceOrDigit,\n OrdinalExpectingSpaceOrDigitUndoImplausibily,\n UpperN,\n LowerN,\n FeminineAbbreviationStartLetter,\n Digit,\n Roman,\n}\n\nstruct LatinCandidate {\n data: &'static SingleByteData,\n prev: u8,\n case_state: LatinCaseState,\n prev_non_ascii: u32,\n ordinal_state: OrdinalState, // Used only when `windows1252 == true`\n windows1252: bool,\n}\n\nimpl LatinCandidate {\n fn new(data: &'static SingleByteData) -> Self {\n LatinCandidate {\n data: data,\n prev: 0,\n case_state: LatinCaseState::Space,\n prev_non_ascii: 0,\n ordinal_state: OrdinalState::Space,\n windows1252: data == &SINGLE_BYTE_DATA[WINDOWS_1252_INDEX],\n }\n }\n\n fn feed(&mut self, buffer: &[u8]) -> Option {\n let mut score = 0i64;\n for &b in buffer {\n let class = self.data.classify(b);\n if class == 255 {\n return None;\n }\n let caseless_class = class & 0x7F;\n\n let ascii = b < 0x80;\n let ascii_pair = self.prev_non_ascii == 0 && ascii;\n\n let non_ascii_penalty = match self.prev_non_ascii {\n 0 | 1 | 2 => 0,\n 3 => -5,\n 4 => -20,\n _ => -200,\n };\n score += non_ascii_penalty;\n // XXX if has Vietnamese-only characters and word length > 7,\n // apply penalty\n\n if !self.data.is_latin_alphabetic(caseless_class) {\n self.case_state = LatinCaseState::Space;\n } else if (class >> 7) == 0 {\n // Penalizing lower case after two upper case\n // is important for avoiding misdetecting\n // windows-1250 as windows-1252 (byte 0x9F).\n if self.case_state == LatinCaseState::AllCaps && !ascii_pair {\n score += IMPLAUSIBLE_LATIN_CASE_TRANSITION_PENALTY;\n }\n self.case_state = LatinCaseState::Lower;\n } else {\n match self.case_state {\n LatinCaseState::Space => {\n self.case_state = LatinCaseState::Upper;\n }\n LatinCaseState::Upper | LatinCaseState::AllCaps => {\n self.case_state = LatinCaseState::AllCaps;\n }\n LatinCaseState::Lower => {\n if !ascii_pair {\n // XXX How bad is this for Irish Gaelic?\n score += IMPLAUSIBLE_LATIN_CASE_TRANSITION_PENALTY;\n }\n self.case_state = LatinCaseState::Upper;\n }\n }\n }\n\n // Treat pairing space-like, which can be non-ASCII, with ASCII as\n // ASCIIish enough not to get a score in order to avoid giving\n // ASCII i and I in windows-1254 next to windows-125x apostrophe/quote\n // a score. This avoids detecting English I’ as Turkish.\n let ascii_ish_pair = ascii_pair\n || (ascii && self.prev == 0)\n || (caseless_class == 0 && self.prev_non_ascii == 0);\n\n if !ascii_ish_pair {\n score += self.data.score(caseless_class, self.prev, false);\n }\n\n if self.windows1252 {\n // This state machine assigns score to the sequences\n // * \" º \" (Spanish)\n // * \" ª \" (Spanish)\n // * \".ª \" (Spanish)\n // * \".º \" (Spanish)\n // * \"n.º1\" (Spanish)\n // * \" Mª \" (Spanish)\n // * \" Dª \" (Spanish)\n // * \" Nª \" (Spanish)\n // * \" Sª \" (Spanish)\n // * \" 3º \" (Italian, where 3 is an ASCII digit)\n // * \" 3ª \" (Italian, where 3 is an ASCII digit)\n // * \" Xº \" (Italian, where X is a small Roman numeral)\n // * \" Xª \" (Italian, where X is a small Roman numeral)\n // * \" Nº1\" (Italian, where 1 is an ASCII digit)\n // * \" Nº \" (Italian)\n // which are problematic to deal with by pairwise scoring\n // without messing up Romanian detection.\n // Initial sc\n match self.ordinal_state {\n OrdinalState::Other => {\n if caseless_class == 0 {\n self.ordinal_state = OrdinalState::Space;\n }\n }\n OrdinalState::Space => {\n if caseless_class == 0 {\n // pass\n } else if b == 0xAA || b == 0xBA {\n self.ordinal_state = OrdinalState::OrdinalExpectingSpace;\n } else if b == b'M' || b == b'D' || b == b'S' {\n self.ordinal_state = OrdinalState::FeminineAbbreviationStartLetter;\n } else if b == b'N' {\n // numero or Nuestra\n self.ordinal_state = OrdinalState::UpperN;\n } else if b == b'n' {\n // numero\n self.ordinal_state = OrdinalState::LowerN;\n } else if caseless_class == (ASCII_DIGIT as u8) {\n self.ordinal_state = OrdinalState::Digit;\n } else if caseless_class == 9 /* I */ || caseless_class == 22 /* V */ || caseless_class == 24\n /* X */\n {\n self.ordinal_state = OrdinalState::Roman;\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n OrdinalState::OrdinalExpectingSpace => {\n if caseless_class == 0 {\n score += ORDINAL_BONUS;\n self.ordinal_state = OrdinalState::Space;\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n OrdinalState::OrdinalExpectingSpaceUndoImplausibility => {\n if caseless_class == 0 {\n score += ORDINAL_BONUS - IMPLAUSIBILITY_PENALTY;\n self.ordinal_state = OrdinalState::Space;\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n OrdinalState::OrdinalExpectingSpaceOrDigit => {\n if caseless_class == 0 {\n score += ORDINAL_BONUS;\n self.ordinal_state = OrdinalState::Space;\n } else if caseless_class == (ASCII_DIGIT as u8) {\n score += ORDINAL_BONUS;\n // Deliberately set to `Other`\n self.ordinal_state = OrdinalState::Other;\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n OrdinalState::OrdinalExpectingSpaceOrDigitUndoImplausibily => {\n if caseless_class == 0 {\n score += ORDINAL_BONUS - IMPLAUSIBILITY_PENALTY;\n self.ordinal_state = OrdinalState::Space;\n } else if caseless_class == (ASCII_DIGIT as u8) {\n score += ORDINAL_BONUS - IMPLAUSIBILITY_PENALTY;\n // Deliberately set to `Other`\n self.ordinal_state = OrdinalState::Other;\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n OrdinalState::UpperN => {\n if b == 0xAA {\n self.ordinal_state =\n OrdinalState::OrdinalExpectingSpaceUndoImplausibility;\n } else if b == 0xBA {\n self.ordinal_state =\n OrdinalState::OrdinalExpectingSpaceOrDigitUndoImplausibily;\n } else if b == b'.' {\n self.ordinal_state = OrdinalState::PeriodAfterN;\n } else if caseless_class == 0 {\n self.ordinal_state = OrdinalState::Space;\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n OrdinalState::LowerN => {\n if b == 0xBA {\n self.ordinal_state =\n OrdinalState::OrdinalExpectingSpaceOrDigitUndoImplausibily;\n } else if b == b'.' {\n self.ordinal_state = OrdinalState::PeriodAfterN;\n } else if caseless_class == 0 {\n self.ordinal_state = OrdinalState::Space;\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n OrdinalState::FeminineAbbreviationStartLetter => {\n if b == 0xAA {\n self.ordinal_state =\n OrdinalState::OrdinalExpectingSpaceUndoImplausibility;\n } else if caseless_class == 0 {\n self.ordinal_state = OrdinalState::Space;\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n OrdinalState::Digit => {\n if b == 0xAA || b == 0xBA {\n self.ordinal_state = OrdinalState::OrdinalExpectingSpace;\n } else if caseless_class == 0 {\n self.ordinal_state = OrdinalState::Space;\n } else if caseless_class == (ASCII_DIGIT as u8) {\n // pass\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n OrdinalState::Roman => {\n if b == 0xAA || b == 0xBA {\n self.ordinal_state =\n OrdinalState::OrdinalExpectingSpaceUndoImplausibility;\n } else if caseless_class == 0 {\n self.ordinal_state = OrdinalState::Space;\n } else if caseless_class == 9 /* I */ || caseless_class == 22 /* V */ || caseless_class == 24\n /* X */\n {\n // pass\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n OrdinalState::PeriodAfterN => {\n if b == 0xBA {\n self.ordinal_state = OrdinalState::OrdinalExpectingSpaceOrDigit;\n } else if caseless_class == 0 {\n self.ordinal_state = OrdinalState::Space;\n } else {\n self.ordinal_state = OrdinalState::Other;\n }\n }\n }\n }\n\n if ascii {\n self.prev_non_ascii = 0;\n } else {\n self.prev_non_ascii += 1;\n }\n self.prev = caseless_class;\n }\n Some(score)\n }\n}\n\nstruct ArabicFrenchCandidate {\n data: &'static SingleByteData,\n prev: u8,\n case_state: LatinCaseState,\n prev_ascii: bool,\n current_word_len: u64,\n longest_word: u64,\n}\n\nimpl ArabicFrenchCandidate {\n fn new(data: &'static SingleByteData) -> Self {\n ArabicFrenchCandidate {\n data: data,\n prev: 0,\n case_state: LatinCaseState::Space,\n prev_ascii: true,\n current_word_len: 0,\n longest_word: 0,\n }\n }\n\n fn feed(&mut self, buffer: &[u8]) -> Option {\n let mut score = 0i64;\n for &b in buffer {\n let class = self.data.classify(b);\n if class == 255 {\n return None;\n }\n let caseless_class = class & 0x7F;\n\n let ascii = b < 0x80;\n let ascii_pair = self.prev_ascii && ascii;\n\n if caseless_class != LATIN_LETTER {\n // We compute case penalties for French only\n self.case_state = LatinCaseState::Space;\n } else if (class >> 7) == 0 {\n if self.case_state == LatinCaseState::AllCaps && !ascii_pair {\n score += IMPLAUSIBLE_LATIN_CASE_TRANSITION_PENALTY;\n }\n self.case_state = LatinCaseState::Lower;\n } else {\n match self.case_state {\n LatinCaseState::Space => {\n self.case_state = LatinCaseState::Upper;\n }\n LatinCaseState::Upper | LatinCaseState::AllCaps => {\n self.case_state = LatinCaseState::AllCaps;\n }\n LatinCaseState::Lower => {\n if !ascii_pair {\n score += IMPLAUSIBLE_LATIN_CASE_TRANSITION_PENALTY;\n }\n self.case_state = LatinCaseState::Upper;\n }\n }\n }\n\n // Count only Arabic word length and ignore French\n let non_ascii_alphabetic = self.data.is_non_latin_alphabetic(caseless_class, true);\n // XXX apply penalty if > 23\n if non_ascii_alphabetic {\n self.current_word_len += 1;\n } else {\n if self.current_word_len > self.longest_word {\n self.longest_word = self.current_word_len;\n }\n self.current_word_len = 0;\n }\n\n if !ascii_pair {\n score += self.data.score(caseless_class, self.prev, true);\n\n if self.prev == LATIN_LETTER && non_ascii_alphabetic {\n score += LATIN_ADJACENCY_PENALTY;\n } else if caseless_class == LATIN_LETTER\n && self.data.is_non_latin_alphabetic(self.prev, true)\n {\n score += LATIN_ADJACENCY_PENALTY;\n }\n }\n\n self.prev_ascii = ascii;\n self.prev = caseless_class;\n }\n Some(score)\n }\n}\n\nstruct CaselessCandidate {\n data: &'static SingleByteData,\n prev: u8,\n prev_ascii: bool,\n current_word_len: u64,\n longest_word: u64,\n}\n\nimpl CaselessCandidate {\n fn new(data: &'static SingleByteData) -> Self {\n CaselessCandidate {\n data: data,\n prev: 0,\n prev_ascii: true,\n current_word_len: 0,\n longest_word: 0,\n }\n }\n\n fn feed(&mut self, buffer: &[u8]) -> Option {\n let mut score = 0i64;\n for &b in buffer {\n let class = self.data.classify(b);\n if class == 255 {\n return None;\n }\n let caseless_class = class & 0x7F;\n\n let ascii = b < 0x80;\n let ascii_pair = self.prev_ascii && ascii;\n\n let non_ascii_alphabetic = self.data.is_non_latin_alphabetic(caseless_class, false);\n // Apply penalty if > 23 and not Thai\n if non_ascii_alphabetic {\n self.current_word_len += 1;\n } else {\n if self.current_word_len > self.longest_word {\n self.longest_word = self.current_word_len;\n }\n self.current_word_len = 0;\n }\n\n if !ascii_pair {\n score += self.data.score(caseless_class, self.prev, false);\n\n if self.prev == LATIN_LETTER && non_ascii_alphabetic {\n score += LATIN_ADJACENCY_PENALTY;\n } else if caseless_class == LATIN_LETTER\n && self.data.is_non_latin_alphabetic(self.prev, false)\n {\n score += LATIN_ADJACENCY_PENALTY;\n }\n }\n\n self.prev_ascii = ascii;\n self.prev = caseless_class;\n }\n Some(score)\n }\n}\n\nfn is_ascii_punctuation(byte: u8) -> bool {\n match byte {\n b'.' | b',' | b':' | b';' | b'?' | b'!' => true,\n _ => false,\n }\n}\n\nstruct LogicalCandidate {\n data: &'static SingleByteData,\n prev: u8,\n prev_ascii: bool,\n plausible_punctuation: u64,\n current_word_len: u64,\n longest_word: u64,\n}\n\nimpl LogicalCandidate {\n fn new(data: &'static SingleByteData) -> Self {\n LogicalCandidate {\n data: data,\n prev: 0,\n prev_ascii: true,\n plausible_punctuation: 0,\n current_word_len: 0,\n longest_word: 0,\n }\n }\n\n fn feed(&mut self, buffer: &[u8]) -> Option {\n let mut score = 0i64;\n for &b in buffer {\n let class = self.data.classify(b);\n if class == 255 {\n return None;\n }\n let caseless_class = class & 0x7F;\n\n let ascii = b < 0x80;\n let ascii_pair = self.prev_ascii && ascii;\n\n let non_ascii_alphabetic = self.data.is_non_latin_alphabetic(caseless_class, false);\n // XXX apply penalty if > 22\n if non_ascii_alphabetic {\n self.current_word_len += 1;\n } else {\n if self.current_word_len > self.longest_word {\n self.longest_word = self.current_word_len;\n }\n self.current_word_len = 0;\n }\n\n if !ascii_pair {\n score += self.data.score(caseless_class, self.prev, false);\n\n let prev_non_ascii_alphabetic = self.data.is_non_latin_alphabetic(self.prev, false);\n if caseless_class == 0 && prev_non_ascii_alphabetic && is_ascii_punctuation(b) {\n self.plausible_punctuation += 1;\n }\n\n if self.prev == LATIN_LETTER && non_ascii_alphabetic {\n score += LATIN_ADJACENCY_PENALTY;\n } else if caseless_class == LATIN_LETTER && prev_non_ascii_alphabetic {\n score += LATIN_ADJACENCY_PENALTY;\n }\n }\n\n self.prev_ascii = ascii;\n self.prev = caseless_class;\n }\n Some(score)\n }\n}\n\nstruct VisualCandidate {\n data: &'static SingleByteData,\n prev: u8,\n prev_ascii: bool,\n prev_punctuation: bool,\n plausible_punctuation: u64,\n current_word_len: u64,\n longest_word: u64,\n}\n\nimpl VisualCandidate {\n fn new(data: &'static SingleByteData) -> Self {\n VisualCandidate {\n data: data,\n prev: 0,\n prev_ascii: true,\n prev_punctuation: false,\n plausible_punctuation: 0,\n current_word_len: 0,\n longest_word: 0,\n }\n }\n\n fn feed(&mut self, buffer: &[u8]) -> Option {\n let mut score = 0i64;\n for &b in buffer {\n let class = self.data.classify(b);\n if class == 255 {\n return None;\n }\n let caseless_class = class & 0x7F;\n\n let ascii = b < 0x80;\n let ascii_pair = self.prev_ascii && ascii;\n\n let non_ascii_alphabetic = self.data.is_non_latin_alphabetic(caseless_class, false);\n // XXX apply penalty if > 22\n if non_ascii_alphabetic {\n self.current_word_len += 1;\n } else {\n if self.current_word_len > self.longest_word {\n self.longest_word = self.current_word_len;\n }\n self.current_word_len = 0;\n }\n\n if !ascii_pair {\n score += self.data.score(caseless_class, self.prev, false);\n\n if non_ascii_alphabetic && self.prev_punctuation {\n self.plausible_punctuation += 1;\n }\n\n if self.prev == LATIN_LETTER && non_ascii_alphabetic {\n score += LATIN_ADJACENCY_PENALTY;\n } else if caseless_class == LATIN_LETTER\n && self.data.is_non_latin_alphabetic(self.prev, false)\n {\n score += LATIN_ADJACENCY_PENALTY;\n }\n }\n\n self.prev_ascii = ascii;\n self.prev = caseless_class;\n self.prev_punctuation = caseless_class == 0 && is_ascii_punctuation(b);\n }\n Some(score)\n }\n}\n\nstruct Utf8Candidate {\n decoder: Decoder,\n}\n\nimpl Utf8Candidate {\n fn feed(&mut self, buffer: &[u8], last: bool) -> Option {\n let mut dst = [0u8; 1024];\n let mut total_read = 0;\n loop {\n let (result, read, _) = self.decoder.decode_to_utf8_without_replacement(\n &buffer[total_read..],\n &mut dst,\n last,\n );\n total_read += read;\n match result {\n DecoderResult::InputEmpty => {\n return Some(0);\n }\n DecoderResult::Malformed(_, _) => {\n return None;\n }\n DecoderResult::OutputFull => {\n continue;\n }\n }\n }\n }\n}\n\nstruct Iso2022Candidate {\n decoder: Decoder,\n}\n\nimpl Iso2022Candidate {\n fn feed(&mut self, buffer: &[u8], last: bool) -> Option {\n let mut dst = [0u16; 1024];\n let mut total_read = 0;\n loop {\n let (result, read, _) = self.decoder.decode_to_utf16_without_replacement(\n &buffer[total_read..],\n &mut dst,\n last,\n );\n total_read += read;\n match result {\n DecoderResult::InputEmpty => {\n return Some(0);\n }\n DecoderResult::Malformed(_, _) => {\n return None;\n }\n DecoderResult::OutputFull => {\n continue;\n }\n }\n }\n }\n}\n\n#[derive(PartialEq)]\nenum LatinCj {\n AsciiLetter,\n Cj,\n Other,\n}\n\n#[derive(PartialEq, Copy, Clone)]\nenum HalfWidthKatakana {\n DakutenForbidden,\n DakutenAllowed,\n DakutenOrHandakutenAllowed,\n}\n\n#[derive(PartialEq)]\nenum LatinKorean {\n AsciiLetter,\n Hangul,\n Hanja,\n Other,\n}\n\nfn cjk_extra_score(u: u16, table: &'static [u16; 128]) -> i64 {\n if let Some(pos) = table.iter().position(|&x| x == u) {\n ((128 - pos) / 16) as i64\n } else {\n 0\n }\n}\n\nstruct GbkCandidate {\n decoder: Decoder,\n prev_byte: u8,\n prev: LatinCj,\n pending_score: Option,\n}\n\nimpl GbkCandidate {\n fn maybe_set_as_pending(&mut self, s: i64) -> i64 {\n assert!(self.pending_score.is_none());\n if self.prev == LatinCj::Cj || !more_problematic_lead(self.prev_byte) {\n s\n } else {\n self.pending_score = Some(s);\n 0\n }\n }\n\n fn feed(&mut self, buffer: &[u8], last: bool) -> Option {\n let mut score = 0i64;\n let mut src = [0u8];\n let mut dst = [0u16; 2];\n for &b in buffer {\n src[0] = b;\n let (result, read, written) = self\n .decoder\n .decode_to_utf16_without_replacement(&src, &mut dst, false);\n if written == 1 {\n let u = dst[0];\n if (u >= u16::from(b'a') && u <= u16::from(b'z'))\n || (u >= u16::from(b'A') && u <= u16::from(b'Z'))\n {\n self.pending_score = None; // Discard pending score\n if self.prev == LatinCj::Cj {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::AsciiLetter;\n } else if u == 0x20AC {\n // euro sign\n self.pending_score = None; // Discard pending score\n // Should there even be a penalty?\n self.prev = LatinCj::Other;\n } else if u >= 0x4E00 && u <= 0x9FA5 {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n if b >= 0xA1 && b <= 0xFE {\n match self.prev_byte {\n 0xA1..=0xD7 => {\n score += GBK_SCORE_PER_LEVEL_1;\n score +=\n cjk_extra_score(u, &data::DETECTOR_DATA.frequent_simplified);\n }\n 0xD8..=0xFE => score += GBK_SCORE_PER_LEVEL_2,\n _ => {\n score += GBK_SCORE_PER_NON_EUC;\n }\n }\n } else {\n score += self.maybe_set_as_pending(GBK_SCORE_PER_NON_EUC);\n }\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else if (u >= 0x3400 && u < 0xA000) || (u >= 0xF900 && u < 0xFB00) {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n // XXX score?\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else if u >= 0xE000 && u < 0xF900 {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n // Treat the GB18030-required PUA mappings as non-EUC ideographs.\n match u {\n 0xE78D..=0xE796\n | 0xE816..=0xE818\n | 0xE81E\n | 0xE826\n | 0xE82B\n | 0xE82C\n | 0xE831\n | 0xE832\n | 0xE83B\n | 0xE843\n | 0xE854\n | 0xE855\n | 0xE864 => {\n score += GBK_SCORE_PER_NON_EUC;\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n }\n _ => {\n score += GBK_PUA_PENALTY;\n self.prev = LatinCj::Other;\n }\n }\n } else {\n match u {\n 0x3000 // Distinct from Korean, space\n | 0x3001 // Distinct from Korean, enumeration comma\n | 0x3002 // Distinct from Korean, full stop\n | 0xFF08 // Distinct from Korean, parenthesis\n | 0xFF09 // Distinct from Korean, parenthesis\n | 0xFF01 // Distinct from Japanese, exclamation\n | 0xFF0C // Distinct from Japanese, comma\n | 0xFF1B // Distinct from Japanese, semicolon\n | 0xFF1F // Distinct from Japanese, question\n => {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n score += CJ_PUNCTUATION;\n }\n 0..=0x7F => {\n self.pending_score = None; // Discard pending score\n }\n _ => {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n score += CJK_OTHER;\n }\n }\n self.prev = LatinCj::Other;\n }\n } else if written == 2 {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n let u = dst[0];\n if u >= 0xDB80 && u <= 0xDBFF {\n score += GBK_PUA_PENALTY;\n self.prev = LatinCj::Other;\n } else if u >= 0xD480 && u < 0xD880 {\n score += GBK_SCORE_PER_NON_EUC;\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else {\n score += CJK_OTHER;\n self.prev = LatinCj::Other;\n }\n }\n match result {\n DecoderResult::InputEmpty => {\n assert_eq!(read, 1);\n }\n DecoderResult::Malformed(malformed_len, _) => {\n if (self.prev_byte == 0xA0 || self.prev_byte == 0xFE || self.prev_byte == 0xFD)\n && (b < 0x80 || b == 0xFF)\n {\n // Mac OS Chinese Simplified single-byte that conflicts with code page GBK lead byte\n // followed by ASCII or a non-conflicting single-byte extension.\n self.pending_score = None; // Just in case\n score += GBK_SINGLE_BYTE_EXTENSION_PENALTY;\n if (b >= b'a' && b <= b'z') || (b >= b'A' && b <= b'Z') {\n self.prev = LatinCj::AsciiLetter;\n } else if b == 0xFF {\n score += GBK_SINGLE_BYTE_EXTENSION_PENALTY;\n self.prev = LatinCj::Other;\n } else {\n self.prev = LatinCj::Other;\n }\n // The GBK decoder has the pending ASCII concept, which is\n // a problem with this trickery, so let's reset the state.\n self.decoder = GBK.new_decoder_without_bom_handling();\n } else if malformed_len == 1 && b == 0xFF {\n // Mac OS Chinese Simplified single-byte extension that doesn't conflict with lead bytes\n self.pending_score = None; // Just in case\n score += GBK_SINGLE_BYTE_EXTENSION_PENALTY;\n self.prev = LatinCj::Other;\n // The GBK decoder has the pending ASCII concept, which is\n // a problem with this trickery, so let's reset the state.\n self.decoder = GBK.new_decoder_without_bom_handling();\n } else {\n return None;\n }\n }\n DecoderResult::OutputFull => {\n unreachable!();\n }\n }\n self.prev_byte = b;\n }\n if last {\n let (result, _, _) = self\n .decoder\n .decode_to_utf16_without_replacement(b\"\", &mut dst, true);\n match result {\n DecoderResult::InputEmpty => {}\n DecoderResult::Malformed(_, _) => {\n return None;\n }\n DecoderResult::OutputFull => {\n unreachable!();\n }\n }\n }\n Some(score)\n }\n}\n\n// Shift_JIS and Big5\nfn problematic_lead(b: u8) -> bool {\n match b {\n 0x91..=0x97 | 0x9A | 0x8A | 0x9B | 0x8B | 0x9E | 0x8E | 0xB0 => true,\n _ => false,\n }\n}\n\n// GBK and EUC-KR\nfn more_problematic_lead(b: u8) -> bool {\n problematic_lead(b) || b == 0x82 || b == 0x84 || b == 0x85 || b == 0xA0\n}\n\nstruct ShiftJisCandidate {\n decoder: Decoder,\n half_width_katakana_seen: bool,\n half_width_katakana_state: HalfWidthKatakana,\n prev: LatinCj,\n prev_byte: u8,\n pending_score: Option,\n}\n\nimpl ShiftJisCandidate {\n fn maybe_set_as_pending(&mut self, s: i64) -> i64 {\n assert!(self.pending_score.is_none());\n if self.prev == LatinCj::Cj || !problematic_lead(self.prev_byte) {\n s\n } else {\n self.pending_score = Some(s);\n 0\n }\n }\n\n fn feed(&mut self, buffer: &[u8], last: bool) -> Option {\n let mut score = 0i64;\n let mut src = [0u8];\n let mut dst = [0u16; 2];\n for &b in buffer {\n src[0] = b;\n let (result, read, written) = self\n .decoder\n .decode_to_utf16_without_replacement(&src, &mut dst, false);\n if written > 0 {\n let half_width_katakana_state = self.half_width_katakana_state;\n self.half_width_katakana_state = HalfWidthKatakana::DakutenForbidden;\n let u = dst[0];\n if (u >= u16::from(b'a') && u <= u16::from(b'z'))\n || (u >= u16::from(b'A') && u <= u16::from(b'Z'))\n {\n self.pending_score = None; // Discard pending score\n if self.prev == LatinCj::Cj {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::AsciiLetter;\n } else if u >= 0xFF61 && u <= 0xFF9F {\n if !self.half_width_katakana_seen {\n self.half_width_katakana_seen = true;\n // To avoid misdetecting title-length inputs\n score += SHIFT_JIS_INITIAL_HALF_WIDTH_KATAKANA_PENALTY;\n }\n self.pending_score = None; // Discard pending score\n score += HALF_WIDTH_KATAKANA_SCORE;\n\n if (u >= 0xFF76 && u <= 0xFF84) || u == 0xFF73 {\n self.half_width_katakana_state = HalfWidthKatakana::DakutenAllowed;\n } else if u >= 0xFF8A && u <= 0xFF8E {\n self.half_width_katakana_state =\n HalfWidthKatakana::DakutenOrHandakutenAllowed;\n } else if u == 0xFF9E {\n if half_width_katakana_state == HalfWidthKatakana::DakutenForbidden {\n score += IMPLAUSIBILITY_PENALTY;\n } else {\n score += HALF_WIDTH_KATAKANA_VOICING_SCORE;\n }\n } else if u == 0xFF9F {\n if half_width_katakana_state\n != HalfWidthKatakana::DakutenOrHandakutenAllowed\n {\n score += IMPLAUSIBILITY_PENALTY;\n } else {\n score += HALF_WIDTH_KATAKANA_VOICING_SCORE;\n }\n }\n\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else if u >= 0x3040 && u < 0x3100 {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n score += SHIFT_JIS_SCORE_PER_KANA;\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else if (u >= 0x3400 && u < 0xA000) || (u >= 0xF900 && u < 0xFB00) {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n if self.prev_byte < 0x98 || (self.prev_byte == 0x98 && b < 0x73) {\n score += self.maybe_set_as_pending(\n SHIFT_JIS_SCORE_PER_LEVEL_1_KANJI\n + cjk_extra_score(u, &data::DETECTOR_DATA.frequent_kanji),\n );\n } else {\n score += self.maybe_set_as_pending(SHIFT_JIS_SCORE_PER_LEVEL_2_KANJI);\n }\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else if u >= 0xE000 && u < 0xF900 {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n score += SHIFT_JIS_PUA_PENALTY;\n self.prev = LatinCj::Other;\n } else {\n match u {\n 0x3000 // Distinct from Korean, space\n | 0x3001 // Distinct from Korean, enumeration comma\n | 0x3002 // Distinct from Korean, full stop\n | 0xFF08 // Distinct from Korean, parenthesis\n | 0xFF09 // Distinct from Korean, parenthesis\n => {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n // Not really needed for CJK distinction\n // but let's give non-zero score for these\n // common byte pairs anyway.\n score += CJ_PUNCTUATION;\n }\n 0..=0x7F => {\n self.pending_score = None; // Discard pending score\n }\n 0x80 => {\n // This is a control character that overlaps euro\n // in windows-1252 and happens to be a non-error\n // is Shift_JIS.\n self.pending_score = None; // Discard pending score\n score += IMPLAUSIBILITY_PENALTY;\n }\n _ => {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n score += CJK_OTHER;\n }\n }\n self.prev = LatinCj::Other;\n }\n }\n match result {\n DecoderResult::InputEmpty => {\n assert_eq!(read, 1);\n }\n DecoderResult::Malformed(malformed_len, _) => {\n if (((self.prev_byte >= 0x81 && self.prev_byte <= 0x9F)\n || (self.prev_byte >= 0xE0 && self.prev_byte <= 0xFC))\n && ((b >= 0x40 && b <= 0x7E) || (b >= 0x80 && b <= 0xFC)))\n && !((self.prev_byte == 0x82 && b >= 0xFA)\n || (self.prev_byte == 0x84 && ((b >= 0xDD && b <= 0xE4) || b >= 0xFB))\n || (self.prev_byte == 0x86 && b >= 0xF2 && b <= 0xFA)\n || (self.prev_byte == 0x87 && b >= 0x77 && b <= 0x7D)\n || (self.prev_byte == 0xFC && b >= 0xF5))\n {\n // Shift_JIS2004 or MacJapanese\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n score += SHIFT_JIS_EXTENSION_PENALTY;\n // Approximate boundary\n if self.prev_byte < 0x87 {\n self.prev = LatinCj::Other;\n } else {\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n }\n } else if malformed_len == 1 && (b == 0xA0 || b >= 0xFD) {\n self.pending_score = None; // Just in case\n score += SHIFT_JIS_SINGLE_BYTE_EXTENSION_PENALTY;\n self.prev = LatinCj::Other;\n } else {\n return None;\n }\n }\n DecoderResult::OutputFull => {\n unreachable!();\n }\n }\n self.prev_byte = b;\n }\n if last {\n let (result, _, _) = self\n .decoder\n .decode_to_utf16_without_replacement(b\"\", &mut dst, true);\n match result {\n DecoderResult::InputEmpty => {}\n DecoderResult::Malformed(_, _) => {\n return None;\n }\n DecoderResult::OutputFull => {\n unreachable!();\n }\n }\n }\n Some(score)\n }\n}\n\nstruct EucJpCandidate {\n decoder: Decoder,\n non_ascii_seen: bool,\n half_width_katakana_state: HalfWidthKatakana,\n prev: LatinCj,\n prev_byte: u8,\n prev_prev_byte: u8,\n}\n\nimpl EucJpCandidate {\n fn feed(&mut self, buffer: &[u8], last: bool) -> Option {\n let mut score = 0i64;\n let mut src = [0u8];\n let mut dst = [0u16; 2];\n for &b in buffer {\n src[0] = b;\n let (result, read, written) = self\n .decoder\n .decode_to_utf16_without_replacement(&src, &mut dst, false);\n if written > 0 {\n let half_width_katakana_state = self.half_width_katakana_state;\n self.half_width_katakana_state = HalfWidthKatakana::DakutenForbidden;\n let u = dst[0];\n if !self.non_ascii_seen && u >= 0x80 {\n self.non_ascii_seen = true;\n if u >= 0xFF61 && u <= 0xFF9F {\n // return None;\n }\n if u >= 0x3040 && u < 0x3100 {\n // Remove the kana advantage over initial Big5\n // hanzi.\n score += EUC_JP_INITIAL_KANA_PENALTY;\n }\n }\n if (u >= u16::from(b'a') && u <= u16::from(b'z'))\n || (u >= u16::from(b'A') && u <= u16::from(b'Z'))\n {\n if self.prev == LatinCj::Cj {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::AsciiLetter;\n } else if u >= 0xFF61 && u <= 0xFF9F {\n score += HALF_WIDTH_KATAKANA_SCORE;\n\n if (u >= 0xFF76 && u <= 0xFF84) || u == 0xFF73 {\n self.half_width_katakana_state = HalfWidthKatakana::DakutenAllowed;\n } else if u >= 0xFF8A && u <= 0xFF8E {\n self.half_width_katakana_state =\n HalfWidthKatakana::DakutenOrHandakutenAllowed;\n } else if u == 0xFF9E {\n if half_width_katakana_state == HalfWidthKatakana::DakutenForbidden {\n score += IMPLAUSIBILITY_PENALTY;\n } else {\n score += HALF_WIDTH_KATAKANA_VOICING_SCORE;\n }\n } else if u == 0xFF9F {\n if half_width_katakana_state\n != HalfWidthKatakana::DakutenOrHandakutenAllowed\n {\n score += IMPLAUSIBILITY_PENALTY;\n } else {\n score += HALF_WIDTH_KATAKANA_VOICING_SCORE;\n }\n }\n\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Other;\n } else if (u >= 0x3041 && u <= 0x3093) || (u >= 0x30A1 && u <= 0x30F6) {\n match u {\n 0x3090 // hiragana wi\n | 0x3091 // hiragana we\n | 0x30F0 // katakana wi\n | 0x30F1 // katakana we\n => {\n // Remove advantage over Big5 Hanzi\n score += EUC_JP_SCORE_PER_NEAR_OBSOLETE_KANA;\n }\n _ => {\n score += EUC_JP_SCORE_PER_KANA;\n }\n }\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else if (u >= 0x3400 && u < 0xA000) || (u >= 0xF900 && u < 0xFB00) {\n if self.prev_prev_byte == 0x8F {\n score += EUC_JP_SCORE_PER_OTHER_KANJI;\n } else if self.prev_byte < 0xD0 {\n score += EUC_JP_SCORE_PER_LEVEL_1_KANJI;\n score += cjk_extra_score(u, &data::DETECTOR_DATA.frequent_kanji);\n } else {\n score += EUC_JP_SCORE_PER_LEVEL_2_KANJI;\n }\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else {\n match u {\n 0x3000 // Distinct from Korean, space\n | 0x3001 // Distinct from Korean, enumeration comma\n | 0x3002 // Distinct from Korean, full stop\n | 0xFF08 // Distinct from Korean, parenthesis\n | 0xFF09 // Distinct from Korean, parenthesis\n => {\n score += CJ_PUNCTUATION;\n }\n 0..=0x7F => {}\n _ => {\n score += CJK_OTHER;\n }\n }\n self.prev = LatinCj::Other;\n }\n }\n match result {\n DecoderResult::InputEmpty => {\n assert_eq!(read, 1);\n }\n DecoderResult::Malformed(_, _) => {\n if b >= 0xA1\n && b <= 0xFE\n && self.prev_byte >= 0xA1\n && self.prev_byte <= 0xFE\n && ((self.prev_prev_byte != 0x8F\n && !(self.prev_byte == 0xA8 && b >= 0xDF && b <= 0xE6)\n && !(self.prev_byte == 0xAC && b >= 0xF4 && b <= 0xFC)\n && !(self.prev_byte == 0xAD && b >= 0xD8 && b <= 0xDE))\n || (self.prev_prev_byte == 0x8F\n && self.prev_byte != 0xA2\n && self.prev_byte != 0xA6\n && self.prev_byte != 0xA7\n && self.prev_byte != 0xA9\n && self.prev_byte != 0xAA\n && self.prev_byte != 0xAB\n && self.prev_byte != 0xED\n && !(self.prev_byte == 0xFE && b >= 0xF7)))\n {\n score += EUC_JP_EXTENSION_PENALTY;\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else {\n return None;\n }\n }\n DecoderResult::OutputFull => {\n unreachable!();\n }\n }\n self.prev_prev_byte = self.prev_byte;\n self.prev_byte = b;\n }\n if last {\n let (result, _, _) = self\n .decoder\n .decode_to_utf16_without_replacement(b\"\", &mut dst, true);\n match result {\n DecoderResult::InputEmpty => {}\n DecoderResult::Malformed(_, _) => {\n return None;\n }\n DecoderResult::OutputFull => {\n unreachable!();\n }\n }\n }\n Some(score)\n }\n}\n\nstruct Big5Candidate {\n decoder: Decoder,\n prev: LatinCj,\n prev_byte: u8,\n pending_score: Option,\n}\n\nimpl Big5Candidate {\n fn maybe_set_as_pending(&mut self, s: i64) -> i64 {\n assert!(self.pending_score.is_none());\n if self.prev == LatinCj::Cj || !problematic_lead(self.prev_byte) {\n s\n } else {\n self.pending_score = Some(s);\n 0\n }\n }\n\n fn feed(&mut self, buffer: &[u8], last: bool) -> Option {\n let mut score = 0i64;\n let mut src = [0u8];\n let mut dst = [0u16; 2];\n for &b in buffer {\n src[0] = b;\n let (result, read, written) = self\n .decoder\n .decode_to_utf16_without_replacement(&src, &mut dst, false);\n if written == 1 {\n let u = dst[0];\n if (u >= u16::from(b'a') && u <= u16::from(b'z'))\n || (u >= u16::from(b'A') && u <= u16::from(b'Z'))\n {\n self.pending_score = None; // Discard pending score\n if self.prev == LatinCj::Cj {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::AsciiLetter;\n } else if (u >= 0x3400 && u < 0xA000) || (u >= 0xF900 && u < 0xFB00) {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n match self.prev_byte {\n 0xA4..=0xC6 => {\n score += self.maybe_set_as_pending(BIG5_SCORE_PER_LEVEL_1_HANZI);\n // score += cjk_extra_score(u, &data::DETECTOR_DATA.frequent_traditional);\n }\n _ => {\n score += self.maybe_set_as_pending(BIG5_SCORE_PER_OTHER_HANZI);\n }\n }\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else {\n match u {\n 0x3000 // Distinct from Korean, space\n | 0x3001 // Distinct from Korean, enumeration comma\n | 0x3002 // Distinct from Korean, full stop\n | 0xFF08 // Distinct from Korean, parenthesis\n | 0xFF09 // Distinct from Korean, parenthesis\n | 0xFF01 // Distinct from Japanese, exclamation\n | 0xFF0C // Distinct from Japanese, comma\n | 0xFF1B // Distinct from Japanese, semicolon\n | 0xFF1F // Distinct from Japanese, question\n => {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n // Not really needed for CJK distinction\n // but let's give non-zero score for these\n // common byte pairs anyway.\n score += CJ_PUNCTUATION;\n }\n 0..=0x7F => {\n self.pending_score = None; // Discard pending score\n }\n _ => {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n score += CJK_OTHER;\n }\n }\n self.prev = LatinCj::Other;\n }\n } else if written == 2 {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n if dst[0] == 0xCA || dst[0] == 0xEA {\n score += CJK_OTHER;\n self.prev = LatinCj::Other;\n } else {\n debug_assert!(dst[0] >= 0xD480 && dst[0] < 0xD880);\n score += self.maybe_set_as_pending(BIG5_SCORE_PER_OTHER_HANZI);\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n }\n }\n match result {\n DecoderResult::InputEmpty => {\n assert_eq!(read, 1);\n }\n DecoderResult::Malformed(malformed_len, _) => {\n if self.prev_byte >= 0x81\n && self.prev_byte <= 0xFE\n && ((b >= 0x40 && b <= 0x7E) || (b >= 0xA1 && b <= 0xFE))\n {\n // The byte pair is in the Big5 range but unmapped.\n // Treat as PUA to avoid rejecting Big5-UAO, etc.\n // We don't reprocess `b` even if ASCII, since it's\n // logically part of the pair.\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n score += BIG5_PUA_PENALTY;\n // Assume Hanzi semantics\n if self.prev == LatinCj::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinCj::Cj;\n } else if (self.prev_byte == 0xA0\n || self.prev_byte == 0xFD\n || self.prev_byte == 0xFE)\n && (b < 0x80 || b == 0xFF)\n {\n // Mac OS Chinese Traditional single-byte that conflicts with code page Big5 lead byte\n // followed by ASCII or a non-conflicting single-byte extension.\n self.pending_score = None; // Just in case\n score += BIG5_SINGLE_BYTE_EXTENSION_PENALTY;\n if (b >= b'a' && b <= b'z') || (b >= b'A' && b <= b'Z') {\n self.prev = LatinCj::AsciiLetter;\n } else if b == 0xFF {\n score += BIG5_SINGLE_BYTE_EXTENSION_PENALTY;\n self.prev = LatinCj::Other;\n } else {\n self.prev = LatinCj::Other;\n }\n } else if malformed_len == 1 && b == 0xFF {\n // Mac OS Chinese Traditional single-byte extension that doesn't conflict with lead bytes\n self.pending_score = None; // Just in case\n score += BIG5_SINGLE_BYTE_EXTENSION_PENALTY;\n self.prev = LatinCj::Other;\n } else {\n return None;\n }\n }\n DecoderResult::OutputFull => {\n unreachable!();\n }\n }\n self.prev_byte = b;\n }\n if last {\n let (result, _, _) = self\n .decoder\n .decode_to_utf16_without_replacement(b\"\", &mut dst, true);\n match result {\n DecoderResult::InputEmpty => {}\n DecoderResult::Malformed(_, _) => {\n return None;\n }\n DecoderResult::OutputFull => {\n unreachable!();\n }\n }\n }\n Some(score)\n }\n}\n\nstruct EucKrCandidate {\n decoder: Decoder,\n prev_byte: u8,\n prev_was_euc_range: bool,\n prev: LatinKorean,\n current_word_len: u64,\n pending_score: Option,\n}\n\nimpl EucKrCandidate {\n fn maybe_set_as_pending(&mut self, s: i64) -> i64 {\n assert!(self.pending_score.is_none());\n if self.prev == LatinKorean::Hangul || !more_problematic_lead(self.prev_byte) {\n s\n } else {\n self.pending_score = Some(s);\n 0\n }\n }\n\n fn feed(&mut self, buffer: &[u8], last: bool) -> Option {\n let mut score = 0i64;\n let mut src = [0u8];\n let mut dst = [0u16; 2];\n for &b in buffer {\n let in_euc_range = b >= 0xA1 && b <= 0xFE;\n src[0] = b;\n let (result, read, written) = self\n .decoder\n .decode_to_utf16_without_replacement(&src, &mut dst, false);\n if written > 0 {\n let u = dst[0];\n if (u >= u16::from(b'a') && u <= u16::from(b'z'))\n || (u >= u16::from(b'A') && u <= u16::from(b'Z'))\n {\n self.pending_score = None; // Discard pending score\n match self.prev {\n LatinKorean::Hangul | LatinKorean::Hanja => {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n _ => {}\n }\n self.prev = LatinKorean::AsciiLetter;\n self.current_word_len = 0;\n } else if u >= 0xAC00 && u <= 0xD7A3 {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n if self.prev_was_euc_range && in_euc_range {\n score += EUC_KR_SCORE_PER_EUC_HANGUL;\n score += cjk_extra_score(u, &data::DETECTOR_DATA.frequent_hangul);\n } else {\n score += self.maybe_set_as_pending(EUC_KR_SCORE_PER_NON_EUC_HANGUL);\n }\n if self.prev == LatinKorean::AsciiLetter {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n self.prev = LatinKorean::Hangul;\n self.current_word_len += 1;\n if self.current_word_len > 5 {\n score += EUC_KR_LONG_WORD_PENALTY;\n }\n } else if (u >= 0x4E00 && u < 0xAC00) || (u >= 0xF900 && u <= 0xFA0B) {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n score += EUC_KR_SCORE_PER_HANJA;\n match self.prev {\n LatinKorean::AsciiLetter => {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n LatinKorean::Hangul => {\n score += EUC_KR_HANJA_AFTER_HANGUL_PENALTY;\n }\n _ => {}\n }\n self.prev = LatinKorean::Hanja;\n self.current_word_len += 1;\n if self.current_word_len > 5 {\n score += EUC_KR_LONG_WORD_PENALTY;\n }\n } else {\n if u >= 0x80 {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n score += CJK_OTHER;\n } else {\n self.pending_score = None; // Discard pending score\n }\n self.prev = LatinKorean::Other;\n self.current_word_len = 0;\n }\n }\n match result {\n DecoderResult::InputEmpty => {\n assert_eq!(read, 1);\n }\n DecoderResult::Malformed(malformed_len, _) => {\n if (self.prev_byte == 0xC9 || self.prev_byte == 0xFE) && b >= 0xA1 && b <= 0xFE\n {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n // The byte pair is in code page 949 EUDC range\n score += EUC_KR_PUA_PENALTY;\n // Assume Hanja semantics\n match self.prev {\n LatinKorean::AsciiLetter => {\n score += CJK_LATIN_ADJACENCY_PENALTY;\n }\n LatinKorean::Hangul => {\n score += EUC_KR_HANJA_AFTER_HANGUL_PENALTY;\n }\n _ => {}\n }\n self.prev = LatinKorean::Hanja;\n self.current_word_len += 1;\n if self.current_word_len > 5 {\n score += EUC_KR_LONG_WORD_PENALTY;\n }\n } else if (self.prev_byte == 0xA1\n || (self.prev_byte >= 0xA3 && self.prev_byte <= 0xA8)\n || (self.prev_byte >= 0xAA && self.prev_byte <= 0xAD))\n && (b >= 0x7B && b <= 0x7D)\n {\n if let Some(pending) = self.pending_score {\n score += pending;\n self.pending_score = None;\n }\n // MacKorean symbols in range not part of code page 949\n score += EUC_KR_MAC_KOREAN_PENALTY;\n self.prev = LatinKorean::Other;\n self.current_word_len = 0;\n } else if (self.prev_byte >= 0x81 && self.prev_byte <= 0x84)\n && (b <= 0x80 || b == 0xFF)\n {\n // MacKorean single-byte that conflicts with code page 949 lead byte\n // followed by ASCII or a non-conflicting single-byte extension.\n self.pending_score = None; // Just in case\n score += EUC_KR_SINGLE_BYTE_EXTENSION_PENALTY;\n if (b >= b'a' && b <= b'z') || (b >= b'A' && b <= b'Z') {\n self.prev = LatinKorean::AsciiLetter;\n } else if b == 0x80 || b == 0xFF {\n score += EUC_KR_SINGLE_BYTE_EXTENSION_PENALTY;\n self.prev = LatinKorean::Other;\n } else {\n self.prev = LatinKorean::Other;\n }\n self.current_word_len = 0;\n } else if malformed_len == 1 && (b == 0x80 || b == 0xFF) {\n // MacKorean single-byte extensions that don't conflict with lead bytes\n self.pending_score = None; // Just in case\n score += EUC_KR_SINGLE_BYTE_EXTENSION_PENALTY;\n self.prev = LatinKorean::Other;\n self.current_word_len = 0;\n } else {\n return None;\n }\n }\n DecoderResult::OutputFull => {\n unreachable!();\n }\n }\n self.prev_was_euc_range = in_euc_range;\n self.prev_byte = b;\n }\n if last {\n let (result, _, _) = self\n .decoder\n .decode_to_utf16_without_replacement(b\"\", &mut dst, true);\n match result {\n DecoderResult::InputEmpty => {}\n DecoderResult::Malformed(_, _) => {\n return None;\n }\n DecoderResult::OutputFull => {\n unreachable!();\n }\n }\n }\n Some(score)\n }\n}\n\nenum InnerCandidate {\n Latin(LatinCandidate),\n NonLatinCased(NonLatinCasedCandidate),\n Caseless(CaselessCandidate),\n ArabicFrench(ArabicFrenchCandidate),\n Logical(LogicalCandidate),\n Visual(VisualCandidate),\n Utf8(Utf8Candidate),\n Iso2022(Iso2022Candidate),\n Shift(ShiftJisCandidate),\n EucJp(EucJpCandidate),\n EucKr(EucKrCandidate),\n Big5(Big5Candidate),\n Gbk(GbkCandidate),\n}\n\nimpl InnerCandidate {\n fn feed(&mut self, buffer: &[u8], last: bool) -> Option {\n match self {\n InnerCandidate::Latin(c) => {\n if let Some(new_score) = c.feed(buffer) {\n if last {\n // Treat EOF as space-like\n if let Some(additional_score) = c.feed(b\" \") {\n Some(new_score + additional_score)\n } else {\n None\n }\n } else {\n Some(new_score)\n }\n } else {\n None\n }\n }\n InnerCandidate::NonLatinCased(c) => {\n if let Some(new_score) = c.feed(buffer) {\n if last {\n // Treat EOF as space-like\n if let Some(additional_score) = c.feed(b\" \") {\n Some(new_score + additional_score)\n } else {\n None\n }\n } else {\n Some(new_score)\n }\n } else {\n None\n }\n }\n InnerCandidate::Caseless(c) => {\n if let Some(new_score) = c.feed(buffer) {\n if last {\n // Treat EOF as space-like\n if let Some(additional_score) = c.feed(b\" \") {\n Some(new_score + additional_score)\n } else {\n None\n }\n } else {\n Some(new_score)\n }\n } else {\n None\n }\n }\n InnerCandidate::ArabicFrench(c) => {\n if let Some(new_score) = c.feed(buffer) {\n if last {\n // Treat EOF as space-like\n if let Some(additional_score) = c.feed(b\" \") {\n Some(new_score + additional_score)\n } else {\n None\n }\n } else {\n Some(new_score)\n }\n } else {\n None\n }\n }\n InnerCandidate::Logical(c) => {\n if let Some(new_score) = c.feed(buffer) {\n if last {\n // Treat EOF as space-like\n if let Some(additional_score) = c.feed(b\" \") {\n Some(new_score + additional_score)\n } else {\n None\n }\n } else {\n Some(new_score)\n }\n } else {\n None\n }\n }\n InnerCandidate::Visual(c) => {\n if let Some(new_score) = c.feed(buffer) {\n if last {\n // Treat EOF as space-like\n if let Some(additional_score) = c.feed(b\" \") {\n Some(new_score + additional_score)\n } else {\n None\n }\n } else {\n Some(new_score)\n }\n } else {\n None\n }\n }\n InnerCandidate::Utf8(c) => c.feed(buffer, last),\n InnerCandidate::Iso2022(c) => c.feed(buffer, last),\n InnerCandidate::Shift(c) => c.feed(buffer, last),\n InnerCandidate::EucJp(c) => c.feed(buffer, last),\n InnerCandidate::EucKr(c) => c.feed(buffer, last),\n InnerCandidate::Big5(c) => c.feed(buffer, last),\n InnerCandidate::Gbk(c) => c.feed(buffer, last),\n }\n }\n}\n\nfn encoding_for_tld(tld: Tld) -> usize {\n match tld {\n Tld::CentralWindows | Tld::CentralCyrillic => EncodingDetector::CENTRAL_WINDOWS_INDEX,\n Tld::Cyrillic => EncodingDetector::CYRILLIC_WINDOWS_INDEX,\n Tld::Generic | Tld::Western | Tld::WesternCyrillic | Tld::WesternArabic | Tld::Eu => {\n EncodingDetector::WESTERN_INDEX\n }\n Tld::IcelandicFaroese => EncodingDetector::ICELANDIC_INDEX,\n Tld::Greek => EncodingDetector::GREEK_ISO_INDEX,\n Tld::TurkishAzeri => EncodingDetector::TURKISH_INDEX,\n Tld::Hebrew => EncodingDetector::LOGICAL_INDEX,\n Tld::Arabic => EncodingDetector::ARABIC_WINDOWS_INDEX,\n Tld::Baltic => EncodingDetector::BALTIC_WINDOWS_INDEX,\n Tld::Vietnamese => EncodingDetector::VIETNAMESE_INDEX,\n Tld::Thai => EncodingDetector::THAI_INDEX,\n Tld::Simplified | Tld::SimplifiedTraditional => EncodingDetector::GBK_INDEX,\n Tld::Traditional | Tld::TraditionalSimplified => EncodingDetector::BIG5_INDEX,\n Tld::Japanese => EncodingDetector::SHIFT_JIS_INDEX,\n Tld::Korean => EncodingDetector::EUC_KR_INDEX,\n Tld::CentralIso => EncodingDetector::CENTRAL_ISO_INDEX,\n }\n}\n\nfn encoding_is_native_to_tld(tld: Tld, encoding: usize) -> bool {\n match tld {\n Tld::CentralWindows => encoding == EncodingDetector::CENTRAL_WINDOWS_INDEX,\n Tld::Cyrillic => {\n encoding == EncodingDetector::CYRILLIC_WINDOWS_INDEX\n || encoding == EncodingDetector::CYRILLIC_KOI_INDEX\n || encoding == EncodingDetector::CYRILLIC_IBM_INDEX\n || encoding == EncodingDetector::CYRILLIC_ISO_INDEX\n }\n Tld::Western => encoding == EncodingDetector::WESTERN_INDEX,\n Tld::Greek => {\n encoding == EncodingDetector::GREEK_WINDOWS_INDEX\n || encoding == EncodingDetector::GREEK_ISO_INDEX\n }\n Tld::TurkishAzeri => encoding == EncodingDetector::TURKISH_INDEX,\n Tld::Hebrew => encoding == EncodingDetector::LOGICAL_INDEX,\n Tld::Arabic => {\n encoding == EncodingDetector::ARABIC_WINDOWS_INDEX\n || encoding == EncodingDetector::ARABIC_ISO_INDEX\n }\n Tld::Baltic => {\n encoding == EncodingDetector::BALTIC_WINDOWS_INDEX\n || encoding == EncodingDetector::BALTIC_ISO13_INDEX\n || encoding == EncodingDetector::BALTIC_ISO4_INDEX\n }\n Tld::Vietnamese => encoding == EncodingDetector::VIETNAMESE_INDEX,\n Tld::Thai => encoding == EncodingDetector::THAI_INDEX,\n Tld::Simplified => encoding == EncodingDetector::GBK_INDEX,\n Tld::Traditional => encoding == EncodingDetector::BIG5_INDEX,\n Tld::Japanese => {\n encoding == EncodingDetector::SHIFT_JIS_INDEX\n || encoding == EncodingDetector::EUC_JP_INDEX\n }\n Tld::Korean => encoding == EncodingDetector::EUC_KR_INDEX,\n Tld::SimplifiedTraditional | Tld::TraditionalSimplified => {\n encoding == EncodingDetector::GBK_INDEX || encoding == EncodingDetector::BIG5_INDEX\n }\n Tld::CentralIso => encoding == EncodingDetector::CENTRAL_ISO_INDEX,\n Tld::IcelandicFaroese => encoding == EncodingDetector::ICELANDIC_INDEX,\n Tld::WesternCyrillic => {\n encoding == EncodingDetector::WESTERN_INDEX\n || encoding == EncodingDetector::CYRILLIC_WINDOWS_INDEX\n || encoding == EncodingDetector::CYRILLIC_KOI_INDEX\n || encoding == EncodingDetector::CYRILLIC_IBM_INDEX\n || encoding == EncodingDetector::CYRILLIC_ISO_INDEX\n }\n Tld::CentralCyrillic => {\n encoding == EncodingDetector::CENTRAL_WINDOWS_INDEX\n || encoding == EncodingDetector::CENTRAL_ISO_INDEX\n || encoding == EncodingDetector::CYRILLIC_WINDOWS_INDEX\n || encoding == EncodingDetector::CYRILLIC_KOI_INDEX\n || encoding == EncodingDetector::CYRILLIC_IBM_INDEX\n || encoding == EncodingDetector::CYRILLIC_ISO_INDEX\n }\n Tld::WesternArabic => {\n encoding == EncodingDetector::WESTERN_INDEX\n || encoding == EncodingDetector::ARABIC_WINDOWS_INDEX\n || encoding == EncodingDetector::ARABIC_ISO_INDEX\n }\n Tld::Eu => {\n encoding == EncodingDetector::WESTERN_INDEX\n || encoding == EncodingDetector::ICELANDIC_INDEX\n || encoding == EncodingDetector::CENTRAL_WINDOWS_INDEX\n || encoding == EncodingDetector::CENTRAL_ISO_INDEX\n || encoding == EncodingDetector::CYRILLIC_WINDOWS_INDEX\n || encoding == EncodingDetector::CYRILLIC_KOI_INDEX\n || encoding == EncodingDetector::CYRILLIC_IBM_INDEX\n || encoding == EncodingDetector::CYRILLIC_ISO_INDEX\n || encoding == EncodingDetector::GREEK_WINDOWS_INDEX\n || encoding == EncodingDetector::GREEK_ISO_INDEX\n || encoding == EncodingDetector::BALTIC_WINDOWS_INDEX\n || encoding == EncodingDetector::BALTIC_ISO13_INDEX\n || encoding == EncodingDetector::BALTIC_ISO4_INDEX\n }\n Tld::Generic => false,\n }\n}\n\nfn score_adjustment(score: i64, encoding: usize, tld: Tld) -> i64 {\n if score < 1 {\n return 0;\n }\n // This is the most ad hoc part of this library.\n let (divisor, constant) = match tld {\n Tld::Generic => {\n unreachable!();\n }\n Tld::CentralWindows | Tld::CentralIso => {\n match encoding {\n EncodingDetector::WESTERN_INDEX\n | EncodingDetector::ICELANDIC_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::VIETNAMESE_INDEX\n | EncodingDetector::TURKISH_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::Cyrillic => {\n match encoding {\n EncodingDetector::BIG5_INDEX\n | EncodingDetector::GBK_INDEX\n | EncodingDetector::EUC_JP_INDEX\n | EncodingDetector::CENTRAL_WINDOWS_INDEX\n | EncodingDetector::CENTRAL_ISO_INDEX\n | EncodingDetector::GREEK_WINDOWS_INDEX\n | EncodingDetector::GREEK_ISO_INDEX\n | EncodingDetector::VISUAL_INDEX\n | EncodingDetector::LOGICAL_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::TURKISH_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::Western | Tld::WesternCyrillic | Tld::WesternArabic => {\n match encoding {\n EncodingDetector::CENTRAL_WINDOWS_INDEX\n | EncodingDetector::CENTRAL_ISO_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::TURKISH_INDEX\n | EncodingDetector::VIETNAMESE_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::Greek => {\n match encoding {\n EncodingDetector::BIG5_INDEX\n | EncodingDetector::GBK_INDEX\n | EncodingDetector::EUC_JP_INDEX\n | EncodingDetector::CENTRAL_WINDOWS_INDEX\n | EncodingDetector::CENTRAL_ISO_INDEX\n | EncodingDetector::CYRILLIC_WINDOWS_INDEX\n | EncodingDetector::CYRILLIC_ISO_INDEX\n | EncodingDetector::CYRILLIC_KOI_INDEX\n | EncodingDetector::CYRILLIC_IBM_INDEX\n | EncodingDetector::VISUAL_INDEX\n | EncodingDetector::LOGICAL_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::TURKISH_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::TurkishAzeri => {\n match encoding {\n EncodingDetector::CENTRAL_WINDOWS_INDEX\n | EncodingDetector::CENTRAL_ISO_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::VIETNAMESE_INDEX\n | EncodingDetector::ICELANDIC_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::Hebrew => {\n match encoding {\n EncodingDetector::CENTRAL_WINDOWS_INDEX\n | EncodingDetector::CENTRAL_ISO_INDEX\n | EncodingDetector::CYRILLIC_WINDOWS_INDEX\n | EncodingDetector::CYRILLIC_ISO_INDEX\n | EncodingDetector::CYRILLIC_KOI_INDEX\n | EncodingDetector::CYRILLIC_IBM_INDEX\n | EncodingDetector::GREEK_WINDOWS_INDEX\n | EncodingDetector::GREEK_ISO_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::VIETNAMESE_INDEX\n | EncodingDetector::TURKISH_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::Arabic => {\n match encoding {\n EncodingDetector::BIG5_INDEX\n | EncodingDetector::GBK_INDEX\n | EncodingDetector::EUC_JP_INDEX\n | EncodingDetector::EUC_KR_INDEX\n | EncodingDetector::CENTRAL_WINDOWS_INDEX\n | EncodingDetector::CENTRAL_ISO_INDEX\n | EncodingDetector::CYRILLIC_WINDOWS_INDEX\n | EncodingDetector::CYRILLIC_ISO_INDEX\n | EncodingDetector::CYRILLIC_KOI_INDEX\n | EncodingDetector::CYRILLIC_IBM_INDEX\n | EncodingDetector::GREEK_WINDOWS_INDEX\n | EncodingDetector::GREEK_ISO_INDEX\n | EncodingDetector::VISUAL_INDEX\n | EncodingDetector::LOGICAL_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::VIETNAMESE_INDEX\n | EncodingDetector::TURKISH_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::Baltic => {\n match encoding {\n EncodingDetector::CENTRAL_WINDOWS_INDEX\n | EncodingDetector::CENTRAL_ISO_INDEX\n | EncodingDetector::ICELANDIC_INDEX\n | EncodingDetector::TURKISH_INDEX\n | EncodingDetector::VIETNAMESE_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::Vietnamese => {\n match encoding {\n EncodingDetector::CENTRAL_WINDOWS_INDEX\n | EncodingDetector::CENTRAL_ISO_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::TURKISH_INDEX\n | EncodingDetector::ICELANDIC_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::Thai => {\n match encoding {\n EncodingDetector::BIG5_INDEX\n | EncodingDetector::GBK_INDEX\n | EncodingDetector::EUC_JP_INDEX\n | EncodingDetector::EUC_KR_INDEX\n | EncodingDetector::SHIFT_JIS_INDEX\n | EncodingDetector::CENTRAL_WINDOWS_INDEX\n | EncodingDetector::CENTRAL_ISO_INDEX\n | EncodingDetector::CYRILLIC_WINDOWS_INDEX\n | EncodingDetector::CYRILLIC_ISO_INDEX\n | EncodingDetector::CYRILLIC_KOI_INDEX\n | EncodingDetector::CYRILLIC_IBM_INDEX\n | EncodingDetector::GREEK_WINDOWS_INDEX\n | EncodingDetector::GREEK_ISO_INDEX\n | EncodingDetector::ARABIC_WINDOWS_INDEX\n | EncodingDetector::ARABIC_ISO_INDEX\n | EncodingDetector::VISUAL_INDEX\n | EncodingDetector::LOGICAL_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::TURKISH_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::Simplified\n | Tld::Traditional\n | Tld::TraditionalSimplified\n | Tld::SimplifiedTraditional\n | Tld::Japanese\n | Tld::Korean => {\n // If TLD default is valid, everything else scores zero\n return score;\n }\n Tld::IcelandicFaroese => {\n match encoding {\n EncodingDetector::CENTRAL_WINDOWS_INDEX\n | EncodingDetector::CENTRAL_ISO_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::TURKISH_INDEX\n | EncodingDetector::VIETNAMESE_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::CentralCyrillic => {\n match encoding {\n EncodingDetector::BIG5_INDEX\n | EncodingDetector::GBK_INDEX\n | EncodingDetector::EUC_JP_INDEX\n | EncodingDetector::GREEK_WINDOWS_INDEX\n | EncodingDetector::GREEK_ISO_INDEX\n | EncodingDetector::VISUAL_INDEX\n | EncodingDetector::LOGICAL_INDEX\n | EncodingDetector::BALTIC_WINDOWS_INDEX\n | EncodingDetector::BALTIC_ISO4_INDEX\n | EncodingDetector::BALTIC_ISO13_INDEX\n | EncodingDetector::TURKISH_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n Tld::Eu => {\n match encoding {\n EncodingDetector::BIG5_INDEX\n | EncodingDetector::GBK_INDEX\n | EncodingDetector::EUC_JP_INDEX\n | EncodingDetector::TURKISH_INDEX\n | EncodingDetector::VIETNAMESE_INDEX => {\n // XXX Tune this better instead of this kind of absolute.\n return score;\n }\n _ => (50, 60),\n }\n }\n };\n (score / divisor) + constant\n}\n\ncfg_if::cfg_if! {\n if #[cfg(feature = \"multithreading\")] {\n #[repr(align(64))] // Align to cache lines to avoid false sharing in the Rayon case\n struct Candidate {\n inner: InnerCandidate,\n score: Option,\n }\n } else {\n struct Candidate {\n inner: InnerCandidate,\n score: Option,\n }\n }\n}\n\nimpl Candidate {\n fn feed(&mut self, buffer: &[u8], last: bool) {\n if let Some(old_score) = self.score {\n if let Some(new_score) = self.inner.feed(buffer, last) {\n self.score = Some(old_score + new_score);\n } else {\n self.score = None;\n }\n }\n }\n\n #[cfg(feature = \"multithreading\")]\n fn qualified(&self) -> bool {\n !self.score.is_none()\n }\n\n fn new_latin(data: &'static SingleByteData) -> Self {\n Candidate {\n inner: InnerCandidate::Latin(LatinCandidate::new(data)),\n score: Some(0),\n }\n }\n\n fn new_non_latin_cased(data: &'static SingleByteData) -> Self {\n Candidate {\n inner: InnerCandidate::NonLatinCased(NonLatinCasedCandidate::new(data)),\n score: Some(0),\n }\n }\n\n fn new_caseless(data: &'static SingleByteData) -> Self {\n Candidate {\n inner: InnerCandidate::Caseless(CaselessCandidate::new(data)),\n score: Some(0),\n }\n }\n\n fn new_arabic_french(data: &'static SingleByteData) -> Self {\n Candidate {\n inner: InnerCandidate::ArabicFrench(ArabicFrenchCandidate::new(data)),\n score: Some(0),\n }\n }\n\n fn new_logical(data: &'static SingleByteData) -> Self {\n Candidate {\n inner: InnerCandidate::Logical(LogicalCandidate::new(data)),\n score: Some(0),\n }\n }\n\n fn new_visual(data: &'static SingleByteData) -> Self {\n Candidate {\n inner: InnerCandidate::Visual(VisualCandidate::new(data)),\n score: Some(0),\n }\n }\n\n fn new_utf_8() -> Self {\n Candidate {\n inner: InnerCandidate::Utf8(Utf8Candidate {\n decoder: UTF_8.new_decoder_without_bom_handling(),\n }),\n score: Some(0),\n }\n }\n\n fn new_iso_2022_jp() -> Self {\n Candidate {\n inner: InnerCandidate::Iso2022(Iso2022Candidate {\n decoder: ISO_2022_JP.new_decoder_without_bom_handling(),\n }),\n score: Some(0),\n }\n }\n\n fn new_shift_jis() -> Self {\n Candidate {\n inner: InnerCandidate::Shift(ShiftJisCandidate {\n decoder: SHIFT_JIS.new_decoder_without_bom_handling(),\n half_width_katakana_seen: false,\n half_width_katakana_state: HalfWidthKatakana::DakutenForbidden,\n prev: LatinCj::Other,\n prev_byte: 0,\n pending_score: None,\n }),\n score: Some(0),\n }\n }\n\n fn new_euc_jp() -> Self {\n Candidate {\n inner: InnerCandidate::EucJp(EucJpCandidate {\n decoder: EUC_JP.new_decoder_without_bom_handling(),\n non_ascii_seen: false,\n half_width_katakana_state: HalfWidthKatakana::DakutenForbidden,\n prev: LatinCj::Other,\n prev_byte: 0,\n prev_prev_byte: 0,\n }),\n score: Some(0),\n }\n }\n\n fn new_euc_kr() -> Self {\n Candidate {\n inner: InnerCandidate::EucKr(EucKrCandidate {\n decoder: EUC_KR.new_decoder_without_bom_handling(),\n prev_byte: 0,\n prev_was_euc_range: false,\n prev: LatinKorean::Other,\n current_word_len: 0,\n pending_score: None,\n }),\n score: Some(0),\n }\n }\n\n fn new_big5() -> Self {\n Candidate {\n inner: InnerCandidate::Big5(Big5Candidate {\n decoder: BIG5.new_decoder_without_bom_handling(),\n prev: LatinCj::Other,\n prev_byte: 0,\n pending_score: None,\n }),\n score: Some(0),\n }\n }\n\n fn new_gbk() -> Self {\n Candidate {\n inner: InnerCandidate::Gbk(GbkCandidate {\n decoder: GBK.new_decoder_without_bom_handling(),\n prev: LatinCj::Other,\n prev_byte: 0,\n pending_score: None,\n }),\n score: Some(0),\n }\n }\n\n fn score(&self, encoding: usize, tld: Tld, expectation_is_valid: bool) -> Option {\n match &self.inner {\n InnerCandidate::NonLatinCased(c) => {\n if c.longest_word < 2 {\n return None;\n }\n }\n InnerCandidate::Caseless(c) => {\n if c.longest_word < 2 && !encoding_is_native_to_tld(tld, encoding) {\n return None;\n }\n }\n InnerCandidate::ArabicFrench(c) => {\n if c.longest_word < 2 && !encoding_is_native_to_tld(tld, encoding) {\n return None;\n }\n }\n InnerCandidate::Logical(c) => {\n if c.longest_word < 2 && !encoding_is_native_to_tld(tld, encoding) {\n return None;\n }\n }\n InnerCandidate::Visual(c) => {\n if c.longest_word < 2 && !encoding_is_native_to_tld(tld, encoding) {\n return None;\n }\n }\n _ => {}\n }\n if tld == Tld::Generic {\n return self.score;\n }\n if let Some(score) = self.score {\n if encoding == encoding_for_tld(tld) {\n return Some(score + 1);\n }\n if encoding_is_native_to_tld(tld, encoding) {\n return Some(score);\n }\n if expectation_is_valid {\n return Some(score - score_adjustment(score, encoding, tld));\n }\n // If expectation is no longer valid, fall back to\n // generic behavior.\n // XXX Flipped Chinese and Central\n return Some(score);\n }\n None\n }\n\n fn plausible_punctuation(&self) -> u64 {\n match &self.inner {\n InnerCandidate::Logical(c) => {\n return c.plausible_punctuation;\n }\n InnerCandidate::Visual(c) => {\n return c.plausible_punctuation;\n }\n _ => {\n unreachable!();\n }\n }\n }\n\n fn encoding(&self) -> &'static Encoding {\n match &self.inner {\n InnerCandidate::Latin(c) => {\n return c.data.encoding;\n }\n InnerCandidate::NonLatinCased(c) => {\n return c.data.encoding;\n }\n InnerCandidate::Caseless(c) => {\n return c.data.encoding;\n }\n InnerCandidate::ArabicFrench(c) => {\n return c.data.encoding;\n }\n InnerCandidate::Logical(c) => {\n return c.data.encoding;\n }\n InnerCandidate::Visual(c) => {\n return c.data.encoding;\n }\n InnerCandidate::Shift(_) => {\n return SHIFT_JIS;\n }\n InnerCandidate::EucJp(_) => {\n return EUC_JP;\n }\n InnerCandidate::Big5(_) => {\n return BIG5;\n }\n InnerCandidate::EucKr(_) => {\n return EUC_KR;\n }\n InnerCandidate::Gbk(_) => {\n return GBK;\n }\n InnerCandidate::Utf8(_) => {\n return UTF_8;\n }\n InnerCandidate::Iso2022(_) => {\n return ISO_2022_JP;\n }\n }\n }\n}\n\n// LLVM doesn't autovectorize this properly for SSE2, so let's help manually.\ncfg_if::cfg_if! {\n if #[cfg(target_feature = \"sse2\")] {\n fn count_non_ascii(buffer: &[u8]) -> u64 {\n let mut count = 0;\n let (prefix, simd, suffix) = unsafe { buffer.align_to::<__m128i>() };\n for &b in prefix {\n if b >= 0x80 {\n count += 1;\n }\n }\n for &s in simd {\n count += unsafe {_mm_movemask_epi8(s)}.count_ones() as u64;\n }\n for &b in suffix {\n if b >= 0x80 {\n count += 1;\n }\n }\n count\n }\n } else {\n fn count_non_ascii(buffer: &[u8]) -> u64 {\n let mut count = 0;\n for &b in buffer {\n if b >= 0x80 {\n count += 1;\n }\n }\n count\n }\n }\n}\n\n#[derive(Clone, Copy)]\nenum BeforeNonAscii {\n None,\n One([u8; 1]),\n Two([u8; 2]),\n}\n\nimpl BeforeNonAscii {\n fn as_slice(&self) -> &[u8] {\n match self {\n BeforeNonAscii::None => b\"\",\n BeforeNonAscii::One(arr) => &arr[..],\n BeforeNonAscii::Two(arr) => &arr[..],\n }\n }\n\n fn push(&mut self, buffer: &[u8]) {\n let len = buffer.len();\n if len >= 2 {\n let arr = [buffer[len - 2], buffer[len - 1]];\n *self = BeforeNonAscii::Two(arr);\n } else if len == 1 {\n match self {\n BeforeNonAscii::None => {\n let arr = [buffer[0]];\n *self = BeforeNonAscii::One(arr);\n }\n BeforeNonAscii::One(first) => {\n let arr = [first[0], buffer[0]];\n *self = BeforeNonAscii::Two(arr);\n }\n BeforeNonAscii::Two(first) => {\n let arr = [first[1], buffer[0]];\n *self = BeforeNonAscii::Two(arr);\n }\n }\n }\n }\n}\n\n/// A Web browser-oriented detector for guessing what character\n/// encoding a stream of bytes is encoded in.\n///\n/// The bytes are fed to the detector incrementally using the `feed`\n/// method. The current guess of the detector can be queried using\n/// the `guess` method. The guessing parameters are arguments to the\n/// `guess` method rather than arguments to the constructor in order\n/// to enable the application to check if the arguments affect the\n/// guessing outcome. (The specific use case is to disable UI for\n/// re-running the detector with UTF-8 allowed and the top-level\n/// domain name ignored if those arguments don't change the guess.)\npub struct EncodingDetector {\n candidates: [Candidate; 27],\n non_ascii_seen: u64,\n // We need to feed up to two bytes of context before non-ASCII\n // thanks to Spanish n.º.\n last_before_non_ascii: BeforeNonAscii,\n esc_seen: bool,\n closed: bool,\n}\n\nimpl EncodingDetector {\n cfg_if::cfg_if! {\n if #[cfg(feature = \"multithreading\")] {\n fn feed_impl(&mut self, buffer: &[u8], last: bool) {\n if buffer.len() < 10 {\n self.candidates.iter_mut().for_each(|candidate| candidate.feed(buffer, last));\n self.non_ascii_seen += count_non_ascii(buffer);\n return;\n }\n // Collect only qualified candidates to avoid Rayon\n // performing thread synchronization only to bail\n // out immediately when trying a disqualified\n // candidate.\n let mut qualified = ArrayVec::<[_; 27]>::new();\n for candidate in self.candidates.iter_mut() {\n if candidate.qualified() {\n qualified.push(candidate);\n }\n }\n let (_, non_ascii) = rayon::join(|| qualified.par_iter_mut().for_each(|candidate| candidate.feed(buffer, last)),\n || count_non_ascii(buffer));\n self.non_ascii_seen += non_ascii;\n }\n } else {\n fn feed_impl(&mut self, buffer: &[u8], last: bool) {\n self.candidates.iter_mut().for_each(|candidate| candidate.feed(buffer, last));\n self.non_ascii_seen += count_non_ascii(buffer);\n }\n }\n }\n\n /// Inform the detector of a chunk of input.\n ///\n /// The byte stream is represented as a sequence of calls to this\n /// method such that the concatenation of the arguments to this\n /// method form the byte stream. It does not matter how the application\n /// chooses to chunk the stream. It is OK to call this method with\n /// a zero-length byte slice.\n ///\n /// The end of the stream is indicated by calling this method with\n /// `last` set to `true`. In that case, the end of the stream is\n /// considered to occur after the last byte of the `buffer` (which\n /// may be zero-length) passed in the same call. Once this method\n /// has been called with `last` set to `true` this method must not\n /// be called again.\n ///\n /// If you want to perform detection on just the prefix of a longer\n /// stream, do not pass `last=true` after the prefix if the stream\n /// actually still continues.\n ///\n /// Returns `true` if after processing `buffer` the stream has\n /// contained at least one non-ASCII byte and `false` if only\n /// ASCII has been seen so far.\n ///\n /// # Panics\n ///\n /// If this method has previously been called with `last` set to `true`.\n pub fn feed(&mut self, buffer: &[u8], last: bool) -> bool {\n assert!(\n !self.closed,\n \"Must not feed again after feeding with last equaling true.\"\n );\n if last {\n self.closed = true;\n }\n let start = if self.non_ascii_seen == 0 && !self.esc_seen {\n let up_to = Encoding::ascii_valid_up_to(buffer);\n let start = if let Some(escape) = memchr::memchr(0x1B, &buffer[..up_to]) {\n self.esc_seen = true;\n escape\n } else {\n up_to\n };\n if start == buffer.len() {\n self.last_before_non_ascii.push(buffer);\n return self.non_ascii_seen != 0;\n }\n if start == 0 || start == 1 {\n let last_before = self.last_before_non_ascii;\n self.last_before_non_ascii = BeforeNonAscii::None;\n self.feed_impl(last_before.as_slice(), false);\n 0\n } else {\n start - 2\n }\n } else {\n 0\n };\n self.feed_impl(&buffer[start..], last);\n self.non_ascii_seen != 0\n"},{"Del":" }\n\n /// Get a valid encoding. This is checked by round-tripping the encoding on `buffer`.\n /// TODO: This is a hack. Make it better. Make it faster.\n pub fn get_valid(\n &self,\n tld: Option<&[u8]>,\n allow_utf8: bool,\n buffer: &[u8],\n ) -> Option<&'static Encoding> {\n if let (encoding, true) = self.guess_assess(tld, allow_utf8) {\n if let (s, e, false) = encoding.decode(buffer) {\n if encoding.encode(&s).0 == buffer {\n return Some(e);\n }\n }\n }\n None\n"},{"Del":" }\n"},{"Del":"\n /// Same as `guess()`, but also returns a Boolean indicating\n /// whether the guessed encoding had a higher score than at least\n /// one other candidate. If this method returns `false`, the\n /// guessed encoding is likely to be wrong.\n pub fn guess_assess(&self, tld: Option<&[u8]>, allow_utf8: bool) -> (&'static Encoding, bool) {\n let mut tld_type = tld.map_or(Tld::Generic, |tld| {\n assert!(!contains_upper_case_period_or_non_ascii(tld));\n classify_tld(tld)\n });\n\n"},{"Del":" if self.non_ascii_seen == 0 && self.esc_seen {\n"},{"Del":" if self.candidates[Self::ISO_2022_JP_INDEX].score.is_some() {\n"},{"Del":" return (ISO_2022_JP, true);\n"},{"Del":" }\n }\n\n if self.candidates[Self::UTF_8_INDEX].score.is_some() {\n if allow_utf8 {\n return (UTF_8, true);\n }\n // Various test cases that prohibit UTF-8 detection want to\n // see windows-1252 specifically. These tests run on generic\n // domains. However, if we returned windows-1252 on\n // some non-generic domains, we'd cause reloads.\n return (self.candidates[encoding_for_tld(tld_type)].encoding(), true);\n }\n\n let mut encoding = self.candidates[encoding_for_tld(tld_type)].encoding();\n"},{"Del":" let mut max = -1i64;\n"},{"Del":" let mut expectation_is_valid = false;\n if tld_type != Tld::Generic {\n for (i, candidate) in self.candidates.iter().enumerate().skip(Self::FIRST_NORMAL) {\n if encoding_is_native_to_tld(tld_type, i) && candidate.score.is_some() {\n expectation_is_valid = true;\n break;\n }\n }\n }\n if !expectation_is_valid {\n // Flip Chinese and Central around\n match tld_type {\n Tld::Simplified => {\n if self.candidates[Self::BIG5_INDEX].score.is_some() {\n tld_type = Tld::Traditional;\n expectation_is_valid = true;\n }\n }\n Tld::Traditional => {\n if self.candidates[Self::GBK_INDEX].score.is_some() {\n tld_type = Tld::Simplified;\n expectation_is_valid = true;\n }\n }\n Tld::CentralWindows => {\n if self.candidates[Self::CENTRAL_ISO_INDEX].score.is_some() {\n tld_type = Tld::CentralIso;\n expectation_is_valid = true;\n }\n }\n Tld::CentralIso => {\n if self.candidates[Self::CENTRAL_WINDOWS_INDEX].score.is_some() {\n tld_type = Tld::CentralWindows;\n expectation_is_valid = true;\n }\n }\n _ => {}\n }\n }\n for (i, candidate) in self.candidates.iter().enumerate().skip(Self::FIRST_NORMAL) {\n if let Some(score) = candidate.score(i, tld_type, expectation_is_valid) {\n"},{"Del":" if score > max {\n max = score;\n encoding = candidate.encoding();\n }\n }\n }\n let visual = &self.candidates[Self::VISUAL_INDEX];\n if let Some(visual_score) = visual.score(Self::VISUAL_INDEX, tld_type, expectation_is_valid)\n {\n if (visual_score > max || encoding == WINDOWS_1255)\n && visual.plausible_punctuation()\n > self.candidates[Self::LOGICAL_INDEX].plausible_punctuation()\n {\n"},{"Del":" max = visual_score;\n"},{"Del":" encoding = ISO_8859_8;\n }\n }\n"},{"Del":" (encoding, max >= 0)\n"},{"Del":" }\n\n // XXX Test-only API\n #[cfg(feature = \"testing-only-no-semver-guarantees-do-not-use\")]\n pub fn find_score(&self, encoding: &'static Encoding) -> Option {\n let mut tld_type = Tld::Generic;\n let mut expectation_is_valid = false;\n if tld_type != Tld::Generic {\n for (i, candidate) in self.candidates.iter().enumerate().skip(Self::FIRST_NORMAL) {\n if encoding_is_native_to_tld(tld_type, i) && candidate.score.is_some() {\n expectation_is_valid = true;\n break;\n }\n }\n }\n if !expectation_is_valid {\n // Flip Chinese and Central around\n match tld_type {\n Tld::Simplified => {\n if self.candidates[Self::BIG5_INDEX].score.is_some() {\n tld_type = Tld::Traditional;\n expectation_is_valid = true;\n }\n }\n Tld::Traditional => {\n if self.candidates[Self::GBK_INDEX].score.is_some() {\n tld_type = Tld::Simplified;\n expectation_is_valid = true;\n }\n }\n Tld::CentralWindows => {\n if self.candidates[Self::CENTRAL_ISO_INDEX].score.is_some() {\n tld_type = Tld::CentralIso;\n expectation_is_valid = true;\n }\n }\n Tld::CentralIso => {\n if self.candidates[Self::CENTRAL_WINDOWS_INDEX].score.is_some() {\n tld_type = Tld::CentralWindows;\n expectation_is_valid = true;\n }\n }\n _ => {}\n }\n }\n for (i, candidate) in self.candidates.iter().enumerate() {\n if encoding == candidate.encoding() {\n return candidate.score(i, tld_type, expectation_is_valid);\n }\n }\n Some(0)\n }\n\n const FIRST_NORMAL: usize = 3;\n\n const UTF_8_INDEX: usize = 0;\n\n const ISO_2022_JP_INDEX: usize = 1;\n\n const VISUAL_INDEX: usize = 2;\n\n const GBK_INDEX: usize = 3;\n\n const EUC_JP_INDEX: usize = 4;\n\n const EUC_KR_INDEX: usize = 5;\n\n const SHIFT_JIS_INDEX: usize = 6;\n\n const BIG5_INDEX: usize = 7;\n\n const WESTERN_INDEX: usize = 8;\n\n const CYRILLIC_WINDOWS_INDEX: usize = 9;\n\n const CENTRAL_WINDOWS_INDEX: usize = 10;\n\n const CENTRAL_ISO_INDEX: usize = 11;\n\n const ARABIC_WINDOWS_INDEX: usize = 12;\n\n const ICELANDIC_INDEX: usize = 13;\n\n const TURKISH_INDEX: usize = 14;\n\n const THAI_INDEX: usize = 15;\n\n const LOGICAL_INDEX: usize = 16;\n\n const GREEK_WINDOWS_INDEX: usize = 17;\n\n const GREEK_ISO_INDEX: usize = 18;\n\n const BALTIC_WINDOWS_INDEX: usize = 19;\n\n const BALTIC_ISO13_INDEX: usize = 20;\n\n const CYRILLIC_KOI_INDEX: usize = 21;\n\n const CYRILLIC_IBM_INDEX: usize = 22;\n\n const ARABIC_ISO_INDEX: usize = 23;\n\n const VIETNAMESE_INDEX: usize = 24;\n\n const BALTIC_ISO4_INDEX: usize = 25;\n\n const CYRILLIC_ISO_INDEX: usize = 26;\n\n /// Creates a new instance of the detector.\n pub fn new() -> Self {\n EncodingDetector {\n candidates: [\n Candidate::new_utf_8(), // 0\n Candidate::new_iso_2022_jp(), // 1\n Candidate::new_visual(&SINGLE_BYTE_DATA[ISO_8859_8_INDEX]), // 2\n Candidate::new_gbk(), // 3\n Candidate::new_euc_jp(), // 4\n Candidate::new_euc_kr(), // 5\n Candidate::new_shift_jis(), // 6\n Candidate::new_big5(), // 7\n Candidate::new_latin(&SINGLE_BYTE_DATA[WINDOWS_1252_INDEX]), // 8\n Candidate::new_non_latin_cased(&SINGLE_BYTE_DATA[WINDOWS_1251_INDEX]), // 9\n Candidate::new_latin(&SINGLE_BYTE_DATA[WINDOWS_1250_INDEX]), // 10\n Candidate::new_latin(&SINGLE_BYTE_DATA[ISO_8859_2_INDEX]), // 11\n Candidate::new_arabic_french(&SINGLE_BYTE_DATA[WINDOWS_1256_INDEX]), // 12\n Candidate::new_latin(&SINGLE_BYTE_DATA[WINDOWS_1252_ICELANDIC_INDEX]), // 13\n Candidate::new_latin(&SINGLE_BYTE_DATA[WINDOWS_1254_INDEX]), // 14\n Candidate::new_caseless(&SINGLE_BYTE_DATA[WINDOWS_874_INDEX]), // 15\n Candidate::new_logical(&SINGLE_BYTE_DATA[WINDOWS_1255_INDEX]), // 16\n Candidate::new_non_latin_cased(&SINGLE_BYTE_DATA[WINDOWS_1253_INDEX]), // 17\n Candidate::new_non_latin_cased(&SINGLE_BYTE_DATA[ISO_8859_7_INDEX]), // 18\n Candidate::new_latin(&SINGLE_BYTE_DATA[WINDOWS_1257_INDEX]), // 19\n Candidate::new_latin(&SINGLE_BYTE_DATA[ISO_8859_13_INDEX]), // 20\n Candidate::new_non_latin_cased(&SINGLE_BYTE_DATA[KOI8_U_INDEX]), // 21\n Candidate::new_non_latin_cased(&SINGLE_BYTE_DATA[IBM866_INDEX]), // 22\n Candidate::new_caseless(&SINGLE_BYTE_DATA[ISO_8859_6_INDEX]), // 23\n Candidate::new_latin(&SINGLE_BYTE_DATA[WINDOWS_1258_INDEX]), // 24\n Candidate::new_latin(&SINGLE_BYTE_DATA[ISO_8859_4_INDEX]), // 25\n Candidate::new_non_latin_cased(&SINGLE_BYTE_DATA[ISO_8859_5_INDEX]), // 26\n ],\n non_ascii_seen: 0,\n last_before_non_ascii: BeforeNonAscii::None,\n esc_seen: false,\n closed: false,\n }\n }\n}\n"},{"Del":" debug!(\"score = {:?} {:?}\", i, score);\n"}]}},{"Replacement":{"inode":{"change":5,"pos":198172},"path":"libpijul/src/working_copy/mod.rs","line":1,"ins":{"up_context":[{"change":5,"pos":198172}],"down_context":[{"change":5,"pos":63}],"flag":"BLOCK","start":0,"end":33,"inode":{"change":5,"pos":198172}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":198172},"to":{"change":5,"start":0,"end":40},"introduced_by":5}],"inode":{"change":5,"pos":198172}},"ins_contents":[{"Add":"use chardetng::EncodingDetector;"}],"del_contents":[{"Del":"use crate::chardetng::EncodingDetector;\n"}]}},{"Replacement":{"inode":{"change":5,"pos":198172},"path":"libpijul/src/working_copy/mod.rs","line":31,"ins":{"up_context":[{"change":5,"pos":171}],"down_context":[{"change":5,"pos":75}],"flag":"BLOCK","start":34,"end":127,"inode":{"change":5,"pos":198172}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":171},"to":{"change":5,"start":0,"end":75},"introduced_by":5}],"inode":{"change":5,"pos":198172}},"ins_contents":[{"Add":" if let Some(e) = crate::get_valid_encoding(&detector, None, true, &buffer[init..]) {"}],"del_contents":[{"Del":" if let Some(e) = detector.get_valid(None, true, &buffer[init..]) {\n"}]}},{"Edit":{"inode":{"change":5,"pos":717381},"path":"libpijul/src/lib.rs","line":38,"atom":{"EdgeMap":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":27639},"to":{"change":5,"start":41,"end":57},"introduced_by":5}],"inode":{"change":5,"pos":717381}}},"contents":[{"Del":"\nmod chardetng;\n"}]}},{"Edit":{"inode":{"change":5,"pos":717381},"path":"libpijul/src/lib.rs","line":713,"atom":{"NewVertex":{"up_context":[{"change":5,"pos":737418}],"down_context":[{"change":5,"pos":737418}],"flag":"BLOCK","start":128,"end":558,"inode":{"change":5,"pos":717381}}},"contents":[{"Add":"}"},{"Add":""},{"Add":"pub(crate) fn get_valid_encoding("},{"Add":" enc: &chardetng::EncodingDetector,"},{"Add":" tld: Option<&[u8]>,"},{"Add":" allow_utf8: bool,"},{"Add":" buffer: &[u8],"},{"Add":") -> Option<&'static encoding_rs::Encoding> {"},{"Add":" if let (encoding, true) = enc.guess_assess(tld, allow_utf8) {"},{"Add":" if let (s, e, false) = encoding.decode(buffer) {"},{"Add":" if encoding.encode(&s).0 == buffer {"},{"Add":" return Some(e);"},{"Add":" }"},{"Add":" }"},{"Add":" }"},{"Add":" None"}]}},{"Replacement":{"inode":{"change":5,"pos":36296},"path":"libpijul/src/change/printable.rs","line":608,"ins":{"up_context":[{"change":5,"pos":52375}],"down_context":[{"change":5,"pos":52441}],"flag":"BLOCK","start":559,"end":618,"inode":{"change":5,"pos":36296}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":52375},"to":{"change":5,"start":52375,"end":52441},"introduced_by":5}],"inode":{"change":5,"pos":36296}},"ins_contents":[{"Add":" let mut detector = chardetng::EncodingDetector::new();"}],"del_contents":[{"Del":" let mut detector = crate::chardetng::EncodingDetector::new();\n"}]}},{"Replacement":{"inode":{"change":5,"pos":36296},"path":"libpijul/src/change/printable.rs","line":610,"ins":{"up_context":[{"change":5,"pos":52476}],"down_context":[{"change":5,"pos":52541}],"flag":"BLOCK","start":619,"end":702,"inode":{"change":5,"pos":36296}},"del":{"edges":[{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":52476},"to":{"change":5,"start":52476,"end":52541},"introduced_by":5}],"inode":{"change":5,"pos":36296}},"ins_contents":[{"Add":" if let Some(e) = crate::get_valid_encoding(&detector, None, true, &contents) {"}],"del_contents":[{"Del":" if let Some(e) = detector.get_valid(None, true, &contents) {\n"}]}},{"Edit":{"inode":{"change":5,"pos":1020742},"path":"libpijul/Cargo.toml","line":20,"atom":{"EdgeMap":{"edges":[{"previous":"","flag":"DELETED","from":{"change":5,"pos":206},"to":{"change":5,"start":125,"end":198},"introduced_by":5},{"previous":"BLOCK","flag":"BLOCK | DELETED","from":{"change":5,"pos":1021214},"to":{"change":5,"start":125,"end":198},"introduced_by":5}],"inode":{"change":5,"pos":1020742}}},"contents":[{"Del":"\"src/chardetng/mod.rs\",\n\"src/chardetng/data.rs\",\n\"src/chardetng/tld.rs\",\n"}]}},{"Edit":{"inode":{"change":5,"pos":1020742},"path":"libpijul/Cargo.toml","line":148,"atom":{"NewVertex":{"up_context":[{"change":4,"pos":3956}],"down_context":[{"change":4,"pos":3956}],"flag":"BLOCK","start":703,"end":725,"inode":{"change":5,"pos":1020742}}},"contents":[{"Add":"chardetng = \"0.1.17\""},{"Add":""}]}},{"Edit":{"inode":{"change":33,"pos":35},"path":"Cargo.lock","line":496,"atom":{"NewVertex":{"up_context":[{"change":33,"pos":7939}],"down_context":[{"change":33,"pos":7939}],"flag":"BLOCK","start":726,"end":977,"inode":{"change":33,"pos":35}}},"contents":[{"Add":""},{"Add":"[[package]]"},{"Add":"name = \"chardetng\""},{"Add":"version = \"0.1.17\""},{"Add":"source = \"registry+https://github.com/rust-lang/crates.io-index\""},{"Add":"checksum = \"14b8f0b65b7b08ae3c8187e8d77174de20cb6777864c6b832d8ad365999cf1ea\""},{"Add":"dependencies = ["},{"Add":" \"cfg-if\","},{"Add":" \"encoding_rs\","},{"Add":" \"memchr\","},{"Add":"]"}]}},{"Edit":{"inode":{"change":33,"pos":35},"path":"Cargo.lock","line":1640,"atom":{"NewVertex":{"up_context":[{"change":33,"pos":35407}],"down_context":[{"change":33,"pos":35407}],"flag":"BLOCK","start":978,"end":992,"inode":{"change":33,"pos":35}}},"contents":[{"Add":" \"chardetng\","}]}}],"owner":"oknozor","repo":"pijul","token":"HRi1w1QS0vWfBmc3/KK06lXpvOZRx/4sN382WzlrEgU=","login":null}

…

Dependencies

Change contents