mirrors/Kiwi
2
0
Fork 0
mirror of https://github.com/bab2min/Kiwi.git synced 2026-06-17 01:54:27 +00:00
Code Issues Projects Releases Packages Wiki Activity
Kiwi/test
History
Exact
bab2min 5895432a20 Add support for pretokenized spans in KiwiCpp tests
2024-06-14 00:27:44 +09:00
..
bit_encode.cpp updated test cases 2022-03-16 01:00:45 +09:00
CMakeLists.txt updated CMakeLists & vcxproj 2023-03-17 02:12:27 +09:00
common.h refactor code & add cmake 2021-07-22 22:37:59 +09:00
packages.config update vcproj version 2022-01-29 00:34:55 +09:00
test.vcxproj moved vcxproj files into vsproj/ 2024-04-24 00:50:22 +09:00
test_c.cpp updated test cases for C API 2024-04-08 01:26:07 +09:00
test_combiner.cpp fixed compilation errors 2022-08-31 02:24:39 +09:00
test_cpp.cpp Add support for pretokenized spans in KiwiCpp tests 2024-06-14 00:27:44 +09:00
test_QEncoder.cpp updated test cases 2022-03-16 01:00:45 +09:00
test_sw_tokenizer.cpp updated test cases 2023-08-12 14:07:52 +09:00
test_typo.cpp added test cases for continualTypoSet 2024-04-08 01:26:34 +09:00
written.fallback_byte.tokenizer.json implemented newline token for SwTokenizer 2023-04-16 15:00:24 +09:00
written.fallback_hangul.tokenizer.json implemented newline token for SwTokenizer 2023-04-16 15:00:24 +09:00
written.newline.tokenizer.json implemented newline token for SwTokenizer 2023-04-16 15:00:24 +09:00
written.tokenizer.json implemented newline token for SwTokenizer 2023-04-16 15:00:24 +09:00