Kiwi/include/kiwi
2026-06-11 00:29:55 +09:00
..
ArchUtils.h implement VLE for context Trie & optimize nst search 2025-02-15 02:02:41 +09:00
BitUtils.h fix emscripten size_t compile errors 2024-06-13 13:30:36 +02:00
capi.h Bump version to 0.23.1 2026-04-05 00:45:11 +09:00
CoNgramModel.h Refactor UnkFormScorer & Implement OOV Handling based on Chr & ChrFreq 2026-02-01 00:39:12 +09:00
Dataset.h Implement ChrTokenizer & ChrDataset 2026-01-18 14:48:23 +09:00
FixedVector.hpp fixed compilation errors 2022-06-26 01:17:37 +09:00
Form.h Bump version to 0.23.1 2026-04-05 00:45:11 +09:00
FrozenTrie.h Implement optimized splitByTrieUsingTypo() 2026-03-12 00:33:01 +09:00
Joiner.h Fix compilation errors 2025-03-23 21:23:56 +09:00
Kiwi.h implement oovTotalConsistency 2026-05-09 16:31:16 +09:00
Knlm.h Refactor LangModel implementations 2025-01-25 01:11:23 +09:00
LangModel.h Refactor LangModel implementations 2025-01-25 01:11:23 +09:00
LmState.h Refactor LangModel implementations 2025-01-25 01:11:23 +09:00
Macro.h Bump version to 0.23.2 in CMakeLists.txt and Macro.h 2026-06-11 00:29:55 +09:00
Mmap.h Implement PoC of KnLM transposed & PcLM 2025-01-13 01:13:36 +09:00
PatternMatcher.h implement oovTotalConsistency 2026-05-09 16:31:16 +09:00
ScriptType.h Add new ScriptType constant 'max' 2024-07-07 01:15:09 +09:00
SkipBigramModel.h Refactor LangModel implementations 2025-01-25 01:11:23 +09:00
SubstringExtractor.h Implement generateUnlikelihoods 2025-03-21 01:07:41 +09:00
SwTokenizer.h Bump version to 0.23.1 2026-04-05 00:45:11 +09:00
TagUtils.h Implement #195 2024-10-27 16:35:44 +09:00
TemplateUtils.hpp Fix mimalloc errors on Linux 2025-09-15 22:59:42 +09:00
ThreadPool.h Fix deprecated std::result_of 2025-03-23 15:11:47 +09:00
Trainer.h update file encoding to UTF-8 BOM 2021-09-11 19:21:24 +09:00
Trie.hpp make KnLM builder general (uint16_t & uint32_t) 2025-01-10 01:11:40 +09:00
Types.h implement oovTotalConsistency 2026-05-09 16:31:16 +09:00
TypoTransformer.h Bump version to 0.23.1 2026-04-05 00:45:11 +09:00
Utils.h Implement prototype of typo-aware splitting 2026-02-28 13:50:30 +09:00
WordDetector.h Address PR feedback: add utility function, throw exception for missing combiningRule.txt, support StreamProvider in WordDetector, simplify loadDictionary 2025-09-13 01:51:12 +09:00