mirrors/Kiwi
2
0
Fork 0
mirror of https://github.com/bab2min/Kiwi.git synced 2026-06-17 01:54:27 +00:00
Code Issues Projects Releases Packages Wiki Activity

Commit graph

  • 693d6f2e02 Bump version to 0.23.2 in CMakeLists.txt and Macro.h main v0.23.2 bab2min 2026-06-11 00:29:55 +09:00
  • dab6f2a665 Fix bab2min/kiwipiepy#221 bab2min 2026-06-07 22:12:51 +09:00
  • 9a8cac8e19 deploy: f916576479 gh-pages bab2min 2026-06-07 12:43:16 +00:00
  • f916576479
         Merge pull request #256 from bab2min/dev/oov_global_consistency Minchul Lee 2026-06-07 21:42:30 +09:00
  • d7d305fa90 Fix workflows to prevent OOM bab2min 2026-06-07 16:56:12 +09:00
  • cbca2f4159 Fix errors on consistency computation bab2min 2026-05-10 01:55:26 +09:00
  • b59681627a
         Merge 2e622cf66b into d4e3e63b08 dependabot[bot] 2026-05-09 12:07:42 -04:00
  • 4f502793e4 implement oovTotalConsistency bab2min 2026-05-09 16:31:16 +09:00
  • 84bb01f051 Refactor findBestPath bab2min 2026-04-24 01:29:30 +09:00
  • 8acf45b4a1
         Merge 704ce2fc0f into d4e3e63b08 dependabot[bot] 2026-04-20 16:49:41 +00:00
  • 270bdcacb5 Optimize Path Evaluation bab2min 2026-04-19 01:18:40 +09:00
  • 303586ad22 Fix duplicated oov detection in default morphemes bab2min 2026-04-19 01:13:10 +09:00
  • 51301dead7 deploy: d4e3e63b08 bab2min 2026-04-04 15:45:59 +00:00
  • d4e3e63b08 Bump version to 0.23.1 v0.23.1 bab2min 2026-04-05 00:45:11 +09:00
  • b30e388e4a Update condition for score discount in FormEvaluator bab2min 2026-04-05 00:42:16 +09:00
  • 2694ca0564 deploy: 8e3fe94a05 bab2min 2026-04-04 15:27:05 +00:00
  • 8e3fe94a05
         Merge pull request #252 from bab2min/dev/fix_new_splitter Minchul Lee 2026-04-05 00:26:19 +09:00
  • d446d3da74 Add more test cases for empty result bab2min 2026-04-04 22:03:33 +09:00
  • a841678d50 Fix empty result more bab2min 2026-04-04 22:02:58 +09:00
  • 6308709f3d
         Merge pull request #251 from bab2min/dev/fix_new_splitter Minchul Lee 2026-04-04 20:15:37 +09:00
  • cc322a9a1a Add more test cases for empty result bug bab2min 2026-04-04 18:41:21 +09:00
  • 9e2870b81a Prevent nan at OOV Handling bab2min 2026-04-04 18:40:53 +09:00
  • cb7ae0d6b4 Fix empty result when typo correction is enabled bab2min 2026-04-04 18:40:16 +09:00
  • 599ca9aee2 Add upper limits of lengthening size for memory efficiency bab2min 2026-04-04 18:39:40 +09:00
  • cce6e1aa77 Split long non-space string into fixed-length chunk for preventing OOM bab2min 2026-04-04 18:39:07 +09:00
  • 8839bb5a11
         Merge pull request #250 from bab2min/dev/issue_246 Minchul Lee 2026-04-04 18:15:26 +09:00
  • 17360c4318 Improve RuleBasedScorer for SN ending with points bab2min 2026-04-04 17:25:47 +09:00
  • d23c7d395d Add test cases for #246 bab2min 2026-04-04 17:24:39 +09:00
  • 4e732fa615
         Update README.md Minchul Lee 2026-03-29 00:31:52 +09:00
  • d9a43a8fd0
         Add Quantized GEMM kernel for Arm NEON on macOS ARM (#249) Copilot 2026-03-28 21:20:11 +09:00
  • 5cdb33d97e Revert scatteredGEMM detour and fix NEON distant quantization storage for cong-global copilot-swe-agent[bot] 2026-03-28 11:00:15 +00:00
  • 4e73491c1a Fix remaining NEON quantized scatteredGEMM context buffer mismatch copilot-swe-agent[bot] 2026-03-28 09:13:29 +00:00
  • ed13bc7d77 Fix NEON S8 score computation to avoid double scaling in quantized context paths copilot-swe-agent[bot] 2026-03-28 08:26:24 +00:00
  • ea86fd16a9 Use S8 in NEON contextEmbPtr and switch remaining NEON context ops to S8 kernels copilot-swe-agent[bot] 2026-03-28 08:04:43 +00:00
  • 08efc19809 Apply NEON-only S8 context storage and keep x86 quantized path unchanged copilot-swe-agent[bot] 2026-03-28 07:48:27 +00:00
  • e2f8d96d03 Limit S8S8 context gemv to NEON and precompute S8 context storage at load copilot-swe-agent[bot] 2026-03-28 07:47:44 +00:00
  • 5e7caeafbe Enable quantized NEON selection and switch quantized context gemv to S8S8 path copilot-swe-agent[bot] 2026-03-28 07:34:47 +00:00
  • 670b75f766 Add ARM NEON int8 qgemm support for cong model on macOS ARM copilot-swe-agent[bot] 2026-03-28 05:56:37 +00:00
  • 569f8e52e7
         Initial plan copilot-swe-agent[bot] 2026-03-28 05:37:24 +00:00
  • 4e8805a6e3
         Merge pull request #247 from bab2min/dev/avx_vnni_on_msvc Minchul Lee 2026-03-27 12:22:22 +09:00
  • b8516fdb05 Fix AVX-VNNI support for MSVC bab2min 2026-03-27 01:23:47 +09:00
  • f3a8f228e1 Fix wrong AVX-VNNI detection logic bab2min 2026-03-27 01:23:16 +09:00
  • 25cc639c96 Fix Swift Workflows v0.23.0 bab2min 2026-03-17 01:00:15 +09:00
  • 11baa0b010 Fix npm publish bab2min 2026-03-17 00:35:30 +09:00
  • 605c2e78c5
         Fix tar command to include all dict files Minchul Lee 2026-03-17 00:11:47 +09:00
  • 8bde46a560 deploy: 86d4733fdd bab2min 2026-03-15 15:42:51 +00:00
  • 86d4733fdd Set default typo transformer for non-standard dialects bab2min 2026-03-16 00:42:05 +09:00
  • 8e818a446f deploy: 5c220fcf0e bab2min 2026-03-15 13:52:55 +00:00
  • 5c220fcf0e
         Merge pull request #245 from bab2min/dev/improve_typo_correction Minchul Lee 2026-03-15 22:52:19 +09:00
  • 2f04fa83dc Add more typo corrections for dialects bab2min 2026-03-15 21:56:58 +09:00
  • a137b4830a Fix dataset errors bab2min 2026-03-15 21:55:17 +09:00
  • b196855830 Remove redundant entries for 충청 and 함경 dialects in combiningRule.txt bab2min 2026-03-15 02:35:12 +09:00
  • ee7c4776e1 Update out-of-vocabulary rule parameters for improved typo correction bab2min 2026-03-15 02:33:17 +09:00
  • 03d6065248 Add boundary condition for typo correction and enhance dialect handling bab2min 2026-03-15 02:33:06 +09:00
  • dd63f3bfdd Bump version to 0.23.0 in CMakeLists.txt and Macro.h bab2min 2026-03-14 20:29:23 +09:00
  • da30e52151 deploy: f68dc34126 bab2min 2026-03-14 11:20:08 +00:00
  • f68dc34126
         Merge pull request #244 from bab2min/dev/optimize_typo_process Minchul Lee 2026-03-14 20:19:19 +09:00
  • 96bffaaffd Add continual typo corrections and adjust lengthening typo cost in Java Binding bab2min 2026-03-14 17:50:13 +09:00
  • d7ce2915cf Fixed typo correction bug in bindings bab2min 2026-03-14 17:34:26 +09:00
  • f2f24de2d3 Update Swift Binding bab2min 2026-03-14 17:22:07 +09:00
  • 71aa41cbd8 Update WASM Binding bab2min 2026-03-14 17:11:49 +09:00
  • ce2a5184f0 Update Java Binding bab2min 2026-03-14 17:11:28 +09:00
  • fc203ca652 Remove support for TypoTransformer in build method and update related calls of KiwiJava bab2min 2026-03-14 16:17:45 +09:00
  • ab8f209690 Update tools compatible to the new typo correction API bab2min 2026-03-14 16:12:26 +09:00
  • 808d90ad1c Update C API compatible to a new typo correction bab2min 2026-03-14 15:25:14 +09:00
  • a3c149d173 Fix KiwiBuilder initialization bab2min 2026-03-14 01:57:31 +09:00
  • bf8a3964bd Add test for MultiWordTypo handling bab2min 2026-03-14 01:49:30 +09:00
  • c77d229d53 Fix errors in Splitter's position calculations & Improve early termination bab2min 2026-03-14 01:48:58 +09:00
  • 368e7915b0 Add option oldSplitter to evaluator bab2min 2026-03-12 21:40:40 +09:00
  • 8692e7ea81 Fix wrong computation of NounEvaluator::computeScore bab2min 2026-03-12 21:39:45 +09:00
  • 683314ab7a Fix test cases bab2min 2026-03-12 21:38:29 +09:00
  • 6b078693e5 Fix wrong behaviors of new Splitter bab2min 2026-03-12 21:37:46 +09:00
  • b455855653 Fix chunking & unk handling of Splitter bab2min 2026-03-12 02:27:34 +09:00
  • 7a2288456c Update test cases for the new typo function bab2min 2026-03-12 00:37:21 +09:00
  • 9163b0583b Add utility functions to AnalyzeOption for match and typo transformer configuration bab2min 2026-03-12 00:34:09 +09:00
  • 12423b0164 Implement optimized splitByTrieUsingTypo() bab2min 2026-03-12 00:33:01 +09:00
  • 71fddc801a Add getDefaultPreparedTypoSet() bab2min 2026-03-12 00:30:03 +09:00
  • fe3cb43be6 Implement continual typo handling & pretokenization to TypoTransformer::generateGraph bab2min 2026-03-12 00:29:31 +09:00
  • 1e2069e115 Add test cases for PreparedTypoTransformer::generateGraph bab2min 2026-02-28 13:51:22 +09:00
  • 640fd8c77a Implement prototype of typo-aware splitting bab2min 2026-02-28 13:50:30 +09:00
  • 54a34a9e15
         Update README.md Minchul Lee 2026-02-23 21:17:15 +09:00
  • ba17128e25 Add testing instructions for WASM package in README bab2min 2026-02-23 01:29:30 +09:00
  • 9e5e384dd9
         Merge pull request #243 from bab2min/dev/ci_cd_for_wasm Minchul Lee 2026-02-23 01:28:40 +09:00
  • ca6c6e0156 Add a workflow for wasm bab2min 2026-02-23 00:56:04 +09:00
  • 84521c8985 Fix integer overflows in constexpr computation bab2min 2026-02-23 00:55:30 +09:00
  • 322801eca0 Add basic unit test for wasm bab2min 2026-02-23 00:54:30 +09:00
  • 78307330c5 Improve wasm binding compatible to recent Kiwi bab2min 2026-02-23 00:48:27 +09:00
  • 3c68055666 Fix xcframework build script bab2min 2026-02-22 20:44:41 +09:00
  • 4580bcd3f4
         Merge pull request #242 from bab2min/dev/fix_macos_intel_fail Minchul Lee 2026-02-22 16:32:21 +09:00
  • 89bc4eff46 Fix macOS build configuration by simplifying compiler setup and ensuring correct deployment target bab2min 2026-02-22 16:04:50 +09:00
  • 83a6f64851
         Clarify Swift binding availability for iOS and macOS Minchul Lee 2026-02-22 15:17:09 +09:00
  • b5990e17b5
         Merge pull request #241 from bab2min/copilot/add-kiwi-swift-binding Minchul Lee 2026-02-22 15:10:21 +09:00
  • 9aa03a40ae Fix project root path in build script for XCFramework bab2min 2026-02-22 15:09:25 +09:00
  • ca6247914f
         Merge pull request #239 from bab2min/copilot/add-kiwi-swift-binding Minchul Lee 2026-02-22 14:47:09 +09:00
  • 4d52e49259 deploy: 95ab533a10 bab2min 2026-02-21 17:49:27 +00:00
  • 95ab533a10 Add joinParticleYo flag to PatternMatcher and C API enums bab2min 2026-02-22 02:48:32 +09:00
  • 0d58375b06 deploy: 28b9c55250 bab2min 2026-02-21 17:35:02 +00:00
  • 28b9c55250
         Merge pull request #240 from bab2min/dev/oov-chr-model Minchul Lee 2026-02-22 02:34:22 +09:00
  • b900cc7faf Update ZCoda test to incorporate oovChrFreqModel in analysis bab2min 2026-02-22 01:54:44 +09:00
  • d7ab4334ec Merge branch 'dev/oov-chr-model' of https://github.com/bab2min/Kiwi into dev/oov-chr-model bab2min 2026-02-22 01:22:03 +09:00