mirrors/tantivy
2
0
Fork 1
mirror of https://github.com/quickwit-oss/tantivy.git synced 2026-06-19 09:16:45 +00:00
Code Issues Projects Releases Packages Wiki Activity
tantivy/tokenizer-api
History
Paul Masurel ad4c940fa3 proof of concept for dynamic tokenizer.
2023-07-03 22:05:10 +09:00
..
src proof of concept for dynamic tokenizer. 2023-07-03 22:05:10 +09:00
Cargo.toml release tantivy (#2083) 2023-06-09 10:47:46 +02:00
README.md move tokenizer API to seperate crate (#1767) 2023-01-09 06:37:38 +01:00

README.md

#Tokenizer-API

An API to interface a tokenizer with tantivy.

The API will be kept stable in order to not break support for existing tokenizers.