spydaz / basic_tokenizer2023 Goto Github PK
View Code? Open in Web Editor NEWThis project forked from spydazwebai-nlp/basic_tokenizer2023
The Tokenizer is a versatile text processing library written in Visual Basic (VB.NET). It provides functionalities for tokenizing text into words, sentences, characters, and n-grams. The library is designed to be flexible, customizable, and easy to integrate into your VB.NET projects.
License: MIT License