lightonai / datatrove Goto Github PK
View Code? Open in Web Editor NEWThis project forked from huggingface/datatrove
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
License: Apache License 2.0