like-aho-corasick-but-different-py's Introduction

lacbd

lacbd is a Python library written in Rust that implements the Aho Corasick algorithm for fast subsentence matching of many keywords against one string.

You can find the actual Rust library as nitros12/like-aho-corasick-but-different.

Features

Supports arbitrary values associated with each keyword
Operates on Unicode word bounds, rather than naïve substring matching
Case insensitive
10× faster than an equivalent regex

None of the existing python libraries fit my needs.

License

This library is AGPLv3+ licensed. That may seem like an odd choice for a library. However, doing so ensures that users of this code must make their application open source, even if run as a service (such as in a Discord bot). If you want to use this to make proprietary software, look somewhere else.

This program is free software: you can redistribute it and/or modify it under the terms of the GNU Affero General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more details.

You should have received a copy of the GNU Affero General Public License along with this program. If not, see https://www.gnu.org/licenses/.

like-aho-corasick-but-different-py's People

Contributors

Stargazers

Watchers

like-aho-corasick-but-different-py's Issues

Romping for wheels

i cheated and put my single romp command line into a .py to build it but... here's the final result:

https://dev.azure.com/altendky/romp-on/_build/results?buildId=5251
/home/altendky/like-aho-corasick-but-different-py/venv/bin/romp --command 'git clone https://github.com/nitros12/like-aho-corasick-but-different-py repo; git -C repo submodule update --init; python -m pip install cibuildwheel; export CIBW_BUILD='"'"'cp36-* cp37-*'"'"'; export CIBW_ENVIRONMENT='"'"'PATH=$PATH:$HOME/.cargo/bin'"'"'; export CIBW_BEFORE_BUILD='"'"'curl --proto "=https" --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y; source $HOME/.cargo/env; python -m pip freeze; echo $PATH; echo $HOME; cat $HOME/.cargo/env'"'"'; python -m cibuildwheel --output-dir wheelhouse repo' --version 3.7 --artifact-paths wheelhouse

Though this is pretty silly since you can ask romp to just upload a .py (or whatever file) for you and run it remotely rather than packing this all in a local command line. Occasional it's 'fun' though. Or something.

https://dev.azure.com/altendky/romp-on/_build/results?buildId=5252

import os
import pathlib
import subprocess
import sys


command = '; '.join((
    'git clone https://github.com/nitros12/like-aho-corasick-but-different-py repo',
    'git -C repo submodule update --init',
    'python -m pip install cibuildwheel',
    "export CIBW_BUILD='cp36-* cp37-*'",
    "export CIBW_ENVIRONMENT='PATH=$PATH:$HOME/.cargo/bin'",
    """export CIBW_BEFORE_BUILD='curl --proto "=https" --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y; source $HOME/.cargo/env; python -m pip freeze; echo $PATH; echo $HOME; cat $HOME/.cargo/env'""",
    'python -m cibuildwheel --output-dir wheelhouse repo',
))


def main():
    subprocess.run(
        [
            os.fspath(pathlib.Path(sys.executable).with_name('romp')),
            '--command', command,
            '--version', '3.7',
            '--artifact-paths', 'wheelhouse',
        ],
        check=True,
    )

main()

Recommend Projects

ioistired / like-aho-corasick-but-different-py Goto Github PK

like-aho-corasick-but-different-py's Introduction

lacbd

Features

License

like-aho-corasick-but-different-py's People

Contributors

Stargazers

Watchers

Forkers

like-aho-corasick-but-different-py's Issues

Romping for wheels

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent