krickert Goto Github PK

bash_crawler

Simple bash script that crawls a website from a list of files and saves the output. Useful for creating unit tests. Not much more.

calcmaxtreepath

Given a binary tree, calculates the maximum path

chunker

collector-http

Norconex Web Crawler (or spider) is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories such as search engines.

crawler-job-creator

Create jobs to launch crawls for selenium.

crawler-manager

web crawler that works over selenium and extracts the text from the plain html

fusion-client-tools

Client tools for working with Fusion, such as to support the hbase-indexer sending docs to a Fusion pipeline.

grpc-client-discover-bug-recreate-krick

grpc_micronaut_420_broken_example

grpc micronaut serialization is broken in 4.2.0 - example code to demonstrate this behavior

hon-lucene-synonyms

Solr query parser plugin that performs proper query-time synonym expansion.

hugegherkin

Implementation of a Gherkin language to test against selenium.

ifpress-solr-plugin

Plugins that extend Solr's capabilities

ipaddresszipcodestatecountrylucenejavasearch

Automatically downloads a database of known IP addresses as well as other location data and creates a lucene index for spatial searching for IP addresses within a specific range (or other criteria). Stores lat/lon, zip, city, country, and IP addresses for fast lucene search. Index is 1GB upon completion.

java-wget

Dead simple java wget. Just one static class and a status enum. No dependencies.

javafast1x1transparentpixel

Sample code to return a 1x1 transparent GIF using Spring MVC as well as a simple servlet. This is useful if you want to implement tracking on your website. It's an in-memory servlet so it's fast as hell and won't open a file handle list most people do so dumbly.

javamongodboplogreader

Simple MongoDB oplog reader written in java. Made to read the oplog from multiple sources.

kafka-committer

A committer allowing a norconex crawl to publish crawled data to a Kafka topic.

lucene-solr

Mirror of Apache Lucene + Solr

markdown-parser

Takes in markdown documents and outputs well structured test. Meant for a precursor for chunking in a text processing pipeline.

micronaut-grpc

Integration between Micronaut and GRPC

micronaut-kafka-container-test-example

simple micronaut kafka container test for kafka unit testing. Examples include kafka serialization with strings, with avro, and with protocolbufs.

msmarc_vectors

a place to store the vectorized documents for solr search

nlp-ner

NLP Named Entity Recognition Text Processor Microservice

pipeline-processor

Takes in a PIpeDocument for a PipeService and runs it through the configured stages.

rag-models

Rag Models for protocol buffers

raspiwrite

A Python Script that prepairs and installs a Raspberry Pi compatiable distro to an SD Card

search-api

Search API for the vector-based search engine ecosystem

search_indexer

RAG search engine based on wikipedia

search_presentation_helper

Introduction to search: from query to results

solr

Apache Solr open-source search software