cisnlp Goto Github PK

analogical_reasoning

bias-in-nlp

Literature overview: gender bias in natural language processing

cisnlp.github.io

Homepage of cisnlp

colexificationnet

Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs

glot500

Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023

glotcc

GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languages

glotlid

GlotLID: Language Identification with Support for More Than 2000 Labels -- EMNLP 2023

glotscript

GlotScript: A Resource and Tool for Low Resource Writing System Identification -- LREC 2024

glotsparse

GlotSparse: Building Corpora in Under-Resourced Languages

glotstorybook

Children StoryBooks for 180 langauges.

glotweb

GlotWeb: Web Indexing for Low-Resource Languages -- under construction.

graph-align

code for EMNLP graph align paper

lohoravens-webpage

masklid

MaskLID: Code-Switching Language Identification through Iterative Masking -- ACL 2024

mplm-sim

mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models

ofa

A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretraining

parcoure

ParCourE - Parallel Corpus Explorer

semi-markov-crf

Code for paper "Neural Semi-Markov Conditional Random Fields for Robust Character-Based Part-of-Speech Tagging"

simalign

Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)

spatial_schemas

taxi1500

translico

TransliCo: A Contrastive Learning Framework to Address the Script Barrier in Multilingual Pretrained Language Models

transliteration-ppa

Breaking the Script Barrier in Multilingual Pre-Trained Language Models with Transliteration-Based Post-Training Alignment

transmi

TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Data

xampler

XAMPLER: Learning to Retrieve Cross-Lingual In-Context Examples