Comments (1)
Hello @mcriggs,
Thank you for your interest in FlauBERT and sorry for my late response!
To generate the embeddings for FlauBERT, you can use either the HuggingFace's transformers
library or XLM
one. We provided examples for doing so in here.
To continue training FlauBERT on your own corpus, you can run the following training command with either of the 2 below additional options:
- (1)
--reload_model
: this option will initialize the model with the pre-trained weights. - (2)
--reload_checkpoint
: this option will resume training from the last checkpoint (so the learning rate will be computed based on the one from the last epoch).
We provided both model weights and checkpoints here.
Please feel free to let me know if you have any issue in using FlauBERT.
from flaubert.
Related Issues (20)
- Typo in corpus download HOT 1
- Datasets: EnronSent, Le Monde, PCT HOT 2
- Model names HOT 1
- fastBPE HOT 2
- weird results on new task using flaubert-large-cased model HOT 1
- Update about the coming soon FLUE tasks HOT 3
- Pretraining with News Crawls by WMT 19 HOT 1
- Finetuning on FLUE HOT 12
- Filling masks HOT 4
- Using the Flaubert for Translation HOT 1
- RuntimeError: [enforce fail at CPUAllocator.cpp:64] . DefaultCPUAllocator: can't allocate memory: you tried to allocate 237414383616 bytes. Error code 12 (Cannot allocate memory) HOT 3
- Different Categories for CLS dataset for French HOT 2
- Will lemmatization negatively affect FlauBERT word embeddings? HOT 9
- Pre-training FlauBERT with Google Colab? HOT 1
- Continued training of FlauBERT (with --reload_model) -- Question about vocab size HOT 1
- Import error in extract_split_cls.py - No module name tools HOT 1
- From pytorch model (with hugging_face library) to XLM model HOT 1
- D'euro j'dis lĂ du son dis bdia d dis fin dis djaifbfl j'dis. L'as bais. Eiabduua bsujsvd HOT 1
- Example de paraphrase HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
đ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. đđđ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google â¤ď¸ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from flaubert.