Comments (5)
I also couldn't find any equivalent to the 'Subword Information' paper's P
in fastText.
But rather than modifying computeNgrams
source, it should be enough to just provide an extreme -minn
or -maxn
parameter.
A minn
larger than maxn
should mean line
Line 128 in 55ba6b5
-maxn 0
would be sufficient to disable char n-grams.from fasttext.
Am I allowed to give a comment
On Aug 8, 2016 12:01 AM, "Gordon Mohr" [email protected] wrote:
I also couldn't find any equivalent to the 'Subword Information' paper's P
in fastText.But rather than modifying computeNgrams source, it should be enough to
just provide an extreme -minn or -maxn parameter.A minn larger than 'maxn' should mean line https://github.com/
facebookresearch/fastText/blob/55ba6b505004539d3621d8eb5a10d5
259faa4bb2/src/dictionary.cc#L128 is never reached, so no word ever
decomposed into char n-grams, so the fastText code equivalent to classic
word-only word2vec. So running fastText with -maxn 0 seems sufficient to
disable char n-grams.—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#16 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/ATll0HRFVKycnJQYRPBkhM8A35lmynUhks5qdmPKgaJpZM4JelKy
.
from fasttext.
Hi,
You are right, the parameter was removed from the final implementation. Given that the code is much more efficient not than then, this parameter was not critical. We may consider re-implementing it later if useful applications are found.
Best,
Piotr
from fasttext.
I think it should be done now it's not about how many codes are there it is
ABOUT the site security because if anyone else finds out you have a hole in
your site it will bring hackers to test their skills and that is nither
good for the server on the site so I suggest it should be fixed latest
this week
On Aug 8, 2016 10:23 AM, "Piotr Bojanowski" [email protected]
wrote:
Hi,
You are right, the parameter was removed from the final implementation.
Given that the code is much more efficient not than then, this parameter
was not critical. We may consider re-implementing it later if useful
applications are found.Best,
Piotr
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#16 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/ATll0BOjrm2kV25ruk4ksSThsT6PB1OKks5qdvWVgaJpZM4JelKy
.
from fasttext.
Thanks a lot for the helpful responses, @gojomo and @piotr-bojanowski
from fasttext.
Related Issues (20)
- if i want to load pretrained model and train, what should i do HOT 1
- How is the underlying embedding matrix updated?
- Cannot install FastText on Windows using pip HOT 6
- Fa
- Improved LangID model?
- Run WASM in web worker HOT 1
- Name of the researchers in references doesn't look aligned well.
- Is there any implementation using fastutil to save memory?
- Makefile dependency errors
- How to do a nearest neighbor search with input of a word vector rather than a word?
- Is fasttext reentrant?
- the number of words in a one-million-token corpus is only 15173?
- The Neapolitan model is unusable
- Backward compatibility with C++11 HOT 2
- Github
- Buid dependency errors in Makefile
- The
- H
- Classify the sentence by keywords. Best approach?
- Failed install HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fasttext.