first20hours / google-10000-english Goto Github PK

Noticed the list is inaccurate in relation to Proper Nouns.
"nottingham" should be capitalized, but it is lowercase.

LICENSE.md doesn't actually contain a license, but rather attribution. Is any or all of this material in the public domain, all rights reserved, or something in between?

why is "usergroupsusergroups" in the 20k list??

Here are some of the bad/potentially offensive words I've found that aren't being filtered (click triangle to show):

in google-10000-english-no-swears.txt "divx" is in there

There is a licence file, but that file just shows where the data is originated. I clicked one of the linked and read the licence there. One thing was,

User shall not publish, retransmit, display, redistribute, reproduce or commercially exploit the Data in any form, except that...

So, it means that you can never use this data in a paid app in any way? It may be better to show the usage terms in the licence text.

I have a hard time believing "information" is more frequent than "when".

Also, there are numerous entries for single letters like "x" and state abbreviations like "sd", IMO are not useful entries.

according to the Oxford 3k world list:

uncontrolled
generously
disturb
alarming
poisonous
steeply
rumour
thickly
congratulate
artificially
grandson
unimportant
unfriendly
nervously
skilfully
unexpectedly
injure
swollen
dissolve
coldly
midday
faithfully
irritating
photocopy
violently
salty
amused
bitterly
irritated
knitted
disgust
criticize
cupboard
entertainer
complicate
accuse
dishonestly
immoral
wrongly
unkind
congratulation
offend
invent
spoil
tonne
cheerfully
strangely
embarrassed
awfully
unload
confidently
anxiously
disapprove
oddly
fasten
beak
swearing
gravely
motorbike
depress
unwillingly
reckon
untidy
entitle
irritate
frighten
milligram
faintly
rudely
frightening
yawn
impatient
kilogram
drugstore
unlucky
dishonest
grandparent
angrily
willingly
alarmed
lorry
coughing
enthusiastically
awkwardly
disgusted
millimetre
deserted
noisily
annoy
thirsty
unsteady
grandchild
hairdresser
embarrassment
suitcase
amuse
downwards
curiously
chairwoman
disapproving
niece
cheaply
exaggerated
artistically
granddaughter
neatly
pleasantly
centimetre
skilful
admiration
confuse
clap
devote
insulting
farthest
politely
waiter
exaggerate
bandage
tiring
brightly
frightened
loudly
contrasting
embarrass
kilometre
disappoint
depressing
carelessly
stiffly
wildly
sideways
calmly
cannot
careless
upsetting
confine
disapproval
disgusting
unfairly
morally
pronounce
amaze

I don't think "mai" is an English word. It might be French.
According to https://en.wiktionary.org/wiki/mai#English
it is:

Determiner mai
1.(anime, manga, fandom slang, Internet slang) Alternative form of my (used in the expressions mai waifu and mai husbando)

which I scarcely consider counts as common usage.
PS: I'd do a pull request, but I'm having problems with my computer.

I find it very hard to believe that "ebay" is the 217th most common word in the English language, and Google's ngram viewer agrees with me (words in linked ngram search appear AFTER "ebay" in "google-10000-english.txt").

Further analysis of the data, using the Google ngram viewer itself, indicates that the order of this list in no way represents the actual relative frequencies at which these words are used.

Of course this list is still useful to many who are looking for a list of common words, but I take issue with the claim that these are the "most common English words in order of frequency."

Exists in 10000 english long words no swears, not really a swear but could be inappropriate

Perhaps this was a misspelling of "foot". Foto does appear in some lists as an alternate spelling of photo, but I doubt that was your intention.

Or at least point me to the tools to make it

81: c
82: e
90: s
98: x

This is very interesting and nice work. I have been searching for a list similar to this in Spanish and other languages for some time now without any luck. Do you know where I could find such a list or at least the data sets to create one? Thanks!

What is the licence for this data?

https://github.com/first20hours/google-10000-english/blob/master/LICENSE.md gives the provenance but not the actual licence.

Don't know if the list is supposed to include brand names, but there are several, including
toshiba, lexus, kijiji, levitra, paxil, firewire, nextel, hewlett, ericsson, garmin, and more.

Shouldn't the list be deduplicated?

includes 'voyuer' which is not a real word

Hi, are you interested in having another permutation of the 10k list that is only valid words? I needed that, so I munged the list a little. You probably would want the whole 10k, but it's pretty close to what I ran.

This is relevant to #1.

Is it possible to add contractions to the list? e.g. "you're" or "can't"

Hello,
Inline 17092 instead of the word "profile", there is "profileprofile"
Pretty sure it was not intended