doremus-anr / string2vocabulary Goto Github PK

Currently it works only if the label is in ecrm:P1_is_identified_by. Make it work also with labels in rdfs:label

When we applied string2vocabulary with strings representing cities and towns to match with Geonames in SILKNOW, we obtained a lot of bad results.

Example: http://data.silknow.org/production/41481202-0c96-3171-82ca-099088faf425.
The original city mentioned is simply "Saint Etienne" identified by http://www.geonames.org/2980291/. Strangely, string2vocabulary has matched it with a much smaller town, "Saint-Étienne-du-Rouvray" identified by http://sws.geonames.org/2980236/. Having said this, there are a 100 cities in France named "Saint Etienne something".

This shows the limit of pure fuzzy string matching. Should we consider having more complex matching techniques, e.g. relying on pre-trained word embeddings. It is possible that "Saint Etienne" used with the other contextual words (satin, faille, soie, tissu façonné) will have lead to the right city.

When getVocabularyCategory returns null, it throws a NullPointerException.

Add a check and a more clear message ("The family is not available").

Add the possibility of automatically search for a singular form if a first search fail.

Example:

• search for sopranos : fail
• singularise -> soprano
• search for soprano: success