jprante / elasticsearch-index-termlist Goto Github PK

How do you use this endpoint in combination with a query request?

Hi I am trying this plugin.
I want to get docFreq,numDocs of terms for each shard.
When i tried this it gives only Name field in the terms.

curl -XGET http://localhost:9200/ads_index/_termlist?field=title

{
_shards: {
total: 3,
successful: 3,
failed: 0
},
total: 4292,
terms: [
{
name: "teresa"
},
{
name: "master"
},
{
name: "is"
}
]
}

After updating version number of ES dependency in pom.xml to 2.0.0 or 2.1.0, the code doesn't build.

I just tried to upgrade my environment to the new version of ES and discovered that index-termlist no longer works:

elasticsearch-1.4.0$ ./bin/elasticsearch
[2014-11-12 22:28:00,212][INFO ][node                     ] [Madame Masque] version[1.4.0], pid[92545], build[bc94bd8/2014-11-05T14:26:12Z]
[2014-11-12 22:28:00,212][INFO ][node                     ] [Madame Masque] initializing ...
[2014-11-12 22:28:00,215][INFO ][plugins                  ] [Madame Masque] loaded [], sites []
[2014-11-12 22:28:02,074][INFO ][node                     ] [Madame Masque] initialized
[2014-11-12 22:28:02,075][INFO ][node                     ] [Madame Masque] starting ...
[2014-11-12 22:28:02,122][INFO ][transport                ] [Madame Masque] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/192.168.1.104:9300]}
[2014-11-12 22:28:02,145][INFO ][discovery                ] [Madame Masque] elasticsearch/8NI0XN43RHqhMyQubzu1RQ
[2014-11-12 22:28:05,918][INFO ][cluster.service          ] [Madame Masque] new_master [Madame Masque][8NI0XN43RHqhMyQubzu1RQ][globogym.local][inet[/192.168.1.104:9300]], reason: zen-disco-join (elected_as_master)
[2014-11-12 22:28:05,932][INFO ][http                     ] [Madame Masque] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/192.168.1.104:9200]}
[2014-11-12 22:28:05,932][INFO ][node                     ] [Madame Masque] started
[2014-11-12 22:28:05,936][INFO ][gateway                  ] [Madame Masque] recovered [0] indices into cluster_state
^C[2014-11-12 22:28:27,469][INFO ][node                     ] [Madame Masque] stopping ...
[2014-11-12 22:28:27,482][INFO ][node                     ] [Madame Masque] stopped
[2014-11-12 22:28:27,482][INFO ][node                     ] [Madame Masque] closing ...
[2014-11-12 22:28:27,486][INFO ][node                     ] [Madame Masque] closed

elasticsearch-1.4.0$ ./bin/plugin -install index-termlist -url http://xbib.org/repository/org/xbib/elasticsearch/plugin/elasticsearch-index-termlist/1.3.0.0/elasticsearch-index-termlist-1.3.0.0-plugin.zip
-> Installing index-termlist...
Trying http://xbib.org/repository/org/xbib/elasticsearch/plugin/elasticsearch-index-termlist/1.3.0.0/elasticsearch-index-termlist-1.3.0.0-plugin.zip...
Downloading ................................DONE
Installed index-termlist into /Users/dblado/Downloads/test/elasticsearch-1.4.0/plugins/index-termlist

elasticsearch-1.4.0$ ./bin/elasticsearch
[2014-11-12 22:28:52,585][INFO ][node                     ] [Gargoyle] version[1.4.0], pid[92614], build[bc94bd8/2014-11-05T14:26:12Z]
[2014-11-12 22:28:52,586][INFO ][node                     ] [Gargoyle] initializing ...
[2014-11-12 22:28:52,595][INFO ][plugins                  ] [Gargoyle] loaded [index-termlist-1.3.0.0-c3c77f6], sites []
{1.4.0}: Initialization Failed ...
1) NoSuchMethodError[org.elasticsearch.action.support.broadcast.TransportBroadcastOperationAction.<init>(Lorg/elasticsearch/common/settings/Settings;Ljava/lang/String;Lorg/elasticsearch/threadpool/ThreadPool;Lorg/elasticsearch/cluster/ClusterService;Lorg/elasticsearch/transport/TransportService;)V]2) NoSuchMethodError[org.elasticsearch.rest.BaseRestHandler.<init>(Lorg/elasticsearch/common/settings/Settings;Lorg/elasticsearch/client/Client;)V]

Any plans to fix the issue?

It seems that this plugin does not compatible with ES 1.1.1.
Once the plugin is installed, the ES can not start and error messages are listed as follows:
{1.1.1}: Initialization Failed ...

• ExecutionError[java.lang.NoClassDefFoundError: org/elasticsearch/ElasticSearchException]
  NoClassDefFoundError[org/elasticsearch/ElasticSearchException]
  ClassNotFoundException[org.elasticsearch.ElasticSearchException]

I really like the look of this plugin. Can I ask when the upgrade to ES 2.2.0 might occur?

When I use as size parameter a value that is equal or bigger than total, I do not get back all results.

E.g. _termlist?field=autocomplete_object&term=kan&size=6

total: 4,
terms: [
{
name: “kandelaars”
},
{
name: “kandelabers”
},
{
name: “kantoorstempels”
}

]

E.g. _termlist?field=autocomplete_object&term=kan&size=4

total: 4,
terms: [
{
name: “kandelaars”
},

{
name: “kandelabers”
},
{
name: “kantoorstempels”
}
]

What am I missing?

After plugin installation and restarting cluster, I've got this :
Version : 1.4.0.2 (http://xbib.org/repository/org/xbib/elasticsearch/plugin/elasticsearch-index-termlist/1.4.0.2/elasticsearch-index-termlist-1.4.0.2-plugin.zip)

curl -XGET 'http://my_elk_.cluster:9200/testpy/_termlist?totalfreqs&pretty'
{
"_shards" : {
"total" : 3,
"successful" : 0,
"failed" : 3,
"failures" : [ {
"index" : "testpy",
"shard" : 0,
"reason" : "BroadcastShardOperationFailedException[[testpy][0] ]; nested: SendRequestTransportException[[Node1][inet[/10.10.10.3:9300]][indices/termlist[s]]]; nested: NullPointerException; "
}, {
"index" : "testpy",
"shard" : 1,
"reason" : "BroadcastShardOperationFailedException[[testpy][1] ]; nested: SendRequestTransportException[[Node2][inet[/10.10.10.4:9300]][indices/termlist[s]]]; nested: NullPointerException; "
}, {
"index" : "testpy",
"shard" : 2,
"reason" : "BroadcastShardOperationFailedException[[testpy][2] ]; nested: SendRequestTransportException[[Node3][inet[/10.10.10.5:9300]][indices/termlist[s]]]; nested: NullPointerException; "
} ]
},
"total" : 0,
"terms" : [ ]
}

any plan to upgrade to support the ES 6.x? I really wanna write the codes, however have no idea about designing a plugin for ES. Any help?

Update to ES 1.5 would be very nice!

Hi guys,

The installation command on the front page does not work for me. I am using 2.3.0. Error message is "failed to download from all possible locations"

./bin/plugin -install index-termlist -url http://xbib.org/repository/org/xbib/elasticsearch/plugin/elasticsearch-index-termlist/1.5.2.0/elasticsearch-index-termlist-1.5.2.0-plugin.zip

BTW, is it possible to access the list with Java API?

Thanks,
Cody

Hi,

Is the compiled 1.3.0.0 version (we are running elastic 1.3.4) available to download?
I have looked at http://xbib.org/repository/org/xbib/elasticsearch/plugin/elasticsearch-index-termlist/ but 1.4.0.2 appears to be the earliest available?

Many thanks

Hi guys,

Are you planning for an upgrade?

Hello. Are there any plans to support 7.x? Thanks.

Is there a upgrade to ES 5.x in plan?

With ES 0.90.7, the REST action is not working, and gives an error like:
No handler found for uri [/_termlist] and method [GET]

Seems it's an incompatibility issue with 0.90.7:
Required changes: TransportTermlistAction -> acquireSearcher API has changed

es-plugin.properties is in src and not in src/main/resources.

Bad install link in README.

Here is correct :)

./bin/plugin -install index-termlist -url http://xbib.org/repository/org/xbib/elasticsearch/plugin/elasticsearch-index-termlist/1.4.0.2/elasticsearch-index-termlist-1.4.0.2-plugin.zip

elasticsearch/bin/plugin install jprante/elasticsearch-index-termlist
-> Installing jprante/elasticsearch-index-termlist...
Trying https://github.com/jprante/elasticsearch-index-termlist/archive/master.zip ...
Downloading ............................................................................................................................................DONE
Verifying https://github.com/jprante/elasticsearch-index-termlist/archive/master.zip checksums if available ...
NOTE: Unable to verify checksum for downloaded plugin (unable to find .sha1 or .md5 file to verify)
ERROR: Could not find plugin descriptor 'plugin-descriptor.properties' in plugin zip

I followed the example in README, created the test index and then

curl -XGET 'http://localhost:9200/test/_termlist'
No handler found for uri [/test/_termlist] and method [GET]

Any hint on why I am getting this message?

{
   "status": 200,
   "name": "Dwith Scrhute",
   "version": {
      "number": "1.2.1",
      "build_hash": "6c95b759f9e7ef0f8e17f77d850da43ce8a4b364",
      "build_timestamp": "2014-06-03T15:02:52Z",
      "build_snapshot": false,
      "lucene_version": "4.8"
   },
   "tagline": "You Know, for Search"
}

Is it possible to generate the term list conditioned by the result of a query? and if not, is it feasible to add this capability to the plugin? forgive me if this questions seem naive, I'm not familiar with the internals of Elasticsearch or how plugins are implemented.

I want to do a GET /twitter/tweet/_termlist
How to do it from your plugin ?

The plugin command in the readme is not valid. It should be elasticsearch-index-termlist not elasticsearch-termlist

variuos -> various

With an index with only "index": "not_analyzed" fields, it is confusing to not see the terms of _all in curl -XGET 'http://localhost:9200/_termlist' (i.e., output is: {"_shards":{"total":1,"successful":1,"failed":0},"terms":[]}), but I see this is intentional in the README.md. Can an option to show these be added?

Hi,

could you add the possibility to have the "tf-idf" (or equivalent) by term, like you've done for the frequency ?