codelibs / elasticsearch-configsync Goto Github PK

I want to ask one thing.
I was trying to register the dictionary file into ES 6.2.3 by using your plugin.
I run this curl command but it was fail.

curl -XPOST -H 'Content-Type:application/json' localhost:9200/_configsync/file?path=stemmer_override.txt --data-binary @stemmer_override.txt

My file contain the following data.

running => run
stemmer => stemmer
add => adding

When I run that command it show the following error that content-type header is not supported.

{"error":"Content-Type header [application/x-www-form-urlencoded] is not supported","status":406}

I would like to know is it because of ES itself or this plugin.
Could you please answer ?(^^ @marevol

Hi, I have a question.

When we use this plugin to sync a user dic among ES instances, which one should we need to do?

1. restart the ES instances to load the user dic
2. close/open all indexes that use the dic
3. or this plugin loads the dic automatically?

Thanks for you plugin, it maybe useful to update files on ES nodes, e.g synonym files. i have few questions:

1. Do I need to have some setting for java security policy to make it running? e.g.:

grant {
permission org.elasticsearch.script.ClassPermission "org.codelibs.elasticsearch.configsync.service.ConfigSyncService";
permission java.io.FilePermission "/etc/elasticsearch/config/test/*", "read,write";
};

2. How can i make the file is sync immediately without waiting for schedule? I tried
   curl -XPOST localhost:9200/_configsync/file?path=test/user-dict.txt --data-binary @/tmp/user-dict.txt with new content in /tmp/user-dict.txt
   however in ES folder, i see test/user-dict.txt is not updated with new content.

At ES Boot.
ERROR][o.c.e.c.s.ConfigSyncService] [node01] Failed to start ConfigFileUpdater.
org.elasticsearch.ElasticsearchSecurityException: action [indices:admin/exists] is unauthorized for user [_system]

hi,

whe i try install
./elasticsearch/bin/elasticsearch-plugin install org.codelibs:elasticsearch-configsync:7.16.0

i get

xception in thread "main" java.lang.IllegalArgumentException: plugin policy [/home/ubuntu/elasticsearch/plugins/.installing-4144819954310129163/plugin-security.policy] contains illegal permission ("java.io.FilePermission" "<<ALL FILES>>" "read,write") in global grant
        at org.elasticsearch.bootstrap.PolicyUtil.validatePolicyPermissionsForJar(PolicyUtil.java:323)
        at org.elasticsearch.bootstrap.PolicyUtil.validatePolicyPermissions(PolicyUtil.java:333)
        at org.elasticsearch.bootstrap.PolicyUtil.getPluginPolicyInfo(PolicyUtil.java:344)
        at org.elasticsearch.plugins.InstallPluginAction.installPlugin(InstallPluginAction.java:852)
        at org.elasticsearch.plugins.InstallPluginAction.execute(InstallPluginAction.java:233)
        at org.elasticsearch.plugins.InstallPluginCommand.execute(InstallPluginCommand.java:84)
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:75)
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:114)
        at org.elasticsearch.cli.MultiCommand.execute(MultiCommand.java:95)
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:114)
        at org.elasticsearch.cli.Command.main(Command.java:79)
        at org.elasticsearch.plugins.PluginCli.main(PluginCli.java:36)

thanks

-> Installing org.codelibs:elasticsearch-configsync:8.4.1.0
-> Downloading org.codelibs:elasticsearch-configsync:8.4.1.0 from maven central
[=================================================] 100%  
Warning: sha512 not found, falling back to sha1. This behavior is deprecated and will be removed in a future release. Please update the plugin to use a sha512 checksum.
-> Failed installing org.codelibs:elasticsearch-configsync:8.4.1.0
-> Rolling back org.codelibs:elasticsearch-configsync:8.4.1.0
-> Rolled back org.codelibs:elasticsearch-configsync:8.4.1.0
Exception in thread "main" java.lang.IllegalArgumentException: plugin policy [/usr/share/elasticsearch/plugins/.installing-4798867217227255170/plugin-se curity.policy] contains illegal permission ("java.io.FilePermission" "<>" "read,write") in global grant
at org.elasticsearch.bootstrap.PolicyUtil.validatePolicyPermissionsForJar(PolicyUtil.java:350)
at org.elasticsearch.bootstrap.PolicyUtil.validatePolicyPermissions(PolicyUtil.java:360)
at org.elasticsearch.bootstrap.PolicyUtil.getPluginPolicyInfo(PolicyUtil.java:371)
at org.elasticsearch.plugins.cli.InstallPluginAction.installPlugin(InstallPluginAction.java:900)
at org.elasticsearch.plugins.cli.InstallPluginAction.execute(InstallPluginAction.java:250)
at org.elasticsearch.plugins.cli.InstallPluginCommand.execute(InstallPluginCommand.java:89)
at org.elasticsearch.common.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:54)
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:85)
at org.elasticsearch.cli.MultiCommand.execute(MultiCommand.java:94)
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:85)
at org.elasticsearch.cli.Command.main(Command.java:50)
at org.elasticsearch.launcher.CliToolLauncher.main(CliToolLauncher.java:64)

If I use the plugin, are synonyms, stopwords, and user dictionaries automatically reflected periodically?

Do you think this plugin works with Sudachi analyzer? If not, what should we do for that?

Sudachi seems much better than Kuromoji.

Related ES issue here: elastic/elasticsearch#69464

I have started getting errors on ES start (cannot start the ES service) related to the configsync plugin

[2021-03-01T09:53:18,461][ERROR][o.e.b.Bootstrap          ] [$HOSTNAME] Exception
 31 java.lang.IllegalArgumentException: plugin policy [/usr/share/elasticsearch/plugins/configsync/plugin-security.policy] contains illegal permission ("java.    io.FilePermission" "<<ALL FILES>>" "read,write") in global grant

When attempting to remove and re-install the configsync plugin, I get the same issues from the installer:

Exception in thread "main" java.lang.IllegalArgumentException: plugin policy [/usr/share/elasticsearch/plugins/.installing-558067918171060695/plugin-security.policy] contains illegal permission ("java.io.FilePermission" "<<ALL FILES>>" "read,write") in global grant
   at org.elasticsearch.bootstrap.PolicyUtil.validatePolicyPermissionsForJar(PolicyUtil.java:300)
   at org.elasticsearch.bootstrap.PolicyUtil.validatePolicyPermissions(PolicyUtil.java:310)
   at org.elasticsearch.bootstrap.PolicyUtil.getPluginPolicyInfo(PolicyUtil.java:321)
   at org.elasticsearch.plugins.InstallPluginCommand.installPlugin(InstallPluginCommand.java:861)
   at org.elasticsearch.plugins.InstallPluginCommand.execute(InstallPluginCommand.java:245)
   at org.elasticsearch.plugins.InstallPluginCommand.execute(InstallPluginCommand.java:215)
   at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:75)
   at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:116)
   at org.elasticsearch.cli.MultiCommand.execute(MultiCommand.java:80)
   at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:116)
   at org.elasticsearch.cli.Command.main(Command.java:79)
   at org.elasticsearch.plugins.PluginCli.main(PluginCli.java:36)

I attempted to follow the symlink instructions in the linked ES issue via mkdir -p /etc/elasticsearch/configsync and ln -s /var/lib/elasticsearch/config /etc/elasticsearch/configsync but there was no effect, I still get the same errors on start and still cannot install the plugin.