maibornwolff / dcos-opendistro Goto Github PK
View Code? Open in Web Editor NEWA DC/OS Framework for Open Distro for Elasticsearch
License: Apache License 2.0
A DC/OS Framework for Open Distro for Elasticsearch
License: Apache License 2.0
After setting up OpenDistro Elastic-search unit, with service.security.transport_encryption.enabled
set to false
, I am seeing the following error in the Kibana logs:
{"type":"log","@timestamp":"2020-02-04T22:59:30Z","tags":["listening","info"],"pid":13,"message":"Server running at http://0.0.0.0:5601"}
...
...
... <once I login through Kibana UI>
{"type":"error","@timestamp":"2020-02-04T23:02:36Z","tags":[],"pid":13,"level":"error","error":{"message":"[index_not_found_exception] no such index [_opendistro], with { resource.type=\"index_expression\" & resource.id=\"_opendistro\" & index_uuid=\"_na_\" & index=\"_opendistro\" }","name":"Error","stack":"Error: [index_not_found_exception] no such index [_opendistro], with { resource.type=\"index_expression\" & resource.id=\"_opendistro\" & index_uuid=\"_na_\" & index=\"_opendistro\" }\n at badImplementation (/opt/lib/mesos/slave/slaves/cf42e75a-9494-44f3-a6ea-31a7c4649ee0-S0/frameworks/586f1066-d290-41ec-991f-e233a5fafc62-0000/executors/infra_opendistro-kibana.instance-22d4f645-47a1-11ea-a3b5-70b3d5800001._app.1/runs/14d59a8f-ef08-4636-9b17-d73708be61b7/kibana-7.2.0-linux-x86_64/plugins/opendistro_security/lib/auth/types/basicauth/routes.js:153:36)\n at process._tickCallback (internal/process/next_tick.js:68:7)"},"url":{"protocol":null,"slashes":null,"auth":null,"host":null,"port":null,"hostname":null,"hash":null,"search":null,"query":{},"pathname":"/api/v1/auth/login","path":"/api/v1/auth/login","href":"/api/v1/auth/login"},"message":"[index_not_found_exception] no such index [_opendistro], with { resource.type=\"index_expression\" & resource.id=\"_opendistro\" & index_uuid=\"_na_\" & index=\"_opendistro\" }"}
Also, I do have to mention, the health check is failing for Kibana even though the above message is reported in the logs.
I am also adding the options-kibana.json
file
{
"kibana": {
"elastic_url": "http://coordinator.infraopendistro.l4lb.thisdcos.directory:9200",
"username_secret": "infra/opendistro-kibana/username",
"password_secret": "infra/opendistro-kibana/password"
},
"service": {
"name": "/infra/opendistro-kibana",
"virtual_network_enabled": false,
"virtual_network_name": "dcos"
},
"node": {
"count": 1,
"mem": 8192,
"cpus": 1
}
}
And options-elastic.json
file:
{
"data_nodes": {
"count": 2,
"cpus": 1,
"disk": 10000,
"disk_type": "ROOT",
"heap": {
"size": 1024
},
"mem": 2048
},
"elasticsearch": {
"health_user": "admin",
"health_user_password": "admin",
"plugins": "",
"opendistro_security_config_zip": "<LOCAL_S3>",
"xpack_security_enabled": false
},
"coordinator_nodes": {
"count": 1,
"mem": 2048,
"heap": {
"size": 1024
},
"cpus": 1
},
"config_node": {
"enabled": true
},
"service": {
"name": "/infra/opendistro",
"security": {
"transport_encryption": {
"enabled": false
}
},
"service_account": "opendistro-principal",
"service_account_secret": "/infra/opendistro/opendistro-secret",
"virtual_network_enabled": true,
"virtual_network_name": "dcos",
"update_strategy": "serial"
}
}
Hi,
as a small contribution, maybe the naming could be changed.
https://www.hanselman.com/blog/EasilyRenameYourGitDefaultBranchFromMasterToMain.aspx“
"git branch -m master main"
"git push -u origin main"
After following the instructions I am finding the service deployment in DC/OS is stalling.
Everytime, irrespective of any change, I am seeing the deployment
plan not finishing to completion.
─$ dcos opendistro plan status deploy --json
{
"phases": [
{
"id": "f7950f5c-f631-4f49-984a-05b69f325c23",
"name": "master-deploy",
"steps": [
{
"id": "4059ef93-6afe-4978-a6b0-9e01ee99449f",
"status": "STARTED",
"name": "master-0:[node]",
"message": "com.mesosphere.sdk.scheduler.plan.DeploymentStep: master-0:[node] [4059ef93-6afe-4978-a6b0-9e01ee99449f] with status: STARTED"
},
{
"id": "d35dcc77-08b4-46be-8f02-36d9ebde40ec",
"status": "STARTED",
"name": "master-1:[node]",
"message": "com.mesosphere.sdk.scheduler.plan.DeploymentStep: master-1:[node] [d35dcc77-08b4-46be-8f02-36d9ebde40ec] with status: STARTED"
},
{
"id": "c00cf9e0-d1b4-492d-b393-a9f322fc801b",
"status": "STARTED",
"name": "master-2:[node]",
"message": "com.mesosphere.sdk.scheduler.plan.DeploymentStep: master-2:[node] [c00cf9e0-d1b4-492d-b393-a9f322fc801b] with status: STARTED"
}
],
"strategy": "parallel",
"status": "STARTED"
},
{
"id": "6ff0686a-06e8-4238-bd83-af997aa55d33",
"name": "data-deploy",
"steps": [
{
"id": "fecbc912-74df-42af-a94a-07f50587490c",
"status": "PREPARED",
"name": "data-0:[node]",
"message": "com.mesosphere.sdk.scheduler.plan.DeploymentStep: data-0:[node] [fecbc912-74df-42af-a94a-07f50587490c] with status: PREPARED"
},
{
"id": "3aeb716d-79b7-4773-b229-df66d3fc1c16",
"status": "PREPARED",
"name": "data-1:[node]",
"message": "com.mesosphere.sdk.scheduler.plan.DeploymentStep: data-1:[node] [3aeb716d-79b7-4773-b229-df66d3fc1c16] with status: PREPARED"
}
],
"strategy": "parallel",
"status": "IN_PROGRESS"
},
{
"id": "2a3e69b7-c6f1-439f-9c9a-fe93b9f0dced",
"name": "ingest-deploy",
"steps": [],
"strategy": "parallel",
"status": "COMPLETE"
},
{
"id": "f0e89363-9b08-450d-a337-b1399e154c17",
"name": "coordinator-deploy",
"steps": [
{
"id": "fe5e60d4-227b-4d4f-ba6d-dcb50abbf5e1",
"status": "STARTED",
"name": "coordinator-0:[node]",
"message": "com.mesosphere.sdk.scheduler.plan.DeploymentStep: coordinator-0:[node] [fe5e60d4-227b-4d4f-ba6d-dcb50abbf5e1] with status: STARTED"
}
],
"strategy": "parallel",
"status": "STARTED"
},
{
"id": "a0363a76-062b-41b3-b69b-6eb5a1c0350d",
"name": "exporter-deploy",
"steps": [
{
"id": "ace420a6-499d-4b72-a7a1-68c108fb7123",
"status": "COMPLETE",
"name": "exporter-0:[node]",
"message": "com.mesosphere.sdk.scheduler.plan.DeploymentStep: exporter-0:[node] [ace420a6-499d-4b72-a7a1-68c108fb7123] with status: COMPLETE"
}
],
"strategy": "parallel",
"status": "COMPLETE"
},
{
"id": "73e4aa02-ed1e-4bca-b211-4aa4d2763e46",
"name": "config-deploy",
"steps": [
{
"id": "22ef4208-17b6-4c15-baae-db31c685e6c5",
"status": "COMPLETE",
"name": "config-0:[node]",
"message": "com.mesosphere.sdk.scheduler.plan.DeploymentStep: config-0:[node] [22ef4208-17b6-4c15-baae-db31c685e6c5] with status: COMPLETE"
}
],
"strategy": "parallel",
"status": "COMPLETE"
}
],
"strategy": "parallel",
"errors": [],
"status": "IN_PROGRESS"
}
From the above output one can see that the cluster isn't fully up yet. This means we do not have any DATA nodes and because of which the cluster is in RED
state.
Even tried eliminating security
add-ons because I would see the following message in the Logs.
Not yet initialized (you may need to run securityadmin)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.