Giter VIP home page Giter VIP logo

Comments (4)

FFrozTT avatar FFrozTT commented on June 13, 2024 1

Yes I went up to 4GB and it seems to be running without exiting now. The reason I've been so frugal with memory is because i'm using a DO Droplet and going from 1GB to 4GB quadruples the price. However that's my problem not yours. You can close this issue.

from bathyscaphe.

creekorful avatar creekorful commented on June 13, 2024

I've run the crawler for 2hours today and didn't notice anything. This error is due to a resolution error. It may happen if the elasticsearch instance isn't started yet or if it's down (maybe memory overhead?) Can you check the elasticsearch process status?

You can do it by running:

docker-compose -f deployment/docker-compose.yml ps

from bathyscaphe.

FFrozTT avatar FFrozTT commented on June 13, 2024

Looks like it may have exited ...?

           Name                          Command                  State                  Ports
----------------------------------------------------------------------------------------------------------
deployments_api_1             ./api --log-level debug -- ...   Up             0.0.0.0:15005->8080/tcp
deployments_crawler_1         ./crawler --log-level debu ...   Up
deployments_elasticsearch_1   /usr/local/bin/docker-entr ...   Exit 137
deployments_kibana_1          /usr/local/bin/dumb-init - ...   Up             0.0.0.0:15004->5601/tcp
deployments_nats_1            nats-server                      Up             4222/tcp, 6222/tcp, 8222/tcp
deployments_persister_1       ./persister --log-level de ...   Up
deployments_scheduler_1       ./scheduler --log-level de ...   Up
deployments_torproxy_1        /sbin/tini -- /usr/bin/tor ...   Up (healthy)   8118/tcp, 9050/tcp, 9051/tcp

hmm, ya maybe it needs more memory again:

ERROR: [2] bootstrap checks failed
[1]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
[2]: the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_master_nodes] must be configured
{"type": "server", "timestamp": "2020-08-10T20:58:56,312Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "33741e624182", "message": "stopping ..." }
{"type": "server", "timestamp": "2020-08-10T20:58:56,371Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "33741e624182", "message": "stopped" }
{"type": "server", "timestamp": "2020-08-10T20:58:56,372Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "33741e624182", "message": "closing ..." }
{"type": "server", "timestamp": "2020-08-10T20:58:56,437Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "33741e624182", "message": "closed" }
{"type": "server", "timestamp": "2020-08-10T20:58:56,443Z", "level": "INFO", "component": "o.e.x.m.p.NativeController", "cluster.name": "docker-cluster", "node.name": "33741e624182", "message": "Native controller process has stopped - no new native processes can be started" }

from bathyscaphe.

creekorful avatar creekorful commented on June 13, 2024

Unfortunately looks like it's the problem. Elasticsearch is very demanding in memory.

I'll take a look at official documentation and how much memory other people give

from bathyscaphe.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.