Giter VIP home page Giter VIP logo

setup's People

Contributors

arikfr avatar johnbullnz avatar jpmckinney avatar justinclift avatar kanlon avatar lucydodo avatar mores avatar snickerjp avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

setup's Issues

Ubuntu 18.04 has reached EOL

Ubuntu 18.04 reached its official End Of Life (EOL) in April for the majority of users (aka those without support contracts):

https://ubuntu.com/about/release-cycle

So, we need to update this for a newer base server version. Probably Ubuntu 20.04, as that's likely the easiest approach that'll do the job.

/opt/redash/setup.sh: 22: USER: parameter not set

I am getting this error when I run setup.sh, Actually I am using Dockerfile to run this script taking Docker machine locally using

docker build . -t redashtest

My Dockerfile:
`FROM ubuntu:latest

RUN apt-get update && apt-get install -y
sudo
curl

RUN adduser --system --no-create-home --disabled-login --gecos "" redash

COPY setup.sh /opt/redash/

RUN /bin/sh /opt/redash/setup.sh`

Error :

100   664  100   664    0     0    402      0  0:00:01  0:00:01 --:--:--   402
100 11.2M  100 11.2M    0     0   703k      0  0:00:16  0:00:16 --:--:-- 2305k
#9 119.6 /opt/redash/setup.sh: 22: USER: parameter not set
------
executor failed running [/bin/sh -c /bin/sh /opt/redash/setup.sh]: exit code: 2

Issue with the setup script

Hi, I grabbed the script and when I executed it, I saw the following errors:

E: The repository 'http://us-central1.gce.archive.ubuntu.com/ubuntu kinetic Release' no longer has a Release file.
E: The repository 'http://us-central1.gce.archive.ubuntu.com/ubuntu kinetic-updates Release' no longer has a Release file.
E: The repository 'http://us-central1.gce.archive.ubuntu.com/ubuntu kinetic-backports Release' does not have a Release file.
E: The repository 'http://security.ubuntu.com/ubuntu kinetic-security Release' no longer has a Release file.

i got a SQL Error when start: ERROR: relation "queries" does not exist at character 979

The detail error logs

scheduler_1         | [2021-02-05 12:55:02,083][PID:25][INFO][Beat] Scheduler: Sending due task sync_user_details (redash.tasks.sync_user_details)
scheduler_1         | [2021-02-05 12:55:02,085][PID:1][INFO][MainProcess] Received task: redash.tasks.sync_user_details[be809368-b74a-4e42-ac62-945db29f570b]   expires:[2021-02-05 12:55:47.083909+00:00]
scheduler_1         | [2021-02-05 12:55:02,087][PID:24][INFO][ForkPoolWorker-2] Task redash.tasks.sync_user_details[be809368-b74a-4e42-ac62-945db29f570b] succeeded in 0.000717621995136s: None
scheduler_1         | [2021-02-05 12:55:02,128][PID:25][INFO][Beat] Scheduler: Sending due task refresh_queries (redash.tasks.refresh_queries)
scheduler_1         | [2021-02-05 12:55:02,130][PID:1][INFO][MainProcess] Received task: redash.tasks.refresh_queries[389d1c89-af7e-41a7-aecf-585691e83607]  
scheduler_1         | [2021-02-05 12:55:02,132][PID:24][INFO][ForkPoolWorker-2] task_name=redash.tasks.refresh_queries task_id=389d1c89-af7e-41a7-aecf-585691e83607 Refreshing queries...
postgres_1          | ERROR:  relation "queries" does not exist at character 979
postgres_1          | STATEMENT:  SELECT queries.query AS queries_query, queries.updated_at AS queries_updated_at, queries.created_at AS queries_created_at, queries.id AS queries_id, queries.version AS queries_version, queries.org_id AS queries_org_id, queries.data_source_id AS queries_data_source_id, queries.latest_query_data_id AS queries_latest_query_data_id, queries.name AS queries_name, queries.description AS queries_description, queries.query_hash AS queries_query_hash, queries.api_key AS queries_api_key, queries.user_id AS queries_user_id, queries.last_modified_by_id AS queries_last_modified_by_id, queries.is_archived AS queries_is_archived, queries.is_draft AS queries_is_draft, queries.schedule AS queries_schedule, queries.schedule_failures AS queries_schedule_failures, queries.options AS queries_options, queries.search_vector AS queries_search_vector, queries.tags AS queries_tags, query_results_1.id AS query_results_1_id, query_results_1.retrieved_at AS query_results_1_retrieved_at 
postgres_1          | 	FROM queries LEFT OUTER JOIN query_results AS query_results_1 ON query_results_1.id = queries.latest_query_data_id 
postgres_1          | 	WHERE queries.schedule IS NOT NULL ORDER BY queries.id
scheduler_1         | [2021-02-05 12:55:02,140][PID:24][ERROR][ForkPoolWorker-2] Task redash.tasks.refresh_queries[389d1c89-af7e-41a7-aecf-585691e83607] raised unexpected: ProgrammingError('(psycopg2.ProgrammingError) relation "queries" does not exist\nLINE 2: FROM queries LEFT OUTER JOIN query_results AS query_results_...\n             ^\n',)
scheduler_1         | Traceback (most recent call last):
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/celery/app/trace.py", line 385, in trace_task
scheduler_1         |     R = retval = fun(*args, **kwargs)
scheduler_1         |   File "/app/redash/worker.py", line 84, in __call__
scheduler_1         |     return TaskBase.__call__(self, *args, **kwargs)
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/celery/app/trace.py", line 648, in __protected_call__
scheduler_1         |     return self.run(*args, **kwargs)
scheduler_1         |   File "/app/redash/tasks/queries.py", line 184, in refresh_queries
scheduler_1         |     for query in models.Query.outdated_queries():
scheduler_1         |   File "/app/redash/models/__init__.py", line 555, in outdated_queries
scheduler_1         |     for query in queries:
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2995, in __iter__
scheduler_1         |     return self._execute_and_instances(context)
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 3018, in _execute_and_instances
scheduler_1         |     result = conn.execute(querycontext.statement, self._params)
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
scheduler_1         |     return meth(self, multiparams, params)
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
scheduler_1         |     return connection._execute_clauseelement(self, multiparams, params)
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
scheduler_1         |     compiled_sql, distilled_params
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1200, in _execute_context
scheduler_1         |     context)
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1413, in _handle_dbapi_exception
scheduler_1         |     exc_info
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 265, in raise_from_cause
scheduler_1         |     reraise(type(exception), exception, tb=exc_tb, cause=cause)
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context
scheduler_1         |     context)
scheduler_1         |   File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 509, in do_execute
scheduler_1         |     cursor.execute(statement, parameters)
scheduler_1         | ProgrammingError: (psycopg2.ProgrammingError) relation "queries" does not exist
scheduler_1         | LINE 2: FROM queries LEFT OUTER JOIN query_results AS query_results_...
scheduler_1         |              ^
scheduler_1         |  [SQL: 'SELECT queries.query AS queries_query, queries.updated_at AS queries_updated_at, queries.created_at AS queries_created_at, queries.id AS queries_id, queries.version AS queries_version, queries.org_id AS queries_org_id, queries.data_source_id AS queries_data_source_id, queries.latest_query_data_id AS queries_latest_query_data_id, queries.name AS queries_name, queries.description AS queries_description, queries.query_hash AS queries_query_hash, queries.api_key AS queries_api_key, queries.user_id AS queries_user_id, queries.last_modified_by_id AS queries_last_modified_by_id, queries.is_archived AS queries_is_archived, queries.is_draft AS queries_is_draft, queries.schedule AS queries_schedule, queries.schedule_failures AS queries_schedule_failures, queries.options AS queries_options, queries.search_vector AS queries_search_vector, queries.tags AS queries_tags, query_results_1.id AS query_results_1_id, query_results_1.retrieved_at AS query_results_1_retrieved_at \nFROM queries LEFT OUTER JOIN query_results AS query_results_1 ON query_results_1.id = queries.latest_query_data_id \nWHERE queries.schedule IS NOT NULL ORDER BY queries.id'] (Background on this error at: http://sqlalche.me/e/f405)

error with: '-fsSL'

Hi,
I'm trying to install on Ubuntu 22.04 (fully updated just before starting, new install, nothing custom), I found similar instruction on several sites, here is one:
https://computingforgeeks.com/install-redash-data-visualization-dashboard-on-ubuntu/

The first step is:

"Run the following commands to install Docker on Ubuntu 22.04/20.04/18.04:"

sudo apt update 
sudo apt -yy install apt-transport-https ca-certificates curl software-properties-common wget pwgen
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /etc/apt/trusted.gpg.d/docker-archive-keyring.gpg
sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu $(lsb_release -cs) stable"
sudo apt update && sudo apt -y install docker-ce docker-ce-cli containerd.io

To which I get the following error:
"Command line option 'S' [from -fsSL] is not understood in combination with the other options"

I tried several variants (-fSSL, -fssL, -fSL, etc.) but nothing seemed to work.

Any ideas? (I have very little knowledge of the CLI)
Thanks,
Mike

LDAP missing requirements

Please include LDAP3 libs in the container builds.

Scheduler container keeps crashing with:
The ldap3 library was not found. This is required to use LDAP authentication (see requirements.txt).

Setup completely breaks docker

After ./setup.sh and docker compose up, every call to docker compose up from anywhere results in something like this:

not@important:~/streamlit-workshop$ docker compose up
[+] Running 7/0
 ✔ Container redash-postgres-1          Running                                                                                                                                            0.0s 
 ✔ Container redash-redis-1             Running                                                                                                                                            0.0s 
 ✔ Container redash-adhoc_worker-1      Running                                                                                                                                            0.0s 
 ✔ Container redash-scheduler-1         Running                                                                                                                                            0.0s 
 ✔ Container redash-scheduled_worker-1  Running                                                                                                                                            0.0s 
 ✔ Container redash-server-1            Running                                                                                                                                            0.0s 
 ✔ Container redash-nginx-1             Running                                                                                                                                            0.0s 
Attaching to redash-adhoc_worker-1, redash-nginx-1, redash-postgres-1, redash-redis-1, redash-scheduled_worker-1, redash-scheduler-1, redash-server-1
redash-scheduler-1         | [2023-12-05 22:33:14,501][PID:24][INFO][Beat] Scheduler: Sending due task sync_user_details (redash.tasks.sync_user_details)
redash-scheduler-1         | [2023-12-05 22:33:14,504][PID:1][INFO][MainProcess] Received task: redash.tasks.sync_user_details[5a16ec2e-2195-464a-bd17-8cab90ca9ad7]   expires:[2023-12-05 22:33:59.502083+00:00]
redash-scheduler-1         | [2023-12-05 22:33:14,506][PID:585][INFO][ForkPoolWorker-563] Task redash.tasks.sync_user_details[5a16ec2e-2195-464a-bd17-8cab90ca9ad7] succeeded in 0.000744658056647s: None
redash-scheduler-1         | [2023-12-05 22:33:22,970][PID:24][INFO][Beat] Scheduler: Sending due task refresh_queries (redash.tasks.refresh_queries)
redash-scheduler-1         | [2023-12-05 22:33:22,973][PID:1][INFO][MainProcess] Received task: redash.tasks.refresh_queries[d42edeb4-c232-4e6f-b39d-aa6649523fcc]  
redash-scheduler-1         | [2023-12-05 22:33:22,975][PID:585][INFO][ForkPoolWorker-563] task_name=redash.tasks.refresh_queries task_id=d42edeb4-c232-4e6f-b39d-aa6649523fcc Refreshing queries...
redash-scheduler-1         | [2023-12-05 22:33:22,983][PID:585][INFO][ForkPoolWorker-563] task_name=redash.tasks.refresh_queries task_id=d42edeb4-c232-4e6f-b39d-aa6649523fcc Done refreshing queries. Found 0 outdated queries: []
redash-scheduler-1         | [2023-12-05 22:33:22,986][PID:585][INFO][ForkPoolWorker-563] Task redash.tasks.refresh_queries[d42edeb4-c232-4e6f-b39d-aa6649523fcc] succeeded in 0.0114565880504s: None
^CGracefully stopping... (press Ctrl+C again to force)
Aborting on container exit...
[+] Stopping 7/7
 ✔ Container redash-adhoc_worker-1      Stopped                                                                                                                                            3.1s 
 ✔ Container redash-nginx-1             Stopped                                                                                                                                            1.0s 
 ✔ Container redash-scheduler-1         Stopped                                                                                                                                            3.5s 
 ✔ Container redash-scheduled_worker-1  Stopped                                                                                                                                            3.8s 
 ✔ Container redash-server-1            Stopped                                                                                                                                            1.5s 
 ✔ Container redash-postgres-1          Stopped                                                                                                                                            1.4s 
 ✔ Container redash-redis-1             Stopped                                                                                                                                            1.1s 
canceled

This project is not redash. Reinstalling docker with

sudo systemctl stop docker
sudo apt-get purge ...
sudo rm -rf /etc/docker /var/lib/docker
...

didn't help. I'll have to reinstall the OS on multiple servers and on my personal PC. This is completely terrible and I might get fired. Even so I hope it's just my fault.

Issue was tested on Debian GNU/Linux 12 (bookworm) x86_64 docker version 20.10.24+dfsg1 and Pop!_OS 22.04 LTS x86_64 docker version 24.0.7. Compose upping was tested on multiple different repositories, with a similar result.

`id -un` != `id -gn`

this script assumes that everyones primary group is the same as primary user - it is not.

Unable to find Zabbix Datasource

Hi Team,
I have recently setup redash instance using setup.sh and trying to integrate Zabbix with It.

I could not find Zabbix Datasource within datasources list

Can you help me

Docker Compose for MacOS / Linux / Windows

Hey,
For anyone having problems with running preview version of Redash (redash/redash:preview)

Use this docker-compose.yml (Alerts is also working)

version: "3"
services:
  server:
    image: redash/redash:preview
    depends_on:
      init-server:
        condition: service_completed_successfully
    restart: always
    environment:
      PYTHONUNBUFFERED: "0"
      REDASH_LOG_LEVEL: "INFO"
      REDASH_REDIS_URL: "redis://redis:6379/0"
      REDASH_COOKIE_SECRET: "xuiCIAEfejj05ZUzQ0odb5pwBttXUkE4"
      REDASH_SECRET_KEY: "9emtXqroCnNhFiETBiFXoQvA4PH0nQuP"
      REDASH_DATABASE_URL: "postgresql://postgres:YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq@postgres/postgres"
      REDASH_RATELIMIT_ENABLED: "false"
      REDASH_MAIL_DEFAULT_SENDER: "[email protected]"
      REDASH_MAIL_SERVER: "email"
      REDASH_MAIL_PORT: 1025
      REDASH_ENFORCE_CSRF: "true"
      REDASH_GUNICORN_TIMEOUT: 60
    ports:
      - "5000:5000"
    platform: linux/amd64
    healthcheck:
      test: ["CMD", "curl", "-f", "http://localhost:5000/ping"]
      interval: 1s
      timeout: 2s
      retries: 30


  init-server:
    image: redash/redash:preview
    depends_on:
      - postgres
      - redis
    command:
      - create_db
    environment:
      PYTHONUNBUFFERED: "0"
      REDASH_LOG_LEVEL: "INFO"
      REDASH_REDIS_URL: "redis://redis:6379/0"
      REDASH_COOKIE_SECRET: "xuiCIAEfejj05ZUzQ0odb5pwBttXUkE4"
      REDASH_SECRET_KEY: "9emtXqroCnNhFiETBiFXoQvA4PH0nQuP"
      REDASH_DATABASE_URL: "postgresql://postgres:YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq@postgres/postgres"
      REDASH_RATELIMIT_ENABLED: "false"
      REDASH_MAIL_DEFAULT_SENDER: "[email protected]"
      REDASH_MAIL_SERVER: "email"
      REDASH_MAIL_PORT: 1025
      REDASH_ENFORCE_CSRF: "true"
      REDASH_GUNICORN_TIMEOUT: 60
    ports:
      - "5000:5000"
    platform: linux/amd64

  scheduler:
    image: redash/redash:preview
    depends_on:
      - redis
    restart: always
    command: scheduler
    environment:
      QUEUES: "celery"
      WORKERS_COUNT: 1
      PYTHONUNBUFFERED: "0"
      REDASH_LOG_LEVEL: "INFO"
      REDASH_REDIS_URL: "redis://redis:6379/0"
      REDASH_COOKIE_SECRET: "xuiCIAEfejj05ZUzQ0odb5pwBttXUkE4"
      REDASH_SECRET_KEY: "9emtXqroCnNhFiETBiFXoQvA4PH0nQuP"
      REDASH_DATABASE_URL: "postgresql://postgres:YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq@postgres/postgres"
      REDASH_RATELIMIT_ENABLED: "false"
      REDASH_MAIL_DEFAULT_SENDER: "[email protected]"
      REDASH_MAIL_SERVER: "email"
      REDASH_MAIL_PORT: 1025
      REDASH_ENFORCE_CSRF: "true"
      REDASH_GUNICORN_TIMEOUT: 60
    platform: linux/amd64

  worker:
    image: redash/redash:preview
    depends_on:
      - redis
    restart: always
    command: worker
    environment:
      QUEUES: "scheduled_queries,schemas,periodic,emails,default"
      WORKERS_COUNT: 6
      PYTHONUNBUFFERED: "0"
      REDASH_LOG_LEVEL: "INFO"
      REDASH_REDIS_URL: "redis://redis:6379/0"
      REDASH_COOKIE_SECRET: "xuiCIAEfejj05ZUzQ0odb5pwBttXUkE4"
      REDASH_SECRET_KEY: "9emtXqroCnNhFiETBiFXoQvA4PH0nQuP"
      REDASH_DATABASE_URL: "postgresql://postgres:YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq@postgres/postgres"
      REDASH_RATELIMIT_ENABLED: "false"
      REDASH_MAIL_DEFAULT_SENDER: "[email protected]"
      REDASH_MAIL_SERVER: "email"
      REDASH_MAIL_PORT: 1025
      REDASH_ENFORCE_CSRF: "true"
      REDASH_GUNICORN_TIMEOUT: 60
    platform: linux/amd64

  adhoc-worker:
    image: redash/redash:preview
    depends_on:
      - redis
    restart: always
    command: worker
    environment:
      QUEUES: "queries"
      WORKERS_COUNT: 2
      PYTHONUNBUFFERED: "0"
      REDASH_LOG_LEVEL: "INFO"
      REDASH_REDIS_URL: "redis://redis:6379/0"
      REDASH_COOKIE_SECRET: "xuiCIAEfejj05ZUzQ0odb5pwBttXUkE4"
      REDASH_SECRET_KEY: "9emtXqroCnNhFiETBiFXoQvA4PH0nQuP"
      REDASH_DATABASE_URL: "postgresql://postgres:YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq@postgres/postgres"
      REDASH_RATELIMIT_ENABLED: "false"
      REDASH_MAIL_DEFAULT_SENDER: "[email protected]"
      REDASH_MAIL_SERVER: "email"
      REDASH_MAIL_PORT: 1025
      REDASH_ENFORCE_CSRF: "true"
      REDASH_GUNICORN_TIMEOUT: 60
    platform: linux/amd64

  redis:
    image: redis:7.0-alpine
    restart: always

  postgres:
    image: postgres:15-alpine
    restart: always
    environment:
      POSTGRES_PASSWORD: "YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq"

  nginx:
    image: redash/nginx:latest
    ports:
      - "80:80"
    depends_on:
      - server
    links:
      - server:redash
    restart: always

  email:
    image: maildev/maildev
    ports:
    - "1080:1080"
    - "1025:1025"
    restart: always

Polluting the environment and and perpetuating that in .profile..

..when from what I can tell a simple cd would suffice should not be done.
And I would like to remind you that docker-compose has other usages than only running redash.

setup/setup.sh

Lines 64 to 67 in cb47626

echo "export COMPOSE_PROJECT_NAME=redash" >> ~/.profile
echo "export COMPOSE_FILE=/opt/redash/docker-compose.yml" >> ~/.profile
export COMPOSE_PROJECT_NAME=redash
export COMPOSE_FILE=/opt/redash/docker-compose.yml

The setup script fails with "ERROR: yaml.scanner.ScannerError: mapping values are not allowed here"

Just following the official guide I get this:

/opt/redash$ bash ~/gits/setup/setup.sh 
[sudo] password for ---: 
Reading package lists... Done
Building dependency tree       
Reading state information... Done
pwgen is already the newest version (2.08-1).
ca-certificates is already the newest version (20190110~18.04.1).
curl is already the newest version (7.58.0-2ubuntu3.10).
software-properties-common is already the newest version (0.96.24.32.14).
wget is already the newest version (1.19.4-1ubuntu2.2).
apt-transport-https is already the newest version (1.6.12ubuntu0.1).
0 upgraded, 0 newly installed, 0 to remove and 2 not upgraded.
OK
Hit:1 http://ru.archive.ubuntu.com/ubuntu bionic InRelease
Hit:2 https://download.docker.com/linux/ubuntu bionic InRelease         
Hit:3 http://ru.archive.ubuntu.com/ubuntu bionic-updates InRelease      
Hit:4 http://ru.archive.ubuntu.com/ubuntu bionic-backports InRelease
Hit:5 http://ru.archive.ubuntu.com/ubuntu bionic-security InRelease
Reading package lists... Done
Hit:1 http://ru.archive.ubuntu.com/ubuntu bionic InRelease
Get:2 http://ru.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]                       
Hit:3 https://download.docker.com/linux/ubuntu bionic InRelease                                               
Get:4 http://ru.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]                                
Get:5 http://ru.archive.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Fetched 252 kB in 1s (386 kB/s)                               
Reading package lists... Done
Reading package lists... Done
Building dependency tree       
Reading state information... Done
docker-ce is already the newest version (5:19.03.13~3-0~ubuntu-bionic).
0 upgraded, 0 newly installed, 0 to remove and 2 not upgraded.
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   651  100   651    0     0   3355      0 --:--:-- --:--:-- --:--:--  3373
100 11.2M  100 11.2M    0     0  4831k      0  0:00:02  0:00:02 --:--:-- 8159k
malformed JSON string, neither array, object, number, string or atom, at character offset 0 (before "(end of string)") at /usr/bin/json_pp line 45.
--2020-09-22 07:57:03--  https://raw.githubusercontent.com/getredash/setup/master/data/docker-compose.yml
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 151.101.0.133, 151.101.64.133, 151.101.128.133, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|151.101.0.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1076 (1.1K) [text/plain]
Saving to: ‘docker-compose.yml.1’

docker-compose.yml.1                                 100%[=====================================================================================================================>]   1.05K  --.-KB/s    in 0s      

2020-09-22 07:57:03 (24.7 MB/s) - ‘docker-compose.yml.1’ saved [1076/1076]

ERROR: yaml.scanner.ScannerError: mapping values are not allowed here
  in "./docker-compose.yml", line 3, column 23

It is a plain Ubuntu 18.04 Server virtual machine:

/opt/redash$ cat /etc/*-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.5 LTS"
NAME="Ubuntu"
VERSION="18.04.5 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.5 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic
/opt/redash$ uname -a
Linux --- 4.15.0-118-generic #119-Ubuntu SMP Tue Sep 8 12:30:01 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
/opt/redash$

Missing directory in script run

Hi! Just wanted to point out an error I was able to work around.

I received the following error:
image

I was able to work around this by navigating to the opt directory and manually creating the redash directory before successfully running the script.

Thanks!

The Docker download page is confusing.

At https://hub.docker.com/r/redash/redash/tags, there is a latest version which is 3 years old, but there is also preview which is 3 months old and a 10.1.0.b50633 tag which is a year old.

latest also is the first one listed in spite of being older.

Which one is the right one, to download?

Are we supposed to install latest then upgrade it, should it be preview or 10.1.0.b50633?

Is there any way to get this to run on Fedora Server OS?

I know it's specifically not listed as a supported OS but (I would have thought) it's somewhat close to RHEL so perhaps there's some hope.

If it's of any use, this is the terminal output I get when trying to run it:

image

I'd happily pursue any directions that might get it to work and share the results ... I'm just not sure where to start trying!

After installation, WORKER TIMEOUT web does not open, in the logs

Installed according to the instructions
after installation the container with

NAME="Ubuntu"
VERSION_ID="22.04"

docker logs redash-server-1

[2024-04-03 13:14:02 +0000] [1] [CRITICAL] WORKER TIMEOUT (pid:16)
[2024-04-03 13:14:02 +0000] [1] [CRITICAL] WORKER TIMEOUT (pid:17)
[2024-04-03 13:14:02 +0000] [1] [CRITICAL] WORKER TIMEOUT (pid:18)
[2024-04-03 13:14:02 +0000] [1] [CRITICAL] WORKER TIMEOUT (pid:19)
[2024-04-03 13:14:02 +0000] [16] [INFO] Worker exiting (pid: 16)
[2024-04-03 13:14:02 +0000] [17] [INFO] Worker exiting (pid: 17)
[2024-04-03 13:14:02 +0000] [18] [INFO] Worker exiting (pid: 18)
[2024-04-03 13:14:02 +0000] [19] [INFO] Worker exiting (pid: 19)
[2024-04-03 13:14:03 +0000] [20] [INFO] Booting worker with pid: 20
[2024-04-03 13:14:03 +0000] [21] [INFO] Booting worker with pid: 21
[2024-04-03 13:14:03 +0000] [22] [INFO] Booting worker with pid: 22
[2024-04-03 13:14:03 +0000] [23] [INFO] Booting worker with pid: 23

Script fails with error : Cannot install -r requirements_all_ds.txt ... :

It used to execute succesfully a couple days ago.
Exact same steps on a VM with the same OS image is now failing with error : Cannot install -r requirements_all_ds.txt ... :

Requirement already satisfied: future>=0.15.0 in /usr/local/lib/python3.7/site-packages (from dql==0.5.26->-r requirements_all_ds.txt (line 12)) (0.18.2)
INFO: pip is looking at multiple versions of azure-kusto-data to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of atsd-client to determine which version is compatible with other requirements. This could take a while.
ERROR: Cannot install -r requirements_all_ds.txt (line 12), -r requirements_all_ds.txt (line 15), -r requirements_all_ds.txt (line 21) and -r requirements_all_ds.txt (line 34) because these package versions have conflicting dependencies.

The conflict is caused by:
    atsd-client 3.0.5 depends on python-dateutil
    azure-kusto-data 0.0.35 depends on python-dateutil>=2.8.0
    botocore 1.13.0 depends on python-dateutil<3.0.0 and >=2.1; python_version >= "2.7"
    dql 0.5.26 depends on python-dateutil<2.7.0

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/user_guide/#fixing-conflicting-dependencies
ERROR: Service 'server' failed to build: The command '/bin/sh -c if [ "x$skip_ds_deps" = "x" ] ; then pip install -r requirements_all_ds.txt ; else echo "Skipping pip install -r requirements_all_ds.txt" ; fi' returned a non-zero code: 1

Steps to reproduce:
run these commands on an Ubuntu, 18.04 LTS (AWS ec2 ami: ami-0823c236601fef765):

    sudo apt update
    sudo apt install apt-transport-https ca-certificates curl software-properties-common -y
    curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -
    sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable"
    sudo apt update
    sudo apt install docker-ce -y
    sudo usermod -aG docker ${USER}


    sudo curl -L https://github.com/docker/compose/releases/download/1.21.2/docker-compose-`uname -s`-`uname -m` -o /usr/local/bin/docker-compose
    sudo chmod +x /usr/local/bin/docker-compose

    git clone https://github.com/getredash/setup.git
    cd setup/
    source ./setup.sh

Custom Image Deployment

Hello There!
I have made some changes and created the new service Images as the following using make compose_build:
REPOSITORY TAG IMAGE ID CREATED SIZE
proddash-scheduler latest 1c424d1a2e4b 7 minutes ago 1.79GB
proddash-worker latest cc8c05ecb95e 7 minutes ago 1.79GB
proddash-server latest 492b479b343b 7 minutes ago 1.79GB

Now i want to deploy those Images to my on-prem Server but the docker-compose template in this Repo has only one Image to pull.
How do i combine my three images into one?

Latest "stable" being reported as 8.0.0.b32245, not 8.0.2.b37747?

Just noticed the LATEST_VERSION being reported for the 8.x series release is 8.0.0.b32245:

setup/setup.sh

Line 58 in cb47626

LATEST_VERSION=`curl -s "https://version.redash.io/api/releases?channel=$REQUESTED_CHANNEL" | json_pp | grep "docker_image" | head -n 1 | awk 'BEGIN{FS=":"}{print $3}' | awk 'BEGIN{FS="\""}{print $1}'`

However, 8.0.2.b37747 is available.

Is the 8.0.2 build not considered stable, or is this just a case of something needing updating? 😄

Add Oracle query in version 10.1.0

Please, could someone show a way to add the Oracle query in redash 10.1.0 ?

There is a docker image with the Oracle query, but it is still in version 7.0.0, I would like to add in the latest version 10.1.0.

Thanks for the time.

When will stable CHANNEL be updated?

When will stable CHANNEL be updated?

in setup.sh

setup/setup.sh

Lines 63 to 64 in e611a6a

REQUESTED_CHANNEL=stable
LATEST_VERSION=$(curl -s "https://version.redash.io/api/releases?channel=$REQUESTED_CHANNEL" | json_pp | grep "docker_image" | head -n 1 | awk 'BEGIN{FS=":"}{print $3}' | awk 'BEGIN{FS="\""}{print $1}')

return 8.0.0.b32245

$ curl -s "https://version.redash.io/api/releases?channel=stable" | json_pp | grep "docker_image" | head -n 1 | awk 'BEGIN{FS=":"}{print $3}' | awk 'BEGIN{FS="\""}{print $1}'
8.0.0.b32245

Is #11 relevant?

Reason.

Because I would like to update my version of Redash.

However, if I go to setup.sh and get the version
replacement, so I cannot update it without modifying setup.sh.

setup/setup.sh

Line 69 in e611a6a

sed -ri "s/image: redash\/redash:([A-Za-z0-9.-]*)/image: redash\/redash:$LATEST_VERSION/" docker-compose.yml

I would like to improve this situation.

Setup Script Timeout

I am trying to install redash on a new Ubuntu 18.04 server using the setup.sh install script. However, I have encountered some error's I haven't seen from any of my previous redash installations using the script:

<succesful script execution above - can be provided if needed> 
...
Digest: sha256:4eaaa7af6476b0422058b0022661ad6129dfbf9065c506fb0904bbf0a16f2007
Status: Downloaded newer image for redash/nginx:latest
redash_postgres_1 is up-to-date                                                                              
redash_redis_1 is up-to-date                                                                                 
Creating redash_server_1 ...                                                                                 
Creating redash_scheduler_1 ...                                                                              
Creating redash_scheduled_worker_1 ...                                                                       
Creating redash_adhoc_worker_1     ...                                                                       
                                                                                                             
ERROR: for redash_scheduler_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read tim
eout=60)                                                                                                     
                                                                                                             
ERROR: for redash_scheduled_worker_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (r
ead timeout=60)                                                                                              
                                                                                                             
ERROR: for redash_server_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeou
t=60)                                                                                                        
                                                                                                             
ERROR: for redash_adhoc_worker_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read 
timeout=60)                                                                                                  
                                                                                                             
ERROR: for scheduler  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60) 
                                                                                                             
ERROR: for scheduled_worker  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeo
ut=60)                                                                                                       
                                                                                                             
ERROR: for server  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)    
                                                                                                             
ERROR: for adhoc_worker  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=6
0)                                                                                                           
ERROR: An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEO
UT to a higher value (current value: 60).                                                                    

After each run of the setup.sh script I have removed the /opt/redash/ folder, stopped all the running docker containers, and have run docker system prune -a -f to try and reset the environment. However, each time I run the script it still ends up failing on the An HTTP request took too long to complete error.

The script seems to run successfully until the following line of the setup.sh script:

    sudo docker-compose run --rm server create_db

But this line also produces the error:

$:/opt/redash# sudo docker-compose run --rm server create_db                                     
Starting redash_redis_1    ... done
Starting redash_postgres_1 ... done
ERROR: An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEO
UT to a higher value (current value: 60).                                                                    
root@vps92871:/opt/redash#                                                                                   

Any advice on why this might be or what I can do about it would be very much appreciated. Thanks in advance!

./setup.sh return FATAL

when i run setup.sh script, i get error. I run it on Ubuntu 18.04 bionic

Starting redash_redis_1    ... done
Traceback (most recent call last):
  File "/app/manage.py", line 9, in <module>
    manager()
  File "/usr/local/lib/python2.7/site-packages/click/core.py", line 716, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/flask/cli.py", line 380, in main
    return AppGroup.main(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/click/core.py", line 696, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python2.7/site-packages/click/core.py", line 1060, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python2.7/site-packages/click/core.py", line 1060, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python2.7/site-packages/click/core.py", line 889, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python2.7/site-packages/click/core.py", line 534, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/flask/cli.py", line 257, in decorator
    return __ctx.invoke(f, *args, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/click/core.py", line 534, in invoke
    return callback(*args, **kwargs)
  File "/app/redash/cli/database.py", line 31, in create_tables
    db.create_all()
  File "/usr/local/lib/python2.7/site-packages/flask_sqlalchemy/__init__.py", line 963, in create_all
    self._execute_for_all_tables(app, bind, 'create_all')
  File "/usr/local/lib/python2.7/site-packages/flask_sqlalchemy/__init__.py", line 955, in _execute_for_all_tables
    op(bind=self.get_engine(app, bind), **extra)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/sql/schema.py", line 4005, in create_all
    tables=tables)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1939, in _run_visitor
    with self._optional_conn_ctx_manager(connection) as conn:
  File "/usr/local/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1932, in _optional_conn_ctx_manager
    with self.contextual_connect() as conn:
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 2123, in contextual_connect
    self._wrap_pool_connect(self.pool.connect, None),
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 2162, in _wrap_pool_connect
    e, dialect, self)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1476, in _handle_dbapi_exception_noconnection
    exc_info
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 265, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 2158, in _wrap_pool_connect
    return fn()
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 400, in connect
    return _ConnectionFairy._checkout(self)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 788, in _checkout
    fairy = _ConnectionRecord.checkout(pool)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 529, in checkout
    rec = pool._do_get()
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 1193, in _do_get
    self._dec_overflow()
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 66, in __exit__
    compat.reraise(exc_type, exc_value, exc_tb)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 1190, in _do_get
    return self._create_connection()
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 347, in _create_connection
    return _ConnectionRecord(self)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 474, in __init__
    self.__connect(first_connect_check=True)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 671, in __connect
    connection = pool._invoke_creator(self)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 106, in connect
    return dialect.connect(*cargs, **cparams)
  File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 412, in connect
    return self.dbapi.connect(*cargs, **cparams)
  File "/usr/local/lib/python2.7/site-packages/psycopg2/__init__.py", line 130, in connect
    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) FATAL:  password authentication failed for user "postgres"
 (Background on this error at: http://sqlalche.me/e/e3q8)

Docker version 19.03.8, build afacb8b7f0

Add documentation about fixing docker-compose after removing redash

After removing redash from a server any use of docker-compose yields the following error:

ERROR: .FileNotFoundError: [Errno 2] No such file or directory: '/opt/redash/docker-compose.yml'

This effectively makes docker-compose unusable for any other purpose. The cause is these two lines in the user's .profile file which are added by the setup script.

export COMPOSE_PROJECT_NAME=redash
export COMPOSE_FILE=/opt/redash/docker-compose.yml

It would be useful if this were documented in the README.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.