goharbor / harbor-helm Goto Github PK

2018-09-11T22:55:06Z [INFO] API controller for chart repository server is successfully initialized
2018-09-11T22:55:06Z [INFO] Policy scheduler start at 2018-09-11T22:55:06Z
[ORM]2018/09/11 22:55:06 register db Ping `clair-db`, pq: database "sslmode=disable" does not exist
2018-09-11T22:55:06Z [FATAL] [main.go:128]: failed to initialize clair database: register db Ping `clair-db`, pq: database "sslmode=disable" does not exist

2018-09-12T14:41:31Z [INFO] initializing system configurations...
2018-09-12T14:41:31Z [INFO] Registering database: type-PostgreSQL host-tim-harbor-database port-5432 databse-registry sslmode-"disable"
[ORM]2018/09/12 14:41:31 register db Ping `default`, pq: password authentication failed for user "postgres"
2018-09-12T14:41:31Z [FATAL] [main.go:46]: failed to initialize the system: register db Ping `default`, pq: password authentication failed for user "postgres"

FATAL:  password authentication failed for user "postgres"
DETAIL:  Password does not match for user "postgres".
	Connection matched pg_hba.conf line 95: "host all all all md5"

[root@localhost harbor-helm]# ls
[root@localhost harbor-helm]# docker push harbor.liudz.net/test/busybox:v1
The push refers to a repository [harbor.liudz.net/test/busybox]
0610f7f0e378: Preparing 
Error: Status 404 trying to push repository test/busybox: "default backend - 404"

here1
hehe2
The files belonging to this database system will be owned by user "postgres".
This user must also own the server process.
The database cluster will be initialized with locales
  COLLATE:  en_US.UTF-8
  CTYPE:    en_US.UTF-8
  MESSAGES: C
  MONETARY: C
  NUMERIC:  C
  TIME:     C
The default text search configuration will be set to "english".
Data page checksums are disabled.
initdb: directory "/var/lib/postgresql/data" exists but is not empty
If you want to create a new database system, either remove or empty
the directory "/var/lib/postgresql/data" or run initdb
with an argument other than "/var/lib/postgresql/data".

Start ui
2018-09-24T23:18:09Z [INFO] Config path: /etc/ui/app.conf
2018-09-24T23:18:09Z [INFO] initializing configurations...
2018-09-24T23:18:09Z [INFO] key path: /etc/ui/key
2018-09-24T23:18:09Z [INFO] initializing client for adminserver http://harbor-adminserver.svc.cluster.local:8080 ...
2018-09-24T23:18:09Z [INFO] initializing the project manager based on local database...
2018-09-24T23:18:09Z [INFO] configurations initialization completed
2018-09-24T23:18:09Z [INFO] Registering database: type-PostgreSQL harbor.rds.amazonaws.com port-5432 databse-harbor sslmode-"disable"
2018-09-24T23:18:09Z [INFO] Register database completed
2018-09-24T23:18:09Z [INFO] User id: 1 already has its encrypted password.
2018-09-24T23:18:09Z [INFO] Enable redis cache for chart caching
2018-09-24T23:18:09Z [INFO] API controller for chart repository server is successfully initialized
2018-09-24T23:18:09Z [INFO] Policy scheduler start at 2018-09-24T23:18:09Z
2018-09-24T23:18:09Z [INFO] initialized clair database
2018-09-24T23:18:09Z [INFO] Handle notification with topic 'scan_all_policy': notifier.ScanPolicyNotification{Type:"daily", DailyTime:0}
2018-09-24T23:18:09Z [INFO] Policy Alternate Policy is scheduled
2018-09-24T23:18:09Z [INFO] Policies:1, Tasks:0, CompletedTasks:0, FailedTasks:0
2018-09-24T23:18:09Z [INFO] Waiting for -83880 seconds after comparing offset 0 and utc time 83880
2018-09-24T23:18:09Z [INFO] Start syncing repositories from registry to DB... 
2018-09-24T23:18:09Z [ERROR] [utils.go:45]: 401 {"errors":[{"code":"UNAUTHORIZED","message":"authentication required","detail":[{"Type":"registry","Class":"","Name":"catalog","Action":"*"}]}]}
2018-09-24T23:18:09Z [ERROR] [main.go:168]: 401 {"errors":[{"code":"UNAUTHORIZED","message":"authentication required","detail":[{"Type":"registry","Class":"","Name":"catalog","Action":"*"}]}]}
2018-09-24T23:18:09Z [INFO] Init proxy
2018/09/24 23:18:09 [I] [asm_amd64.s:2337] http server Running on http://:8080
2018-09-24T23:20:00Z [WARNING] Not found an entry.
2018-09-24T23:20:02Z [ERROR] [security.go:211]: failed to authenticate harbor: Failed to authenticate user, due to error 'Not found an entry'
2018-09-24T23:20:02Z [WARNING] Not found an entry.
2018-09-24T23:20:04Z [ERROR] [security.go:211]: failed to authenticate harbor: Failed to authenticate user, due to error 'Not found an entry'

---
apiVersion: v1
kind: Service
metadata:
  name: "harbor-ui"
  namespace: ournamespace
  labels:
    name: "harbor-ui"
    dns_zone: "{{ dns_zone }}"
spec:
  ports:
    - name: http
      port: 8080
      nodePort: 0
      protocol: TCP
  type: NodePort
  selector:
    name: "harbor-ui"
    sha: "{{ docker_version[0:7] }}"

---
kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: "harbor-ui-{{ docker_version[0:7] }}"
  namespace: ournamespace
  labels: 
    app: harbor-ui
    sha: "{{ docker_version[0:7] }}"
spec:
  replicas: 1
  template:
    metadata:
      labels:
        name: "harbor-ui"
        sha: "{{ docker_version[0:7] }}"
    spec:
      containers:
        - name: "harbor-ui"
          image: "ourreg/harbor-ui:{{ docker_version }}"
          env:
            - name: UI_SECRET
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-ui-secret
            - name: JOBSERVICE_SECRET
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-jobservice-secret
            - name: _REDIS_URL
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-redis-url
            - name: GODEBUG
              value: netdns=cgo
            - name: LOG_LEVEL
              value: info
            - name: CONFIG_PATH
              value: /etc/ui/app.conf
            - name: ENABLE_HARBOR_SCAN_ON_PUSH
              value: "1"
            - name: ADMINSERVER_URL
              value: "http://harbor-adminserver.svc.cluster.local:8080"
            - name: CHART_CACHE_DRIVER
              value: "redis"
            - name: secretKey
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-secretKey
            - name: secret
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-secret
            - name: tokenServiceRootCertBundle
              valueFrom:
                secretKeyRef:
                  name: harbor-certs
                  key: root.crt
            - name: tokenServicePrivateKey
              valueFrom:
                secretKeyRef:
                  name: harbor-certs
                  key: private_key.pem
            - name: WITH_CLAIR
              value: "true"
            - name: CLAIR_DB_HOST
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-clair-pgsql-host
            - name: CLAIR_DB_PORT
              value:  "5432"
            - name: CLAIR_DB_USERNAME
              value: "harborclair"
            - name: CLAIR_DB_PASSWORD
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-clair-db-password
            - name: CLAIR_DB
              value: "harborclair"
            - name: CLAIR_URL
              value: "http://harbor-clair.svc.cluster.local:6060"
            - name: CLAIR_DB_SSLMODE
              value: "disable"
            - name: SYNC_REGISTRY
              value: "true"
          ports:
            - containerPort: 8080
          volumeMounts:
            - name: harbor-certs
              mountPath: /ssl/
            - name: harbor-config
              mountPath: /etc/ui/config
      imagePullSecrets:
        - name: portus-pull-secret
      volumes:
        - name: harbor-config
          secret:
            secretName: harbor-config
        - name: harbor-certs
          secret:
            secretName: harbor-certs

---
kind: Service
apiVersion: v1
metadata:
  name: "harbor-adminserver"
  namespace: ournamespace
  labels:
    name: "harbor-adminserver"
    dns_zone: "{{ dns_zone }}"
spec:
  ports:
    - name: http
      port: 8080
      protocol: TCP
  type: NodePort
  selector:
    name: "harbor-adminserver"
    sha: "{{ docker_version[0:7] }}"

---

kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: "harbor-adminserver-{{ docker_version[0:7] }}"
  namespace: ournamespace
  labels: 
    app: harbor-adminserver
    sha: "{{ docker_version[0:7] }}"
spec:
  replicas: 1
  template:
    metadata:
      labels:
        name: "harbor-adminserver"
        sha: "{{ docker_version[0:7] }}"
    spec:
      containers:
        - name: "harbor-adminserver"
          image: "ourreg/harbor-adminserver:{{ docker_version }}"
          env:
            - name: secretKey
              valueFrom:
                  secretKeyRef:
                    name: harbor-config
                    key: harbor-secretKey
            - name: EMAIL_PWD
              valueFrom:
                  secretKeyRef:
                    name: harbor-config
                    key: harbor-email-pwd
            - name: HARBOR_ADMIN_PASSWORD
              valueFrom:
                  secretKeyRef:
                    name: harbor-config
                    key: harbor-admin-password
            - name: JOBSERVICE_SECRET
              valueFrom:
                  secretKeyRef:
                    name: harbor-config
                    key: harbor-jobservice-secret
            - name: UI_SECRET
              valueFrom:
                  secretKeyRef:
                    name: harbor-config
                    key: harbor-ui-secret
            - name: POSTGRESQL_HOST
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-pgsql-host
            - name: POSTGRESQL_PASSWORD
              valueFrom:
                  secretKeyRef:
                    name: harbor-config
                    key: harbor-pgsql-password
            - name: POSTGRESQL_SSLMODE
              value: "disable"
            - name: POSTGRESQL_PORT
              value: "5432"
            - name: POSTGRESQL_USERNAME
              value: "harbor"
            - name: POSTGRESQL_DATABASE
              value: "harbor"
            - name: EMAIL_HOST
              value: "ourmailserver"
            - name: EMAIL_PORT
              value: "587"
            - name: EMAIL_USR
              value: "ouruser"
            - name: EMAIL_SSL
              value: "true"
            - name: EMAIL_FROM
              value: "[email protected]"
            - name: EMAIL_INSECURE
              value: "false"
            - name: EXT_ENDPOINT
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: https-harbor-dns-value
            - name: UI_URL
              value: "http://harbor-ui.svc.cluster.local:8080"
            - name: JOBSERVICE_URL
              value: "http://harbor-jobservice.svc.cluster.local:8080"
            - name: REGISTRY_URL
              value: "http://harbor-registry.svc.cluster.local:5000"
            - name: TOKEN_SERVICE_URL
              value: "http://harbor-ui.svc.cluster.local:8080/service/token"
            - name: WITH_NOTARY
              value: "false"
            - name: NOTARY_URL
              value: "http://notary-server.svc.cluster.local:4443"
            - name: LOG_LEVEL
              value: "info"
            - name: IMAGE_STORE_PATH
              value: "/" # This is a temporary hack.
            - name: AUTH_MODE
              value: "ldap_auth"
            - name: SELF_REGISTRATION 
              value: "on"
            - name: LDAP_URL
              value: "ldaps://ourldapserver"
            - name: LDAP_SEARCH_DN
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: "harbor-ldap-search-dn"
            - name: LDAP_SEARCH_PWD
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-ldap-search-pwd
            - name: LDAP_BASE_DN
              value: "ourbasedn"
            - name: LDAP_FILTER 
              value: ""
            - name: LDAP_UID
              value: "cn"
            - name: LDAP_SCOPE
              value: "2"
            - name: LDAP_TIMEOUT
              value: "5"
            - name: LDAP_VERIFY_CERT
              value: "false"
            - name: DATABASE_TYPE
              value: "postgresql"
            - name: PROJECT_CREATION_RESTRICTION
              value: "everyone"
            - name: VERIFY_REMOTE_CERT
              value: "off"
            - name: MAX_JOB_WORKERS
              value: "3"
            - name: TOKEN_EXPIRATION
              value: "30"
            - name: CFG_EXPIRATION
              value: "5"
            - name: GODEBUG
              value: "netdns=cgo"
            - name: ADMIRAL_URL
              value: "NA"
            - name: RESET 
              value: "false"
            - name: WITH_CLAIR
              value: "true"
            - name: CLAIR_DB_HOST
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-clair-pgsql-host
            - name: CLAIR_DB_PORT
              value:  "5432"
            - name: CLAIR_DB_USERNAME
              value: "harborclair"
            - name: CLAIR_DB_PASSWORD
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: harbor-clair-db-password
            - name: CLAIR_DB
              value: "harborclair"
            - name: CLAIR_URL
              value: "http://harbor-clair.svc.cluster.local:6060"
            - name: CLAIR_DB_SSLMODE
              value: "disable"
            - name: REGISTRY_STORAGE_PROVIDER_NAME
              value: "s3"
            - name: WITH_CHARTMUSEUM
              value: "true"
            - name: CHART_REPOSITORY_URL
              valueFrom:
                secretKeyRef:
                  name: harbor-config
                  key: chartmuseum-dns-value
            - name: PORT
              value: "8080"
            - name: JSON_CFG_STORE_PATH
              value: /etc/adminserver/config/config.json
            - name: KEY_PATH
              value: /etc/adminserver/secrets/harbor-secretKey
          ports:
            - containerPort: 8080
          volumeMounts:
          - name: harbor-certs
            mountPath: /ssl/
          - name: harbor-config
            mountPath: /etc/adminserver/secrets
      imagePullSecrets:
        - name: portus-pull-secret
      volumes:
        - name: harbor-config
          secret:
            secretName: harbor-config
        - name: harbor-certs
          secret:
            secretName: harbor-certs

# this is necessary for us to be able to disable request buffering in all cases
proxy_http_version 1.1;

upstream ui {
  server harbor-ui.svc.cluster.local:8080;
}

upstream registry {
  least_conn;
  server harbor-registry.svc.cluster.local:5000;
}

log_format timed_combined '$remote_addr - '
  '"$request" $status $body_bytes_sent '
  '"$http_referer" "$http_user_agent" '
  '$request_time $upstream_response_time $pipe';
access_log /dev/stdout timed_combined;

server {
  listen 443 ssl;
  server_name HARBOR_DNS_VALUE;
  server_tokens off;
  # SSL
  ssl_certificate /etc/ssl/harbornginx/harbor.crt;
  ssl_certificate_key /etc/ssl/harbornginx/harbor.key;

  # Recommendations from https://raymii.org/s/tutorials/Strong_SSL_Security_On_nginx.html
  ssl_protocols TLSv1.1 TLSv1.2;
  ssl_ciphers '!aNULL:kECDH+AESGCM:ECDH+AESGCM:RSA+AESGCM:kECDH+AES:ECDH+AES:RSA+AES:';
  ssl_prefer_server_ciphers on;
  ssl_session_cache shared:SSL:10m;

  # disable any limits to avoid HTTP 413 for large image uploads
  client_max_body_size 0;

  # required to avoid HTTP 411: see Issue #1486 (https://github.com/docker/docker/issues/1486)
  chunked_transfer_encoding on;
  location / {
    proxy_pass http://ui/;
    proxy_set_header X-Forwarded-Ssl on;
    proxy_set_header Host               $http_host;   # required for docker client's sake
    proxy_set_header X-Real-IP          $remote_addr; # pass on real client's IP
    proxy_set_header X-Forwarded-For    $proxy_add_x_forwarded_for;
    proxy_set_header X-Forwarded-Proto  https;

    # Add Secure flag when serving HTTPS
    proxy_cookie_path / "/; secure";
    proxy_read_timeout                  900;
    proxy_buffering                     on;
  }

  location /api/ {
    proxy_pass http://ui/api/;
    proxy_set_header                X-Forwarded-Ssl     on;
    proxy_set_header Host               $http_host;   # required for docker client's sake
    proxy_set_header X-Real-IP          $remote_addr; # pass on real client's IP
    proxy_set_header X-Forwarded-For    $proxy_add_x_forwarded_for;
    proxy_set_header X-Forwarded-Proto  https;
    proxy_read_timeout                  900;
    proxy_buffering                     on;
  }
  location ~ ^/(login|log_out|sendEmail|language|reset|userExists|reset_password|chartrepo) {
    proxy_pass http://ui;
    proxy_set_header                X-Forwarded-Ssl     on;
    proxy_set_header Host               $http_host;   # required for docker client's sake
    proxy_set_header X-Real-IP          $remote_addr; # pass on real client's IP
    proxy_set_header X-Forwarded-For    $proxy_add_x_forwarded_for;
    proxy_set_header X-Forwarded-Proto  https;
    proxy_read_timeout                  900;
    proxy_buffering                     on;
  }
  location /v1/ {
    return 404;
  }
  location /v2/ {
    proxy_pass http://registry/;
    proxy_set_header Host               $http_host;   # required for docker client's sake
    proxy_set_header X-Real-IP          $remote_addr; # pass on real client's IP
    proxy_set_header X-Forwarded-For    $proxy_add_x_forwarded_for;
    proxy_set_header X-Forwarded-Proto  https;
    proxy_read_timeout                  900;
    proxy_buffering                     on;
    proxy_redirect  http://registry/v2/ https://HARBOR_DNS_VALUE/v2/;
          
  }

  location /service/ {
    proxy_pass http://ui/service/;
    proxy_set_header                X-Forwarded-Ssl     on;
    proxy_set_header Host               $http_host;   # required for docker client's sake
    proxy_set_header X-Real-IP          $remote_addr; # pass on real client's IP
    proxy_set_header X-Forwarded-For    $proxy_add_x_forwarded_for;
    proxy_set_header X-Forwarded-Proto  https;
    proxy_read_timeout                  900;
    proxy_buffering                     on;
  }		
  location /service/notifications {
    return 404;
  }
}
  server {
    listen 80;
    server_name HARBOR_DNS_VALUE;
    return 301 https://$host$request_uri;
} 

[root@k8s-master01 harbor-helm]# helm install --name harbor-v1 .  --wait --timeout 1500 --debug --namespace kube-system
[debug] Created tunnel using local port: '32771'

[debug] SERVER: "127.0.0.1:32771"

[debug] Original chart version: ""
[debug] CHART PATH: /root/harbor-helm

E1116 02:07:15.077032   22003 portforward.go:178] lost connection to pod
Error: transport is closing

[root@k8s-master01 harbor-helm]# helm version
Client: &version.Version{SemVer:"v2.11.0", GitCommit:"2e55dbe1fdb5fdb96b75ff144a339489417b146b", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.11.0", GitCommit:"2e55dbe1fdb5fdb96b75ff144a339489417b146b", GitTreeState:"clean"}

2018-09-10T12:48:01Z [DEBUG] [init.go:37]: topic StartReplication is subscribed
2018-09-10T12:48:01Z [DEBUG] [init.go:37]: topic OnPush is subscribed
2018-09-10T12:48:01Z [DEBUG] [init.go:37]: topic OnDeletion is subscribed
2018-09-10T12:48:01Z [DEBUG] [authenticator.go:126]: Registered authencation helper for auth mode: db_auth
2018-09-10T12:48:01Z [DEBUG] [authenticator.go:126]: Registered authencation helper for auth mode: ldap_auth
2018-09-10T12:48:01Z [DEBUG] [authenticator.go:126]: Registered authencation helper for auth mode: uaa_auth
2018-09-10T12:48:01Z [INFO] Config path: /etc/ui/app.conf
2018-09-10T12:48:01Z [INFO] initializing configurations...
2018-09-10T12:48:01Z [INFO] key path: /etc/ui/key
2018-09-10T12:48:01Z [INFO] initializing client for adminserver http://harbor-harbor-adminserver ...
2018-09-10T12:48:01Z [INFO] initializing the project manager based on local database...
2018-09-10T12:48:01Z [INFO] configurations initialization completed
2018-09-10T12:48:01Z [INFO] Registering database: type-PostgreSQL host-172.30.124.16 port-5432 databse-registry sslmode-"disable"
2018-09-10T12:48:01Z [INFO] Register database completed
2018-09-10T12:48:01Z [INFO] User id: 1 already has its encrypted password.
2018-09-10T12:48:01Z [INFO] Enable redis cache for chart caching
2018-09-10T12:48:01Z [DEBUG] [chart_repository.go:435]: Chart storage server is set to http://harbor-harbor-chartmuseum
2018-09-10T12:48:01Z [INFO] API controller for chart repository server is successfully initialized
2018-09-10T12:48:01Z [INFO] Policy scheduler start at 2018-09-10T12:48:01Z
2018-09-10T12:48:01Z [INFO] initialized clair database
2018-09-10T12:48:01Z [INFO] Handle notification with topic 'scan_all_policy': notifier.ScanPolicyNotification{Type:"daily", DailyTime:0}
2018-09-10T12:48:01Z [INFO] Policy Alternate Policy is scheduled
2018-09-10T12:48:01Z [INFO] Policies:1, Tasks:0, CompletedTasks:0, FailedTasks:0
2018-09-10T12:48:01Z [INFO] Waiting for -46080 seconds after comparing offset 0 and utc time 46080
2018-09-10T12:48:01Z [ERROR] [main.go:162]: Failed to parse SYNC_REGISTRY: strconv.ParseBool: parsing "": invalid syntax
2018-09-10T12:48:01Z [INFO] Because SYNC_REGISTRY set false , no need to sync registry
2018-09-10T12:48:01Z [INFO] Init proxy
2018/09/10 12:48:01 [I] [asm_amd64.s:2337] http server Running on http://:8080

2018-09-10T12:47:32Z [INFO] initializing system configurations...
2018-09-10T12:47:32Z [INFO] Registering database: type-PostgreSQL host-172.30.124.16 port-5432 databse-registry sslmode-"disable"
2018-09-10T12:47:32Z [INFO] Register database completed
2018-09-10T12:47:32Z [INFO] Upgrading schema for pgsql ...
2018-09-10T12:47:34Z [INFO] the path of json configuration storage: /etc/adminserver/config/config.json
2018-09-10T12:47:34Z [INFO] the path of key used by key provider: /etc/adminserver/key
2018-09-10T12:47:34Z [INFO] system initialization completed
10.131.0.1 - - [10/Sep/2018:12:47:37 +0000] "GET /api/configurations HTTP/1.1" 200 1764
10.131.0.1 - - [10/Sep/2018:12:47:43 +0000] "GET /api/configurations HTTP/1.1" 200 1764
10.131.0.1 - - [10/Sep/2018:12:47:44 +0000] "GET /api/configurations HTTP/1.1" 200 1764
10.131.0.1 - - [10/Sep/2018:12:48:01 +0000] "GET /api/configurations HTTP/1.1" 200 1764
10.131.0.1 - - [10/Sep/2018:12:49:22 +0000] "GET /api/configurations HTTP/1.1" 200 1764
10.131.0.1 - - [10/Sep/2018:12:50:09 +0000] "GET /api/configurations HTTP/1.1" 200 1764

time="2018-09-10T12:47:35.983596138Z" level=info msg="debug server listening localhost:5001"
time="2018-09-10T12:47:35.985067135Z" level=info msg="configuring endpoint harbor (http://harbor-harbor-ui/service/notifications), timeout=3s, headers=map[]" go.version=go1.7.3 instance.id=1e597611-7150-4d0f-9225-cf91c8a8e804 service=registry version=v2.6.2
time="2018-09-10T12:47:36.037144366Z" level=info msg="using redis blob descriptor cache" go.version=go1.7.3 instance.id=1e597611-7150-4d0f-9225-cf91c8a8e804 service=registry version=v2.6.2
time="2018-09-10T12:47:36.037733838Z" level=info msg="listening on [::]:5000" go.version=go1.7.3 instance.id=1e597611-7150-4d0f-9225-cf91c8a8e804 service=registry version=v2.6.2

2018-11-16T15:57:24Z [FATAL] [service_logger.go:73]: Failed to load and run worker pool: connect to redis server timeout: dial tcp 10.96.137.238:0: i/o timeout

[root@k8s-master01 harbor-helm]# kubectl get pod -n harbor
NAME                                              READY     STATUS             RESTARTS   AGE
harbor-v1-harbor-adminserver-5b59c684b4-rwgvs     1/1       Running            2          17m
harbor-v1-harbor-chartmuseum-699cf6599-4bb5p      1/1       Running            0          17m
harbor-v1-harbor-clair-6d9bb84485-c829n           1/1       Running            2          17m
harbor-v1-harbor-database-0                       1/1       Running            0          17m
harbor-v1-harbor-jobservice-5c9496775d-8nfkp      0/1       CrashLoopBackOff   6          17m
harbor-v1-harbor-notary-server-5fb65b6866-6scfj   1/1       Running            0          17m
harbor-v1-harbor-notary-signer-5bfcfcd5cf-clslv   1/1       Running            0          17m
harbor-v1-harbor-registry-75c9b6b457-rzdd5        1/1       Running            0          17m
harbor-v1-harbor-ui-5974bd5549-kvcjk              1/1       Running            5          17m
harbor-v1-redis-84dffd8574-l6swk                  1/1       Running            0          17m

host:port,pool_size,password
100 is the default value of pool size
*/}}
{{- define "harbor.redisForUI" -}}
  {{- template "harbor.redis.host" . }}:{{ template "harbor.redis.port" . }},100,{{ template "harbor.redis.password" . }}
{{- end -}}

{{- define "harbor.redis.host" -}}
  {{- if .Values.redis.external.enabled -}}
    {{- .Values.redis.external.host -}}
  {{- else -}}
    {{- .Release.Name }}-redis-master
  {{- end -}}
{{- end -}}

{{- define "harbor.redis.port" -}}
  {{- if .Values.redis.external.enabled -}}
    {{- .Values.redis.external.port -}}
  {{- else -}}
    {{- .Values.redis.master.port }}
  {{- end -}}
{{- end -}}

redis:
  # if external Redis is used, set "external.enabled" to "true"
  # and fill the connection informations in "external" section.
  # or the internal Redis will be used
  usePassword: false
  password: "changeit"
  cluster:
    enabled: false
  master:
    persistence:
      enabled: *persistence_enabled
      storageClass: "gluster-heketi"
      accessMode: ReadWriteOnce
      size: 1Gi
  persistence:
    # existingClaim:

redis:
  # if external Redis is used, set "external.enabled" to "true"
  # and fill the connection informations in "external" section.
  # or the internal Redis will be used
  usePassword: false
  password: "changeit"
  cluster:
    enabled: false
  master:
    port: 6379
    persistence:
      enabled: *persistence_enabled
      storageClass: "gluster-heketi"
      accessMode: ReadWriteOnce
      size: 1Gi
  persistence:
    # existingClaim:

[root@k8s-master01 harbor-helm]# helm del --purge harbor-v1
[root@k8s-master01 harbor-helm]# helm install --name harbor-v1 .   --wait --timeout 1500 --debug --namespace harbor

2018-10-23T07:41:04Z [INFO] the readonly request has been sent successfully
2018-10-23T07:41:04Z [INFO] start to run gc in job.
2018-10-23T07:41:04Z [ERROR] [job_logger.go:82]: failed to connect to redis invalid redis URL scheme: 
2018-10-23T07:41:04Z [INFO] the readonly request has been sent successfully

2018-10-16T22:56:19Z [INFO] initializing system configurations...
2018-10-16T22:56:19Z [FATAL] [main.go:46]: failed to initialize the system: pq: no pg_hba.conf entry for host "<ip address>", user "<username>", database "<core_database>", SSL off

[root@master harbor-helm]# kubectl -n harbor-dev get pvc
NAME                                         STATUS    VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE
data-harbor-dev-harbor-redis-0               Bound     pvc-29181d68-e3cb-11e8-86c1-fa163eb28327   1Gi        RWO            rbd            12m
database-data-harbor-dev-harbor-database-0   Bound     pvc-290d3930-e3cb-11e8-86c1-fa163eb28327   1Gi        RWO            rbd            12m
harbor-dev-harbor-chartmuseum                Bound     pvc-289b297a-e3cb-11e8-86c1-fa163eb28327   5Gi        RWO            rbd            12m
harbor-dev-harbor-jobservice                 Bound     pvc-289d7b74-e3cb-11e8-86c1-fa163eb28327   1Gi        RWO            rbd            12m
harbor-dev-harbor-registry                   Bound     pvc-289ef921-e3cb-11e8-86c1-fa163eb28327   50Gi       RWO            rbd            12m
[root@master harbor-helm]# kubectl -n harbor-dev get po 
NAME                                               READY     STATUS             RESTARTS   AGE
harbor-dev-harbor-adminserver-5f5bb8479-gtk6c      1/1       Running            3          12m
harbor-dev-harbor-chartmuseum-7865bbfc46-fkblk     1/1       Running            0          12m
harbor-dev-harbor-clair-568d6cc674-7dtsb           1/1       Running            2          12m
harbor-dev-harbor-core-6d6d659975-92gzp            1/1       Running            3          12m
harbor-dev-harbor-database-0                       1/1       Running            0          12m
harbor-dev-harbor-jobservice-845c69c5c-s5lcw       0/1       CrashLoopBackOff   6          12m
harbor-dev-harbor-notary-server-668cc9b786-khdkn   1/1       Running            0          12m
harbor-dev-harbor-notary-signer-657f4cbfdd-mnkhg   1/1       Running            0          12m
harbor-dev-harbor-portal-67c958994c-hr2ls          1/1       Running            0          12m
harbor-dev-harbor-redis-0                          1/1       Running            0          12m
harbor-dev-harbor-registry-68b5c6c88f-sfzmm        2/2       Running            0          12m

[root@master harbor-helm]# kubectl -n harbor-dev logs -f harbor-dev-harbor-jobservice-845c69c5c-s5lcw
panic: load configurations error: missing logger config of job service


goroutine 1 [running]:
main.main()
	/go/src/github.com/goharbor/harbor/src/jobservice/main.go:41 +0x265

kubectl -n registry get po
NAME                                             READY     STATUS                       RESTARTS   AGE
registry-harbor-adminserver-56bdf58596-lv95s     0/1       CreateContainerConfigError   0          13m
registry-harbor-chartmuseum-56f6dbbfd8-jmmt7     1/1       Running                      0          13m
registry-harbor-clair-5c89b85f5f-2r92l           0/1       CreateContainerConfigError   0          13m
registry-harbor-database-0                       1/1       Running                      0          13m
registry-harbor-jobservice-6685ff9f44-5rzgq      0/1       CreateContainerConfigError   0          13m
registry-harbor-notary-server-6499cfb799-6lm8c   0/1       CreateContainerConfigError   0          13m
registry-harbor-notary-signer-68b48c78bf-dkxxv   1/1       Running                      0          13m
registry-harbor-registry-65b8458c75-w9s4t        0/1       CreateContainerConfigError   0          13m
registry-harbor-ui-7d8f58b85d-fqq5w              0/1       CreateContainerConfigError   0          13m
registry-redis-master-0                          1/1       Running                      0          13m

Events:
  Type     Reason                 Age                 From                        Message
  ----     ------                 ----                ----                        -------
  Normal   Scheduled              16m                 default-scheduler           Successfully assigned registry-harbor-clair-5c89b85f5f-2r92l to node1
  Normal   SuccessfulMountVolume  12m                 kubelet, node1  MountVolume.SetUp succeeded for volume "clair-config"
  Normal   SuccessfulMountVolume  12m                 kubelet, node1  MountVolume.SetUp succeeded for volume "default-token-xvtr2"
  Warning  Failed                 10m (x11 over 12m)  kubelet, node1  Error: failed to prepare subPath for volumeMount "clair-config" of container "clair"
  Normal   Pulled                 7m (x25 over 12m)   kubelet, node1  Container image "goharbor/clair-photon:dev" already present on machine

# helm upgrade harbor --set externalURL=https://harbor.172.50.0.29.nip.io --set ingress.hosts.core=harbor.172.50.0.29.nip.io --set ingress.hosts.notary=notary.172.50.0.29.nip.io --namespace=harbor .
Error: UPGRADE FAILED: StatefulSet.apps "harbor-redis-master" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', and 'updateStrategy' are forbidden. && StatefulSet.apps "harbor-harbor-database" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', and 'updateStrategy' are forbidden.

unsupported backend: local"

STORAGE: local"

STORAGE: local

   当我部署完Harbor之后，因为我修改了harbor-ui的服务的spec.type为NodePort，
   所以我可以通过hostIP+port的方式在浏览器里访问harbor-ui。
   但是当我想登录registry时，遇到了一个错误，
    我在命令行执行：“docker login core.harbor.domain”时，
     报错“Error response from daemon: Get https://core.harbor.domain/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)”。
 这里我需要怎么来配置我的harbor服务来让我可以通过命令行来登录它，并且上传我的镜像呢？