balena-os / balenaos-in-container Goto Github PK

View Code? Open in Web Editor NEW

48.0 10.0 14.0 165 KB

Run balenaOS as a docker container

Home Page: https://www.balena.io/os/

License: Apache License 2.0

Shell 100.00%

docker resinos containers containerization resin

balenaos-in-container's Introduction

balenaOS in a docker container

This is a tool which enables running balenaOS docker images as a docker container.

Prerequisites

Before running this tool make sure:

Docker daemon is running
Current user has privileges to run docker commands.
Depending on what balenaOS image you are trying to boot, you might need aufs or overlayfs on your host.
The balenaOS image is compatible with the architecture where you are running the script. e.g. If you are running this script on your laptop (x86_64), you can run balenaOS images built for the NUC which are also x86_64. ***
balenaos-in-container does not support cgroups v2 yet. Check the version of cgroups of your machine. Guides for Linux users, and Docker Desktop on Mac users. Downgrade your cgroups to v1 if you want to use balenaos-in-container.

How to use

docker-compose up --build

This assumes you have a config.json in the project directory. It can be downloaded from your balenaCloud dashboard. Once you have added an application click "Add a new device", click to expand the "Advanced" section and check "Download configuration file only" now click "Download configuration file".

You can find the latest balenaOS images on dockerhub.

If you need to clear volumes and start with a clean state, use the following compose commands:

# bring down all services and remove volumes
docker-compose down --volumes --remove-orphans

# build and bring up services again with new volumes
docker-compose up -d --build

Running other architectures

It's possible to run a container images that target other platforms than your host system by registering QEMU's user-mode emulation. Check out https://github.com/dbhi/qus/#setup for how to set that up.

Development

Want to contribute? Great! Throw pull requests at us.

balenaos-in-container's People

Contributors

Stargazers

Watchers

Forkers

chrischabot wngr garretfick xevoinc yveszb38 fehlerquelle glimpsewearables vutting4221 peakydicers dayson7 harandk abirchebbi s5-chris dial0ut

balenaos-in-container's Issues

`AUTH_FAILED` problem during initial device provisioning

I have an AWS EC2 instance running balenaos-in-container release 2.68.1. I need to run a separate BalenaOS instance in the same host. The Docker container starts up fine. However, it never gets registered with Balena.

If I docker exec -ti <container> bash and run journalctl --follow I get the following messages over and over again:

Jul 20 15:01:09 6621a1e 629ea5729bfc[231]: [event]   Event: Device bootstrap {}
Jul 20 15:01:09 6621a1e resin-supervisor[718]: [event]   Event: Device bootstrap {}
Jul 20 15:01:09 6621a1e 629ea5729bfc[231]: [error]   Unable to get architecture: Error: ENOENT: no such file or directory, open '/mnt/root/mnt/boot/device-type.json'
Jul 20 15:01:09 6621a1e 629ea5729bfc[231]: [error]   Unable to get device type: Error: ENOENT: no such file or directory, open '/mnt/root/mnt/boot/device-type.json'
Jul 20 15:01:09 6621a1e 629ea5729bfc[231]: [info]    New device detected. Provisioning...
Jul 20 15:01:09 6621a1e resin-supervisor[718]: [error]   Unable to get architecture: Error: ENOENT: no such file or directory, open '/mnt/root/mnt/boot/device-type.json'
Jul 20 15:01:09 6621a1e resin-supervisor[718]: [error]   Unable to get device type: Error: ENOENT: no such file or directory, open '/mnt/root/mnt/boot/device-type.json'
Jul 20 15:01:09 6621a1e resin-supervisor[718]: [info]    New device detected. Provisioning...
Jul 20 15:01:09 6621a1e 629ea5729bfc[231]: [event]   Event: Device bootstrap failed, retrying {"delay":30000,"error":{"message":""}}
Jul 20 15:01:09 6621a1e resin-supervisor[718]: [event]   Event: Device bootstrap failed, retrying {"delay":30000,"error":{"message":""}}
Jul 20 15:01:18 6621a1e prepare-openvpn[1447]: prepare-openvpn: [INFO] Balena.io VPN authentication.
Jul 20 15:01:18 6621a1e openvpn[1463]: Tue Jul 20 15:01:18 2021 WARNING: file '/var/volatile/vpn-auth' is group or others accessible
Jul 20 15:01:18 6621a1e openvpn[1463]: Tue Jul 20 15:01:18 2021 OpenVPN 2.4.7 x86_64-poky-linux-gnu [SSL (OpenSSL)] [LZO] [LZ4] [EPOLL] [MH/PKTINFO] [AEAD] built on Feb 20 2019
Jul 20 15:01:18 6621a1e openvpn[1463]: Tue Jul 20 15:01:18 2021 library versions: OpenSSL 1.1.1i  8 Dec 2020, LZO 2.10
Jul 20 15:01:18 6621a1e openvpn[1463]: Tue Jul 20 15:01:18 2021 NOTE: the current --script-security setting may allow this configuration to call user-defined scripts
Jul 20 15:01:18 6621a1e openvpn[1463]: Tue Jul 20 15:01:18 2021 TCP/UDP: Preserving recently used remote address: [AF_INET]35.169.89.252:443
Jul 20 15:01:18 6621a1e openvpn[1463]: Tue Jul 20 15:01:18 2021 Socket Buffers: R=[131072->131072] S=[16384->16384]
Jul 20 15:01:18 6621a1e openvpn[1463]: Tue Jul 20 15:01:18 2021 Attempting to establish TCP connection with [AF_INET]35.169.89.252:443 [nonblock]
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 TCP connection established with [AF_INET]35.169.89.252:443
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 TCP_CLIENT link local: (not bound)
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 TCP_CLIENT link remote: [AF_INET]35.169.89.252:443
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 NOTE: UID/GID downgrade will be delayed because of --client, --pull, or --up-delay
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 TLS: Initial packet from [AF_INET]35.169.89.252:443, sid=1c6e9942 77953491
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 WARNING: this configuration may cache passwords in memory -- use the auth-nocache option to prevent this
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 VERIFY OK: depth=1, C=AU, ST=Some-State, O=Internet Widgits Pty Ltd
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 VERIFY KU OK
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 Validating certificate extended key usage
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 ++ Certificate has EKU (str) TLS Web Server Authentication, expects TLS Web Server Authentication
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 VERIFY EKU OK
Jul 20 15:01:19 6621a1e openvpn[1463]: Tue Jul 20 15:01:19 2021 VERIFY OK: depth=0, C=US, ST=WA, O=balena.io, OU=balenaCloud, CN=vpn.balena-cloud.com
Jul 20 15:01:21 6621a1e openvpn[1463]: Tue Jul 20 15:01:21 2021 Control Channel: TLSv1.3, cipher TLSv1.3 TLS_AES_256_GCM_SHA384, 2048 bit RSA
Jul 20 15:01:21 6621a1e openvpn[1463]: Tue Jul 20 15:01:21 2021 [vpn.balena-cloud.com] Peer Connection Initiated with [AF_INET]35.169.89.252:443
Jul 20 15:01:22 6621a1e openvpn[1463]: Tue Jul 20 15:01:22 2021 SENT CONTROL [vpn.balena-cloud.com]: 'PUSH_REQUEST' (status=1)
Jul 20 15:01:22 6621a1e openvpn[1463]: Tue Jul 20 15:01:22 2021 AUTH: Received control message: AUTH_FAILED
Jul 20 15:01:22 6621a1e openvpn[1463]: Tue Jul 20 15:01:22 2021 SIGTERM[soft,auth-failure] received, process exiting
Jul 20 15:01:32 6621a1e prepare-openvpn[1480]: prepare-openvpn: [INFO] Balena.io VPN authentication.
Jul 20 15:01:32 6621a1e openvpn[1503]: Tue Jul 20 15:01:32 2021 WARNING: file '/var/volatile/vpn-auth' is group or others accessible
Jul 20 15:01:32 6621a1e openvpn[1503]: Tue Jul 20 15:01:32 2021 OpenVPN 2.4.7 x86_64-poky-linux-gnu [SSL (OpenSSL)] [LZO] [LZ4] [EPOLL] [MH/PKTINFO] [AEAD] built on Feb 20 2019
Jul 20 15:01:32 6621a1e openvpn[1503]: Tue Jul 20 15:01:32 2021 library versions: OpenSSL 1.1.1i  8 Dec 2020, LZO 2.10
Jul 20 15:01:32 6621a1e openvpn[1503]: Tue Jul 20 15:01:32 2021 NOTE: the current --script-security setting may allow this configuration to call user-defined scripts
Jul 20 15:01:32 6621a1e openvpn[1503]: Tue Jul 20 15:01:32 2021 TCP/UDP: Preserving recently used remote address: [AF_INET]3.227.28.93:443
Jul 20 15:01:32 6621a1e openvpn[1503]: Tue Jul 20 15:01:32 2021 Socket Buffers: R=[131072->131072] S=[16384->16384]
Jul 20 15:01:32 6621a1e openvpn[1503]: Tue Jul 20 15:01:32 2021 Attempting to establish TCP connection with [AF_INET]3.227.28.93:443 [nonblock]
Jul 20 15:01:33 6621a1e openvpn[1503]: Tue Jul 20 15:01:33 2021 TCP connection established with [AF_INET]3.227.28.93:443
Jul 20 15:01:33 6621a1e openvpn[1503]: Tue Jul 20 15:01:33 2021 TCP_CLIENT link local: (not bound)
Jul 20 15:01:33 6621a1e openvpn[1503]: Tue Jul 20 15:01:33 2021 TCP_CLIENT link remote: [AF_INET]3.227.28.93:443
Jul 20 15:01:33 6621a1e openvpn[1503]: Tue Jul 20 15:01:33 2021 NOTE: UID/GID downgrade will be delayed because of --client, --pull, or --up-delay
Jul 20 15:01:35 6621a1e openvpn[1503]: Tue Jul 20 15:01:35 2021 TLS: Initial packet from [AF_INET]3.227.28.93:443, sid=65da59c0 302d7b29
Jul 20 15:01:35 6621a1e openvpn[1503]: Tue Jul 20 15:01:35 2021 WARNING: this configuration may cache passwords in memory -- use the auth-nocache option to prevent this
Jul 20 15:01:35 6621a1e openvpn[1503]: Tue Jul 20 15:01:35 2021 VERIFY OK: depth=1, C=AU, ST=Some-State, O=Internet Widgits Pty Ltd
Jul 20 15:01:35 6621a1e openvpn[1503]: Tue Jul 20 15:01:35 2021 VERIFY KU OK
Jul 20 15:01:35 6621a1e openvpn[1503]: Tue Jul 20 15:01:35 2021 Validating certificate extended key usage
Jul 20 15:01:35 6621a1e openvpn[1503]: Tue Jul 20 15:01:35 2021 ++ Certificate has EKU (str) TLS Web Server Authentication, expects TLS Web Server Authentication
Jul 20 15:01:35 6621a1e openvpn[1503]: Tue Jul 20 15:01:35 2021 VERIFY EKU OK
Jul 20 15:01:35 6621a1e openvpn[1503]: Tue Jul 20 15:01:35 2021 VERIFY OK: depth=0, C=US, ST=WA, O=balena.io, OU=balenaCloud, CN=vpn.balena-cloud.com
Jul 20 15:01:35 6621a1e openvpn[1503]: Tue Jul 20 15:01:35 2021 Control Channel: TLSv1.3, cipher TLSv1.3 TLS_AES_256_GCM_SHA384, 2048 bit RSA
Jul 20 15:01:35 6621a1e openvpn[1503]: Tue Jul 20 15:01:35 2021 [vpn.balena-cloud.com] Peer Connection Initiated with [AF_INET]3.227.28.93:443
Jul 20 15:01:37 6621a1e openvpn[1503]: Tue Jul 20 15:01:37 2021 SENT CONTROL [vpn.balena-cloud.com]: 'PUSH_REQUEST' (status=1)
Jul 20 15:01:37 6621a1e openvpn[1503]: Tue Jul 20 15:01:37 2021 AUTH: Received control message: AUTH_FAILED
Jul 20 15:01:37 6621a1e openvpn[1503]: Tue Jul 20 15:01:37 2021 SIGTERM[soft,auth-failure] received, process exiting

I thought that it might be something to do with the config.json file so I downloaded a new one, but it still does not work.

Broadband gets disconnected once the balena container starts

I have Ubuntu 18.04 running on a system with Intel atom processor. It has 4G (Sierra Wireless) built-in and it connects fine. But the moment I start the balena-os-in-container (resin/resinos:2.50.1_rev1.dev-intel-nuc), the 4G gets disconnected and it does not connect again until I reboot the machine. Is there something that needs to be done to prevent this?

The content of the config file is as follows: (masked the ids)

{"applicationId":xxx,"deviceType":"intel-nuc","userId":xxx,"appUpdatePollInterval":600000,"listenPort":48484,"vpnPort":443,"apiEndpoint":"https://api.balena-cloud.com","vpnEndpoint":"vpn.balena-cloud.com","registryEndpoint":"registry2.balena-cloud.com","deltaEndpoint":"https://delta.balena-cloud.com","mixpanelToken":"xxx","apiKey":"xxx"}

Dependency Dashboard

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

This repository currently has no open or pending branches.

Detected dependencies

docker-compose

docker-compose.yml

dockerfile

Dockerfile.template

github-actions

.github/workflows/flowzone.yml

product-os/flowzone master

openBalena support

Hello,

Is there anyway to get this working with openBalena? When the container starts up, it never connects to the openBalena server. I see in /var/local/config.json that my correct endpoints are set, but I see in the balena-supervisor journal

Aug 26 20:38:47 16a1ecb balena-supervisor[32673]: Error: No such object: registry2.balena-cloud.com

Thanks.

Create a ResinOS Docker image

HI!
I don't understand how to create the Docker image starting from the resinOS image downloaded from the website. I have tried with "docker import", including the .img file in a tar.gz archive, but doesn't work.

Thank you!

[Question] balenos-in-container without balenaCloud

Is it possible to exploit this project without having a balenaCloud account and using only the open-balena?

if yes, is it possible to use a config.json from another device?

Thanks

Move to balenaOS v3+?

This project currently pulls down https://hub.docker.com/r/resin/resinos version 2.95.12+rev1. The last x86 resinOS published to Docker Hub was 2.99.27_rev2-genericx86-64-ext - over a year ago.

resinOS was renamed to balenaOS almost 5 years ago.

Since there is no balenaOS containers published to docker hub, the balenalib -run containers seem like they might provide the correct path forward into balenaOS v3+ ... but there are 29 to choose from and I need to get to the bottom of how to get one to actually behave like balenaOS. The other great thing here is that there are ARM images, so this project can eventually support both x86 and ARM.

Questions:

Has anyone else started down this path?
~~2. Does v3 fix the cgroup2 issue?~~ no cgroup v2 support

Use drop-in units for changing engine graphdriver

depends-on https://github.com/balena-os/meta-balena/pull/2175/files

[FAILED] Failed to start Resin acti… root partition mount service.

Hi,

I'm used this project in the past.
Last time I know it worked without issues was April 2022. I might have used it in the meantime, but not 100% certain.
Something changed in the meantime, but I'm unsure what.

I'm trying to use this fleet config (config.json):

{
  "applicationId": 1390541,
  "deviceType": "intel-nuc",
  "userId": 125346,
  "appUpdatePollInterval": 60000,
  "listenPort": 48484,
  "vpnPort": 443,
  "apiEndpoint": "https://api.balena-cloud.com",
  "vpnEndpoint": "cloudlink.balena-cloud.com",
  "registryEndpoint": "registry2.balena-cloud.com",
  "deltaEndpoint": "https://delta.balena-cloud.com",
  "mixpanelToken": "some token, censored, unsure if sensitive",
  "apiKey": "some api key, censored, unsure if sensitive"
}

I'm using docker desktop with wsl2:

wsl --version
WSL version: 1.2.5.0
Kernel version: 5.15.90.1
WSLg version: 1.0.51
MSRDC version: 1.2.3770
Direct3D version: 1.608.2-61064218
DXCore version: 10.0.25131.1002-220531-1700.rs-onecore-base2-hyp
Windows version: 10.0.22621.1555

docker -v
Docker version 20.10.21, build baeda1f

When investigating cgroups in the docker-desktop container:

mount | grep group
tmpfs on /sys/fs/cgroup type tmpfs (rw,nosuid,nodev,noexec,relatime,mode=755)
cgroup2 on /sys/fs/cgroup/unified type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/cpu type cgroup (rw,nosuid,nodev,noexec,relatime,cpu)
cgroup on /sys/fs/cgroup/cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpuacct)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_prio)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)

So I think the kernel supports both cgroups v1 and v2?

docker-compose logs:

balenaos-in-container-master>docker-compose up --build
[+] Building 5.6s (11/11) FINISHED
 => [internal] load build definition from Dockerfile.template                                                                                                 0.0s
 => => transferring dockerfile: 41B                                                                                                                           0.0s
 => [internal] load .dockerignore                                                                                                                             0.0s
 => => transferring context: 2B                                                                                                                               0.0s
 => resolve image config for docker.io/docker/dockerfile:1.2                                                                                                  4.2s
 => CACHED docker-image://docker.io/docker/dockerfile:1.2@sha256:e2a8561e419ab1ba6b2fe6cbdf49fd92b95912df1cf7d313c3e2230a333fdbcc                             0.0s
 => [internal] load metadata for docker.io/resin/resinos:2.95.12_rev1-genericx86-64-ext                                                                       1.1s
 => [1/4] FROM docker.io/resin/resinos:2.95.12_rev1-genericx86-64-ext@sha256:22998055523a55b1906a3d958348d4683464b69c28806b15feb9e4a0964f2380                 0.0s
 => [internal] load build context                                                                                                                             0.0s
 => => transferring context: 99B                                                                                                                              0.0s
 => CACHED [2/4] COPY ./entry.sh /entry.sh                                                                                                                    0.0s
 => CACHED [3/4] COPY ./conf/systemd-watchdog.conf /etc/systemd/system.conf.d/watchdog.conf                                                                   0.0s
 => CACHED [4/4] RUN rm /lib/systemd/system/sysinit.target.wants/systemd-udev-trigger.service                                                                 0.0s
 => exporting to image                                                                                                                                        0.0s
 => => exporting layers                                                                                                                                       0.0s
 => => writing image sha256:3bed77be16afe0142b488888bb80937f81557bf92788ed59a431caae79f0f3cb                                                                  0.0s
 => => naming to docker.io/library/balenaos-in-container-master-os                                                                                            0.0s

Use 'docker scan' to run Snyk tests against images to find vulnerabilities and learn how to fix them
[+] Running 1/0
 - Container balenaos-in-container-master-os-1  Created                                                                                                       0.0s
Attaching to balenaos-in-container-master-os-1
balenaos-in-container-master-os-1  | Configuration file /etc/systemd/system.conf.d/watchdog.conf is marked executable. Please remove executable permission bits. Proceeding anyway.
balenaos-in-container-master-os-1  | Failed to create symlink /sys/fs/cgroup/cpu: File exists
balenaos-in-container-master-os-1  | Failed to create symlink /sys/fs/cgroup/cpuacct: File exists
balenaos-in-container-master-os-1  | Failed to create symlink /sys/fs/cgroup/net_prio: File exists
balenaos-in-container-master-os-1  | Failed to create symlink /sys/fs/cgroup/net_cls: File exists
balenaos-in-container-master-os-1  |
balenaos-in-container-master-os-1  | Welcome to balenaOS 2.95.12+rev1!
balenaos-in-container-master-os-1  |
balenaos-in-container-master-os-1  | Failed to attach 1 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/init.scope: No such file or directory
balenaos-in-container-master-os-1  | /lib/systemd/system/balena-host.socket:5: ListenStream= references a path below legacy directory /var/run/, updating /var/run/balena-host.sock → /run/balena-host.sock; please update the unit file accordingly.
balenaos-in-container-master-os-1  | /lib/systemd/system/balena-engine.socket:5: ListenStream= references a path below legacy directory /var/run/, updating /var/run/balena-engine.sock → /run/balena-engine.sock; please update the unit file accordingly.
balenaos-in-container-master-os-1  | [  OK  ] Created slice system-balena\x2dinfo.slice.
balenaos-in-container-master-os-1  | [  OK  ] Created slice system-getty.slice.
balenaos-in-container-master-os-1  | [  OK  ] Created slice system-serial\x2dgetty.slice.
balenaos-in-container-master-os-1  | [  OK  ] Created slice User and Session Slice.
balenaos-in-container-master-os-1  | [  OK  ] Started Forward Password R…uests to Wall Directory Watch.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Development features.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Remote File Systems.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Slices.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Swap.
balenaos-in-container-master-os-1  | [  OK  ] Listening on initctl Compatibility Named Pipe.
balenaos-in-container-master-os-1  | [  OK  ] Listening on Journal Socket (/dev/log).
balenaos-in-container-master-os-1  | [  OK  ] Listening on Journal Socket.
balenaos-in-container-master-os-1  | [  OK  ] Listening on udev Control Socket.
balenaos-in-container-master-os-1  | [  OK  ] Listening on udev Kernel Socket.
balenaos-in-container-master-os-1  | Failed to attach 17 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/dev-hugepages.mount: No such file or directory
balenaos-in-container-master-os-1  |          Mounting Huge Pages File System...
balenaos-in-container-master-os-1  | Failed to attach 17 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/dev-hugepages.mount: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 18 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/sys-kernel-debug.mount: No such file or directory
balenaos-in-container-master-os-1  |          Mounting Kernel Debug File System...
balenaos-in-container-master-os-1  | Failed to attach 18 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/sys-kernel-debug.mount: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 19 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/mnt-sysroot-active.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Resin active root partition mount service...
balenaos-in-container-master-os-1  | Failed to attach 19 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/mnt-sysroot-active.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 20 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/resin-boot.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Resin boot partition mount service...
balenaos-in-container-master-os-1  | Failed to attach 20 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/resin-boot.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 21 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/resin-state.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Resin state partition mount service...
balenaos-in-container-master-os-1  | Failed to attach 21 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/resin-state.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 22 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/rollback-clear-bootcount.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Rollback clear bo…boot crumb is still present...
balenaos-in-container-master-os-1  | Failed to attach 22 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/rollback-clear-bootcount.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 25 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/sys-fs-fuse-connections.mount: No such file or directory
balenaos-in-container-master-os-1  |          Mounting FUSE Control File System...
balenaos-in-container-master-os-1  | Failed to attach 25 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/sys-fs-fuse-connections.mount: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 27 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-remount-fs.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Remount Root and Kernel File Systems...
balenaos-in-container-master-os-1  | Failed to attach 27 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-remount-fs.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 28 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-sysctl.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Apply Kernel Variables...
balenaos-in-container-master-os-1  | Failed to attach 28 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-sysctl.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 29 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-udev-settle.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting udev Wait for Complete Device Initialization...
balenaos-in-container-master-os-1  | Failed to attach 29 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-udev-settle.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 30 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-vconsole-setup.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Setup Virtual Console...
balenaos-in-container-master-os-1  | Failed to attach 30 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-vconsole-setup.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 35 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/timeinit-buildtime.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Set the system clock from the build timestamp...
balenaos-in-container-master-os-1  | Failed to attach 35 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/timeinit-buildtime.service: No such file or directory
balenaos-in-container-master-os-1  | [  OK  ] Mounted Huge Pages File System.
balenaos-in-container-master-os-1  | [  OK  ] Mounted Kernel Debug File System.
balenaos-in-container-master-os-1  | resin-boot.service: Main process exited, code=exited, status=1/FAILURE
balenaos-in-container-master-os-1  | resin-boot.service: Failed with result 'exit-code'.
balenaos-in-container-master-os-1  | [FAILED] Failed to start Resin boot partition mount service.
balenaos-in-container-master-os-1  | See 'systemctl status resin-boot.service' for details.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Netw…on fragments from config.json.
balenaos-in-container-master-os-1  | os-networkmanager.service: Job os-networkmanager.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Show Plymouth Boot Screen.
balenaos-in-container-master-os-1  | plymouth-start.service: Job plymouth-start.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Prepare OpenVPN.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for OpenVPN.
balenaos-in-container-master-os-1  | openvpn.service: Job openvpn.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | prepare-openvpn.service: Job prepare-openvpn.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Resin network configure service.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Resin NTP server configure service.
balenaos-in-container-master-os-1  | balena-ntp-config.service: Job balena-ntp-config.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | balena-net-config.service: Job balena-net-config.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Balena rollback checks health.
balenaos-in-container-master-os-1  | rollback-health.service: Job rollback-health.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Balena EFI partition mount service.
balenaos-in-container-master-os-1  | balena-efi.service: Job balena-efi.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Balena Hostname Configuration.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Avahi mDNS/DNS-SD Stack.
balenaos-in-container-master-os-1  | avahi-daemon.service: Job avahi-daemon.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bale… Application Container Engine.
balenaos-in-container-master-os-1  | balena.service: Job balena.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | balena-hostname.service: Job balena-hostname.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Balena device UUID.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Balena supervisor.
balenaos-in-container-master-os-1  | balena-supervisor.service: Job balena-supervisor.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | balena-device-uuid.service: Job balena-device-uuid.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for OS SSH keys.
balenaos-in-container-master-os-1  | os-sshkeys.service: Job os-sshkeys.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for conf…plit into configuration units.
balenaos-in-container-master-os-1  | os-config-json.service: Job os-config-json.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Balena rollback checks altboot.
balenaos-in-container-master-os-1  | rollback-altboot.service: Job rollback-altboot.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for udev…onfiguration from config.json.
balenaos-in-container-master-os-1  | os-udevrules.service: Job os-udevrules.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for OS configuration update service.
balenaos-in-container-master-os-1  | os-config.service: Job os-config.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for OS c…figuration device key service.
balenaos-in-container-master-os-1  | os-config-devicekey.service: Job os-config-devicekey.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Config.json path watch.
balenaos-in-container-master-os-1  | config-json.path: Job config-json.path/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for reds… transparent proxy redirector.
balenaos-in-container-master-os-1  | redsocks.service: Job redsocks.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Resin proxy configuration service.
balenaos-in-container-master-os-1  | balena-proxy-config.service: Job balena-proxy-config.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Balena persistent logs.
balenaos-in-container-master-os-1  | balena-persistent-logs.service: Job balena-persistent-logs.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | resin-state.service: Main process exited, code=exited, status=1/FAILURE
balenaos-in-container-master-os-1  | resin-state.service: Failed with result 'exit-code'.
balenaos-in-container-master-os-1  | [FAILED] Failed to start Resin state partition mount service.
balenaos-in-container-master-os-1  | See 'systemctl status resin-state.service' for details.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /home/root/.docker.
balenaos-in-container-master-os-1  | bind-home-root-.docker.service: Job bind-home-root-.docker.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /etc/fake-hwclock.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Restore/save the current clock.
balenaos-in-container-master-os-1  | fake-hwclock.service: Job fake-hwclock.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | etc-fake\x2dhwclock.mount: Job etc-fake\x2dhwclock.mount/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind…orkManager/system-connections.
balenaos-in-container-master-os-1  | bind-etc-NetworkManager-system-connections.service: Job bind-etc-NetworkManager-system-connections.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /etc/docker.
balenaos-in-container-master-os-1  | bind-etc-docker.service: Job bind-etc-docker.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /etc/openvpn.
balenaos-in-container-master-os-1  | bind-etc-openvpn.service: Job bind-etc-openvpn.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind…nt for /etc/balena-supervisor.
balenaos-in-container-master-os-1  | bind-etc-balena-supervisor.service: Job bind-etc-balena-supervisor.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /var/lib/bluetooth.
balenaos-in-container-master-os-1  | bind-var-lib-bluetooth.service: Job bind-var-lib-bluetooth.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /home/root/.ssh.
balenaos-in-container-master-os-1  | bind-home-root-.ssh.service: Job bind-home-root-.ssh.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /var/lib/chrony.
balenaos-in-container-master-os-1  | bind-var-lib-chrony.service: Job bind-var-lib-chrony.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Resin reset OS state.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /var/lib/systemd.
balenaos-in-container-master-os-1  | bind-var-lib-systemd.service: Job bind-var-lib-systemd.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /etc/hostname.
balenaos-in-container-master-os-1  | bind-etc-hostname.service: Job bind-etc-hostname.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind…t for /var/lib/NetworkManager.
balenaos-in-container-master-os-1  | bind-var-lib-NetworkManager.service: Job bind-var-lib-NetworkManager.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /home/root/.rnd.
balenaos-in-container-master-os-1  | bind-home-root-.rnd.service: Job bind-home-root-.rnd.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /etc/ssh/hostkeys.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for OpenSSH Key Generation.
balenaos-in-container-master-os-1  | sshdgenkeys.service: Job sshdgenkeys.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | bind-etc-ssh-hostkeys.service: Job bind-etc-ssh-hostkeys.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /etc/udev/rules.d.
balenaos-in-container-master-os-1  | bind-etc-udev-rules.d.service: Job bind-etc-udev-rules.d.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind…or /etc/NetworkManager/conf.d.
balenaos-in-container-master-os-1  | bind-etc-NetworkManager-conf.d.service: Job bind-etc-NetworkManager-conf.d.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind…/share/ca-certificates/balena.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Bind mount for /etc/ssl/certs.
balenaos-in-container-master-os-1  | bind-etc-ssl-certs.service: Job bind-etc-ssl-certs.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Extract custom CA from config.json.
balenaos-in-container-master-os-1  | extract-balena-ca.service: Job extract-balena-ca.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | bind-usr-share-ca-certificates-balena.service: Job bind-usr-share-ca-certificates-balena.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | resin-state-reset.service: Job resin-state-reset.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Balena supervisor state migrator.
balenaos-in-container-master-os-1  | migrate-supervisor-state.service: Job migrate-supervisor-state.service/start failed with result 'dependency'.
balenaos-in-container-master-os-1  | [  OK  ] Started Rollback clear boo…ltboot crumb is still present.
balenaos-in-container-master-os-1  | [  OK  ] Mounted FUSE Control File System.
balenaos-in-container-master-os-1  | [  OK  ] Started Apply Kernel Variables.
balenaos-in-container-master-os-1  | [  OK  ] Started Setup Virtual Console.
balenaos-in-container-master-os-1  | [  OK  ] Started Dispatch Password …ts to Console Directory Watch.
balenaos-in-container-master-os-1  | Failed to attach 39 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/resin-filesystem-expand.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Expand resin-data partition...
balenaos-in-container-master-os-1  | Failed to attach 39 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/resin-filesystem-expand.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 41 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-journald.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Journal Service...
balenaos-in-container-master-os-1  | Failed to attach 41 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-journald.service: No such file or directory
balenaos-in-container-master-os-1  | [  OK  ] Started Remount Root and Kernel File Systems.
balenaos-in-container-master-os-1  | [  OK  ] Started Set the system clock from the build timestamp.
balenaos-in-container-master-os-1  | Failed to attach 45 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-tmpfiles-setup-dev.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Create Static Device Nodes in /dev...
balenaos-in-container-master-os-1  | Failed to attach 45 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-tmpfiles-setup-dev.service: No such file or directory
balenaos-in-container-master-os-1  | [  OK  ] Started Create Static Device Nodes in /dev.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Local File Systems (Pre).
balenaos-in-container-master-os-1  | [  OK  ] Set up automount mnt-sysroot-inactive partition.
balenaos-in-container-master-os-1  | Failed to attach 46 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/var-volatile.mount: No such file or directory
balenaos-in-container-master-os-1  |          Mounting /var/volatile...
balenaos-in-container-master-os-1  | Failed to attach 46 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/var-volatile.mount: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 47 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-udevd.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting udev Kernel Device Manager...
balenaos-in-container-master-os-1  | Failed to attach 47 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-udevd.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 48 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-journald.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 48 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/systemd-journald.service: No such file or directory
balenaos-in-container-master-os-1  | [  OK  ] Mounted /var/volatile.
balenaos-in-container-master-os-1  | Failed to attach 49 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/development-features.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Runtime development features management...
balenaos-in-container-master-os-1  | Failed to attach 49 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/development-features.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 50 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/var-volatile-cache.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Bind mount volatile /var/cache...
balenaos-in-container-master-os-1  | Failed to attach 50 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/var-volatile-cache.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 51 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/var-volatile-lib.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Bind mount volatile /var/lib...
balenaos-in-container-master-os-1  | Failed to attach 51 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/var-volatile-lib.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 53 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/var-volatile-spool.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Bind mount volatile /var/spool...
balenaos-in-container-master-os-1  | Failed to attach 53 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/var-volatile-spool.service: No such file or directory
balenaos-in-container-master-os-1  | Failed to attach 55 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/var-volatile-srv.service: No such file or directory
balenaos-in-container-master-os-1  |          Starting Bind mount volatile /srv...
balenaos-in-container-master-os-1  | Failed to attach 55 to compat systemd cgroup /docker/731cd9f59e60c685d7a8806e5eb9f16843981861915fd647c95b3412a6a9fa44/system.slice/var-volatile-srv.service: No such file or directory
balenaos-in-container-master-os-1  | [  OK  ] Started Journal Service.
balenaos-in-container-master-os-1  | [  OK  ] Started Bind mount volatile /var/cache.
balenaos-in-container-master-os-1  | [  OK  ] Started Bind mount volatile /var/spool.
balenaos-in-container-master-os-1  | [  OK  ] Started Bind mount volatile /srv.
balenaos-in-container-master-os-1  | [  OK  ] Started Bind mount volatile /var/lib.
balenaos-in-container-master-os-1  | [  OK  ] Started udev Kernel Device Manager.
balenaos-in-container-master-os-1  | [  OK  ] Started udev Wait for Complete Device Initialization.
balenaos-in-container-master-os-1  | [  OK  ] Started Hardware RNG Entropy Gatherer Daemon.
balenaos-in-container-master-os-1  | [  OK  ] Reached target System Time Set.
balenaos-in-container-master-os-1  | [  OK  ] Reached target System Time Synchronized.
balenaos-in-container-master-os-1  | [  OK  ] Started Runtime development features management.
[FAILED] Failed to start Resin acti… root partition mount service.
balenaos-in-container-master-os-1  | See 'systemctl status mnt-sysroot-active.service' for details.
balenaos-in-container-master-os-1  | [  OK  ] Started Expand resin-data partition.
balenaos-in-container-master-os-1  |          Starting Resin data partition mount service...
balenaos-in-container-master-os-1  | [FAILED] Failed to start Resin data partition mount service.
balenaos-in-container-master-os-1  | See 'systemctl status resin-data.service' for details.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for resin-data bind mount.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for balena reset OS data.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Docker data mountpoint.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Local File Systems.
balenaos-in-container-master-os-1  |          Starting Create Volatile Files and Directories...
balenaos-in-container-master-os-1  | [  OK  ] Started Create Volatile Files and Directories.
balenaos-in-container-master-os-1  |          Starting Update UTMP about System Boot/Shutdown...
balenaos-in-container-master-os-1  | [  OK  ] Started Update UTMP about System Boot/Shutdown.
balenaos-in-container-master-os-1  | [  OK  ] Reached target System Initialization.
balenaos-in-container-master-os-1  | [  OK  ] Started balena-hostname path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started balena-net-config path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started balena-ntp-config path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started balena-supervisor path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started development-features path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started dnsmasq path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started extract-balena-ca path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started os-networkmanager path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started os-sshkeys path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started os-udevrules path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started prepare-openvpn path watch.
balenaos-in-container-master-os-1  | [  OK  ] Started Periodic check for configuration changes.
balenaos-in-container-master-os-1  | [  OK  ] Started Periodic vacuum of journald logs.
balenaos-in-container-master-os-1  | [  OK  ] Started Daily Cleanup of Temporary Directories.
balenaos-in-container-master-os-1  | [  OK  ] Started Balena supervisor updater timer.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Paths.
balenaos-in-container-master-os-1  | [  OK  ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket.
balenaos-in-container-master-os-1  |          Starting Docker Socket for the API.
balenaos-in-container-master-os-1  |          Starting Docker Socket for the API.
balenaos-in-container-master-os-1  | [  OK  ] Listening on D-Bus System Message Bus Socket.
balenaos-in-container-master-os-1  |          Starting sshd.socket.
balenaos-in-container-master-os-1  | [  OK  ] Listening on Docker Socket for the API.
balenaos-in-container-master-os-1  | [  OK  ] Listening on Docker Socket for the API.
balenaos-in-container-master-os-1  | [  OK  ] Listening on sshd.socket.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Sockets.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Basic System.
balenaos-in-container-master-os-1  |          Starting Modem Manager...
balenaos-in-container-master-os-1  | [  OK  ] Started D-Bus System Message Bus.
balenaos-in-container-master-os-1  |          Starting IPv6 Packet Filtering Framework...
balenaos-in-container-master-os-1  |          Starting IPv4 Packet Filtering Framework...
balenaos-in-container-master-os-1  | [  OK  ] Reached target Login Prompts.
balenaos-in-container-master-os-1  |          Starting Login Service...
balenaos-in-container-master-os-1  | [  OK  ] Started IPv6 Packet Filtering Framework.
balenaos-in-container-master-os-1  | [  OK  ] Started IPv4 Packet Filtering Framework.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Network (Pre).
balenaos-in-container-master-os-1  |          Starting Network Manager...
balenaos-in-container-master-os-1  | [  OK  ] Started Login Service.
balenaos-in-container-master-os-1  | [  OK  ] Started Network Manager.
balenaos-in-container-master-os-1  | [  OK  ] Reached target Network.
balenaos-in-container-master-os-1  |          Starting DNS forwarder and DHCP server...
balenaos-in-container-master-os-1  |          Starting Resin init service...
balenaos-in-container-master-os-1  |          Starting Set system clock from a secure website...
balenaos-in-container-master-os-1  | [  OK  ] Started Modem Manager.
balenaos-in-container-master-os-1  | [  OK  ] Started DNS forwarder and DHCP server.
balenaos-in-container-master-os-1  | [  OK  ] Started Resin init service.
balenaos-in-container-master-os-1  |          Starting Hostname Service...
balenaos-in-container-master-os-1  | [  OK  ] Started Hostname Service.
balenaos-in-container-master-os-1  |          Starting Network Manager Script Dispatcher Service...
balenaos-in-container-master-os-1  | [  OK  ] Started Network Manager Script Dispatcher Service.
[ TIME ] Timed out waiting for device /dev/zram0.
balenaos-in-container-master-os-1  | [DEPEND] Dependency failed for Enab…sed swap in memory using zram.
         Starting Cleanup of Temporary Directories...
balenaos-in-container-master-os-1  | [  OK  ] Started Cleanup of Temporary Directories.
[ ***  ] A start job is running for Set syst…ure website (26min 12s / no limit)
Gracefully stopping... (press Ctrl+C again to force)
[+] Running 1/1
 - Container balenaos-in-container-master-os-1  Stopped                                                                                                       0.8s
canceled

docker exec -it balenaos-in-container-master-os-1 journalctl -u mnt-sysroot-active.service

> docker exec -it balenaos-in-container-master-os-1 journalctl -u mnt-sysroot-active.service
-- Logs begin at Mon 2023-05-15 08:08:42 UTC, end at Mon 2023-05-15 08:10:12 UT>
May 15 08:09:13 731cd9f59e60 resin-partition-mounter[19]: ERROR: Timeout while >
May 15 08:09:13 731cd9f59e60 systemd[1]: mnt-sysroot-active.service: Main proce>
May 15 08:09:13 731cd9f59e60 systemd[1]: mnt-sysroot-active.service: Failed wit>
May 15 08:09:13 731cd9f59e60 systemd[1]: Failed to start Resin active root part>
lines 1-5/5 (END)...skipping...
-- Logs begin at Mon 2023-05-15 08:08:42 UTC, end at Mon 2023-05-15 08:10:12 UTC. --
May 15 08:09:13 731cd9f59e60 resin-partition-mounter[19]: ERROR: Timeout while waiting for /dev/disk/by-state/active to come up.
May 15 08:09:13 731cd9f59e60 systemd[1]: mnt-sysroot-active.service: Main process exited, code=exited, status=1/FAILURE
May 15 08:09:13 731cd9f59e60 systemd[1]: mnt-sysroot-active.service: Failed with result 'exit-code'.
May 15 08:09:13 731cd9f59e60 systemd[1]: Failed to start Resin active root partition mount service.
~
~
~

If I can provide more information, please let me know.

Docker-compose up returns resin-init error

Hello.

I am running the container inside ubuntu, and the image although the image seems up, the system gets stuck at a loop between the supervisor starting up and starting libcontainer.

_1  | [  OK  ] Started DNS forwarder and DHCP server.
os_1  |          Starting Balena Application Container Engine...
os_1  |          Starting Resin proxy configuration service...
os_1  |          Starting Hostname Service...
os_1  | [FAILED] Failed to start Resin init service.
os_1  | See 'systemctl status resin-init.service' for details.
os_1  | [  OK  ] Started Hostname Service.
os_1  |          Starting Network Manager Script Dispatcher Service...
os_1  | [  OK  ] Started Network Manager Script Dispatcher Service.
os_1  | [  OK  ] Started Resin proxy configuration service.
os_1  | [  OK  ] Started Balena Application Container Engine.
os_1  |          Starting Balena supervisor...
os_1  |          Starting Load balena healthcheck image...
os_1  | [  OK  ] Started Balena supervisor.
os_1  | [  OK  ] Started Load balena healthcheck image.
os_1  | [  OK  ] Started libcontainer conta…745d4ae5626c43d75e9836f37bb74.
os_1  | [  OK  ] Started libcontainer conta…d7efc105230bb319508a1b5d078cf.
[  OK  ] Stopped Balena supervisor.
os_1  |          Starting Balena supervisor...
os_1  | [  OK  ] Started Balena supervisor.
os_1  | [  OK  ] Stopped OpenVPN.
os_1  |          Starting Prepare OpenVPN...
os_1  | [  OK  ] Started Prepare OpenVPN.
os_1  | [  OK  ] Started OpenVPN.
os_1  | [  OK  ] Started libcontainer conta…2c709edb0797d08d637bf7c9fea05.
[  OK  ] Stopped Balena supervisor.
os_1  |          Starting Balena supervisor...
os_1  | [  OK  ] Started Balena supervisor.
os_1  | [  OK  ] Started libcontainer conta…9e1c648e573cba083734aaf754cbe.
os_1  | [  OK  ] Stopped OpenVPN.
os_1  |          Starting Prepare OpenVPN...
os_1  | [  OK  ] Started Prepare OpenVPN.
os_1  | [  OK  ] Started OpenVPN.

then I get other errors before the process seems to complete.

os_1  |          Starting Balena supervisor...
os_1  | [  OK  ] Started Balena supervisor.
os_1  | [  OK  ] Started libcontainer conta…413b0ee5ee749cd38ab3a2a45ab2f.
os_1  | [  OK  ] Stopped OpenVPN.
os_1  |          Starting Prepare OpenVPN...
os_1  | [  OK  ] Started Prepare OpenVPN.
os_1  | [  OK  ] Started OpenVPN.
os_1  | [ TIME ] Timed out waiting for device /dev/zram0.
os_1  | [DEPEND] Dependency failed for Enab…sed swap in memory using zram.
os_1  | [ TIME ] Timed out waiting for device /dev/ttyS0.
os_1  | [DEPEND] Dependency failed for Serial Getty on ttyS0.
os_1  | [  OK  ] Reached target Login Prompts.
os_1  | [  OK  ] Reached target Multi-User System.
os_1  |          Starting Update UTMP about System Runlevel Changes...
os_1  | [  OK  ] Started Update UTMP about System Runlevel Changes.

I can get to the console of the container, but i cant seem to see the system on the cloud dashboard.

Mem: 2234672K used, 1420568K free, 70948K shrd, 155736K buff, 1072308K cached
CPU:   7% usr   3% sys   0% nic  89% idle   0% io   0% irq   0% sirq
Load average: 0.59 0.51 0.51 5/613 3381
  PID  PPID USER     STAT   VSZ %VSZ %CPU COMMAND
  275   242 root     S     867m  24%   0% balena-engine-containerd --config /var/run/balena-engine/containerd/
 3278  3243 root     R     4248   0%   0% top
  242     1 root     S     939m  26%   0% /usr/bin/balenad --experimental --log-driver=journald -s overlay2 -H
 1210     1 root     S     721m  20%   0% {runc:[2:INIT]} balena-engine-runc init
  696     1 root     S     651m  18%   0% {runc:[2:INIT]} balena-engine-runc init
  796     1 root     S     651m  18%   0% {runc:[2:INIT]} balena-engine-runc init
 1415     1 root     S     651m  18%   0% {runc:[2:INIT]} balena-engine-runc init
 1522     1 root     S     651m  18%   0% {runc:[2:INIT]} balena-engine-runc init
 2143     1 root     S     651m  18%   0% {runc:[2:INIT]} balena-engine-runc init
 2947     1 root     S     651m  18%   0% {runc:[2:INIT]} balena-engine-runc init

any ideas?

puc

Not working properly with resinos greater than 2.29

I have a test resinos-in-container setup running on image resin/resinos:2.29.0_rev2-intel-nuc. I updated to resin/resinos:2.36.0_rev2-intel-nuc and it started up correctly and showed up in the dashboard. Then I changed the --id parameter to simulate a brand-new device, but it never showed up.

System specifications:

$ lsb_release -a
LSB Version:    core-10.2019031300ubuntu1-noarch:printing-10.2019031300ubuntu1-noarch:security-10.2019031300ubuntu1-noarch
Distributor ID: Ubuntu
Description:    Ubuntu 19.04
Release:        19.04
Codename:       disco

$ docker --version
Docker version 18.09.5, build e8ff056

$ git --no-pager log --no-decorate -n 1 --pretty=%H
0165ba38f62baea19110a5b5a1d76846b81408cb

host system max_user_namespaces is set to 0

When running this container on Ubuntu derivatives and using cgroups v1 as required, the host max_user_namespaces can get reset to 0 causing various issues on the host.

Linux system76 5.15.11-76051511-generic #202112220937~1640185481~21.04~b3a2c21-Ubuntu SMP Mon Jan 3 16:5 x86_64 x86_64 x86_64 GNU/Linux

Retrieve the current value with

sudo sysctl -a | grep max_user_namespaces

Can be restored with

echo 10000 | sudo tee /proc/sys/user/max_user_namespaces

Device not shown in BalenaCloud

System:
OS: Windows 10
Docker Desktop / Docker Engine Version - 19.03.12

Balena Images Tests:
resinos:2.50.1_rev1.dev-intel-nuc
resinos:2.46.0_rev1.dev-intel-nuc

How to reproduce:

Download the config file from BalenaCloud
Run command .\balenaos-in-container.ps1 -image resin/resinos:2.46.0_rev1.dev-intel-nuc -id testBalena -c "$PWD\**.config.json" -detach -clean_volumes

Result: of docker logs:

Failed to find module 'autofs4'
Configuration file /etc/systemd/system.conf.d/watchdog.conf is marked executable. Please remove executable permission bits. Proceeding anyway.
Failed to create symlink /sys/fs/cgroup/net_cls: File exists
Failed to create symlink /sys/fs/cgroup/net_prio: File exists
Failed to create symlink /sys/fs/cgroup/cpuacct: File exists
Failed to create symlink /sys/fs/cgroup/cpu: File exists

Welcome to balenaOS 2.46.0+rev1!

/lib/systemd/system/chronyd.service:9: PIDFile= references path below legacy directory /var/run/, updating /var/run/chrony/chronyd.pid → /run/chrony/chronyd.pid; please update the unit file accordingly.
[  OK  ] Listening on udev Control Socket.
[  OK  ] Listening on Journal Audit Socket.
[  OK  ] Listening on Syslog Socket.
[  OK  ] Reached target Remote File Systems.
[  OK  ] Listening on Journal Socket.
         Starting Setup Virtual Console...
         Starting Create list of re…odes for the current kernel...
         Starting Remount Root and Kernel File Systems...
[  OK  ] Listening on Journal Socket (/dev/log).
[  OK  ] Listening on udev Kernel Socket.
[  OK  ] Created slice User and Session Slice.
[  OK  ] Created slice system-serial\x2dgetty.slice.
[  OK  ] Created slice system-resin\x2dinfo.slice.
         Mounting Kernel Debug File System...
[  OK  ] Started Forward Password R…uests to Wall Directory Watch.
[  OK  ] Reached target Slices.
         Starting Apply Kernel Variables...
         Starting OS configuration device key service...
         Starting Rollback clear bo…boot crumb is still present...
         Mounting FUSE Control File System...
         Starting udev Coldplug all Devices...
[  OK  ] Reached target Swap.
         Mounting Temporary Directory (/tmp)...
[  OK  ] Created slice system-getty.slice.
         Starting Journal Service...
         Mounting Huge Pages File System...
[UNSUPP] Starting of mnt-sysroot-inactive partition not supported.
[  OK  ] Listening on initctl Compatibility Named Pipe.
[  OK  ] Started Setup Virtual Console.
[  OK  ] Started Create list of req… nodes for the current kernel.
[  OK  ] Started Remount Root and Kernel File Systems.
[  OK  ] Mounted Kernel Debug File System.
[  OK  ] Started Apply Kernel Variables.
os-config-devicekey.service: Main process exited, code=exited, status=1/FAILURE
os-config-devicekey.service: Failed with result 'exit-code'.
[FAILED] Failed to start OS configuration device key service.
See 'systemctl status os-config-devicekey.service' for details.
[DEPEND] Dependency failed for Prepare OpenVPN.
[DEPEND] Dependency failed for OpenVPN.
openvpn.service: Job openvpn.service/start failed with result 'dependency'.
prepare-openvpn.service: Job prepare-openvpn.service/start failed with result 'dependency'.
[DEPEND] Dependency failed for Balena supervisor.
resin-supervisor.service: Job resin-supervisor.service/start failed with result 'dependency'.
[  OK  ] Started Rollback clear boo…ltboot crumb is still present.
[  OK  ] Mounted FUSE Control File System.
[  OK  ] Mounted Temporary Directory (/tmp).
[  OK  ] Mounted Huge Pages File System.
         Starting Create Static Device Nodes in /dev...
[  OK  ] Started Create Static Device Nodes in /dev.
[  OK  ] Reached target Local File Systems (Pre).
[  OK  ] Reached target Containers.
         Mounting /var/volatile...
         Mounting resin-data bind mount...
[  OK  ] Started Journal Service.
[  OK  ] Mounted /var/volatile.
[  OK  ] Mounted resin-data bind mount.
         Starting Bind mount volatile /var/spool...
         Starting Bind mount volatile /var/cache...
         Starting Bind mount volatile /srv...
         Starting Bind mount volatile /var/lib...
[  OK  ] Started Bind mount volatile /var/spool.
[  OK  ] Started Bind mount volatile /var/cache.
[  OK  ] Started udev Coldplug all Devices.
         Starting udev Wait for Complete Device Initialization...
[  OK  ] Started Bind mount volatile /srv.
[  OK  ] Started Bind mount volatile /var/lib.
         Mounting Docker data mountpoint...
[  OK  ] Mounted Docker data mountpoint.
[  OK  ] Reached target Local File Systems.
         Starting Create Volatile Files and Directories...
[  OK  ] Started Create Volatile Files and Directories.
         Starting Bind mount for /home/root/.docker...
         Starting Bind mount for /etc/NetworkManager/conf.d...
         Starting Bind mount for /etc/hostname...
         Starting Bind mount for /etc/openvpn...
         Starting Bind mount for /var/lib/systemd...
         Starting Bind mount for /var/lib/chrony...
         Starting Bind mount for /etc/udev/rules.d...
         Starting Bind mount for /home/root/.rnd...
         Starting Bind mount for /etc/ssh/hostkeys...
         Starting Update UTMP about System Boot/Shutdown...
         Starting Bind mount for /etc/docker...
         Starting Bind mount for /var/lib/NetworkManager...
         Starting Bind mount for /e…kManager/system-connections...
         Starting Bind mount for /home/root/.ssh...
         Starting Bind mount for /etc/resin-supervisor...
         Starting Bind mount for /var/lib/bluetooth...
[  OK  ] Started Bind mount for /home/root/.docker.
[  OK  ] Started Bind mount for /etc/NetworkManager/conf.d.
[  OK  ] Started Bind mount for /etc/hostname.
[  OK  ] Started Bind mount for /etc/openvpn.
[  OK  ] Started Bind mount for /var/lib/systemd.
[  OK  ] Started Bind mount for /var/lib/chrony.
[  OK  ] Started Bind mount for /etc/udev/rules.d.
[  OK  ] Started Bind mount for /home/root/.rnd.
[  OK  ] Started Bind mount for /etc/ssh/hostkeys.
[  OK  ] Started Bind mount for /etc/docker.
[  OK  ] Started Bind mount for /var/lib/NetworkManager.
[  OK  ] Started Bind mount for /et…orkManager/system-connections.
[  OK  ] Started Bind mount for /home/root/.ssh.
[  OK  ] Started Bind mount for /etc/resin-supervisor.
[  OK  ] Started Bind mount for /var/lib/bluetooth.
         Starting udev Kernel Device Manager...
[  OK  ] Started Update UTMP about System Boot/Shutdown.
[  OK  ] Started udev Kernel Device Manager.
[  OK  ] Started udev Wait for Complete Device Initialization.
[  OK  ] Started Hardware RNG Entropy Gatherer Daemon.
         Starting Initialize system clock from build timestamp...
[  OK  ] Reached target System Initialization.
         Starting Docker Socket for the API.
[  OK  ] Started Config.json path watch.
         Starting sshd.socket.
[  OK  ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket.
[  OK  ] Listening on D-Bus System Message Bus Socket.
[  OK  ] Started Daily Cleanup of Temporary Directories.
[  OK  ] Started Balena supervisor updater timer.
[  OK  ] Reached target Timers.
         Starting Docker Socket for the API.
[  OK  ] Started Dispatch Password …ts to Console Directory Watch.
[  OK  ] Reached target Paths.
[  OK  ] Listening on Docker Socket for the API.
[  OK  ] Listening on sshd.socket.
[  OK  ] Listening on Docker Socket for the API.
[  OK  ] Started Initialize system clock from build timestamp.
[  OK  ] Reached target Sockets.
[  OK  ] Reached target Basic System.
         Starting OpenSSH Key Generation...
[  OK  ] Started System Logging Service.
         Starting NetworkManager co… fragments from config.json...
[  OK  ] Started Kernel Logging Service.
         Starting Balena device UUID...
[  OK  ] Started D-Bus System Message Bus.
         Starting udev rules configuration from config.json...
         Starting OS SSH keys...
[  OK  ] Started NTP client/server.
[  OK  ] Reached target System Time Synchronized.
         Starting Resin persistent logs...
         Starting Resin network configure service...
         Starting Modem Manager...
[  OK  ] Started OpenSSH Key Generation.
[FAILED] Failed to start Resin network configure service.
See 'systemctl status resin-net-config.service' for details.
[FAILED] Failed to start NetworkMan…on fragments from config.json.
See 'systemctl status os-networkmanager.service' for details.
[  OK  ] Started Resin persistent logs.
         Starting Network Manager...
[  OK  ] Started Modem Manager.
[FAILED] Failed to start OS SSH keys.
See 'systemctl status os-sshkeys.service' for details.
[  OK  ] Started udev rules configuration from config.json.
[FAILED] Failed to start Balena device UUID.
See 'systemctl status balena-device-uuid.service' for details.
[DEPEND] Dependency failed for Resin Hostname Configuration.
[DEPEND] Dependency failed for Avahi mDNS/DNS-SD Stack.
[  OK  ] Started Network Manager.
[  OK  ] Reached target Network.
         Starting DNS forwarder and DHCP server...
         Starting Resin init service...
[  OK  ] Started OS configuration update service.
         Starting Hostname Service...
[  OK  ] Started DNS forwarder and DHCP server.
         Starting Balena Application Container Engine...
         Starting Resin proxy configuration service...
[FAILED] Failed to start Resin proxy configuration service.
See 'systemctl status resin-proxy-config.service' for details.
[DEPEND] Dependency failed for reds… transparent proxy redirector.
[FAILED] Failed to start Resin init service.
See 'systemctl status resin-init.service' for details.
[  OK  ] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[  OK  ] Started Network Manager Script Dispatcher Service.
[  OK  ] Started Balena Application Container Engine.
[  OK  ] Created slice libcontainer…12_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer…12_systemd_test_default.slice.
[  OK  ] Started libcontainer conta…60f581d2958caed95ab17b0871252.
[  OK  ] Created slice libcontainer…46_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer…46_systemd_test_default.slice.
[  OK  ] Created slice libcontainer…52_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer…52_systemd_test_default.slice.
[  OK  ] Created slice libcontainer…59_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer…59_systemd_test_default.slice.
[  OK  ] Created slice libcontainer…72_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer…72_systemd_test_default.slice.
[  OK  ] Created slice libcontainer…79_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer…79_systemd_test_default.slice.
[  OK  ] Stopped OS configuration update service.
         Starting OS configuration device key service...
[FAILED] Failed to start OS configuration device key service.
See 'systemctl status os-config-devicekey.service' for details.
[  OK  ] Started OS configuration update service.
[  OK  ] Stopped OS configuration update service.
         Starting OS configuration device key service...
[FAILED] Failed to start OS configuration device key service.
See 'systemctl status os-config-devicekey.service' for details.
[  OK  ] Started OS configuration update service.
[ ***  ] A start job is running for /dev/ttyS0 (31s / 1min 30s)

Expected:
Device should be shown on BalenaCloud

Does not currently support unified images

resin/resinos:2.95.12_rev1-genericx86-64-ext is a unified release so there is no distinction between production & development images. The image will be configured appropriately if a user downloads it using the SDK/CLI/web. If they use the hostapp it will be configured with whatever their config.json states for developmentMode, as the hostapp does not include the boot partition.

It currently hardcodes a -dev to images (as seen in Dockerfile.template#L6 )

The config.json that is copied to the boot mount should have developmentMode: true. The config.json is downloaded from the balenaCloud dashboard—this needs to be a development version.

Also, it should stop using dockerhub and use bh.cr instead

Current workaround: Use balenaos-in-container as is for balenaOS releases before v2.85

Privileged option: Necessary?

Currently, the resin container is run in privileged mode, according to https://github.com/resin-os/resinos-in-container/blob/master/resinos-in-container.sh#L144.

As this poses certain security issues, is that necessary? If yes, could you please elaborate why?

Thanks,
Oliver

Unable to use this on a linux/arm64/v8 OS

All the images available are for linux/amd64. Is there a way available to run BalenaOS in Docker on a linux/arm64/v8 OS?

Automatically rename the device

there is https://www.balena.io/docs/reference/api/resources/device/#rename-device

mDNS publisher inside balenaOS container not working - failing port mapping

The current solution does not support resolving the .local domain name resolution that is generally supported by balenaOS devices.
The issue here is, that for this feature the avahi/mdns publisher running inside the balenaOS is used. This service is listening on a fixed / reserved IP (224.0. 0.251 ) and needs to bind / listen on port 5353. This port is already in use on macOS for bonjour service (macOS mDNS publisher service).
Hence, mapping the container to 5353 on the host doesn't work.

I've no idea on how to solve this, maybe in the future the .local resolution needs to be address in some central / cloud managed service.

balena push do not restart services

Bug:
When doing balena push <fleet> the services do not seem to restart and the Restart Services button has to be manually pressed.
Are there any dependencies in the used docker-compose.yml file below here that will affect how the services are restarted/pushed etc?

Running balenaOS 2.58.6+rev1 on Generic x86_64

Used docker-compose.yml

Changes from original in this repo:

network_mode: bridge => host
Commented out: dns:

version: '2.2'

services:
  os:
    build:
      context: .
      dockerfile: Dockerfile.template
      args:
        OS_VERSION: ${OS_VERSION:-2.83.18_rev1}
        DEVICE_TYPE: ${DEVICE_TYPE:-genericx86-64-ext}
    privileged: true
    restart: unless-stopped
    stop_signal: SIGRTMIN+3
    stop_grace_period: 30s
    volumes:
      - /lib/modules:/lib/modules:ro
      - ${CONFIG_JSON:-./config.json}:/var/local/config.json
      - boot:/mnt/boot
      - data:/mnt/data
      - state:/mnt/state
    tmpfs:
      - /run
      - /run/lock
      - /tmp
      - /var/lib/journal
      - /sys/fs/cgroup/systemd
    # this is required for the dns option to have any effect
    # see https://github.com/docker/compose/issues/2847#issuecomment-658999887
    network_mode: host
    #dns:
    #  - 127.0.0.2
    tty: true

balenaos container starts but with a few lingering errors

         Starting Resin init service...
[  OK  ] Started OS configuration update service.
         Starting Hostname Service...
[  OK  ] Started DNS forwarder and DHCP server.
         Starting Balena Application Container Engine...
         Starting Resin proxy configuration service...
[FAILED] Failed to start Resin init service.
See 'systemctl status resin-init.service' for details.
[  OK  ] Started Hostname Service.
[  OK  ] Started Resin proxy configuration service.
         Starting Network Manager Script Dispatcher Service...
[  OK  ] Started Network Manager Script Dispatcher Service.
[  OK  ] Started Balena Application Container Engine.
         Starting Balena supervisor...
[  OK  ] Started Balena supervisor.
[  OK  ] Started Balena supervisor updater.

[ TIME ] Timed out waiting for device /dev/ttyS0.
[DEPEND] Dependency failed for Serial Getty on ttyS0.

bash-4.4# systemctl status resin-init.service
● resin-init.service - Resin init service
   Loaded: loaded (/lib/systemd/system/resin-init.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Fri 2020-05-15 13:13:43 UTC; 2min 39s ago
  Process: 258 ExecStart=/bin/bash /usr/bin/resin-init (code=exited, status=123)
 Main PID: 258 (code=exited, status=123)

May 15 13:13:43 6fca902 bash[258]: Board specific initialization...
May 15 13:13:43 6fca902 bash[258]: lsblk: /dev/sda3[/var/snap/docker/common/var-lib-docker/volumes/balena-boot-devalien15/_data]: not a block device
May 15 13:13:43 6fca902 systemd[1]: resin-init.service: Main process exited, code=exited, status=123/n/a
May 15 13:13:43 6fca902 systemd[1]: resin-init.service: Failed with result 'exit-code'.
May 15 13:13:43 6fca902 systemd[1]: Failed to start Resin init service.
bash-4.4#

This is the first time I am attempting to run this on my linux laptop -- are these critical errors?

Balena fails to start with v2.12.5 images

I am trying to run latest NUC and QEMU images on my laptop, but I hit a "Failed to start Balena Application Container Engine". I tried older 2.9.7 images and they boot successfully.

Front conversations

Need to bind mount kernel modules

For properly running balenaOS, modules might need to be bind mounted, if not yet, otherwise run into a hanging issue, when required modules (such as ip6_tables cannot be loaded)

Startup fails

e413fce (current HEAD) doesn't start for me:

~/balena/resinos-in-container$ ./balenaos-in-container.sh --image resin/resinos:2.44.0_rev1-intel-nuc -c config.json --id REC-1 --extra-args "-p 4001:4001"
INFO: Reusing balena_boot_volume docker volume...
INFO: Reusing balena_state_volume docker volume...
INFO: Reusing balena_data_volume docker volume...
INFO: Running balenaOS as container balena-container-REC-1 ...
WARNING: Localhost DNS setting (--dns=127.0.0.2) may fail in containers.

Welcome to balenaOS 2.44.0+rev1!

Failed to bump fs.file-max, ignoring: Invalid argument
/lib/systemd/system/chronyd.service:9: PIDFile= references path below legacy directory /var/run/, updating /var/run/chrony/chronyd.pid → /run/chrony/chronyd.pid; please update the unit file accordingly.
[  OK  ] Listening on Journal Audit Socket.
[  OK  ] Reached target Remote File Systems.
[  OK  ] Listening on Journal Socket.
         Starting Rollback clear bootcount if altboot crumb is still present...
         Starting Setup Virtual Console...
         Mounting Kernel Debug File System...
         Starting Create list of required static device nodes for the current kernel...
[  OK  ] Listening on udev Kernel Socket.
[  OK  ] Reached target Swap.
[  OK  ] Reached target Login Prompts.
[  OK  ] Listening on Journal Socket (/dev/log).
         Starting Apply Kernel Variables...
[  OK  ] Listening on initctl Compatibility Named Pipe.
         Mounting FUSE Control File System...
         Mounting Huge Pages File System...
[  OK  ] Started Forward Password Requests to Wall Directory Watch.
         Mounting Kernel Configuration File System...
         Starting Remount Root and Kernel File Systems...
[  OK  ] Listening on Syslog Socket.
         Starting Journal Service...
         Starting OS configuration device key service...
[  OK  ] Listening on udev Control Socket.
         Starting udev Coldplug all Devices...
[  OK  ] Created slice User and Session Slice.
[  OK  ] Reached target Slices.
         Mounting Temporary Directory (/tmp)...
[  OK  ] Set up automount mnt-sysroot-inactive partition.
[  OK  ] Started Rollback clear bootcount if altboot crumb is still present.
[  OK  ] Started Setup Virtual Console.
[  OK  ] Mounted Kernel Debug File System.
[  OK  ] Started Create list of required static device nodes for the current kernel.
[  OK  ] Started Apply Kernel Variables.
[  OK  ] Mounted FUSE Control File System.
[  OK  ] Mounted Huge Pages File System.
[  OK  ] Mounted Kernel Configuration File System.
[  OK  ] Started Remount Root and Kernel File Systems.
os-config-devicekey.service: Main process exited, code=exited, status=1/FAILURE
os-config-devicekey.service: Failed with result 'exit-code'.
[FAILED] Failed to start OS configuration device key service.
See 'systemctl status os-config-devicekey.service' for details.
[DEPEND] Dependency failed for Prepare OpenVPN.
[DEPEND] Dependency failed for OpenVPN.
openvpn.service: Job openvpn.service/start failed with result 'dependency'.
prepare-openvpn.service: Job prepare-openvpn.service/start failed with result 'dependency'.
[DEPEND] Dependency failed for Resin supervisor.
resin-supervisor.service: Job resin-supervisor.service/start failed with result 'dependency'.
[  OK  ] Mounted Temporary Directory (/tmp).
         Starting Create Static Device Nodes in /dev...
[  OK  ] Started Create Static Device Nodes in /dev.
[  OK  ] Reached target Local File Systems (Pre).
[  OK  ] Reached target Containers.
         Mounting resin-data bind mount...
         Mounting /var/volatile...
[  OK  ] Started Journal Service.
[  OK  ] Mounted resin-data bind mount.
[  OK  ] Mounted /var/volatile.
         Starting Bind mount volatile /srv...
         Starting Bind mount volatile /var/cache...
         Starting Bind mount volatile /var/spool...
         Starting Bind mount volatile /var/lib...
[  OK  ] Started Bind mount volatile /srv.
[  OK  ] Started Bind mount volatile /var/cache.
[  OK  ] Started Bind mount volatile /var/spool.
[  OK  ] Started Bind mount volatile /var/lib.
         Mounting Docker data mountpoint...
[  OK  ] Mounted Docker data mountpoint.
[  OK  ] Reached target Local File Systems.
         Starting Create Volatile Files and Directories...
[  OK  ] Started udev Coldplug all Devices.
         Starting udev Wait for Complete Device Initialization...
[  OK  ] Started Create Volatile Files and Directories.
         Starting Bind mount for /var/lib/systemd...
         Starting Bind mount for /etc/NetworkManager/system-connections...
         Starting Bind mount for /home/root/.docker...
         Starting Bind mount for /home/root/.ssh...
         Starting Bind mount for /etc/NetworkManager/conf.d...
         Starting Update UTMP about System Boot/Shutdown...
         Starting Bind mount for /var/lib/chrony...
         Starting Bind mount for /etc/hostname...
         Starting Bind mount for /home/root/.rnd...
         Starting Bind mount for /etc/docker...
         Starting Bind mount for /etc/resin-supervisor...
         Starting Bind mount for /var/lib/bluetooth...
         Starting Bind mount for /var/lib/NetworkManager...
         Starting Bind mount for /etc/openvpn...
         Starting Bind mount for /etc/ssh/hostkeys...
         Starting Bind mount for /etc/udev/rules.d...
[  OK  ] Started Bind mount for /var/lib/systemd.
[  OK  ] Started Bind mount for /etc/NetworkManager/system-connections.
[  OK  ] Started Bind mount for /home/root/.docker.
[  OK  ] Started Bind mount for /home/root/.ssh.
[  OK  ] Started Bind mount for /etc/NetworkManager/conf.d.
[  OK  ] Started Bind mount for /var/lib/chrony.
[  OK  ] Started Bind mount for /etc/hostname.
[  OK  ] Started Bind mount for /home/root/.rnd.
[  OK  ] Started Bind mount for /etc/docker.
[  OK  ] Started Bind mount for /etc/resin-supervisor.
[  OK  ] Started Bind mount for /var/lib/bluetooth.
[  OK  ] Started Bind mount for /var/lib/NetworkManager.
[  OK  ] Started Bind mount for /etc/openvpn.
[  OK  ] Started Bind mount for /etc/ssh/hostkeys.
[  OK  ] Started Bind mount for /etc/udev/rules.d.
[  OK  ] Started Update UTMP about System Boot/Shutdown.
         Starting udev Kernel Device Manager...
[  OK  ] Started udev Kernel Device Manager.
[  OK  ] Started udev Wait for Complete Device Initialization.
         Starting Initialize system clock from build timestamp...
[  OK  ] Started Hardware RNG Entropy Gatherer Daemon.
[  OK  ] Started Dispatch Password Requests to Console Directory Watch.
[  OK  ] Reached target System Initialization.
         Starting Docker Socket for the API.
         Starting Docker Socket for the API.
[  OK  ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket.
[  OK  ] Started Daily Cleanup of Temporary Directories.
[  OK  ] Started Resin supervisor updater timer.
[  OK  ] Reached target Timers.
[  OK  ] Listening on D-Bus System Message Bus Socket.
[  OK  ] Started Config.json path watch.
[  OK  ] Reached target Paths.
         Starting sshd.socket.
[  OK  ] Listening on Docker Socket for the API.
[  OK  ] Listening on Docker Socket for the API.
[  OK  ] Listening on sshd.socket.
[  OK  ] Reached target Sockets.
[  OK  ] Reached target Basic System.
[  OK  ] Started Kernel Logging Service.
[  OK  ] Started System Logging Service.
         Starting udev rules configuration from config.json...
         Starting NetworkManager configuration fragments from config.json...
         Starting Resin network configure service...
         Starting Balena device UUID...
         Starting Modem Manager...
[  OK  ] Started D-Bus System Message Bus.
         Starting OS SSH keys...
         Starting OpenSSH Key Generation...
         Starting Resin persistent logs...
[  OK  ] Started Initialize system clock from build timestamp.
[FAILED] Failed to start NetworkManager configuration fragments from config.json.
See 'systemctl status os-networkmanager.service' for details.
[FAILED] Failed to start Resin network configure service.
See 'systemctl status resin-net-config.service' for details.
[  OK  ] Started OpenSSH Key Generation.
[  OK  ] Started Resin persistent logs.
[  OK  ] Started NTP client/server.
         Starting Network Manager...
[  OK  ] Reached target System Time Synchronized.
[  OK  ] Started Network Manager.
[  OK  ] Started OS configuration update service.
[  OK  ] Reached target Network.
         Starting DNS forwarder and DHCP server...
         Starting Resin init service...
[  OK  ] Started DNS forwarder and DHCP server.
         Starting Resin proxy configuration service...
         Starting Balena Application Container Engine...
[  OK  ] Started Modem Manager.
[FAILED] Failed to start Resin proxy configuration service.
See 'systemctl status resin-proxy-config.service' for details.
[DEPEND] Dependency failed for redsocks transparent proxy redirector.
[  OK  ] Started udev rules configuration from config.json.
[FAILED] Failed to start Balena device UUID.
See 'systemctl status balena-device-uuid.service' for details.
[DEPEND] Dependency failed for Resin Hostname Configuration.
[DEPEND] Dependency failed for Avahi mDNS/DNS-SD Stack.
[FAILED] Failed to start OS SSH keys.
See 'systemctl status os-sshkeys.service' for details.
[  OK  ] Started Resin init service.
         Starting Hostname Service...
[  OK  ] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[  OK  ] Started Network Manager Script Dispatcher Service.
[  OK  ] Created slice libcontainer_339_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer_339_systemd_test_default.slice.
[  OK  ] Started libcontainer container 0b94da13c49fdbf62e2618ce3231a8e9a5640505f9c427dd3ba7df3ae349bff2.
[  OK  ] Created slice libcontainer_373_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer_373_systemd_test_default.slice.
[  OK  ] Created slice libcontainer_380_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer_380_systemd_test_default.slice.
[  OK  ] Created slice libcontainer_387_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer_387_systemd_test_default.slice.
[  OK  ] Created slice libcontainer_398_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer_398_systemd_test_default.slice.
[  OK  ] Created slice libcontainer_404_systemd_test_default.slice.
[  OK  ] Removed slice libcontainer_404_systemd_test_default.slice.
[  OK  ] Stopped OS configuration update service.
         Starting OS configuration device key service...
[FAILED] Failed to start OS configuration device key service.
See 'systemctl status os-config-devicekey.service' for details.
[  OK  ] Started OS configuration update service.
[  OK  ] Started Balena Application Container Engine.
[  OK  ] Reached target Multi-User System.
         Starting Update UTMP about System Runlevel Changes...
[  OK  ] Started Update UTMP about System Runlevel Changes.

[..]

Going back to 16b91dc works:

$ ./balenaos-in-container.sh --image resin/resinos:2.44.0_rev1-intel-nuc -c config.json --id REC-1 --extra-args "-p 4001:4001"
INFO: Reusing balena-boot-REC-1 docker volume...
INFO: Reusing balena-state-REC-1 docker volume...
INFO: Reusing balena-data-REC-1 docker volume...
INFO: Running balenaOS as container balena-container-REC-1 ...
WARNING: Localhost DNS setting (--dns=127.0.0.2) may fail in containers.

Welcome to balenaOS 2.44.0+rev1!

Failed to bump fs.file-max, ignoring: Invalid argument
/lib/systemd/system/chronyd.service:9: PIDFile= references path below legacy directory /var/run/, updating /var/run/chrony/chronyd.pid → /run/chrony/chronyd.pid; please update the unit file accordingly.
[  OK  ] Listening on initctl Compatibility Named Pipe.
[  OK  ] Listening on udev Kernel Socket.
[  OK  ] Listening on udev Control Socket.
[  OK  ] Set up automount mnt-sysroot-inactive partition.
[  OK  ] Listening on Syslog Socket.
[  OK  ] Listening on Journal Socket (/dev/log).
[  OK  ] Listening on Journal Audit Socket.
[  OK  ] Reached target Swap.
[  OK  ] Listening on Journal Socket.
         Starting Create list of required static device nodes for the current kernel...
         Starting udev Coldplug all Devices...
         Mounting Kernel Configuration File System...
         Mounting Kernel Debug File System...
         Starting Journal Service...
         Mounting Temporary Directory (/tmp)...
         Starting Rollback clear bootcount if altboot crumb is still present...
         Mounting Huge Pages File System...
         Mounting FUSE Control File System...
         Starting Apply Kernel Variables...
[  OK  ] Reached target Login Prompts.
         Starting Setup Virtual Console...
[  OK  ] Created slice User and Session Slice.
[  OK  ] Reached target Slices.
[  OK  ] Reached target Remote File Systems.
         Starting Remount Root and Kernel File Systems...
[  OK  ] Started Forward Password Requests to Wall Directory Watch.
         Starting OS configuration device key service...
[  OK  ] Started Create list of required static device nodes for the current kernel.
[  OK  ] Mounted Kernel Configuration File System.
[  OK  ] Mounted Kernel Debug File System.
[  OK  ] Mounted Temporary Directory (/tmp).
[  OK  ] Started Rollback clear bootcount if altboot crumb is still present.
[  OK  ] Mounted Huge Pages File System.
[  OK  ] Mounted FUSE Control File System.
[  OK  ] Started Apply Kernel Variables.
[  OK  ] Started Setup Virtual Console.
[  OK  ] Started Remount Root and Kernel File Systems.
         Starting Create Static Device Nodes in /dev...
[  OK  ] Started OS configuration device key service.
[  OK  ] Started Journal Service.
[  OK  ] Started Create Static Device Nodes in /dev.
[  OK  ] Reached target Local File Systems (Pre).
         Mounting resin-data bind mount...
[  OK  ] Reached target Containers.
         Mounting /var/volatile...
[  OK  ] Mounted /var/volatile.
         Starting Bind mount volatile /srv...
         Starting Bind mount volatile /var/lib...
         Starting Bind mount volatile /var/spool...
         Starting Bind mount volatile /var/cache...
[  OK  ] Mounted resin-data bind mount.
[  OK  ] Started Bind mount volatile /srv.
[  OK  ] Started Bind mount volatile /var/spool.
[  OK  ] Started Bind mount volatile /var/lib.
[  OK  ] Started Bind mount volatile /var/cache.
         Mounting Docker data mountpoint...
[  OK  ] Mounted Docker data mountpoint.
[  OK  ] Reached target Local File Systems.
         Starting Create Volatile Files and Directories...
[  OK  ] Started udev Coldplug all Devices.
         Starting udev Wait for Complete Device Initialization...
[  OK  ] Started Create Volatile Files and Directories.
         Starting Bind mount for /etc/NetworkManager/conf.d...
         Starting Bind mount for /etc/hostname...
         Starting Bind mount for /etc/docker...
         Starting Bind mount for /var/lib/systemd...
         Starting Bind mount for /var/lib/chrony...
         Starting Bind mount for /etc/udev/rules.d...
         Starting Bind mount for /home/root/.rnd...
         Starting Bind mount for /home/root/.docker...
         Starting Bind mount for /etc/resin-supervisor...
         Starting Bind mount for /var/lib/bluetooth...
         Starting Bind mount for /etc/NetworkManager/system-connections...
         Starting Bind mount for /var/lib/NetworkManager...
         Starting Bind mount for /etc/ssh/hostkeys...
         Starting Bind mount for /etc/openvpn...
         Starting Bind mount for /home/root/.ssh...
         Starting Update UTMP about System Boot/Shutdown...
[  OK  ] Started Bind mount for /etc/NetworkManager/conf.d.
[  OK  ] Started Bind mount for /etc/hostname.
[  OK  ] Started Bind mount for /etc/docker.
[  OK  ] Started Bind mount for /var/lib/systemd.
[  OK  ] Started Bind mount for /var/lib/chrony.
[  OK  ] Started Bind mount for /etc/udev/rules.d.
[  OK  ] Started Bind mount for /home/root/.rnd.
[  OK  ] Started Bind mount for /home/root/.docker.
[  OK  ] Started Bind mount for /etc/resin-supervisor.
[  OK  ] Started Bind mount for /var/lib/bluetooth.
[  OK  ] Started Bind mount for /etc/NetworkManager/system-connections.
[  OK  ] Started Bind mount for /var/lib/NetworkManager.
[  OK  ] Started Bind mount for /etc/ssh/hostkeys.
[  OK  ] Started Bind mount for /etc/openvpn.
[  OK  ] Started Bind mount for /home/root/.ssh.
[  OK  ] Started Update UTMP about System Boot/Shutdown.
         Starting udev Kernel Device Manager...
[  OK  ] Started udev Kernel Device Manager.
[  OK  ] Started udev Wait for Complete Device Initialization.
[  OK  ] Started Dispatch Password Requests to Console Directory Watch.
[  OK  ] Started Hardware RNG Entropy Gatherer Daemon.
[  OK  ] Reached target System Initialization.
         Starting Docker Socket for the API.
[  OK  ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket.
         Starting Docker Socket for the API.
[  OK  ] Started Resin supervisor updater timer.
         Starting sshd.socket.
[  OK  ] Listening on D-Bus System Message Bus Socket.
[  OK  ] Started Config.json path watch.
[  OK  ] Reached target Paths.
[  OK  ] Started Daily Cleanup of Temporary Directories.
[  OK  ] Reached target Timers.
         Starting Initialize system clock from build timestamp...
[  OK  ] Listening on Docker Socket for the API.
[  OK  ] Listening on Docker Socket for the API.
[  OK  ] Listening on sshd.socket.
[  OK  ] Reached target Sockets.
[  OK  ] Reached target Basic System.
[  OK  ] Started System Logging Service.
[  OK  ] Started Kernel Logging Service.
         Starting OpenSSH Key Generation...
         Starting Modem Manager...
         Starting Resin network configure service...
[  OK  ] Started D-Bus System Message Bus.
         Starting Resin persistent logs...
         Starting udev rules configuration from config.json...
         Starting Balena device UUID...
         Starting NetworkManager configuration fragments from config.json...
         Starting OS SSH keys...
[  OK  ] Started Initialize system clock from build timestamp.
[  OK  ] Started OpenSSH Key Generation.
[  OK  ] Started NTP client/server.
[  OK  ] Reached target System Time Synchronized.
[  OK  ] Started Modem Manager.
[  OK  ] Started Resin persistent logs.
[  OK  ] Started Resin network configure service.
[  OK  ] Started OS SSH keys.
[  OK  ] Started udev rules configuration from config.json.
[  OK  ] Started Balena device UUID.
         Starting Resin Hostname Configuration...
         Starting Config.json watcher service...
[  OK  ] Started Config.json watcher service.
[  OK  ] Started Resin Hostname Configuration.
         Starting Avahi mDNS/DNS-SD Stack...
[  OK  ] Started Avahi mDNS/DNS-SD Stack.
[  OK  ] Started NetworkManager configuration fragments from config.json.
         Starting Network Manager...
[  OK  ] Started Network Manager.
[  OK  ] Started OS configuration update service.
[  OK  ] Reached target Network.
         Starting Resin init service...
         Starting DNS forwarder and DHCP server...
         Starting Hostname Service...
[  OK  ] Started DNS forwarder and DHCP server.
         Starting Balena Application Container Engine...
         Starting Resin proxy configuration service...
[  OK  ] Started Resin init service.
[  OK  ] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[  OK  ] Started Network Manager Script Dispatcher Service.
[  OK  ] Started Resin proxy configuration service.
         Starting Prepare OpenVPN...
[  OK  ] Started Prepare OpenVPN.
[  OK  ] Started OpenVPN.

Running container logs out host machine and forces it to reboot

Running the container (see command below) crashes my ubuntu 19.10 machine running docker. I have run it on the same hardware (dell xps 15 intel i7) on my windows partition without it booting me out. Can you please help or advise why I am getting this behaviour

Command:
./balenaos-in-container.sh --image resin/resinos:2.50.1_rev1.dev-genericx86-64-ext --id test -c "config.json" --detach