karamelchef / karamel-examples Goto Github PK

Hello,

I tried the example karamel-examples/stable/hopsworks-aws-eu-west-xlarge.yml on AWS using Karamel v0.5 installed on my macbook.

There is an error when running the recipes livy::install

I found the error message "No space left on device", so there is no space in the AWS VM instance?

How should I get it correct? Also, are there newer examples that I can try?

Thanks a lot!

The log is as follows (attached file):

Starting Chef Client, version 13.4.19�[0m
resolving cookbooks for run list: ["livy::install"]�[0m
Synchronizing Cookbooks:�[0m

• livy (0.9.0)�[0m
• hadoop_spark (0.9.0)�[0m
• ndb (0.9.0)�[0m
• hops (0.9.0)�[0m
• kagent (0.9.0)�[0m
• java (4.1.0)�[0m
• magic_shell (1.0.0)�[0m
• hopsmonitor (0.9.0)�[0m
• hive2 (0.9.0)�[0m
• ulimit (0.9.0)�[0m
• sysctl (1.0.5)�[0m
• cmake (0.3.0)�[0m
• kzookeeper (0.9.0)�[0m
• openssl (8.5.5)�[0m
• sudo (5.4.4)�[0m
• hostsfile (3.0.1)�[0m
• ntp (2.0.3)�[0m
• conda (0.9.0)�[0m
• homebrew (5.0.8)�[0m
• windows (6.0.0)�[0m
• elastic (0.9.0)�[0m
• ohai (5.2.5)�[0m
• influxdb (6.3.1)�[0m
• elasticsearch (4.0.6)�[0m
• ulimit2 (0.2.0)�[0m
• nodejs (6.0.0)�[0m
• chef_handler (3.0.3)�[0m
• apt (7.1.1)�[0m
• yum (5.1.0)�[0m
• chef-sugar (5.0.1)�[0m
• ark (4.0.0)�[0m
• build-essential (8.2.1)�[0m
• seven_zip (3.1.1)�[0m
• mingw (2.1.0)�[0m
  Installing Cookbook Gems:�[0m
  Compiling Cookbooks...�[0m
  Converging 17 resources�[0m
  Recipe: java::notify�[0m

• log[jdk-version-changed] action nothing (skipped due to action :nothing)
  Recipe: java::openjdk�[0m
• apt_repository[openjdk-r-ppa] action add
  • execute[apt-cache gencaches] action nothing (skipped due to action :nothing)
  • apt_update[openjdk-r-ppa] action nothing (skipped due to action :nothing)
  • execute[install-key DA1A4A13543B466853BAF164EB9B1D8886F44E2A] action run
    �[32m- execute apt-key adv --recv --keyserver hkp://keyserver.ubuntu.com:80 DA1A4A13543B466853BAF164EB9B1D8886F44E2A�[0m
    �[0m * execute[apt-cache gencaches] action run
    �[32m- execute apt-cache gencaches�[0m
    �[0m * file[/etc/apt/sources.list.d/openjdk-r-ppa.list] action create
    �[32m- create new file /etc/apt/sources.list.d/openjdk-r-ppa.list�[0m
    �[32m- update content in file /etc/apt/sources.list.d/openjdk-r-ppa.list from none to 7c008e�[0m
    �[37m--- /etc/apt/sources.list.d/openjdk-r-ppa.list 2019-07-05 09:25:19.194285534 +0000�[0m
    �[37m+++ /etc/apt/sources.list.d/.chef-openjdk-r-ppa20190705-3739-1113czk.list 2019-07-05 09:25:19.194285534 +0000�[0m
    �[37m@@ -1 +1,2 @@�[0m
    �[37m+deb "http://ppa.launchpad.net/openjdk-r/ppa/ubuntu" xenial main�[0m
    �[32m- change mode from '' to '0644'�[0m
    �[32m- change owner from '' to 'root'�[0m
    �[32m- change group from '' to 'root'�[0m
    �[0m * execute[apt-cache gencaches] action run
    �[32m- execute apt-cache gencaches�[0m
    �[0m * apt_update[openjdk-r-ppa] action update
    �[32m- force update new lists of packages�[0m
    • directory[/var/lib/apt/periodic] action create (up to date)
    • directory[/etc/apt/apt.conf.d] action create (up to date)
    • file[/etc/apt/apt.conf.d/15update-stamp] action create_if_missing (up to date)
    • execute[apt-get -q update] action run
      �[32m- execute apt-get -q update�[0m
      �[0m
      �[0m
      �[0m * apt_package[openjdk-8-jdk, openjdk-8-jre-headless] action install
      �[32m- install version 8u212-b03-0ubuntu1.16.04.1 of package openjdk-8-jdk�[0m
      �[32m- install version 8u212-b03-0ubuntu1.16.04.1 of package openjdk-8-jre-headless�[0m
      �[0mRecipe: java::notify�[0m
• log[jdk-version-changed] action write

�[0mRecipe: java::openjdk�[0m

• java_alternatives[set-java-alternatives] action set
  �[32m- Removing alternative for appletviewer with old priority�[0m
  �[32m- Add alternative for appletviewer�[0m
  �[32m- Removing alternative for extcheck with old priority�[0m
  �[32m- Add alternative for extcheck�[0m
  �[32m- Removing alternative for idlj with old priority�[0m
  �[32m- Add alternative for idlj�[0m
  �[32m- Removing alternative for jar with old priority�[0m
  �[32m- Add alternative for jar�[0m
  �[32m- Removing alternative for jarsigner with old priority�[0m
  �[32m- Add alternative for jarsigner�[0m
  �[32m- Add alternative for java�[0m
  �[32m- Removing alternative for javac with old priority�[0m
  �[32m- Add alternative for javac�[0m
  �[32m- Removing alternative for javadoc with old priority�[0m
  �[32m- Add alternative for javadoc�[0m
  �[32m- Removing alternative for javah with old priority�[0m
  �[32m- Add alternative for javah�[0m
  �[32m- Removing alternative for javap with old priority�[0m
  �[32m- Add alternative for javap�[0m
  �[32m- Removing alternative for jcmd with old priority�[0m
  �[32m- Add alternative for jcmd�[0m
  �[32m- Removing alternative for jconsole with old priority�[0m
  �[32m- Add alternative for jconsole�[0m
  �[32m- Removing alternative for jdb with old priority�[0m
  �[32m- Add alternative for jdb�[0m
  �[32m- Removing alternative for jdeps with old priority�[0m
  �[32m- Add alternative for jdeps�[0m
  �[32m- Removing alternative for jhat with old priority�[0m
  �[32m- Add alternative for jhat�[0m
  �[32m- Removing alternative for jinfo with old priority�[0m
  �[32m- Add alternative for jinfo�[0m
  �[32m- Add alternative for jjs�[0m
  �[32m- Removing alternative for jmap with old priority�[0m
  �[32m- Add alternative for jmap�[0m
  �[32m- Removing alternative for jps with old priority�[0m
  �[32m- Add alternative for jps�[0m
  �[32m- Removing alternative for jrunscript with old priority�[0m
  �[32m- Add alternative for jrunscript�[0m
  �[32m- Removing alternative for jsadebugd with old priority�[0m
  �[32m- Add alternative for jsadebugd�[0m
  �[32m- Removing alternative for jstack with old priority�[0m
  �[32m- Add alternative for jstack�[0m
  �[32m- Removing alternative for jstat with old priority�[0m
  �[32m- Add alternative for jstat�[0m
  �[32m- Removing alternative for jstatd with old priority�[0m
  �[32m- Add alternative for jstatd�[0m
  �[32m- Add alternative for keytool�[0m
  �[32m- Removing alternative for native2ascii with old priority�[0m
  �[32m- Add alternative for native2ascii�[0m
  �[32m- Add alternative for orbd�[0m
  �[32m- Add alternative for pack200�[0m
  �[32m- Add alternative for policytool�[0m
  �[32m- Removing alternative for rmic with old priority�[0m
  �[32m- Add alternative for rmic�[0m
  �[32m- Add alternative for rmid�[0m
  �[32m- Add alternative for rmiregistry�[0m
  �[32m- Removing alternative for schemagen with old priority�[0m
  �[32m- Add alternative for schemagen�[0m
  �[32m- Removing alternative for serialver with old priority�[0m
  �[32m- Add alternative for serialver�[0m
  �[32m- Add alternative for servertool�[0m
  �[32m- Add alternative for tnameserv�[0m
  �[32m- Add alternative for unpack200�[0m
  �[32m- Removing alternative for wsgen with old priority�[0m
  �[32m- Add alternative for wsgen�[0m
  �[32m- Removing alternative for wsimport with old priority�[0m
  �[32m- Add alternative for wsimport�[0m
  �[32m- Removing alternative for xjc with old priority�[0m
  �[32m- Add alternative for xjc�[0m
  �[0mRecipe: java::default_java_symlink�[0m
• link[/usr/lib/jvm/default-java] action create
  �[32m- create symlink at /usr/lib/jvm/default-java to /usr/lib/jvm/java-8-openjdk-amd64�[0m
  �[0mRecipe: java::set_java_home�[0m
• directory[/etc/profile.d] action create (up to date)
• template[/etc/profile.d/jdk.sh] action create
  �[32m- create new file /etc/profile.d/jdk.sh�[0m
  �[32m- update content in file /etc/profile.d/jdk.sh from none to 2a5cdf�[0m
  �[37m--- /etc/profile.d/jdk.sh 2019-07-05 09:25:48.481977665 +0000�[0m
  �[37m+++ /etc/profile.d/.chef-jdk20190705-3739-ha5uq5.sh 2019-07-05 09:25:48.481977665 +0000�[0m
  �[37m@@ -1 +1,2 @@�[0m
  �[37m+export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64�[0m
  �[32m- change mode from '' to '0755'�[0m
  �[0m * ruby_block[Set JAVA_HOME in /etc/environment] action run
  �[32m- execute the ruby block Set JAVA_HOME in /etc/environment�[0m
  �[0mRecipe: livy::install�[0m
• group[certs] action create
  �[32m- create group certs�[0m
  �[0m * group[ubuntu] action create (skipped due to not_if)
• linux_user[ubuntu] action create (skipped due to not_if)
• group[certs] action modify
  �[32m- modify group certs�[0m
  �[32m- add missing member(s): ubuntu�[0m
  �[0m * group[ubuntu] action modify
  �[32m- modify group ubuntu�[0m
  �[32m- add missing member(s): ubuntu�[0m
  �[0m * remote_file[/tmp/chef-solo/livy-0.6.0.0-incubating-bin.zip] action create_if_missing
  �[0m
  ================================================================================�[0m
  �[31mError executing action create_if_missing on resource 'remote_file[/tmp/chef-solo/livy-0.6.0.0-incubating-bin.zip]'�[0m
  ================================================================================�[0m

�[0m Errno::ENOSPC�[0m
-------------�[0m
No space left on device @ io_write - /tmp/chef-rest20190705-3739-136f0ia�[0m

�[0m Resource Declaration:�[0m
---------------------�[0m
# In /tmp/chef-solo/cookbooks/livy/recipes/install.rb
�[0m
�[0m 47: remote_file cached_package_filename do
�[0m 48: source package_url
�[0m 49: owner "#{node['livy']['user']}"
�[0m 50: mode "0644"
�[0m 51: action :create_if_missing
�[0m 52: end
�[0m 53:
�[0m
�[0m Compiled Resource:�[0m
------------------�[0m
# Declared in /tmp/chef-solo/cookbooks/livy/recipes/install.rb:47:in `from_file'
�[0m
�[0m remote_file("/tmp/chef-solo/livy-0.6.0.0-incubating-bin.zip") do
�[0m provider Chef::Provider::RemoteFile
�[0m action [:create_if_missing]
�[0m default_guard_interpreter :default
�[0m source ["http://193.10.67.171/hops/livy-0.6.0.0-incubating-bin.zip"]
�[0m use_etag true
�[0m use_last_modified true
�[0m declared_type :remote_file
�[0m cookbook_name "livy"
�[0m recipe_name "install"
�[0m owner "ubuntu"
�[0m mode "0644"
�[0m remote_domain nil
�[0m remote_user nil
�[0m path "/tmp/chef-solo/livy-0.6.0.0-incubating-bin.zip"
�[0m group nil
�[0m checksum nil
�[0m verifications []
�[0m end
�[0m
�[0m System Info:�[0m
------------�[0m
chef_version=13.4.19
�[0m platform=ubuntu
�[0m platform_version=16.04
�[0m ruby=ruby 2.4.2p198 (2017-09-14 revision 59899) [x86_64-linux]
�[0m program_name=chef-solo worker: ppid=3734;start=09:25:11;
�[0m executable=/opt/chefdk/bin/chef-solo�[0m

�[0m�[0m
Running handlers:�[0m
[2019-07-05T09:25:50+00:00] ERROR: Running exception handlers
Running handlers complete
�[0m[2019-07-05T09:25:50+00:00] ERROR: Exception handlers complete
Chef Client failed. 16 resources updated in 38 seconds�[0m
[2019-07-05T09:25:50+00:00] FATAL: Stacktrace dumped to /tmp/chef-solo/chef-stacktrace.out
[2019-07-05T09:25:50+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2019-07-05T09:25:50+00:00] ERROR: remote_file[/tmp/chef-solo/livy-0.6.0.0-incubating-bin.zip] (livy::install line 47) had an error: Errno::ENOSPC: No space left on device @ io_write - /tmp/chef-rest20190705-3739-136f0ia
[2019-07-05T09:25:50+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)

deploy_logfile.txt