zardus / ctf-tools Goto Github PK

I tried install ctf-tools on kali linux,but error occurred in this command

 ./manage-tools setup

this behave is not changed when using sudo.

please tell me why this error occurred.

thanks.

there are a bunch of tools downloaded over http. this isn't great in the case of being somewhere where your wifi can't be trusted (onsite at a ctf for example ;-) )

As per 4 days ago or so...

https://blog.torproject.org/blog/discontinuing-hardened-tor-browser-series

The 'successor' is sandboxed tor browser which atm has to be built from source as per -

https://trac.torproject.org/projects/tor/wiki/doc/TorBrowser/Sandbox/Linux

So entire new install script will need to be done.

https://github.com/endrazine/wcc

https://www.youtube.com/watch?v=nbvswQjsIUQ&feature=youtu.be

The install failed -- looks like the package installation wasn't done in a writeable location?

Installing collected packages: binwalk
Running setup.py develop for binwalk
error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the
installation directory:

    [Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/test-easy-install-8583.write-test'

The installation directory you specified (via --install-dir, --prefix, or
the distutils default setting) was:

    /usr/local/lib/python2.7/dist-packages/

Perhaps your account does not have write access to this directory?  If the
installation directory is a system-owned directory, you may need to sign in
as the administrator or "root" account.  If you do not have administrative
access to this machine, you may wish to choose a different installation
directory, preferably one that is listed in your PYTHONPATH environment
variable.

For information on other options, you may wish to consult the
documentation at:

  https://pythonhosted.org/setuptools/easy_install.html

Please make the appropriate changes for your system and try again.

Complete output from command /usr/bin/python -c "import setuptools, tokenize; __file__='/home/edg/code/ctf-tools/binwalk/binwalk/setup.py'; exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" develop --no-deps:
running develop

error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the

installation directory:

[Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/test-easy-install-8583.write-test'

The installation directory you specified (via --install-dir, --prefix, or

the distutils default setting) was:

/usr/local/lib/python2.7/dist-packages/

Perhaps your account does not have write access to this directory? If the

installation directory is a system-owned directory, you may need to sign in

as the administrator or "root" account. If you do not have administrative

access to this machine, you may wish to choose a different installation

directory, preferably one that is listed in your PYTHONPATH environment

variable.

For information on other options, you may wish to consult the

documentation at:

https://pythonhosted.org/setuptools/easy_install.html

Please make the appropriate changes for your system and try again.

Cleaning up...
Command /usr/bin/python -c "import setuptools, tokenize; file='/home/edg/code/ctf-tools/binwalk/binwalk/setup.py'; exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" develop --no-deps failed with error code 1 in /home/edg/code/ctf-tools/binwalk/binwalk
Storing debug log for failure in /tmp/tmp1q6Xkc

https://github.com/haxkor/forkever

O e drive Does. Not open up

This is a CTF tools framework, hoping to be your collection
Https://github.com/0Linchen/CTFCrackTools
China 's first CTF tool framework
Thank you!

W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/trusty-updates/main/source/Sources Hash Sum mismatch

I just tested all Dockerfiles;

for df in Dockerfile*; do sudo docker build -t "ctf-tools-${df,,}" -f $df .; done

The Dockerfiles for Arch Linux, Fedora, and Ubuntu Artful are not working. See details below:

Arch Linux:

Step 1/29 : FROM base/archlinux
Trying to pull repository docker.io/base/archlinux ... 
Trying to pull repository registry.fedoraproject.org/base/archlinux ... 
Trying to pull repository quay.io/base/archlinux ... 
Trying to pull repository registry.access.redhat.com/base/archlinux ... 
Trying to pull repository registry.centos.org/base/archlinux ... 
Trying to pull repository docker.io/base/archlinux ... 
manifest for docker.io/base/archlinux:latest not found

Ubuntu Artful:

Step 1/22 : FROM ubuntu:artful
 ---> e211a66937c6
Step 2/22 : COPY .docker/apt-get-install /usr/local/bin/apt-get-install
 ---> Using cache
 ---> 35929049c268
Step 3/22 : RUN chmod +x /usr/local/bin/apt-get-install
 ---> Using cache
 ---> 6846ad88f6d9
Step 4/22 : RUN apt-get-install build-essential libtool g++ gcc     texinfo curl wget automake autoconf python python-dev git subversion     unzip virtualenvwrapper sudo  git virtualenvwrapper
 ---> Running in 593beb27edac
Ign:1 http://security.ubuntu.com/ubuntu artful-security InRelease
Err:2 http://security.ubuntu.com/ubuntu artful-security Release
  404  Not Found [IP: 91.189.88.149 80]
Ign:3 http://archive.ubuntu.com/ubuntu artful InRelease
Ign:4 http://archive.ubuntu.com/ubuntu artful-updates InRelease
Ign:5 http://archive.ubuntu.com/ubuntu artful-backports InRelease
Err:6 http://archive.ubuntu.com/ubuntu artful Release
  404  Not Found [IP: 91.189.91.23 80]
Err:7 http://archive.ubuntu.com/ubuntu artful-updates Release
  404  Not Found [IP: 91.189.91.23 80]
Err:8 http://archive.ubuntu.com/ubuntu artful-backports Release
  404  Not Found [IP: 91.189.91.23 80]
Reading package lists...
E: The repository 'http://security.ubuntu.com/ubuntu artful-security Release' does not have a Release file.
E: The repository 'http://archive.ubuntu.com/ubuntu artful Release' does not have a Release file.
E: The repository 'http://archive.ubuntu.com/ubuntu artful-updates Release' does not have a Release file.
E: The repository 'http://archive.ubuntu.com/ubuntu artful-backports Release' does not have a Release file.
The command '/bin/sh -c apt-get-install build-essential libtool g++ gcc     texinfo curl wget automake autoconf python python-dev git subversion     unzip virtualenvwrapper sudo  git virtualenvwrapper' returned a non-zero code: 100

Fedora:

[...]
Step 17/21 : RUN bin/manage-tools -s setup
 ---> Running in 3cc4dba74129
Last metadata expiration check: 0:01:53 ago on Mon Jun 24 09:52:08 2019.
Package gcc-9.1.1-1.fc30.x86_64 is already installed.
Package gcc-c++-9.1.1-1.fc30.x86_64 is already installed.
Package curl-7.64.0-7.fc30.x86_64 is already installed.
Package python-unversioned-command-2.7.16-2.fc30.noarch is already installed.
Package git-2.21.0-1.fc30.x86_64 is already installed.
Package unzip-6.0-43.fc30.x86_64 is already installed.
No match for argument: python-virtualenvwrapper
Package redhat-rpm-config-128-1.fc30.noarch is already installed.
Error: Unable to find a match
The command '/bin/sh -c bin/manage-tools -s setup' returned a non-zero code: 1

Best
Martin

.

Dozens of tools

https://github.com/zed-0xff/zsteg

detect stegano-hidden data in PNG & BMP

https://github.com/lunixbochs/patchkit

Problem is it depends on the keystone, capstone, unicorn triad all from git. Should we install those generically and set LD_LIBRARY_PATH so that all other tools can use it, or keep it just to the patchkit subdir?

Tests are broken after the intelligent tool grouping stuff.

New link: https://github.com/rogerhu/gdb-heap

Old one is dead.

Should probably install 'liblzma-dev' with -s

It seems this already has Ropper, rp++, and other tools to create rop gadgets.

So, would it be interesting to add ropgadget? (my go to tool) Or, do you want to minimize duplication of tools for the job?

Cool cryptanalysis lib: https://github.com/nccgroup/featherduster

TOOLS | zsteg | starting install, logging to /home/ctf/tools/zsteg/install.log
TOOLS | zsteg | Warning: make sure build dependencies are installed!
TOOLS | zsteg | INSTALL FAILED
+ gem install --user-install zsteg
./install: line 3: gem: command not found

gem shall be added in the Dockerfile or explicitly installed in zsteg/install.

manage-tools search crypto for example should list the crypto tools and descriptions.

the stuff is all in the .md file, but it would be nice to be able to search from the script itself.

It seems the docker installation broke recently. I remember being able to use the docker file before summer but when installing on a new machine this is where it failed.

As title.

` File "/root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pkg_resources/init.py", line 74, in

import appdirs

ImportError: No module named appdirs

Cleaning up...
Command /root/.virtualenvs/ctftools/bin/python2 -c "import setuptools, tokenize;file='/root/.virtualenvs/ctftools/build/cffi/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-mkVBh_-record/install-record.txt --single-version-externally-managed --compile --install-headers /root/.virtualenvs/ctftools/include/site/python2.7 failed with error code 1 in /root/.virtualenvs/ctftools/build/cffi
Traceback (most recent call last):
File "/root/.virtualenvs/ctftools/bin/pip", line 11, in
sys.exit(main())
File "/root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/init.py", line 185, in main
guess = get_similar_commands(cmd_name)
File "/root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/basecommand.py", line 161, in main
},
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 31: ordinal not in range(128)
`

Using a clean install of Ubuntu Trusty 14.04.

Haven't done any pull requests for a while so I don't know the conventions on using pip install for tool installs.

something like

manage-tools upgrade to update to the latest version of tools would be really awesome. Some things like afl-fuzz and radare2 update very frequently, and keeping in sync would be helpful.

looks interesting - https://codisec.com/veles/

Conflicts with https://github.com/grke/burp

***During Installation of "stegdetect" warning occurs:

WARNING: aclocal-1.4' is needed, and you do not seem to have it handy on your system. You might have modified some files without having the proper tools for further handling them. Check the README' file,
it often tells you about the needed prerequirements for installing
this package. You may also peek at any GNU archive site, in case
some other package would contain this missing `aclocal-1.4' program.
Makefile:183: recipe for target 'aclocal.m4' failed
make: *** [aclocal.m4] Error 1

***Doing "autoreconf -f -i" brought another error:

Makefile.am: error: Assembler source seen but 'CCAS' is undefined
Makefile.am: The usual way to define 'CCAS' is to add 'AM_PROG_AS'
Makefile.am: to 'configure.in' and run 'aclocal' and 'autoconf' again.
Makefile.am: error: Assembler source seen but 'CCASFLAGS' is undefined
Makefile.am: The usual way to define 'CCASFLAGS' is to add 'AM_PROG_AS'
Makefile.am: to 'configure.in' and run 'aclocal' and 'autoconf' again.
autoreconf: automake failed with exit status: 1

valgrind is very strict about the kernel versions it will build under, but it might still work if that check is disabled (like we do for libc, IIRC). We need to do this for the various valgrind tools we have.

https://github.com/pfalcon/ScratchABit

ly and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning.
InsecurePlatformWarning
Downloading https://github.com/aquynh/capstone/archive/next.zip
/root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning.
InsecurePlatformWarning
Requirement already up-to-date: pip in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 1))
Requirement already up-to-date: pycparser in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 2))
Requirement already up-to-date: psutil>=3.1.0 in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 3))
Requirement already up-to-date: python-ptrace>=0.8 in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 4))
Requirement already up-to-date: pyelftools in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 5))
Requirement already up-to-date: isort in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 6))
Requirement already up-to-date: six in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 7))
Requirement already up-to-date: future in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 8))
Requirement already up-to-date: ROPgadget in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 9))
Requirement already up-to-date: unicorn>=1.0.0 in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 10))
Installing collected packages: capstone
Found existing installation: capstone 4.0.0rc1
Uninstalling capstone-4.0.0rc1:
Successfully uninstalled capstone-4.0.0rc1
Running setup.py install for capstone: started
Running setup.py install for capstone: finished with status 'done'
Successfully installed capstone-4.0.0rc1

• popd
  ~/ctf-tools/pwndbg
• pip install -U capstone
  /root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#snimissingwarning.
  SNIMissingWarning
  /root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning.
  InsecurePlatformWarning
  Requirement already up-to-date: capstone in /root/.virtualenvs/ctftools/lib/python2.7/site-packages
• manage-tools install unicorn
  TOOLS | unicorn | starting install, logging to /root/ctf-tools/unicorn/install.log
• ctf-tools-pip install -U unicorn
  Requirement already up-to-date: unicorn in /root/.virtualenvs/ctftools/lib/python2.7/site-packages
• ctf-tools-pip3 install -U unicorn
  Downloading/unpacking unicorn
  Running setup.py (path:/root/.virtualenvs/ctftools3/build/unicorn/setup.py) egg_info for package unicorn

Installing collected packages: unicorn
Running setup.py install for unicorn
Building C extensions
cd qemu &&
./configure --cc="cc" --extra-cflags="-DUNICORN_HAS_X86 -DUNICORN_HAS_ARM -DUNICORN_HAS_M68K -DUNICORN_HAS_ARM64 -DUNICORN_HAS_MIPS -DUNICORN_HAS_MIPSEL -DUNICORN_HAS_MIPS64 -DUNICORN_HAS_MIPS64EL -DUNICORN_HAS_SPARC -fPIC -fvisibility=hidden" --target-list="x86_64-softmmu, arm-softmmu, m68k-softmmu, aarch64-softmmu, mips-softmmu, mipsel-softmmu, mips64-softmmu, mips64el-softmmu, sparc-softmmu,sparc64-softmmu,"

ERROR: Cannot use 'python', Python 2.4 or later is required.
       Note that Python 3 or later is not yet supported.
       Use --python=/path/to/python to specify a supported Python.

make: *** [qemu/config-host.h-timestamp] Error 1
error: [Errno 2] No such file or directory: 'libunicorn.so'
Complete output from command /root/.virtualenvs/ctftools3/bin/python3 -c "import setuptools, tokenize;__file__='/root/.virtualenvs/ctftools3/build/unicorn/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-nut9ondu-record/install-record.txt --single-version-externally-managed --compile --install-headers /root/.virtualenvs/ctftools3/include/site/python3.4:
running install

running build

Building C extensions

cd qemu && \

./configure --cc="cc" --extra-cflags="-DUNICORN_HAS_X86 -DUNICORN_HAS_ARM -DUNICORN_HAS_M68K -DUNICORN_HAS_ARM64 -DUNICORN_HAS_MIPS -DUNICORN_HAS_MIPSEL -DUNICORN_HAS_MIPS64 -DUNICORN_HAS_MIPS64EL -DUNICORN_HAS_SPARC -fPIC -fvisibility=hidden" --target-list="x86_64-softmmu, arm-softmmu, m68k-softmmu, aarch64-softmmu, mips-softmmu, mipsel-softmmu, mips64-softmmu, mips64el-softmmu, sparc-softmmu,sparc64-softmmu,"

ERROR: Cannot use 'python', Python 2.4 or later is required.

   Note that Python 3 or later is not yet supported.

   Use --python=/path/to/python to specify a supported Python.

make: *** [qemu/config-host.h-timestamp] Error 1

error: [Errno 2] No such file or directory: 'libunicorn.so'

Cleaning up...
Command /root/.virtualenvs/ctftools3/bin/python3 -c "import setuptools, tokenize;file='/root/.virtualenvs/ctftools3/build/unicorn/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-nut9ondu-record/install-record.txt --single-version-externally-managed --compile --install-headers /root/.virtualenvs/ctftools3/include/site/python3.4 failed with error code 1 in /root/.virtualenvs/ctftools3/build/unicorn
Storing debug log for failure in /root/.pip/pip.log
TOOLS | unicorn | INSTALL FAILED

• apt-get -y install libglib2.0-dev
  Reading package lists...
  Building dependency tree...
  Reading state information...
  libglib2.0-dev is already the newest version.
  0 to upgrade, 0 to newly install, 0 to remove and 0 not to upgrade.
• ctf-tools-pip install -U unicorn
  Requirement already up-to-date: unicorn in /root/.virtualenvs/ctftools/lib/python2.7/site-packages
• ctf-tools-pip3 install -U unicorn
  Downloading/unpacking unicorn
  Running setup.py (path:/root/.virtualenvs/ctftools3/build/unicorn/setup.py) egg_info for package unicorn

Installing collected packages: unicorn
Running setup.py install for unicorn
Building C extensions
cd qemu &&
./configure --cc="cc" --extra-cflags="-DUNICORN_HAS_X86 -DUNICORN_HAS_ARM -DUNICORN_HAS_M68K -DUNICORN_HAS_ARM64 -DUNICORN_HAS_MIPS -DUNICORN_HAS_MIPSEL -DUNICORN_HAS_MIPS64 -DUNICORN_HAS_MIPS64EL -DUNICORN_HAS_SPARC -fPIC -fvisibility=hidden" --target-list="x86_64-softmmu, arm-softmmu, m68k-softmmu, aarch64-softmmu, mips-softmmu, mipsel-softmmu, mips64-softmmu, mips64el-softmmu, sparc-softmmu,sparc64-softmmu,"

ERROR: Cannot use 'python', Python 2.4 or later is required.
       Note that Python 3 or later is not yet supported.
       Use --python=/path/to/python to specify a supported Python.

make: *** [qemu/config-host.h-timestamp] Error 1
error: [Errno 2] No such file or directory: 'libunicorn.so'
Complete output from command /root/.virtualenvs/ctftools3/bin/python3 -c "import setuptools, tokenize;__file__='/root/.virtualenvs/ctftools3/build/unicorn/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-nut9ondu-record/install-record.txt --single-version-externally-managed --compile --install-headers /root/.virtualenvs/ctftools3/include/site/python3.4:
running install

running build

Building C extensions

cd qemu && \

./configure --cc="cc" --extra-cflags="-DUNICORN_HAS_X86 -DUNICORN_HAS_ARM -DUNICORN_HAS_M68K -DUNICORN_HAS_ARM64 -DUNICORN_HAS_MIPS -DUNICORN_HAS_MIPSEL -DUNICORN_HAS_MIPS64 -DUNICORN_HAS_MIPS64EL -DUNICORN_HAS_SPARC -fPIC -fvisibility=hidden" --target-list="x86_64-softmmu, arm-softmmu, m68k-softmmu, aarch64-softmmu, mips-softmmu, mipsel-softmmu, mips64-softmmu, mips64el-softmmu, sparc-softmmu,sparc64-softmmu,"

ERROR: Cannot use 'python', Python 2.4 or later is required.

   Note that Python 3 or later is not yet supported.

   Use --python=/path/to/python to specify a supported Python.

make: *** [qemu/config-host.h-timestamp] Error 1

error: [Errno 2] No such file or directory: 'libunicorn.so'

Cleaning up...
Command /root/.virtualenvs/ctftools3/bin/python3 -c "import setuptools, tokenize;file='/root/.virtualenvs/ctftools3/build/unicorn/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-nut9ondu-record/install-record.txt --single-version-externally-managed --compile --install-headers /root/.virtualenvs/ctftools3/include/site/python3.4 failed with error code 1 in /root/.virtualenvs/ctftools3/build/unicorn
Storing debug log for failure in /root/.pip/pip.log
TOOLS | pwndbg | INSTALL FAILED

• apt-get install -y libc6-dbg
  Reading package lists...
  Building dependency tree...
  Reading state information...
  libc6-dbg is already the newest version.
  0 to upgrade, 0 to newly install, 0 to remove and 0 not to upgrade.
• set -e -o pipefail
• git clone --depth 1 https://github.com/pwndbg/pwndbg
  Cloning into 'pwndbg'...
• source ctf-tools-venv-activate
  ++ [[ ./install =~ pip3 ]]
  ++ [[ ./install =~ pip2 ]]
  ++ [[ -z '' ]]
  ++ PY_VERSION=2
  +++ which python2
  ++ PY_INTERPRETER=/usr/bin/python2
  ++ [[ -z '' ]]
  ++ CTF_TOOLS_VE=ctftools
  ++ [[ 2 -eq 3 ]]
  ++ [[ -z '' ]]
  ++ export WORKON_HOME=/root/.virtualenvs
  ++ WORKON_HOME=/root/.virtualenvs
  ++ [[ ! -d /root/.virtualenvs ]]
  ++ VE_DIR=/root/.virtualenvs/ctftools
  ++ [[ ! -d /root/.virtualenvs/ctftools ]]
  ++ [[ ! -e /root/.virtualenvs/ctftools/bin/activate ]]
  ++ [[ -z '' ]]
  ++ [[ -n '' ]]
  ++ source /root/.virtualenvs/ctftools/bin/activate
  +++ deactivate nondestructive
  +++ unset pydoc
  +++ '[' -n '' ']'
  +++ '[' -n '' ']'
  +++ '[' -n /bin/bash -o -n '' ']'
  +++ hash -r
  +++ '[' -n '' ']'
  +++ unset VIRTUAL_ENV
  +++ '[' '!' nondestructive = nondestructive ']'
  +++ VIRTUAL_ENV=/root/.virtualenvs/ctftools
  +++ export VIRTUAL_ENV
  +++ _OLD_VIRTUAL_PATH=/root/ctf-tools/bin:/root/ctf-tools/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
  +++ PATH=/root/.virtualenvs/ctftools/bin:/root/ctf-tools/bin:/root/ctf-tools/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
  +++ export PATH
  +++ '[' -n '' ']'
  +++ '[' -z '' ']'
  +++ _OLD_VIRTUAL_PS1=
  +++ '[' x '!=' x ']'
  ++++ basename /root/.virtualenvs/ctftools
  +++ '[' ctftools = __ ']'
  ++++ basename /root/.virtualenvs/ctftools
  +++ PS1='(ctftools)'
  +++ export PS1
  +++ alias 'pydoc=python -m pydoc'
  +++ '[' -n /bin/bash -o -n '' ']'
  +++ hash -r
• pushd pwndbg
  ~/ctf-tools/pwndbg/pwndbg ~/ctf-tools/pwndbg
• pip install -Ur ./requirements.txt
  Collecting https://github.com/aquynh/capstone/archive/next.zip#subdirectory=bindings/python (from -r ./requirements.txt (line 11))
  /root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#snimissingwarning.
  SNIMissingWarning
  /root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning.
  InsecurePlatformWarning
  /root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning.
  InsecurePlatformWarning
  Downloading https://github.com/aquynh/capstone/archive/next.zip
  /root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning.
  InsecurePlatformWarning
  Requirement already up-to-date: pip in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 1))
  Requirement already up-to-date: pycparser in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 2))
  Requirement already up-to-date: psutil>=3.1.0 in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 3))
  Requirement already up-to-date: python-ptrace>=0.8 in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 4))
  Requirement already up-to-date: pyelftools in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 5))
  Requirement already up-to-date: isort in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 6))
  Requirement already up-to-date: six in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 7))
  Requirement already up-to-date: future in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 8))
  Requirement already up-to-date: ROPgadget in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 9))
  Requirement already up-to-date: unicorn>=1.0.0 in /root/.virtualenvs/ctftools/lib/python2.7/site-packages (from -r ./requirements.txt (line 10))
  Installing collected packages: capstone
  Found existing installation: capstone 4.0.0rc1
  Uninstalling capstone-4.0.0rc1:
  Successfully uninstalled capstone-4.0.0rc1
  Running setup.py install for capstone: started
  Running setup.py install for capstone: finished with status 'done'
  Successfully installed capstone-4.0.0rc1
• popd
  ~/ctf-tools/pwndbg
• pip install -U capstone
  /root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#snimissingwarning.
  SNIMissingWarning
  /root/.virtualenvs/ctftools/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning.
  InsecurePlatformWarning
  Requirement already up-to-date: capstone in /root/.virtualenvs/ctftools/lib/python2.7/site-packages
• manage-tools install unicorn
  TOOLS | unicorn | starting install, logging to /root/ctf-tools/unicorn/install.log
• ctf-tools-pip install -U unicorn
  Requirement already up-to-date: unicorn in /root/.virtualenvs/ctftools/lib/python2.7/site-packages
• ctf-tools-pip3 install -U unicorn
  Downloading/unpacking unicorn
  Running setup.py (path:/root/.virtualenvs/ctftools3/build/unicorn/setup.py) egg_info for package unicorn

Installing collected packages: unicorn
Running setup.py install for unicorn
Building C extensions
cd qemu &&
./configure --cc="cc" --extra-cflags="-DUNICORN_HAS_X86 -DUNICORN_HAS_ARM -DUNICORN_HAS_M68K -DUNICORN_HAS_ARM64 -DUNICORN_HAS_MIPS -DUNICORN_HAS_MIPSEL -DUNICORN_HAS_MIPS64 -DUNICORN_HAS_MIPS64EL -DUNICORN_HAS_SPARC -fPIC -fvisibility=hidden" --target-list="x86_64-softmmu, arm-softmmu, m68k-softmmu, aarch64-softmmu, mips-softmmu, mipsel-softmmu, mips64-softmmu, mips64el-softmmu, sparc-softmmu,sparc64-softmmu,"

ERROR: Cannot use 'python', Python 2.4 or later is required.
       Note that Python 3 or later is not yet supported.
       Use --python=/path/to/python to specify a supported Python.

make: *** [qemu/config-host.h-timestamp] Error 1
error: [Errno 2] No such file or directory: 'libunicorn.so'
Complete output from command /root/.virtualenvs/ctftools3/bin/python3 -c "import setuptools, tokenize;__file__='/root/.virtualenvs/ctftools3/build/unicorn/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-nut9ondu-record/install-record.txt --single-version-externally-managed --compile --install-headers /root/.virtualenvs/ctftools3/include/site/python3.4:
running install

running build

Building C extensions

cd qemu && \

./configure --cc="cc" --extra-cflags="-DUNICORN_HAS_X86 -DUNICORN_HAS_ARM -DUNICORN_HAS_M68K -DUNICORN_HAS_ARM64 -DUNICORN_HAS_MIPS -DUNICORN_HAS_MIPSEL -DUNICORN_HAS_MIPS64 -DUNICORN_HAS_MIPS64EL -DUNICORN_HAS_SPARC -fPIC -fvisibility=hidden" --target-list="x86_64-softmmu, arm-softmmu, m68k-softmmu, aarch64-softmmu, mips-softmmu, mipsel-softmmu, mips64-softmmu, mips64el-softmmu, sparc-softmmu,sparc64-softmmu,"

ERROR: Cannot use 'python', Python 2.4 or later is required.

   Note that Python 3 or later is not yet supported.

   Use --python=/path/to/python to specify a supported Python.

make: *** [qemu/config-host.h-timestamp] Error 1

error: [Errno 2] No such file or directory: 'libunicorn.so'

Cleaning up...
Command /root/.virtualenvs/ctftools3/bin/python3 -c "import setuptools, tokenize;file='/root/.virtualenvs/ctftools3/build/unicorn/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-nut9ondu-record/install-record.txt --single-version-externally-managed --compile --install-headers /root/.virtualenvs/ctftools3/include/site/python3.4 failed with error code 1 in /root/.virtualenvs/ctftools3/build/unicorn
Storing debug log for failure in /root/.pip/pip.log
TOOLS | unicorn | INSTALL FAILED

• apt-get -y install libglib2.0-dev
  Reading package lists...
  Building dependency tree...
  Reading state information...
  libglib2.0-dev is already the newest version.
  0 to upgrade, 0 to newly install, 0 to remove and 0 not to upgrade.
• ctf-tools-pip install -U unicorn
  Requirement already up-to-date: unicorn in /root/.virtualenvs/ctftools/lib/python2.7/site-packages
• ctf-tools-pip3 install -U unicorn
  Downloading/unpacking unicorn
  Running setup.py (path:/root/.virtualenvs/ctftools3/build/unicorn/setup.py) egg_info for package unicorn

Installing collected packages: unicorn
Running setup.py install for unicorn
Building C extensions
cd qemu &&
./configure --cc="cc" --extra-cflags="-DUNICORN_HAS_X86 -DUNICORN_HAS_ARM -DUNICORN_HAS_M68K -DUNICORN_HAS_ARM64 -DUNICORN_HAS_MIPS -DUNICORN_HAS_MIPSEL -DUNICORN_HAS_MIPS64 -DUNICORN_HAS_MIPS64EL -DUNICORN_HAS_SPARC -fPIC -fvisibility=hidden" --target-list="x86_64-softmmu, arm-softmmu, m68k-softmmu, aarch64-softmmu, mips-softmmu, mipsel-softmmu, mips64-softmmu, mips64el-softmmu, sparc-softmmu,sparc64-softmmu,"

ERROR: Cannot use 'python', Python 2.4 or later is required.
       Note that Python 3 or later is not yet supported.
       Use --python=/path/to/python to specify a supported Python.

make: *** [qemu/config-host.h-timestamp] Error 1
error: [Errno 2] No such file or directory: 'libunicorn.so'
Complete output from command /root/.virtualenvs/ctftools3/bin/python3 -c "import setuptools, tokenize;__file__='/root/.virtualenvs/ctftools3/build/unicorn/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-nut9ondu-record/install-record.txt --single-version-externally-managed --compile --install-headers /root/.virtualenvs/ctftools3/include/site/python3.4:
running install

running build

Building C extensions

cd qemu && \

./configure --cc="cc" --extra-cflags="-DUNICORN_HAS_X86 -DUNICORN_HAS_ARM -DUNICORN_HAS_M68K -DUNICORN_HAS_ARM64 -DUNICORN_HAS_MIPS -DUNICORN_HAS_MIPSEL -DUNICORN_HAS_MIPS64 -DUNICORN_HAS_MIPS64EL -DUNICORN_HAS_SPARC -fPIC -fvisibility=hidden" --target-list="x86_64-softmmu, arm-softmmu, m68k-softmmu, aarch64-softmmu, mips-softmmu, mipsel-softmmu, mips64-softmmu, mips64el-softmmu, sparc-softmmu,sparc64-softmmu,"

ERROR: Cannot use 'python', Python 2.4 or later is required.

   Note that Python 3 or later is not yet supported.

   Use --python=/path/to/python to specify a supported Python.

make: *** [qemu/config-host.h-timestamp] Error 1

error: [Errno 2] No such file or directory: 'libunicorn.so'

Cleaning up...
Command /root/.virtualenvs/ctftools3/bin/python3 -c "import setuptools, tokenize;file='/root/.virtualenvs/ctftools3/build/unicorn/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-nut9ondu-record/install-record.txt --single-version-externally-managed --compile --install-headers /root/.virtualenvs/ctftools3/include/site/python3.4 failed with error code 1 in /root/.virtualenvs/ctftools3/build/unicorn
Storing debug log for failure in /root/.pip/pip.log

root@anon-virtual-machine:/ctf-tools/bin# uname
Linux
root@anon-virtual-machine:/ctf-tools/bin# uname -r
4.4.0-72-generic

I'll be honest I'm not too sure what the problem is... guessing should be using python 2 instead of python 3?

maybe we should mention this in the README?

it would be nice to be able to install angr with ctf-tools

create an option where user can install dependencies for all or specific tools before the install

zsteg gets installed, but the directory (/home/vagrant/.gem/ruby/1.9.1/bin) doesn't get added to the $PATH.

When installing binwalk, the $VIRTUAL_ENV is not set and results in broken symlinks (see the binwalk install script)

https://github.com/mmiszczyk/deepmage

Output:

LIEF - Library to Instrument Executable Formats is a library to parse/modify ELF/PE/Mach-O and seems pretty useful.

https://github.com/lief-project/LIEF

Potentially it would be a cool to have:

• Autopsy

environment

kali linux 2018.3a

errors

root@kali7777:~/config_files/ctf-tools# manage-tools setup tor-browser
無視:1 http://dl.google.com/linux/chrome/deb stable InRelease
ヒット:2 https://download.docker.com/linux/debian stretch InRelease            
ヒット:3 http://packages.microsoft.com/repos/vscode stable InRelease           
ヒット:4 http://dl.google.com/linux/chrome/deb stable Release                  
ヒット:6 http://ftp.ne.jp/Linux/packages/kali/kali kali-rolling InRelease      
パッケージリストを読み込んでいます... 完了
N: リポジトリ 'https://download.docker.com/linux/debian stretch InRelease' がアーキテクチャ 'i386' をサポートしないため設定ファイル 'stable/binary-i386/Packages' の取得をスキップ
W: ターゲット Packages (main/binary-amd64/Packages) は /etc/apt/sources.list:7 と /etc/apt/sources.list:17 で複数回設定されています
W: ターゲット Packages (main/binary-i386/Packages) は /etc/apt/sources.list:7 と /etc/apt/sources.list:17 で複数回設定されています
Warning: cannot find svn location for chirp===daily-20170714
root@kali7777:~/config_files/ctf-tools# 

just a heads up

All binjitsu changes have been added to pwntools upstream as mentioned here -

https://github.com/Gallopsled/pwntools/blob/dev/CHANGELOG.md

This was a large release (1305 commits since 2.2.0) with a lot of bugfixes and changes. The Binjitsu project, a fork of Pwntools, was merged back into Pwntools. As such, its features are now available here.

Binjitsu is no longer necessary.

Currently, we force the user to create a virtualenv before running manage-tools. Maybe we should have manage-tools automatically create a virtualenv for each tool?

Adding the Steganography tool steghide can help a lot

sudo apt install steghide

https://github.com/iGio90/frick

So keystone and unicorn are on pypi now. Currently they're built from git master. Should we switch to pip install (keystone|unicorn) and install the stable versions?

capstone is already installed from pypi.

https://github.com/AirbusCyber/grap