zeropwn / spyse.py Goto Github PK

Python API wrapper and command-line client for the tools hosted on spyse.com.

License: MIT License

Python 100.00%

spyse.py's Introduction

Dominik Penner (@zer0pwn)

Introduction

Experienced leader, developer, consultant, and security researcher. I specialize in application and cloud security. I have helped a wide variety of organizations secure their systems over the course of approximately 12 years. Some of these include: Internet Service Providers & Electronic Medical Software vendors and Open Source projects. My main focus is to report critical vulnerabilities in software/hardware before malicious adversaries have the opportunity to exploit them.

Security Advisories

CVE-2019-11354 (EA Origin RCE) [Blog post, Advisory]
CVE-2019-12828 (EA Origin RCE) [Blog post, Advisory]
CVE-2019-14277 (Axway SecureTransport XML Injection / XXE) [Blog post, Advisory]
CVE-2019-14744 (KDE Frameworks < 51.60 Command Execution) [Blog post, Advisory]
CVE-2020-16116 (KDE Ark < 20.08.0 Directory Traveral Code Execution) [Blog post, Advisory]
CVE-2020-24656 (Maltego XML External Entity Injection) [Blog post, Advisory]

Projects

Porch Pirate

Porch Pirate is the most comprehensive recon / OSINT client and framework for Postman that facilitates the automated discovery and exploitation of API endpoints and secrets committed to workspaces, collections, requests, users and teams. Porch Pirate can be used as a client or be incorporated into your own applications.

Intelligence X API Wrapper

intelx.py is a Python command-line utility and API wrapper for intelx.io, made to perform any kind of open-source intelligence.

spyse.py's People

Contributors

Stargazers

Watchers

spyse.py's Issues

Traceback shows JSONDecodeError in Archlinux. (CLOSED, DUPLICATED)

Hi:
I have installed the program directly from Github with a specific dependence for Arch Linux "Python-argparse".
After install and run "python setup.py install" all goes fine, but when I try to run it, shows this error:

spyse -target xbox.com --subdomains

Traceback (most recent call last):
File "/usr/bin/spyse", line 4, in
import('pkg_resources').run_script('spyse.py==0.13.3.9', 'spyse')
File "/usr/lib/python3.9/site-packages/pkg_resources/init.py", line 651, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/usr/lib/python3.9/site-packages/pkg_resources/init.py", line 1455, in run_script
exec(script_code, namespace, namespace)
File "/usr/lib/python3.9/site-packages/spyse.py-0.13.3.9-py3.9.egg/EGG-INFO/scripts/spyse", line 410, in
File "/usr/lib/python3.9/site-packages/spyse.py-0.13.3.9-py3.9.egg/EGG-INFO/scripts/spyse", line 266, in get_subdomains_aggregate
File "/usr/lib/python3.9/site-packages/spyse.py-0.13.3.9-py3.9.egg/spyse/spyse.py", line 561, in subdomains_aggregate
File "/usr/lib/python3.9/site-packages/requests/models.py", line 910, in json
return complexjson.loads(self.text, **kwargs)
File "/usr/lib/python3.9/site-packages/simplejson/init.py", line 525, in loads
return _default_decoder.decode(s)
File "/usr/lib/python3.9/site-packages/simplejson/decoder.py", line 370, in decode
obj, end = self.raw_decode(s)
File "/usr/lib/python3.9/site-packages/simplejson/decoder.py", line 400, in raw_decode
return self.scan_once(s, idx=_w(s, idx).end())
simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Reading the last line, something is wrong with JSONDecode but I have no idea about what's happening.
Any help will be welcome.
Thanks

Spyse command not found

I've downloaded the .zip, extracted it and installed pip3. Then I used pip3 to install spyse.py from the extracted folder (both as sudo and normal) but it doesn't seem to be installed.
I cannot use the library and it doesn't recognize spyse as a command.

Anyone got any idea on how to resolve this issue?

pip installation fails to resolve module

$ pip3 install spyse.py

Collecting spyse.py
  Downloading https://files.pythonhosted.org/packages/9f/96/4de4d5a0fe7a0ee7c4790847eaf713b56ec73c60829a41719af80a486477/spyse.py-0.13.3.7-py3-none-any.whl
Requirement already satisfied: requests in /usr/local/lib/python3.7/site-packages (from spyse.py) (2.21.0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python3.7/site-packages (from requests->spyse.py) (3.0.4)
Requirement already satisfied: idna<2.9,>=2.5 in /usr/local/lib/python3.7/site-packages (from requests->spyse.py) (2.8)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in /usr/local/lib/python3.7/site-packages (from requests->spyse.py) (1.24.3)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/site-packages (from requests->spyse.py) (2019.3.9)
Installing collected packages: spyse.py
Successfully installed spyse.py-0.13.3.7

$ spyse --help
usage: spyse [-h] [-target TARGET] [-param PARAM] [-page PAGE]
             [-apikey APIKEY] [--raw] [--dns-ptr] [--dns-soa] [--dns-mx]
             [--dns-aaaa] [--dns-ns] [--dns-a] [--dns-txt] [--dns-all]
             [--domains-with-same-ns] [--domains-using-as-mx]
             [--domains-on-ip] [--domains-with-same-mx]
             [--domains-using-as-ns] [--download-dns-aaaa]
             [--download-dns-soa] [--download-dns-ns] [--download-dns-ptr]
             [--download-dns-mx] [--download-dns-a] [--download-dns-txt]
             [--download-dns-all] [--ip-port-lookup]
             [--ip-port-lookup-aggregate] [--ssl-certificates] [--subdomains]

Client for Spyse.com

optional arguments:
  -h, --help            show this help message and exit
  -target TARGET        target
  -param PARAM          parameter to use (ip, domain, cidr, url, hash)
  -page PAGE            page
  -apikey APIKEY        set the api key
  --raw                 show raw json
  --dns-ptr             show dns ptr records
  --dns-soa             show dns soa records
  --dns-mx              show dns mx records
  --dns-aaaa            show dns aaaa records
  --dns-ns              show dns ns records
  --dns-a               show dns a records
  --dns-txt             show dns txt records
  --dns-all             show all dns records
  --domains-with-same-ns
                        show domains with same ns
  --domains-using-as-mx
                        show domains using as mx
  --domains-on-ip       show domains on ip
  --domains-with-same-mx
                        show domains with same mx
  --domains-using-as-ns
                        show domains using as ns
  --download-dns-aaaa   download dns aaaa records
  --download-dns-soa    download dns soa records
  --download-dns-ns     download dns ns records
  --download-dns-ptr    download dns ptr records
  --download-dns-mx     download dns mx records
  --download-dns-a      download dns a records
  --download-dns-txt    download dns txt records
  --download-dns-all    download all dns records
  --ip-port-lookup      show ip port lookup
  --ip-port-lookup-aggregate
                        show ip port lookup aggregate
  --ssl-certificates    show ssl certificates associated with a target
  --subdomains          show subdomains

Usage: spyse -target <TARGET> -param <PARAM> --subdomains

$ /usr/local/bin/spyse

          ██████  ██▓███ ▓██   ██▓  ██████ ▓█████
        ▒██    ▒ ▓██░  ██▒▒██  ██▒▒██    ▒ ▓█   ▀
        ░ ▓██▄   ▓██░ ██▓▒ ▒██ ██░░ ▓██▄   ▒███
          ▒   ██▒▒██▄█▓▒ ▒ ░ ▐██▓░  ▒   ██▒▒▓█  ▄
        ▒██████▒▒▒██▒ ░  ░ ░ ██▒▓░▒██████▒▒░▒████▒
        ▒ ▒▓▒ ▒ ░▒▓▒░ ░  ░  ██▒▒▒ ▒ ▒▓▒ ▒ ░░░ ▒░ ░
        ░ ░▒  ░ ░░▒ ░     ▓██ ░▒░ ░ ░▒  ░ ░ ░ ░  ░
        ░  ░  ░  ░░       ▒ ▒ ░░  ░  ░  ░     ░
              ░           ░ ░           ░     ░  ░
                          ░ ░           by @zer0pwn

Traceback (most recent call last):
  File "/usr/local/bin/spyse", line 63, in <module>
    s = spyse()
TypeError: 'module' object is not callable

get_domains_using_as_ns not work

$ spyse -apikey APIKEY --domains-using-as-ns -target ns.example.com -page 1 -param domain

  ██████  ██▓███ ▓██   ██▓  ██████ ▓█████ 
▒██    ▒ ▓██░  ██▒▒██  ██▒▒██    ▒ ▓█   ▀ 
░ ▓██▄   ▓██░ ██▓▒ ▒██ ██░░ ▓██▄   ▒███   
  ▒   ██▒▒██▄█▓▒ ▒ ░ ▐██▓░  ▒   ██▒▒▓█  ▄ 
▒██████▒▒▒██▒ ░  ░ ░ ██▒▓░▒██████▒▒░▒████▒
▒ ▒▓▒ ▒ ░▒▓▒░ ░  ░  ██▒▒▒ ▒ ▒▓▒ ▒ ░░░ ▒░ ░
░ ░▒  ░ ░░▒ ░     ▓██ ░▒░ ░ ░▒  ░ ░ ░ ░  ░
░  ░  ░  ░░       ▒ ▒ ░░  ░  ░  ░     ░   
      ░           ░ ░           ░     ░  ░
                  ░ ░           by @zer0pwn

Traceback (most recent call last):
File "/home/ec2-user/.local/bin/spyse", line 416, in
print(get_domains_using_as_ns(args.target, param, page))
File "/home/ec2-user/.local/bin/spyse", line 211, in get_domains_using_as_ns
record['ip']['ip']
TypeError: list indices must be integers or slices, not str

Help with spyse.py - can't find 'main' module in 'spyse' - json - simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Hello :)

I did...(python3.8, pip3)

git clone https://github.com/zeropwn/spyse.py.git
cd spyse.py
python3 setup.py install

Executing this in current path: >>> python3 spyse -target hackerone.com --subdomains
/root/tools/SPYSE/bin/python3: can't find 'main' module in 'spyse'

Command Without python >>> spyse -target hackerone.com --subdomains
Traceback (most recent call last):
File "/root/tools/SPYSE/bin/spyse", line 4, in
import('pkg_resources').run_script('spyse.py==0.13.3.9', 'spyse')
File "/root/tools/SPYSE/lib/python3.7/site-packages/pkg_resources/init.py", line 667, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/root/tools/SPYSE/lib/python3.7/site-packages/pkg_resources/init.py", line 1455, in run_script
.format(**locals()),
pkg_resources.ResolutionError: Script 'scripts/spyse' not found in metadata at '/root/tools/SPYSE/lib/python3.7/site-packages/spyse.py-0.13.3.9.dist-info'

Executing in /bin/spyse: >>> python spyse -target hackerone.com --subdomains
Traceback (most recent call last):
File "spyse", line 410, in
print(get_subdomains_aggregate(args.target, param, page, raw=args.raw))
File "spyse", line 266, in get_subdomains_aggregate
data = s.subdomains_aggregate(target, param=param, page=page)['cidr']
File "/usr/local/lib/python3.8/dist-packages/spyse.py-0.13.3.9-py3.8.egg/spyse/spyse.py", line 561, in subdomains_aggregate
File "/usr/lib/python3/dist-packages/requests/models.py", line 898, in json
return complexjson.loads(self.text, **kwargs)
File "/usr/lib/python3/dist-packages/simplejson/init.py", line 525, in loads
return _default_decoder.decode(s)
File "/usr/lib/python3/dist-packages/simplejson/decoder.py", line 370, in decode
obj, end = self.raw_decode(s)
File "/usr/lib/python3/dist-packages/simplejson/decoder.py", line 400, in raw_decode
return self.scan_once(s, idx=_w(s, idx).end())
simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

May you help me, please? Any idea what may be causing this?
Thanks in advance!! Cheers!

some issues with domains not being found

when i run aquatone with spyse it does not return domains..

spyse -target starbucks.com -param domain --subdomains --raw | aquatone
aquatone v1.7.0 started at 2019-10-05T11:33:50-04:00

No targets found in input.
wondering if i could get some help on this.

look up subdomains with AS

hi is there a way to look for subdomains using AS on the terminal at is online?i tried --help with no luck was hoping if i can get guidance on this thank you in advance.

it is not working now!!!

hello.The spsee's program, which worked well before, no longer works. cidr and ssl-certificates scans now fail. the program started giving json errors.


root@localhost:~# spyse -target 55.105.40.0/24 -param cidr --domains-on-ip

  File "/usr/local/bin/spyse", line 188, in get_domains_on_ip
    data = s.domains_on_ip(target, param=param, page=page)
  File "/usr/local/lib/python3.7/dist-packages/spyse/spyse.py", line 216, in domains_on_ip
    return r.json()
  File "/usr/local/lib/python3.7/dist-packages/requests/models.py", line 892, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/lib/python3/dist-packages/simplejson/__init__.py", line 518, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3/dist-packages/simplejson/decoder.py", line 370, in decode
    obj, end = self.raw_decode(s)
  File "/usr/lib/python3/dist-packages/simplejson/decoder.py", line 400, in raw_decode
    return self.scan_once(s, idx=_w(s, idx).end())
simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

root@localhost:~# spyse -target "org: Microsoft" --ssl-certificates    

Traceback (most recent call last):
  File "/usr/local/bin/spyse", line 242, in get_ssl_certificates
    certs = s.ssl_certificates(target, param, page)
  File "/usr/local/lib/python3.7/dist-packages/spyse/spyse.py", line 457, in ssl_certificates
    return r.json()
  File "/usr/local/lib/python3.7/dist-packages/requests/models.py", line 892, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/lib/python3/dist-packages/simplejson/__init__.py", line 518, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3/dist-packages/simplejson/decoder.py", line 370, in decode
    obj, end = self.raw_decode(s)
  File "/usr/lib/python3/dist-packages/simplejson/decoder.py", line 400, in raw_decode
    return self.scan_once(s, idx=_w(s, idx).end())
simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/spyse", line 448, in <module>
    print(get_ssl_certificates(args.target, param, page))
  File "/usr/local/bin/spyse", line 258, in get_ssl_certificates
    return certs
UnboundLocalError: local variable 'certs' referenced before assignment

How Can I fix cannot import name 'Client' from 'spyse'

I just installed theHarvester on my Laptop and it required to me install spyse.py and I installed it, and I get this error:
cannot import name 'Client' from 'spyse' (/home/muhammadsiddiq/.local/lib/python3.9/site-packages/spyse/__init__.py) sys:1: RuntimeWarning: coroutine 'start.<locals>.store' was never awaited RuntimeWarning: Enable tracemalloc to get the object allocation traceback
How Can I fix it ?

pkg_resources.ResolutionError: Script 'scripts/spyse' not found in metadata

Hello,

After fresh ubuntu install I am unable to get the spyse working.

Git cloned the package and ran pip3 install spyse.py. Once tried to run via spyse -h getting below:

spyse -h
Traceback (most recent call last):
File "/usr/local/bin/spyse", line 4, in
import('pkg_resources').run_script('spyse.py==0.13.3.9', 'spyse')
File "/home/xxx/.local/lib/python3.6/site-packages/pkg_resources/init.py", line 666, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/home/xxx/.local/lib/python3.6/site-packages/pkg_resources/init.py", line 1453, in run_script
.format(**locals()),
pkg_resources.ResolutionError: Script 'scripts/spyse' not found in metadata at '/home/xxx/.local/lib/python3.6/site-packages/spyse.py-0.13.3.9.dist-info'

Any idea what may be causing this?

Thanks in advance!