Giter VIP home page Giter VIP logo

sdk's Introduction

Intelligence X Public SDK

The software development kit (SDK) allows anyone to use the Intelligence X search engine. It is free to use and Intelligence X welcomes any integrations into 3rd party tools and services.

Intelligence X is a search engine and data archive. For additional details please visit https://intelx.io.

The SDK contains these parts:

  1. API documentation
  2. HTML code example
  3. PHP code example
  4. Python code examples
  5. Go package and code
  6. Maltego Transform

Latest updates:

  • 12.04.2020 - Version 2: New Python API wrapper and Command Line Interface
  • 24.06.2020 - Version 3: Additional filter for phonebook.cz like lookups in Python code
  • 04.07.2020 - Version 4: New Maltego Transform
  • 02.02.2024 - Version 5: Python Package moved to Python Repository

You will need an API key which you can obtain at https://intelx.io/account?tab=developer. Please note that integration into your commercial service/product requires a paid license. If your product is open source, do not embed your API key. The use of public API keys is discontinued.

Link to intelx.io

Instead of directly using the API, you can always do the ghetto version instead and just link to the website.

https://intelx.io/?s=[search term]

Examples:

https://intelx.io/?s=test.com
https://intelx.io/[email protected]

The search engine supports only the following strong selector types. Anything else will be rejected.

  • Email address
  • Domain, including wildcards like *.example.com
  • URL
  • IPv4 and IPv6
  • CIDRv4 and CIDRv6
  • Phone Number
  • Bitcoin address
  • MAC address
  • IPFS Hash
  • UUID
  • Simhash
  • Credit Card Number
  • Social Security Number
  • IBAN

Contact

We love contributions! Feel free to use the issue tracker for any feature requests, bug reports and contributions. You can contact us via email [email protected].

The Terms of Service https://intelx.io/terms-of-service apply.

© 2018 - 2024 Intelligence X

sdk's People

Contributors

cmlh avatar deadbits avatar etherverser avatar jxdv avatar kleissner avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

sdk's Issues

Creating the Color file mentioned

Can someone please walk me through how to create that color.reg and set it up? I'm not computer illiterate but I am beginning with all this so I do require a little more explanation than what was listed. Thanks!

phonebook data issue

Hi,
phonebook website provides more count of email ID, while querying phonebook through python api the count of email IDs are limited (less than the counts collected from website). Is there any solution for it?

Note: Checked with changing max_result limit too.. But I could see the difference.

Telephone search

Second observation... without using the API, just a direct query thru the web interface:

The phone number: 5491139393710 is detected as a valid entry, (shows no results tho).
However the phone number: 5491160177952 is not detected as a valid entry.

As you can see, both numbers have the same format (54 911 XXXX XXXX)

Any clue why this might be happening?

Go instalation instructions are out of date.

Dear Intelx team, you are probably aware of this, but here we go in any case:

As the title states, the installation instructions for Go are not up to date.

For example: "go get -u github.com/IntelligenceX/SDK/Go/ixapi" is not longer working in the actual go versions.

I had to use "go install github.com/IntelligenceX/SDK/Go/ixapi@latest" instead.

The output of the command was the following:

go: finding module for package github.com/go-dedup/simhash
go: finding module for package github.com/gofrs/uuid
go: found github.com/go-dedup/simhash in github.com/go-dedup/simhash v0.0.0-20170904020510-9ecaca7b509c
go: found github.com/gofrs/uuid in github.com/gofrs/uuid v4.4.0+incompatible
go: finding module for package github.com/go-dedup/text
go: found github.com/go-dedup/text in github.com/go-dedup/text v0.0.0-20170907015346-8bb1b95e3cb7
go: finding module for package github.com/go-dedup/megophone
go: found github.com/go-dedup/megophone in github.com/go-dedup/megophone v0.0.0-20170830025436-f01be21026f5
package github.com/IntelligenceX/SDK/Go/ixapi is not a main package

I'm having some issues to make this work. If I manage to solve the installation, I'll be happy to update the documentation in this ticket.

Ubuntu 22, Go version go1.18.1 linux/amd64

Golang module missing core functionalities

Hi,

When comparing the Golang API with the Python SDK, I've noticed that the Golang version lacks core functionalities such as tree view and file view, among others. Additionally, there seems to be an issue with the SearchResult struct. It omits some important fields, such as an 'indexfile' field that would specify the storage location to search for in the tree view.

Here's the current struct definition for reference:

type SearchResult struct {
    Item
    AccessLevelH string                
    MediaH       string              
    SimhashH     string                
    TypeH        string                
    TagsH        []PanelSearchResultTag 
    RandomID     uuid.UUID            
    BucketH      string               
}

This struct is missing some important fields that are necessary for implementing a tree view, such as a reference to the specific storage to search. This limitation significantly affects the API's usability for certain applications. Are there any plans to update the Golang API to include these missing functionalities and fields?"

intelx.INTEL_SEARCH() Received None

Hi,

It seems the API has changed, because intelx.py doesn't display results. This is what I get each time I search for something!

intelx.py -apikey $intelx_key -search apple.com
[15:33:26] Limit argument not supplied, setting default to 10 results.
[15:33:26] Starting search of "apple.com".
[!] intelx.INTEL_SEARCH() Received None

Any idea ?

Error installing intelx in python

When you try to install the python SDK by following these steps:

git clone https://github.com/intelligencex/sdk
cd sdk/Python
pip3 install -r requirements.txt
pip3 install .

You get the following error:
#0 46.86 Building wheels for collected packages: intelx
#0 46.86 Building wheel for intelx (pyproject.toml): started
#0 47.93 Building wheel for intelx (pyproject.toml): finished with status 'error'
#0 47.96 error: subprocess-exited-with-error
#0 47.96
#0 47.96 × Building wheel for intelx (pyproject.toml) did not run successfully.
#0 47.96 │ exit code: 1
#0 47.96 ╰─> [17 lines of output]
#0 47.96 running bdist_wheel
#0 47.96 running build
#0 47.96 running build_py
#0 47.96 creating build
#0 47.96 creating build/lib
#0 47.96 copying intelx/intelxapi.py -> build/lib
#0 47.96 copying intelx/intelx_identity.py -> build/lib
#0 47.96 running egg_info
#0 47.96 writing intelx/intelx.egg-info/PKG-INFO
#0 47.96 writing dependency_links to intelx/intelx.egg-info/dependency_links.txt
#0 47.96 writing requirements to intelx/intelx.egg-info/requires.txt
#0 47.96 writing top-level names to intelx/intelx.egg-info/top_level.txt
#0 47.96 reading manifest file 'intelx/intelx.egg-info/SOURCES.txt'
#0 47.96 writing manifest file 'intelx/intelx.egg-info/SOURCES.txt'
#0 47.96 running build_scripts
#0 47.96 creating build/scripts-3.8
#0 47.96 error: [Errno 2] No such file or directory: 'scripts/intelx.py'
#0 47.96 [end of output]
#0 47.96
#0 47.96 note: This error originates from a subprocess, and is likely not a problem with pip.
#0 47.97 ERROR: Failed building wheel for intelx

FileView Example Traceback

Traceback (most recent call last):
File "fileview.py", line 7, in <module>
contents = intelx.FILE_VIEW(result['type'], result['media'], result['storageid'], result['bucket'])
KeyError: 'type'

No [FOSS] License File

The Python Package should have a OSI Approved License and associated LICENSE file.

As documented within 989c0a8, the following is an example of what is to be inserted into pyproject.toml

license = { file="LICENSE" }
...
classifiers = [
"License :: OSI Approved :: FOSS License",
]

Build error in repository

When running the tool, it is not possible to complete the installation, and the following error appears. It has happened after the last changes made, since the previous week it worked without problem.

raise ValueError(f"{error}\n{summary}") from None
#0 38.51       ValueError: invalid pyproject.toml config: `project.scripts.intelx-cli`.
#0 38.51       configuration error: `project.scripts.intelx-cli` must be python-entrypoint-reference
#0 38.51       [end of output]
#0 38.51
#0 38.51   note: This error originates from a subprocess, and is likely not a problem with pip.
#0 38.53 error: subprocess-exited-with-error
#0 38.53
#0 38.53 × Getting requirements to build wheel did not run successfully.
#0 38.53 │ exit code: 1
#0 38.53 ╰─> See above for output.
#0 38.53
#0 38.53 note: This error originates from a subprocess, and is likely not a problem with pip.
#0 38.57
#0 38.57 [notice] A new release of pip is available: 23.0.1 -> 23.3.2
#0 38.57 [notice] To update, run: pip install --upgrade pip

TypeError: 'int' object is not subscriptable

$ intelx.py -search apple.com


         _____      _       ___   __
        |_   _|    | |     | \ \ / /
          | | _ __ | |_ ___| |\ V / 
          | || '_ \| __/ _ \ |/   \ 
         _| || | | | ||  __/ / /^\ \
         \___/_| |_|\__\___|_\/   \/

           a command line client
               for intelx.io         


[16:09:35] Limit argument not supplied, setting default to 10 results.
[16:09:35] Starting search of "apple.com".
Traceback (most recent call last):
  File "/venv/bin/intelx.py", line 174, in <module>
    search = search(
             ^^^^^^^
  File "/venv/bin/intelx.py", line 39, in search
    s = ix.search(args.search, maxresults, buckets, timeout, datefrom, dateto, sort, media, terminate)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/venv/lib/python3.11/site-packages/intelxapi.py", line 239, in search
    for a in r['records']:
             ~^^^^^^^^^^^
TypeError: 'int' object is not subscriptable
                                                                                                                                                                                                                                           
$

GitHub Issue zeropwn/intelx.py#4 is not directly related but the latest intelx script causes this error.

Pull Request #517 is unrelated.

installation instructions for Mac?

I've been suffering with this transform because I love your tool but for the life of my I can't get the gosh darn thing to work.

Do you have Mac specific instructions and I've overlooked them?

Thanks.

Not Working

First error:

sander@Bl4ckC47:~$ python3 ix_search.py 2.intelx.io 49e4ad58-****-****-****-8158551bb30d test.com
Traceback (most recent call last):
  File "ix_search.py", line 101, in <module>
    if not validators.domain(api_domain):
NameError: name 'validators' is not defined

I removed the part of the code that was showing an error, and another error came up:

sander@Bl4ckC47:~$ python3 ix_search.py 2.intelx.io 49e4ad58-****-****-****-8158551bb30d test.com
[+]Successful API Authentication. Starting records search.
Traceback (most recent call last):
  File "ix_search.py", line 105, in <module>
    ix_search(api_domain, api_key, selector)
  File "ix_search.py", line 71, in ix_search
    unicode(json.dumps(data, indent=4, default=jsondate), 'UTF-8'),
NameError: name 'unicode' is not defined

Enhancement "f" and "l" Parameters of Search API

Transfer Pull Request IntelligenceX/Python#24

Patch from @anhtn512 has been reproduced below:

    def INTEL_EXPORT(self, id, start=1, end=1000, filename="sample"):
        """
        Export all file from search. Use this for direct data download All file in one time.
        id search:
        - Specifies search ID.
        start option:
        - start index of search
        - default: 1
        end option:
        - end index of search
        - default: 1000
        filename option:
        - Specify the name to save the file as (default: sample, extention alway is zip).
        """
        time.sleep(self.API_RATE_LIMIT)
        h = {'x-key': self.API_KEY, 'User-Agent': self.USER_AGENT}
        r = requests.get(f"{self.API_ROOT}/intelligent/search?id={id}&f={start}&l={end}", headers=h, stream=True)
        if r.status_code == 200:
            with open(f"{filename}.zip", "wb") as f:
                f.write(r.content)
                f.close()
            return True
        else:
            return r.status_code

Search not filtering by Dates

Hi,
I'm implementing an python program using intelxapi but I notice that search method is not filtering the results by date, as an example:
When I use
records = itx.search(email, maxresults=100, )['records']
I
got 51 results but using

records = itx.search(email, maxresults=100, dateto="2021/09/09 00:07:07", datefrom="2021/09/08 00:07:07")['records']
I also got the same 51 results (some of them are more than 1 year old)

Does anyone also experiencing this?

Identity support

Good morning, we developed some code to use Identity API, only in Python if you are interest we could try a pull request.

Best

Error - from intelxapi import intelx

getting error for 'from intelxapi import intelx
tried with pip install intelxapi. this is also getting error
ERROR: Could not find a version that satisfies the requirement intelxapi (from versions: none)
ERROR: No matching distribution found for intelxapi

Originally posted by @smk1710 in #9 (comment)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.