nanshihui / scan-t Goto Github PK

方便安装哇~~

基于ubuntu安装的，按照wiki来安装的，导入数据库的时候出错了
ERROR 1128 (HY000): Function 'mysqlcft' is not defined

结果到最后就有下面的问题了
sqltool : ERROR 数据库错误(1146, "Table 'datap.snifferdata' doesn't exist")
sqltool : ERROR 数据库错误(1146, "Table 'datap.snifferdata' doesn't exist")
sqltool : ERROR 数据库错误(1146, "Table 'datap.snifferdata' doesn't exist")
sqltool : ERROR 数据库错误(1146, "Table 'datap.snifferdata' doesn't exist")
ERROR:sqltool:数据库错误(1146, "Table 'datap.snifferdata' doesn't exist")
error in elasticsearch No module named elasticsearch_dsl.query

请问怎么解决

有一个相关的模块是这个库，能解决pickle的问题。
但是使用这个模块会导致动态添加任务的一些问题

你好，大佬，我
请问无法解码JSON对象json错误
线程-8发起请求：
线程8数据库任务执行任务中2020-04-12 12：55：29.322370
返回的消息：elasticsearch中有2个
错误没有模块名为
elasticsearchmanage Thread-8数据库任务结束2020-04-12 12：55：29.357824
线程Thread-8完成请求

我安装了elasticsearch，但是不可以，这是什么问题呢

线程Thread-56完成请求
File "/usr/lib/python2.7/SocketServer.py", line 596, in process_request_thread
self.finish_request(request, client_address)
File "/usr/lib/python2.7/SocketServer.py", line 331, in finish_request
self.RequestHandlerClass(request, client_address, self)
File "/usr/local/lib/python2.7/dist-packages/django/core/servers/basehttp.py", line 99, in init
super(WSGIRequestHandler, self).init(*args, **kwargs)
File "/usr/lib/python2.7/SocketServer.py", line 652, in init
self.handle()
File "/usr/local/lib/python2.7/dist-packages/django/core/servers/basehttp.py", line 164, in handle
self.raw_requestline = self.rfile.readline(65537)
File "/usr/lib/python2.7/socket.py", line 480, in readline
data = self._sock.recv(self._rbufsize)
timeout: timed out

Traceback (most recent call last):
File "/usr/lib/python2.7/SocketServer.py", line 596, in process_request_thread
self.finish_request(request, client_address)
File "/usr/lib/python2.7/SocketServer.py", line 331, in finish_request
self.RequestHandlerClass(request, client_address, self)
File "/usr/local/lib/python2.7/dist-packages/django/core/servers/basehttp.py", line 99, in init
super(WSGIRequestHandler, self).init(*args, **kwargs)
File "/usr/lib/python2.7/SocketServer.py", line 652, in init
self.handle()
File "/usr/local/lib/python2.7/dist-packages/django/core/servers/basehttp.py", line 164, in handle
self.raw_requestline = self.rfile.readline(65537)
File "/usr/lib/python2.7/socket.py", line 480, in readline
data = self._sock.recv(self._rbufsize)
timeout: timed out

在添加任务的时候怎么使用ip段呢？
我使用了cidr和-来表示，然后都扫描不出来结果。
然后我单个主机扫描的结果在首页也搜索不出来

好像找不到 zenmap==7.12

Performing system checks...

Unhandled exception in thread started by <function wrapper at 0x7fe2dbb7d230>
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/django/utils/autoreload.py", line 226, in wrapper
fn(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/django/core/management/commands/runserver.py", line 116, in inner_run
self.check(display_num_errors=True)
File "/usr/local/lib/python2.7/dist-packages/django/core/management/base.py", line 426, in check
include_deployment_checks=include_deployment_checks,
File "/usr/local/lib/python2.7/dist-packages/django/core/checks/registry.py", line 75, in run_checks
new_errors = check(app_configs=app_configs)
File "/usr/local/lib/python2.7/dist-packages/django/core/checks/model_checks.py", line 28, in check_all_models
errors.extend(model.check(**kwargs))
File "/usr/local/lib/python2.7/dist-packages/django/db/models/base.py", line 1170, in check
errors.extend(cls._check_fields(**kwargs))
File "/usr/local/lib/python2.7/dist-packages/django/db/models/base.py", line 1247, in _check_fields
errors.extend(field.check(**kwargs))
File "/usr/local/lib/python2.7/dist-packages/django/db/models/fields/init.py", line 925, in check
errors = super(AutoField, self).check(**kwargs)
File "/usr/local/lib/python2.7/dist-packages/django/db/models/fields/init.py", line 208, in check
errors.extend(self._check_backend_specific_checks(**kwargs))
File "/usr/local/lib/python2.7/dist-packages/django/db/models/fields/init.py", line 317, in _check_backend_specific_checks
return connections[db].validation.check_field(self, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/mysql/validation.py", line 18, in check_field
field_type = field.db_type(connection)
File "/usr/local/lib/python2.7/dist-packages/django/db/models/fields/init.py", line 625, in db_type
return connection.data_types[self.get_internal_type()] % data
File "/usr/local/lib/python2.7/dist-packages/django/db/init.py", line 36, in getattr
return getattr(connections[DEFAULT_DB_ALIAS], item)
File "/usr/local/lib/python2.7/dist-packages/django/utils/functional.py", line 33, in get
res = instance.dict[self.name] = self.func(instance)
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/mysql/base.py", line 184, in data_types
if self.features.supports_microsecond_precision:
File "/usr/local/lib/python2.7/dist-packages/django/utils/functional.py", line 33, in get
res = instance.dict[self.name] = self.func(instance)
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/mysql/features.py", line 53, in supports_microsecond_precision
return self.connection.mysql_version >= (5, 6, 4) and Database.version_info >= (1, 2, 5)
File "/usr/local/lib/python2.7/dist-packages/django/utils/functional.py", line 33, in get
res = instance.dict[self.name] = self.func(instance)
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/mysql/base.py", line 359, in mysql_version
with self.temporary_connection():
File "/usr/lib/python2.7/contextlib.py", line 17, in enter
return self.gen.next()
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/base/base.py", line 564, in temporary_connection
cursor = self.cursor()
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/base/base.py", line 233, in cursor
cursor = self.make_cursor(self._cursor())
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/base/base.py", line 204, in _cursor
self.ensure_connection()
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/base/base.py", line 199, in ensure_connection
self.connect()
File "/usr/local/lib/python2.7/dist-packages/django/db/utils.py", line 95, in exit
six.reraise(dj_exc_type, dj_exc_value, traceback)
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/base/base.py", line 199, in ensure_connection
self.connect()
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/base/base.py", line 171, in connect
self.connection = self.get_new_connection(conn_params)
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/mysql/base.py", line 264, in get_new_connection
conn = Database.connect(**conn_params)
File "/usr/lib/python2.7/dist-packages/MySQLdb/init.py", line 86, in Connect
return Connection(*args, **kwargs)
File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 204, in init
super(Connection, self).init(*args, **kwargs2)
django.db.utils.OperationalError: (1698, "Access denied for user 'root'@'localhost'")

目前遇到的问题都是 ubuntu:latest 环境。

相关程序的安装：

apt-get update 
apt-get install -y nmap
apt-get install -y libjson-c-dev libjson-c2  libjson0 libjson0-dev
apt-get install -y redis-server zmap libffi-dev libssl-dev python-pip libmysqlclient-dev
apt-get install -y wget unzip

获取代码

wget https://github.com/nanshihui/toolforspider/archive/master.zip
unzip master.zip 
cd toolforspider-master/

安装相关的package

pip install MySQL-python
pip install BeautifulSoup==3.2.1
pip install beautifulsoup4==4.4.1
pip install Django==1.9
pip install python-nmap==0.5.0.post1
pip install DBUtils==1.1
pip install paramiko==1.16.0
pip install ruamel.ordereddict==0.4.9
pip install scapy==2.3.2
pip install scapy-http==1.7
pip install objgraph==2.0.1
pip install pycrypto==2.6.1
pip install dozer
pip install faulthandler
pip install apscheduler

配置

数据库配置位于 spidermanage/spidertool/config.py

如果本机没有装mysql，可以按照如下方式进行安装。

apt-get install mysql-server

启动mysql服务

/etc/init.d/mysql start

建立数据库

mysql -uroot -p -e 'create database datap'

启动

先迁移下数据库

python spidermanage/manage.py  migrate
mysql -uroot -p datap -e 'source /toolforspider-master/spidermanage/sqldata/Dump20160331.sql'

注意：因为环境问题，我去掉了/*!50100 WITH PARSER mysqlcft */ 这段。
mysqlcft 比较老旧，怕以后有兼容性问题，所以不打算继续折腾。

添加网站账户

mysql -uroot -p datap -e "insert INTO user_table set username = 'admin',password = 'admin'"

正式启动

python spidermanage/manage.py runserver 0.0.0.0:80

登录后你会发现有些页面点击进去会发生错误，那是因为作者有些功能还没有完成。

在 /toolforspider-master/spidermanage/common_static/nmaptool/css/bootstrap/ 下
新建 lib 文件夹
并且下载
http://cine9deabril.com.br/fn/jquery/jquery-ui-1.10.2.custom/css/custom-theme/jquery-ui-1.10.2.custom.css
https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.6.3/css/font-awesome.css
这两个文件到文件夹里

WARNING:elasticsearch:GET /datap/snifferdata/_search [status:404 request:0.015s]
ERROR:django.request:Internal Server Error: /search/searchdetail/
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/django/core/handlers/base.py", line 149, in get_response
response = self.process_exception_by_middleware(e, request)
File "/usr/local/lib/python2.7/dist-packages/django/core/handlers/base.py", line 147, in get_response
response = wrapped_callback(request, _callback_args, *_callback_kwargs)
File "/opt/godeye/godeye/spidermanage/fontsearch/searchroute.py", line 56, in detailpage
print e
File "/usr/local/lib/python2.7/dist-packages/elasticsearch/exceptions.py", line 55, in str
cause = ', %r' % self.info['error']['root_cause'][0]['reason']
TypeError: string indices must be integers
[07/Jul/2016 17:42:53] "POST /search/searchdetail/ HTTP/1.1" 500 27