update_github_per_day's Introduction

update_github_per_day

从github每日定时爬虫更新的文件使用python脚本调用github的方式

step1:

git clone 下来你要的资源（注意里面的.git文件 ls -a）

git clone https://github.com/stamparm/maltrail.git> 这时候你的本地就会有所有的代码，找到你要的文件夹，
git fetch 可以把本地的信息与远程仓库对比本地的叫master 远程仓库叫origin/master

出现了个问题：会出现因为chmod的变化引起diff变化所以type这个命令

 git config --add core.filemode false

找到不同的文件（香港服务器，并且写到/data/sftp/weihai_feed/maltrail/diff_name_only.txt）

[root@iZj6cjas64u6t81eu372kvZ maltrail]# cat  /data/weihai_feed/update_git_maltrail.py
import git
import re
repo = git.Repo('/data/sftp/weihai_feed/maltrail')
remote = repo.remote()
t=remote.fetch()
res = repo.git.diff(t)
diff_name_only = re.findall('diff --git a/trails/static/malware/(.*) b/', res)
print("update file",diff_name_only)
if len(diff_name_only)>0:
    with open("/data/sftp/weihai_feed/maltrail/diff_name_only.txt","w") as f_new:
        for i in diff_name_only:
            f_new.write(i)
            f_new.write("\n")
p=remote.pull()

生成的文件： diff_name_only.txt

[root@iZj6cjas64u6t81eu372kvZ maltrail]# cat diff_name_only.txt 
agenttesla.txt
android_anubis.txt
android_bankbot.txt
android_cerberus.txt
android_phonespy.txt
android_roamingmantis.txt
apt_deathstalker.txt
apt_gamaredon.txt
apt_lazarus.txt
astaroth.txt
asyncrat.txt
buer.txt
chanitor.txt
cobaltstrike.txt
dridex.txt
elf_kaiten.txt
formbook.txt
generic.txt
glupteba.txt
grandoreiro.txt
hiddentear.txt
icedid.txt
locked.txt
manabot.txt
nanocore.txt
njrat.txt
powershell_injector.txt
qakbot.txt
qrat.txt
raccoon.txt
redline.txt
ryuk.txt
systembc.txt
trickbot.txt
ursnif.txt
zloader.txt

之后读入这些文件去在我的开发机上

Recommend Projects