stamparm / fetch-some-proxies Goto Github PK
View Code? Open in Web Editor NEWSimple Python script for fetching "some" (usable) proxies
Simple Python script for fetching "some" (usable) proxies
Excellent script.
I seem to be having an issue with getting results from certain countries.
Is there any way to define the protocol* and port? ie --port="1080"
Your script pulls from here and runs them against a predefined list of ip checking addresses.
Looking a the list I find no socks5 protocol proxies - is this intentional? **
I'm new to python and was looking for something very similar and your script is perfect to build upon.
The hassle of finding working proxies has definitely been reduced with your script - Thanks.
*, ** Upon closer examination of the script I found that type
defines the protocol. Adding the --type="socks5"
switch to the query, it did indeed filter the output accordingly.
Is there any way to check from a live
proxy list such as the one here?
Again, thanks! Just what I was looking for to help me get started!
I keep getting this error " [i] initial testing... [i] retrieving list of proxies... [!] something went wrong during the proxy list retrieval/parsing. Please check your network settings and try again [Program finished]"
My connection is alright tho
I've been using this script for a good few months now and it's been working great thanks.
But since 7-10 days ago it stop returning any usable proxies when it's run.
From looking at "fetch-some-list.txt" it seems as if the list is a lot smaller than it used to be, maybe some trouble with generating that list?
`╭─uzz3r@linux-q1a4 ~/Pentest/fetch-some-proxies ‹master›
╰─$ ./fetch.py
+-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-+
|f||e||t||c||h||-||s||o||m||e||-||p||r||o||x||i||e||s| <- v3.2.0
+-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-+
[i] initial testing...
[i] retrieving list of proxies...
[!] something went wrong during the proxy list retrieval/parsing. Please check your network settings and try again
`
https://i.imgur.com/Yxp86St.png
+-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-+
|f||e||t||c||h||-||s||o||m||e||-||p||r||o||x||i||e||s| <- v2.64
+-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-+
[i] initial testing...
[i] retrieving list of proxies...
[!]something went wrong during the proxy list retrieval/parsing. Please check your network settings and try again
Thanks for this nice tool! I'm using it as a base for a little helper script I am writing to automatically append my proxychains.conf
configuration file with proxies, using fzf
as a selector.
Currently it kinda works but I'm using the --out
option to work on the fetched proxies. but that means I'm losing the comments with extra information that fetch.py
prints on the right of IP addresses. Those would be of great convenience for fuzzy searches (country, anonymity level, etc.).
As I can't really use the direct output of fetch.py
by manually exporting it to a file with bash (I would end up having no UI or terminal activity for tens of seconds), I prefer to keep using --out
, but would really love to see an extra option to keep comments.
Thanks!
Just tested your script but it seems that some proxies in fetch-some-list.txt
have bad countries along them. For example http://185.93.3.123:8080
is in Czech Republic according to the fetch-some-list.txt
but https://www.iplocation.net/ returns Spain, Madrid. How to do you discover geolocations for fetch-some-list.txt
?
Hi, thank you for good script. i run it with python 3.5.2 and use --output
switch but despite of showing proxies on cmd any proxy was not saved in the file. i try this with python 2 and it works.
some of other switches in python 3 not works.
subprocess.Popen("timeout %d curl %s" % (TIMEOUT, IFCONFIG_URL), shell=True
This does not sound like a good idea to me, especially the shell=True part.
fetch.py
+-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-+
|f||e||t||c||h||-||s||o||m||e||-||p||r||o||x||i||e||s| <- v3.2.3
+-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-++-+
[i] initial testing...
[i] retrieving list of proxies...
[!] something went wrong during the proxy list retrieval/parsing (''). Please check your network settings and try again
thank you bro , my python no information, can you translate php?
thank you so much....
Also my website php..
you can check https://hidester.net/proxylist/
the list is not available so the ./fetch.py is not able to start properly
I just downloaded fetch.py (Mac 10.14.2) and then run next line in Terminal and i always get same error:
python /Users/Henrietta/Downloads/fetch.py
File "/Users/Henrietta/Downloads/fetch.py", line 245
main()
^
IndentationError: expected an indented block
fetch.py:212: DeprecationWarning: isAlive() is deprecated, use is_alive() instead
if thread.isAlive():
Hi,
You said that socks are currently not supported by windows.
Are you planing on making it work on windows or is there any why to get it to work on windows?
Greetings Jolle!
good job
I am running this fetch script in alpine linux (docker based), which is a lightweight system with only really necessary things, so it doesn't have curl by default. And the 'initial testing' in our fetch script uses curl to test a random 'ifconfig' target which ends up to failure of course because I don't have it, then fetch script discard all sock4/5 proxies. A warning here would be more user friendly I think.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.