nightshift2k / binance-proxy Goto Github PK

Describe your environment

• Operating system: Debian 10
• Python Version: 3.8.10 (python -V)
• CCXT version: 1.59.2 (pip freeze | grep ccxt)
• Freqtrade Version: 2021.10 (freqtrade -V or docker-compose run --rm freqtrade -V for Freqtrade running in docker)

Your question

Well, I'm trying to understand docker networking, because I'm having problems communicating two services (freqtrade + binance-proxy) without luck...

I created two containers for this, the proxy with a static IP. The gateways are the following ones:

root@DESKTOP-74LHUDF:/mnt/e/Python/freqtrade-docker# docker network inspect bot_1 | grep '"Gateway"' | head -n 1
                    "Gateway": "172.23.0.1"
root@DESKTOP-74LHUDF:/mnt/e/Python/freqtrade-docker# docker network inspect bot_2 | grep '"Gateway"' | head -n 1
                    "Gateway": "172.24.0.1"
root@DESKTOP-74LHUDF:/mnt/e/Python/freqtrade-docker# docker network inspect bot_3 | grep '"Gateway"' | head -n 1
                    "Gateway": "172.25.0.1"
root@DESKTOP-74LHUDF:/mnt/e/Python/freqtrade-docker# docker network inspect bot_4 | grep '"Gateway"' | head -n 1
                    "Gateway": "172.26.0.1"
root@DESKTOP-74LHUDF:/mnt/e/Python/freqtrade-docker# docker network inspect bot_5 | grep '"Gateway"' | head -n 1
                    "Gateway": "172.27.0.1"
root@DESKTOP-74LHUDF:/mnt/e/Python/freqtrade-docker# docker network inspect bot_6 | grep '"Gateway"' | head -n 1
                    "Gateway": "172.28.0.1"
root@DESKTOP-74LHUDF:/mnt/e/Python/freqtrade-docker# docker network inspect bot_7 | grep '"Gateway"' | head -n 1
                    "Gateway": "172.29.0.1"
root@DESKTOP-74LHUDF:/mnt/e/Python/freqtrade-docker# docker network inspect bot_8 | grep '"Gateway"' | head -n 1
                    "Gateway": "172.30.0.1"

The proxy has the following number: 172.x.0.2. (Freqtrade I cannot know, continue reading and you will know why)

I can reach the internet using docker exec -it <container_name> ping google.com, but I cannot reach a proxy created using binance-proxy although I can ping it, neither I cannot httping it nor from the host machine or from freqtrade container.

I already tried several things but I cannot see where is the problem...

I used docker inspect and docker network inspect, also I tried to execute docker exec -it ... /bin/bash to check ifconfig and iptables without luck, ping works correctly:

It's working for only the first bot, I don't know if I used a command before to enable networking (on the first bot, because it works)

I don't know why I can't ping on the docker container but at least the proxy is reaching google DNS.

Also I tried static IPs without luck because gateway was missing on the docker inspect command:

This is how I run it:

#!/bin/bash

cd /mnt/e/Python/freqtrade-docker/bot_2
docker run -w="/mnt/e/Python/freqtrade-docker/bot_2" -d --name proxy_2 --net bot_2 -p 8092:8092 nightshift2k/binance-proxy:latest
docker-compose up -d

This is my docker-compose.yml file:

---
version: '3'
services:
  freqtrade:
    image: freqtradeorg/freqtrade:stable
    restart: unless-stopped
    container_name: freqtrade_2
    volumes:
      - "./user_data:/freqtrade/user_data"
    # Expose api on port 8082 (localhost only)
    # Please read the https://www.freqtrade.io/en/stable/rest-api/ documentation
    # before enabling this.
    ports:
      - "127.0.0.1:8082:8082"
      # - "0.0.0.0:8082:8082"
    networks:
          - default
    # Default command used when running `docker compose up`
    command: >
      trade
      --logfile /freqtrade/user_data/logs/freqtrade.log
      --db-url sqlite:////freqtrade/user_data/tradesv3.sqlite
      --config /freqtrade/user_data/config.json
      --strategy xxx

networks:
  default:
    external: true
    name: bot_2

This is my docker-compose.yml for the bot... I also tried networks, 0.0.0.0 with http://172.x.0.2:8092/api/v3 instead of using localhost ip (127.0.0.1)

And also I configured correctly Freqtrade config as stated here:

Maybe the problem is with the proxy, but I cannot debug correctly the bot because it's ending every time it tries to connect...

(Just see what does on the status column)

This exception causes the program to crash and restart:

Is there any way to prevent the bot to restart every time it fails?

Also, what can I try more to see where is the problem? Because I have one bot working but the other ones cannot start and the config I'm using is the same. So what's going here?

I inspected the two proxy + freqtrade containers and I don't find any differences...

configs.zip

The only thing is that when I change the cctx json config to the gateway IP it's not having any problems (in the first bot) (in this case 172.x.0.1:809x/api/v3). But in the rest of the bots I'm having this error:

But if I do the same on the second bot, I'm having this other problem: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))

I'm using binance-proxy 1.2.4 as a proxy for 3 freqtrade bots that run on a lot of pairs on multiple timeframes on futures.
When I restart binance-proxy, I get banned by binance. There's no direct link between the bots and binance, they all go through binance-proxy.

time="2022-08-15T08:19:57Z" level=error msg="FUTURES C98USDT@5m kline initialization via REST failed
error: code=-1003, msg=Way too many requests; IP() banned until 16605565089
Please use the websocket for live updates to avoid bans.."

I have no ideea why binance-proxy would get banned as I think it's its responsibility to ratelimit the queries.

Please update modules with latest versions

Hi, I got this message:

level=error msg="SPOT XTZUSDT@5m kline websocket connection error: websocket: close 1006 (abnormal closure): unexpected EOF connected."

How can i fix it? proxy could stop working due to this error?
Thanks.

Hi,

Will try to reproduce with verbose mode

time="2021-11-29T21:16:22Z" level=info msg="SIGINT received, aborting ..."

got this error message and then proxy is killed.

Have a nice day.

Edit : strange behavior seems like it dosent apply docker restart policy -> i use restart always but it don't work

Hello.

Please implement binnace proxy for this endpoint:
https://www.binancezh.com/gateway-api/v1/public/cms/article/list/query

This is the fastest unofficial api for the binance listing.

Hello,

I would like to know if there any chance ti contact you I would like to understand a little bit more.

The contrainer restarts every 1 minute. The log is saying
level=fatal msg="unknown flag e' - unknown flag"`

I use this

  exchange-proxy:
    image: nightshift2k/binance-proxy:latest
    restart: unless-stopped
    container_name: exchange-proxy
    command: -verbose 0

one my docker-compose.yml

Hi There,

I would like to use proxy for Binance US. I have replaced a hostname, but it works for USDT, but not for USD.

pnmice@f27b938

proxy log
level=debug msg="SPOT HBARUSD@5m kline websocket connected."

bot log
freqtrade.exchange.common - WARNING - fetch_l2_order_book() returned exception: "Could not get order book due to RequestTimeout. Message: binanceus GET http://binance-proxy:8090/api/v3/depth?symbol=HBARUSD&limit=5"
freqtrade.exchange.common - WARNING - retrying fetch_l2_order_book() still for 4 times

Not working with USD
curl 'https://172.29.0.11:8090/api/v3/depth?symbol=HBARUSD&limit=5'
it's stuck

If I use USDT, it works
curl -I 'http://172.29.0.11:8090/api/v3/depth?symbol=HBARUSDT&limit=5'
HTTP/1.1 200 OK
Content-Type: application/json
Data-Source: websocket

Good
curl -I 'https://api.binance.us/api/v3/depth?symbol=HBARUSD&limit=5'
HTTP/2 200

Could you give a hint? Are there some limitations in code for USD tickers? Thanks!