fcfangcc / pyxxl Goto Github PK

View Code? Open in Web Editor NEW

44.0 44.0 12.0 1.82 MB

XXL-JOB的Python执行器实现，可以方便的将Python方法注册到XXL-JOB的调度中心上进行管理

Home Page: https://fcfangcc.github.io/pyxxl/

License: GNU General Public License v3.0

Python 97.31% Shell 2.69%

pyxxl's Introduction

Hi there 👋

👋 I’m a DevOps developer in company, with Python🐍,Vue...
☝ I'm current learning and using Rust.

🧑‍💼

pyxxl's People

Contributors

Stargazers

Watchers

Forkers

sydowma gerdong mrmalleable geisha-design everzytang mrlai daboltz qingyi-well wstray

pyxxl's Issues

并发情况，任务参数重复/漏任务

xxl admin同时进行三次调度，即任务执行在同一秒，xxl日志显示1毫秒完成三次任务发送，三次任务参数不同；
python执行器获取到的三次参数，有一次重复，即同一参数的任务获取了两次，另一任务参数未获取到；
还不清楚什么原因;

job方法：

@app.register(name="processData")
async def test_task():
    # 模拟异步操作
    await asyncio.sleep(1)
    return "成功..."

调用结果截图：

报错日志详情

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/pyxxl/executor.py", line 228, in _run
    await self.xxl_client.callback(data.logId, start_time, code=200, msg=result)
  File "/usr/local/lib/python3.9/site-packages/pyxxl/xxl_client.py", line 81, in callback
    await self._post("callback", payload)
  File "/usr/local/lib/python3.9/site-packages/pyxxl/xxl_client.py", line 93, in _post
    raise XXLRegisterError(r.msg or "")
pyxxl.error.XXLRegisterError: java.lang.NullPointerException

感谢作者开发该项目，希望能一起帮忙解决

AttributeError: Can't pickle local object 'PyxxlRunner.run_with_daemon.<locals>._runner'

AttributeError: Can't pickle local object 'PyxxlRunner.run_with_daemon.._runner'
搭配 FastAPI 一起使用时，按照文档上的方法操作，发现爆这个错误

python 3.9.15

试了一下 example 也同样有这个问题

  self.cfg.when_ready(self)
  File "gunicorn.conf.py", line 30, in when_ready
    runner.run_with_daemon()
  File "/Users/xxx/xxx/xxx/pyxxl/example/gunicorn_app/env/lib/python3.9/site-packages/pyxxl/main.py", line 110, in run_with_daemon
    daemon.start()
  File "/opt/homebrew/Cellar/[email protected]/3.9.15/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/opt/homebrew/Cellar/[email protected]/3.9.15/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/context.py", line 224, in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "/opt/homebrew/Cellar/[email protected]/3.9.15/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/opt/homebrew/Cellar/[email protected]/3.9.15/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/opt/homebrew/Cellar/[email protected]/3.9.15/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/opt/homebrew/Cellar/[email protected]/3.9.15/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 47, in _launch
    reduction.dump(process_obj, fp)
  File "/opt/homebrew/Cellar/[email protected]/3.9.15/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/reduction.py", line 60, in dump
    ForkingPickler(file, protocol).dump(obj)
AttributeError: Can't pickle local object 'PyxxlRunner.run_with_daemon.<locals>._runner'

执行完任务后，就掉线了，然后后续就不会再重试链接上服务端，导致服务端调度失败

2023-11-02 13:37:08.362 [MainThread] [170428] WARNING /usr/local/lib/python3.9/site-packages/pyxxl/executor.py(_run:237) -
Traceback (most recent call last):
File "/app/main.py", line 21, in test_task
await asyncio.sleep(1)
File "/usr/local/lib/python3.9/asyncio/tasks.py", line 652, in sleep
return await future
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/lib/python3.9/asyncio/tasks.py", line 490, in wait_for
return fut.result()
asyncio.exceptions.CancelledError

2.再有就是执行的进度如何返回？

xxl_admin_baseurl 不支持https

xxl_admin_baseurl为https时会有问题，[SSLCertVerificationError: (1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)')]

ExecutorConfig里有注入账户密码的参数配置嘛

主要是服务器上需要账户密码

Connection error 1 times: Cannot connect to host http://ip:443 ssl:True [SSLCertVerificationError: (1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate (_ssl.c:992)')], retry afert 5

你好，帮忙看下，注册时连接报错

我本地git clone了xxl_job:2.3.0
启动了xxl-job-admin（127.0.0.1:8080）、xxl-job-executor-sample-springboot（127.0.0.1:9999）
然后运行pyxxl项目的app.py，但是在xxl-job-admin（127.0.0.1:8080）没有发现任务被注册上去，可以帮忙解决一下吗，是有什么配置错误了吗