Giter VIP home page Giter VIP logo

Comments (11)

NanmiCoder avatar NanmiCoder commented on August 15, 2024

看样子是redis连接超时了，可以检查你的redis是否设置密码了以及密码是否正确。

from mediacrawler.

tanpenggood avatar tanpenggood commented on August 15, 2024

我在本地6379端口启动的redis，没有设置密码，配置如下：

config/db_config.py

# redis config
REDIS_DB_HOST = "redis://127.0.0.1"  # your redis host
REDIS_DB_PWD = ""  # your redis password

# mysql config
RELATION_DB_URL = "mysql://root:youdbpassword@localhost:3306/media_crawler"

# save data to database option
IS_SAVED_DATABASED = False  # if you want to save data to database, set True

from mediacrawler.

NanmiCoder avatar NanmiCoder commented on August 15, 2024

浅看了一下aioredis中Client视乎对密码是必填的，意味着你需要先设置下 Redis Server 配置文件的密码，再在db_config.py中配置密码，不能填空字符。

from mediacrawler.

tanpenggood avatar tanpenggood commented on August 15, 2024

我给redis设置了密码 123456，
再次python main.py --platform xhs --lt qrcode
仍然是上面的错误。

from mediacrawler.

NanmiCoder avatar NanmiCoder commented on August 15, 2024

找到原因了，这是一个aioredis的bug，对python3.11版本不支持了，稍后我会用redis模块来替换aioredis，aio-libs-abandoned/aioredis-py#1409

from mediacrawler.

tanpenggood avatar tanpenggood commented on August 15, 2024

太棒了！ 我拉下来，因为这个问题好几天都没启动😂

from mediacrawler.

tanpenggood avatar tanpenggood commented on August 15, 2024

刚刚还特意用redis-test.py，做连接redis的测试，发现报错同样和上面一样。

import config
import aioredis

if __name__ == '__main__':
    redis_obj = aioredis.from_url(url=config.REDIS_DB_HOST, password=config.REDIS_DB_PWD, decode_responses=True)
    value = redis_obj.get("hello")
    print(value)

这个坎儿算是过去了，我还以为电脑出问题了😆。

from mediacrawler.

NanmiCoder avatar NanmiCoder commented on August 15, 2024

该问题已经修复，已将aioredis替换为官方的redis实现，麻烦你拉下最新代码跑跑看，能否启动起来。

from mediacrawler.

tanpenggood avatar tanpenggood commented on August 15, 2024

OK!

software version
OS mac
python 3.11 
$ pip install -r requirements.txt

...

$ python main.py --platform xhs --lt qrcode
2023-07-30  21:03:41 MediaCrawler INFO Begin create browser context ... 
2023-07-30  21:03:49 MediaCrawler INFO Begin create xiaohongshu API client ... 
2023-07-30  21:03:49 MediaCrawler INFO begin to ping xhs... 
2023-07-30  21:03:50 MediaCrawler INFO Begin search xiaohongshu keywords 
2023-07-30  21:03:50 MediaCrawler INFO Current keyword: 健身 
...

from mediacrawler.

tanpenggood avatar tanpenggood commented on August 15, 2024

LOGIN_TYPE = 'cookie'时, COOKIES我应该怎么设置呢？

from mediacrawler.

NanmiCoder avatar NanmiCoder commented on August 15, 2024

LOGIN_TYPE = 'cookie'时, COOKIES我应该怎么设置呢？

MediaCrawler/config/base_config.py

Lines 4 to 5 in 1d3c235

LOGIN_TYPE = "qrcode" # qrcode or phone or cookie
COOKIES = "" # login by cookie, if login_type is cookie, you must set this value

from mediacrawler.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.