附docker compose 文件 <div class="highlight highlight-source-yaml notranslate positio

爬取微信公众号的Demo执行失败 about liuli HOT 3 CLOSED

howie6879 commented on July 28, 2024

爬取微信公众号的Demo执行失败

from liuli.

Comments (3)

Colin-XKL commented on July 28, 2024

附docker compose 文件

version: "3"
services:
  liuli_api:
    image: liuliio/api:v0.1.3
    restart: always
    container_name: liuli_api
    ports:
      - "10030:8765"
    volumes:
      - ./pro.env:/data/code/pro.env
    depends_on:
      - liuli_mongodb
    networks:
      - liuli-network
  liuli_schedule:
#    image: liuliio/schedule:v0.2.4
    image: liuliio/schedule:v0.2.4_playwright
    restart: always
    container_name: liuli_schedule
    volumes:
      - ./pro.env:/data/code/pro.env
      - ./liuli_config:/data/code/liuli_config
    depends_on:
      - liuli_mongodb
    networks:
      - liuli-network
  liuli_mongodb:
    image: mongo:3.6
    restart: always
    container_name: liuli_mongodb
    environment:
      - MONGO_INITDB_ROOT_USERNAME=liuli
      - MONGO_INITDB_ROOT_PASSWORD=liuli
    ports:
      - "27027:27017"
    volumes:
      - /data/docker/Database/DBLiuli:/data/db
    command: mongod
    networks:
      - liuli-network

networks:
  liuli-network:
    driver: bridge

使用的config

{
    "name": "default",
    "author": "liuli_team",
    "collector": {
        "wechat_sougou": {
            "wechat_list": [
                "老胡的储物柜"
            ],
            "delta_time": 5,
            "spider_type": "playwright"
        }
    },
    "processor": {
        "before_collect": [],
        "after_collect": [{
            "func": "ad_marker",
            "cos_value": 0.6
        }, {
            "func": "to_rss",
            "link_source": "github"
        }]
    },
    "sender": {
        "sender_list": [],
        "query_days": 7,
        "delta_time": 3
    },
    "backup": {
        "backup_list": ["mongodb"],
        "query_days": 7,
        "delta_time": 3,
        "init_config": {},
        "after_get_content": [{
            "func": "str_replace",
            "before_str": "data-src=\"",
            "after_str": "src=\"https://images.weserv.nl/?url="
        }]
    },
    "schedule": {
        "period_list": [
            "00:10",
            "12:10",
            "21:10"
        ]
    }
}

env

PYTHONPATH=${PYTHONPATH}:${PWD}
LL_M_USER="liuli"
LL_M_PASS="liuli"
LL_M_HOST="liuli_mongodb"
LL_M_PORT="27017"
LL_M_DB="admin"
LL_M_OP_DB="liuli"
LL_FLASK_DEBUG=0
LL_HOST="0.0.0.0"
LL_HTTP_PORT=8765
LL_WORKERS=1
# 上面这么多配置不用改，下面的才需要各自配置
# 请填写你的实际IP
LL_DOMAIN="http://light.colinx.oldnine.xyz:10030"
# 请填写微信分发配置
#LL_WECOM_ID=""
#LL_WECOM_AGENT_ID="-1"
#LL_WECOM_SECRET=""

from liuli.

Colin-XKL commented on July 28, 2024

参考了https://github.com/liuli-io/liuli/blob/main/liuli_config/wechat.json 调整之后能够正常运行了，
"doc_source": "liuli_wechat", 这个需要单独配置
还有采集器wechat-sogou要更改为wechat
看来是微信公众号的那篇文章过时了，有些配置项有更改，麻烦作者有空的时候标明下。

from liuli.

howie6879 commented on July 28, 2024

参考了https://github.com/liuli-io/liuli/blob/main/liuli_config/wechat.json 调整之后能够正常运行了， "doc_source": "liuli_wechat", 这个需要单独配置还有采集器wechat-sogou要更改为wechat 看来是微信公众号的那篇文章过时了，有些配置项有更改，麻烦作者有空的时候标明下。

谢谢提醒，很快就会搭建liuli的文档官网了，到时候会同步更新

from liuli.

爬取微信公众号的Demo执行失败 about liuli HOT 3 CLOSED

Comments (3)

Related Issues (20)

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent