ez-hwh / autocrawler Goto Github PK

Hi,
Thank you for releasing this amazing research! Would you mind adding a license?
Thanks!

The length of webpage content will exceed the length limit of ChatGPT, right? How will the excess be handled?

I've tried to install the dependencies as the README.md instructs:
pip install -r requirements.txt
and the following error appeared:

ERROR: Cannot install -r requirements.txt (line 10) and numpy==1.23.3 because these package versions have conflicting dependencies.

The conflict is caused by:
    The user requested numpy==1.23.3
    together 1.1.2 depends on numpy>=1.23.5; python_version < "3.12"

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

version "1.0.1" works just fine. I can't tell if this affects the rest of the code somehow.

ModuleNotFoundError: No module named 'utils.ms_api_copy'

Is the data pointed in this location '/mnt/data122/harryhuang/swde/sourceCode' available for download from somewhere?
I could not find it anywhere in the internet. please help with this.