thunlp / chateval Goto Github PK

作者你好，我在启动交互界面的时候按照你的步骤来，每一步都正常运行了，但是最后显示：NETWORK ERROR DUE TO HIGH TRAFFIC. PLEASE REGENERATE OR REFRESH THIS PAGE. 这是为什么呢？

就是模型名称那边也不显示，无法选择 ，我是下载到本地的模型。

Hi, nice work!
I would like to ask whether you will provide the evaluation results in this repository.
thanks!

UserWarning: Importing OpenAI from langchain root module is no longer supported. Please use langchain.llms.OpenAI instead.
UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain.prompts.PromptTemplate instead.
UserWarning: Importing SerpAPIWrapper from langchain root module is no longer supported. Please use langchain.utilities.SerpAPIWrapper instead.
warnings.warn(
Namespace(task='llm_eval/multi_role/only_static_assign/faireval/two_turns_sequential/two_different_role/calc_score_comparison/gpt_35_0301', data_path='./agentverse/tasks/llm_eval/data/faireval/preprocessed_data/test.json', output_dir='./outputs/llm_eval/multi_role/only_static_assign/faireval/two_turns_sequential/two_different_role/calc_score_comparison/gpt_35_0301', reverse_input=False)
================================instance 0====================================
12/01/2023 17:14:50 - ERROR - root - Error communicating with OpenAI
12/01/2023 17:14:50 - WARNING - root - Retrying...
12/01/2023 17:14:52 - ERROR - root - Error communicating with OpenAI
12/01/2023 17:14:52 - WARNING - root - Retrying...
12/01/2023 17:14:54 - ERROR - root - Error communicating with OpenAI
12/01/2023 17:14:54 - WARNING - root - Retrying...
12/01/2023 17:14:54 - ERROR - root - After 3 failed try, end the loop
12/01/2023 17:14:54 - ERROR - root - General Public failed to generate valid response.
12/01/2023 17:14:54 - INFO - root - General Public:

请问这是什么原因

想用chateval这套代码评估我自己微调后模型与原模型的不同回复，在运行时报错no module named 'bmtools.agent'，如果我把bmtools这个开源项目放到chateval这个文件夹中那么所有from bmtools都要改，但是bmtools这个包安装最新版本之后仍然报错

Thank you for your work. However, I find that I cannot locate the code in the "Run the scripts" section. For instance, I am unable to find gpt_35_0301.sh for one-by-one communication. Could you please provide an example and the corresponding code?

In the description here: https://github.com/thunlp/ChatEval#prepare-dataset

I see that you support question-answer. But do you support multi-turn also, or how to make it work?

When I run this file, I get an error. How can I solve this problem? Does anyone have the same problem as me?Please help.

class BabyAGI(Chain, BaseModel):
TypeError: metaclass conflict: the metaclass of a derived class must be a (non-strict) subclass of the metaclasses of all its bases