Giter VIP home page Giter VIP logo

fresh_eval's Introduction

still under construction, try to adopt it online

I use RWKV2 as the environment set PIP_INDEX_URL=https://pypi.douban.com/simple export PIP_INDEX_URL=https://pypi.douban.com/simple pip install playwright playwright install

cd /mntnfs/med_data5/chenghao/uncheatable_eval/ python /mntnfs/med_data5/chenghao/uncheatable_eval/cmd_crawl.py

conda export > playright.env conda create -f playright.env

udo yum update

playwright codegen https://www.bbc.com/news

playwright codegen https://www.quora.com/ https://www.bloomberg.com

数据类型 代表性网站 网址
金融新闻 Yahoo Yahoo.com
政治新闻 BBC News bbc.com/news
讨论 Reddit reddit_new.com(更多的主题确定一下)
网文 Wattpad wattpad.com
百科 Wikipedia 最新更改 en.wikipedia.org/wiki/Special:NewPages
论文 arXiv arxiv.org(多个主题)(目前还在做 但是适配应该是挺快的)
代码 GitHub Trending github.com/trending
论坛 Quora quora_week.com(多个主题)

现在的任务:通arxiv,github,然后等人来了通那几个程序 事件线 9.45 arxiv读明白 github 15min读明白获取 的逻辑(上传代码,复制模块) 然后立刻就是一些设计性的东西,quora的按照 问题去写(设计问题领域)(问问gpt,)

| 博客 | Medium | medium.com | | 代码题目 | LeetCode | leetcode.com |

''' cd the fresh_eval folder cd C:\Users\jijivski\Desktop\local_VS\fresh_eval python C:\Users\jijivski\Desktop\local_VS\fresh_eval\cmd_crawl.py '''

Citation

Please use the following citation if you intend to use our repo:

@misc{FreshBench,
  title={Evaluating LLMs at Evaluating Temporal Generalization},
  author={Chenghao Zhu, Nuo Chen, Yufei Gao, Benyou Wang},
  year = {2024},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/FreedomIntelligence/FreshBench}},
}

fresh_eval's People

Contributors

jijivski avatar jellyfish042 avatar nuojohnchen avatar wangxidong06 avatar

Watchers

Butui Hu avatar potter  avatar waby avatar Zhan Su avatar  avatar jinpeng avatar 肖宁宁 avatar Feng Jiang avatar anon.W avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.