Future Direction and Requests about chatarena HOT 4 OPEN

These are very interesting direction to explore, and we definitely see the possibility that ChatArena could evolve in these directions. We completely agree that making the environments more accessible to ordinary users and more enjoyable for human player bear huge value. But due to our limited capacity, our team currently focuses on enriching the set of environments and LLMs backends, so that more LLMs can interact with each other in various diverse environments. We would like to welcome community contribution to make it more fun to play with and develop more intuitive interfaces.

We are going to release a detailed development plan this week. Please join our Slack channel to get the latest updates of ChatArena.

from chatarena.

See GPT-Bargaining for a tournament!

https://github.com/FranxYao/GPT-Bargaining

Basically we ask GPT/ Claude/ Cohere/ Jurrasic models to bargain with each other and see who can get a better deal.

Our ranking is: GPT-4 > Claude-v1.3 > GPT-3.5-Trubo > Claude-instant-v1.0 > jurrasic > cohere

We have just finished the paper and will very soon integrate the bargaining game into ChatArena!

from chatarena.

Thank you all for your replies. I hope this project will develop.
This is an interesting experiment, and it is great that Claude v1.3 is performing well.
I look forward to demonstrating it at ChatArena.

from chatarena.

We've announce our coming features and future directions in #36. Feel free to comment and request new features there if your wanted feature is not covered.

from chatarena.