How to ask LLM generate ReAct format? about react HOT 5 CLOSED

I think the data collected for fine-tuning in this paper does not really require to take very long since the author just mention that they prompted the larger language models for the data, it is basically knowledge distillation.

from react.

In the langchain example, they prepend the [EXAMPLES] which are examples of how to go about following the REact framework, this is basically few-shot learning based off prompt. This is purely prompt engineering and does not touch the weights of the model.

The method is correct. You can also use the examples for fine-tuning the llms if you have the resources (data + compute) and want better results as shown by the author of the paper in a few different datasets challenges.

from react.

Thank you for the confirmation!

So in your paper, you are fine-tuning, which produces better output but needs a long manual data preparation period. And while fine-tuning save some token when calling API, it also increases each API call's cost. So each has pros and cons.

I will use few-shot prompt engineering as a start, and collect data for fine-tuning.

from react.

hi @linonetwo , is there a followup question?

from react.

I was confused about why it could do this. But I read more materials these days and I know even OpenAI doesn't know why there is the emergence.

from react.