top_k_top_p_filtering import error about trl HOT 10 CLOSED

Make sure that you have transformers version 4.38.2 as "top_k_top_p_filtering" is removed in the next version. Then, as previously mentioned by @ashokchhetri7 , importing it from"transformers.generation.utils" should work.

from trl.

pip install transformers==4.38.2 worked for me as well

from trl.

Changing the transformer version to 4.38.2 did work for me, as well.

from trl.

Thanks for pointing this out. I made a hard dependency to the transformers (2.6.0) library to avoid such issues (see commit 1662d78). I will upgrade the library to transformers 3.0 at a later time. In the meantime, feel free to create a PR if you have time to test if the library works under transformers 3.0.

To upgrade the library use pip install trl==0.0.2.

from trl.

So, in the previous code, the top_k_top_p_filtering was imported from the transformers.generation_utils. I changed underscore to . as shown in following and it solved my problem:

from transformers.generation.utils import top_k_top_p_filtering

from trl.

After directly installing transformer from its repository.
and using latest version of trl, im still encountering this error

from trl.

Same here I encountered the same error as @Aryan-Deshpande this week. Last week can import SFTTrainer without this error.

from trl.

I might have found the issue with this, we have to import TrainerArguments from transformers instead.
'from transformers import TrainerArguments' please correct me if i am wrong.

from trl.

In my case, My original work already separated import SFTTrainer and TrainerArguments but still burst the same error

from trl.

pip install transformers==4.38.2 worked for me as well

I'm still getting the import error even with transformers==4.38.2

Any idea what could be wrong here?

from trl.