Generation config commented out? about transformers.js HOT 5 CLOSED

Got it, feel free to close this issue then. Would be great to be able to use the params you mentioned!

from transformers.js.

Great, I'll give it a shot.

from transformers.js.

The main reason is I copied it from HuggingFace's transformers library code, but either (1) no supported model uses it or (2) it hasn't been implemented yet.

The reason it's commented out (and not, well, deleted), is because I plan to add it :) For example, the RepetitionPenaltyLogitsProcessor, NoRepeatNGramLogitsProcessor, and MinLengthLogitsProcessor classes will be coming soon!

from transformers.js.

Is there a rough timeline for implementing additional config, like the three you mentioned above? Just curious since it would be very useful to my project. I could also take a look at implementing them if there is no work started on that.

I saw the python code here: https://huggingface.co/transformers/v4.1.1/internal/generation_utils.html#transformers.RepetitionPenaltyLogitsProcessor

from transformers.js.

That would be awesome if you could try implementing it! I'm currently adding new model types, so, I'd only be able to get to adding this in ~a week or so.

Here's the original implementation code from HF: https://github.com/huggingface/transformers/blob/main/src/transformers/generation/logits_process.py

and this library's implementation is here: https://github.com/xenova/transformers.js/blob/main/src/generation.js

The conversion shouldn't be too difficult, but if you have any questions, feel free to ask!

from transformers.js.