toluclassics / candle-tutorial Goto Github PK

Hi @LaurentMazare, I started putting this together as part of huggingface/candle#1075. It's a good idea to include code snippets across both Pytorch and Candle in the document but I'm likely to end up with a really long write-up. I was able to convert Roberta and XLM-R models and I intend to do RWKV next.

I was wondering if you had any particular directions in mind on how to document the conversion.

hi.

any suggestions on how to get a decoded output once I have done

let output = model.forward(&input_ids, &token_ids)?;

Am trying to go from a text input, extract input and token_ids, and then decode to a text output. I tried to do some basic convert but didn't get anywhere. if you have an example, I would appreciate it, am kinda struggling to connect the bits.