Question about allias about maid HOT 4 CLOSED

The second option is how its added but i can change it pretty easily

from maid.

Spoiler alert: from the behavior of the model, I do know that the allias is in fact added so I guess it ends up in something like \n<|im_start|>useruser or \n<|im_start|>user user

I would appreciate if you could hint me at the place in the code where the allias is added.

from maid.

Im not really sure what your question is but the user alias is added here:

https://github.com/Mobile-Artificial-Intelligence/maid/blob/main/src/core.cpp#L175-L178

and the assistant alias is added here:

https://github.com/Mobile-Artificial-Intelligence/maid/blob/main/src/core.cpp#L192-L195C10

in core.cpp the alias are refered to as inp_pfx (user alias) and inp_sfx (assistant alias) this is just how it was in llama.cpp. Hope that helps

from maid.

Im not really sure what your question is

I'm trying to figure out how the alias is used.

Let me explain it this way I thought that the allias changed the text in this way:
user_alias = "Bob"
assistant_alias = "assistant"

<|im_start|>Bob
Hi
<|im_start|>assistant
Hello, how can I help you?

But that seems to not be the case because <|im_start|>user is hardcoded.

So what is the app doing instead?
Is it something like this?

Bob
<|im_start|>user
Hi
assistant 
<|im_start|>assistant
Hello, how can I help you?

Or

<|im_start|>userBob
Hi
<|im_start|>assistantassitant
Hello, how can I help you?

In other words I expected to find something like this in the code
"<|im_start|>" + user_alias; instead of "<|im_start|>user"

I hope this time it was clear.

from maid.