Sometimes responses are blank

[SouljaVR]

Hi,

Firstly, thanks for your work with ChatterUI. It's the best frontend on android for interacting with LLM's by far, been having a ton of fun with it and it has been great for my workflow. I just had a question/need some help with an issue I can't quite figure out.

For some reason, with certain characters I import, the responses from the character is always blank. It does not seem to be a context length issue as I am using a locally hosted model that has the context set to 16k via the sampler settings.

Here is an example of a character card that gives me this issue:

https://pygmalion.chat/character/286733db-af9c-4b12-bfc3-b15ed147a7ea

And here is a character that has no issues for me and gives me replies:

https://www.chub.ai/characters/cptpants/Gorou

When I use this, the models response is just empty. I noticed it doesn't happen if I use external API's like GroqCloud etc, but if i use my own API hosted locally on my network via Msty, some models will break like this while others are completely fine. But again, other models do work fine. I just wonder what is different between the working character cards and non-working cards. I have looked at them as thoroughly as I can to see the differences in the configuration but I honestly can't see anything problematic that would cause no response at all.

Any ideas what the issue could be? Thank you.
I don't think it's a problem with ChatterUI itself, but I am not sure where else to get support for something like this so I'm asking here, I hope that is okay.

Is it just an issue with Msty? Should I use something else? Thank you.

[Vali-98]

Any ideas what the issue could be? Thank you.

It's hard to say, what are you using to connect to msty? If its Text Completions, you may need to configure the Formatting depending on the model.

[SouljaVR]

Thanks for the reply. Yes, this is exactly how I have it set up.

And weirdly enough, enabling "wrap in newline" in the formatting seems to have fixed the output issue. I can't quite wrap my head around why a character card could affect this, but I will look into it more. Thank you for your help and your work once again!