Markdown stream

[AndiLeni]

Hello,

I am trying to print a stream from an ai api directly to the console and render it as markdown.

The code I tries looks like this:

raw_text = ""

try:
    for chunk in client.chat_stream(
        model="mistral-medium",
        messages=[
            ChatMessage(
                role="system",
                content=f"Answer the user's questions based on the below context. If the context doesn't contain any relevant information to the question, don't make something up and just say 'I don't know': <context>${combined_string}</context>",
            ),
            ChatMessage(role="user", content=query),
        ],
    ):
        if chunk.choices[0].delta.content is not None:
            # print(chunk.choices[0].delta.content, end="")
            raw_text += chunk.choices[0].delta.content
            md = Markdown(raw_text)
            console.print(md, end="\r")
except Exception as e:
    print(f"Error: {e}")

However, this produces a new line after each received chunk:

Is there any way to not create a new line and rather overwrite the current text?

Thanks and kind regards

[willmcgugan]

You can use Live, but for something like this you may be better off using Textual

[AndiLeni]

Thanks for your quick answer. I do not have much experience with textualize, so please bear with my lack of knowledge.
Could you point me the direction (docs, example) for this issue? I am still figuring out how using textualize may solve this problem for this specific usecase.

[willmcgugan]

This project does something similar. https://github.com/darrenburns/elia

Suggest you join the Discord server if you have any questions.

[AndiLeni]

This looks like a good repo to take inspiration from. Thanks :)