Skip to content

Conversation

@DajanaV
Copy link
Collaborator

@DajanaV DajanaV commented Nov 12, 2025

Mirrored from ggml-org/llama.cpp#16971

Close #16097

Add Continue and Save features for chat messages

What's new

Continue button for assistant messages

  • Click the arrow button on any assistant response to keep generating from where it left off
  • Useful for getting longer outputs or continuing after you've edited a response
  • New content gets appended to the existing message

Save button when editing user messages

  • Now you get three options when editing: Cancel, Save, and Send
  • Save keeps your edit without regenerating the response (preserves the conversation below)
  • Send saves and regenerates like before
  • Useful when you just want to fix a typo without losing the assistant's response

Technical notes

  • Added continueAssistantMessage() and editUserMessagePreserveResponses() methods to ChatStore
  • Continue feature sends a synthetic "continue" prompt to the API (not saved to the database)
  • Assistant message edits now preserve trailing whitespace for proper continuation
  • Follows existing component architecture patterns

Demos

ggml-org/gpt-oss-20b-GGUF

demo1.mp4

unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF

demo2.mp4

@DajanaV DajanaV force-pushed the upstream-PR16971-branch_allozaur-16097-continue-response branch from 4741f81 to c7e23c7 Compare November 12, 2025 18:40
@DajanaV DajanaV force-pushed the main branch 10 times, most recently from 24733fb to 4b4bb7c Compare November 13, 2025 12:15
@DajanaV DajanaV closed this Nov 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants