Skip to content

Session memory: condense-then-retrieve#30

Merged
markgewhite merged 2 commits into
mainfrom
feature/9-session-memory-condense
Apr 11, 2026
Merged

Session memory: condense-then-retrieve#30
markgewhite merged 2 commits into
mainfrom
feature/9-session-memory-condense

Conversation

@markgewhite

Copy link
Copy Markdown
Owner

Summary

  • Added Condenser module that rewrites follow-up questions into standalone queries via Ollama LLM call
  • First/independent questions (no chat history) skip condensation — no LLM overhead
  • Chat history tracked per session, kept separate from answer generation context window
  • Standalone question used for both retrieval and reranking

Closes #9

Test plan

  • Condenser skips condensation when no chat history
  • Condenser rewrites follow-up questions using chat history
  • Correct model passed to LLM call
  • History included in condensation prompt
  • Output whitespace stripped
  • Integrated into Chainlit pipeline
  • Full test suite: 82 tests pass

🤖 Generated with Claude Code

markgewhite and others added 2 commits April 11, 2026 23:02
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
…tory

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@markgewhite markgewhite merged commit d86ed83 into main Apr 11, 2026
1 check passed
@markgewhite markgewhite deleted the feature/9-session-memory-condense branch April 11, 2026 22:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Session memory: condense-then-retrieve

1 participant