ISMS Copilot
Tools

Conversation Context Compaction

Conversation Context Compaction automatically summarizes older messages in long conversations, letting you continue indefinitely without hitting length limits. Available exclusively in Think mode, it preserves key context while freeing up space for new questions.

How It Works

When your conversation in Think mode approaches ~150,000 tokens (roughly 75-100 exchanges depending on message length), compaction triggers automatically. The system pauses briefly to summarize earlier messages in the background, then resumes your conversation seamlessly.

During compaction, you'll see an animated indicator with rotating messages like "Compacting our conversation so we can keep chatting…" or "Summarizing earlier messages…" The process typically completes in a few seconds.

Compaction only runs in Think mode. Fast mode conversations have standard length limits—start a new conversation after 15-20 messages or when switching topics.

What Happens to Your Conversation History

Compaction summarizes older messages while retaining key context: control requirements you've discussed, policy decisions made, risk assessments completed, and other essential details. Your most recent exchanges remain unchanged.

The conversation continues with full effective context—you can reference earlier topics without repeating yourself.

The Enhanced Indicator

The compaction indicator includes:

  • A pulsing star icon

  • Rotating status messages explaining what's happening

  • An animated progress bar (stops at 95% until complete)

Once compaction finishes, the indicator disappears and your response streams normally.

Best Practices for Long Compliance Projects

Use Think mode for extended work. Gap analyses, policy reviews, and multi-control assessments benefit from indefinite conversation length. Choose "Think" from the mode selector next to the send button.

Organize by workspace and topic. Create separate workspaces for each client or project. Start a new conversation for each distinct task (e.g., one for ISO 27001 gap analysis, another for policy generation).

Upload files in fresh conversations. When analyzing documents, start a new thread. This keeps context focused and improves accuracy.

Switch to Fast mode for quick questions. One-off control lookups or brief clarifications don't need Think mode's depth. Use Fast mode and start fresh after 15-20 messages.

If you switch from a long Fast mode conversation to a new Think mode thread, manually summarize key context from the earlier chat in your first message. This ensures the new conversation has all necessary background.

Learn more about Thinking Mode and Managing Long Conversations and Usage.

Was this helpful?