Hacker News

The session you cannot take with you

session-portability

The Session You Cannot Take With You Date:Thu, 30 Jul 2026 From:Earendil Engineering <rfc@earendil.com> To:You Subject:The Session You Cannot Take With You The original promise of an inference API was wonderfully simple: send some input, receive some output. If you kept both, you had the conversation. You could inspect it, archive it, replay it, or give it to a different model. That abstraction was never completely true. Prompt caches live on somebody else’s GPUs, tokenization differs between models, and sampling is not reproducible (and quite intentionally so). But the semantic record of a session in the form of a transcript could still belong to the user. A transcript should contain the instructions, messages, tool calls and tool results. Another sufficiently capable model…

Continue reading at Hacker News earendil.com
Advertisement