I want everything local – Building my offline AI workspace

Back to blogI Want Everything Local — Building My Offline AI WorkspaceManishAugust 8, 202510 min readBlogStory I want everything local — no cloud, no remote code execution. That’s what a friend said. That one-line requirement, albeit simple, would need multiple things to work in tandem to make it happen. What does a mainstream LLM (Large Language Model) chat app like ChatGPT or Claude provide at a high level? Ability to use chat with a cloud hosted LLM, Ability to run code generated by them mostly on their cloud infra, sometimes locally via shell, Ability to access the internet for new content or services. With so many LLMs being open source / open weights, shouldn’t it be possible to do all that locally? But just local LLM is not enough, we need a truely isolated environment to…

Read more on Hacker News