I’d like some LLM features centered around “here is my organized folder of documents for context” but without paying $20/month or buying a $2,000 GPU or giving all of my data to Google/Microsoft. I couldn’t find anything that actually worked even if I did pay money or give my data to Google/Microsoft. Ignoring even the folder thing, I remember asking Claude to summarize a novel I’m writing and it kept mixing character’s with details that unambiguously only applied to other characters.

If only there was a way to run this on linux.

Thanks! I estimate I’m at least 25% of the way through, where the last 75% will be editing and finding beta readers.

I’m still writing, slow and steady lol.

I made a similar thread a year ago if that helps: https://hexbear.net/post/185417