I’ve recently been writing fiction and using an AI as a critic/editor to help me tighten things up (as I’m not a particularly skilled prose writer myself). Currently the two ways I’ve been trying are just writing text in a basic editor and then either saving files to add to a hosted LLM or copy pasting into a local one. Or using pycharm and AI integration plugins for it.

Neither is particularly satisfactory and I’m wondering if anyone knows of a good setup for this (preferably open source but not neccesary), integration with at least one of ollama or open-router would be needed.

Edit: Thanks for the recommendations everyone, lots of things for me to check out when I get the time!

  • SmokeyDope@lemmy.worldMEnglish
    1·
    2 days ago

    In an ideal work what exactly would you want an AI integrated text editor to do? Depending on what you need to have happen in your workflow you can automate copy pasting and automatic output logging with python scripts and your engines api.

    Editing and audiing stories isnt that much different from auditing codebases. It all boils down to the understanding and correct use of language to convey abstraction. I bet tweaking some agebic personalities and goals in vscode+roo could get you somewhere

    • Womble@lemmy.worldOPEnglish
      1·
      2 days ago

      Things like highlight sections, ask the llm to review something about it, include other files as context (worldbuilding, lore material backstory etc) and easily insert bits of the text back into the main body. As I said I’ve used pycharm with AI integration for doing this but then you’re using a code editor which doesnt really have features that would be nice for writing prose. I was wondering if there was anything off the shelf (or close to) that combined the two.

      • SmokeyDope@lemmy.worldMEnglish
        1·
        2 days ago

        Have you by chance checked out kobold.cpp lite webUI? It allows some of what your asking for like RAG for worldbuilding, adding images for the llm to describe to add into the story, easy editing of input and output, lots of customization in settings. I have a public instance of kobold webui setup on my website and I’m cool with allowing fellow hobbyist using my compute to experiment with things. If your interested in trying it out to see if its more what youre looking for, feel free to send me a pm and I’ll send you the address and a api key/password.

        • Womble@lemmy.worldOPEnglish
          1·
          2 days ago

          I havent tried kobold. I have tried silly tavern, which I think is similar, but that wasnt really what I wanted as I dont want to use the LLM as a character but as an editor.