I’ve been using open webui (search for it with those terms) to run local models in a docker container served from Llama for the last few months and I love it.

Sometimes I serve apps with Flask, he wanted to get into some python as well

Yeah, OK. I just watched a complete novice ask ChatGPT how to go through installing node, pip, and creating a react app (of course ChatGPT being of 2021 suggested CRA). After 2 minutes, his confidence was soaring. And then he tried to run the react app and ran into an issue that required 2 days of troubleshooting for him to resolve. (When he asked me about it I told him he could have just deleted the file and moved on.)

So, yah, just let the CEO type in the code into the magic box, what could go wrong.

If trump got delirium and had uncontrollable diarrhea how would we tell the difference?

My 9th gen intel is still not the bottleneck of my 120hz 4K/AI rig, not by a longshot.

I agree, I hope this means that Steam OS will be coming to the main legion go.

So Tim Cook is a trump supporter then

Why is it always like this in Thursknuple??

PLAYER 2 START

old man scratches balls, news at 11.

dropped netflix this month for the first time in, god, like 17 years. Just not watching it and all the trash behavior they engage in. When a few services finally crash and burn and get consolidated and everyone stops piecemealing out the rights, maybe I’ll come back. Til then, ahoy.

They’ve been terrible for a long time. After Anthem, honestly never again. Sorry.

Putendo

The way h1b visa are applied will 100% cost highly skilled Americans their jobs.

My friend with an ultra wide swears by fancy zones (part of windows power toys) to partition his screen for him.

Yeah I got mind refurbished also, so someone else took the first hit on driving it off the lot (and waiting for it to be built). I guess they didn’t use it to its full extent though. That didn’t make it “cheap” though.

It’s sort of a niche within a niche and I appreciate your sharing some knowledge with me, thanks!

Hmm maybe in the new year I’ll try and update my process. I’m in the middle of a project though so it’s more about reliability than optimization. Thanks for the info though.

I usually run batches of 16 at 512x768 at most, doing more than that causes bottlenecks, but I feel like I was also able to do that on the 3070ti also. I’ll look into those other tools though when I’m home, thanks for the resources. (HF diffusers? I’m still using A1111)

(ETA: I have written a bunch of unreleased plugins to make A1111 work better for me, like VSCode-like editing for special symbols like (/[, and a bunch of other optimizations. I haven’t released them because they’re not “perfect” yet and I have other projects to be working on, but there’s reasons I haven’t left A1111)

I did tell one of them a few months ago that all they’re going to do is train the AI that sometimes people end their posts with useless copyright notices. It doesn’t understand anything. But superstitious monkeys gonna be superstitious monkeys.