• 45 Posts
  • 981 Comments
Joined 2 years ago
cake
Cake day: July 1st, 2023

help-circle





  • Your primary gaming desktop gpu will be best bet for running models. First check your card for exact information more vram the better. Nvidia is preferred but AMD cards work.

    First you can play with llamafiles to just get started no fuss no muss download them and follow the quickstart to run as app.

    Once you get it running learn the ropes a little and want some more like better performance or latest models then you can spend some time installing and running kobold.cpp with cublas for nvidia or vulcan for amd to offload layers onto the GPU.

    If you have linux you can boot into CLI environment to save some vram.

    Connect with program using your phone pi or other PC through local IP and open port.

    In theory you can use all your devices in distributed interfacing like exo.


  • First you need to get a program that reads and runs the models. If you are an absolute newbie who doesn’t understand anything technical your best bet is llamafiles. They are extremely simple to run just download and follow the quickstart guide to start it like a application They recommend llava model you can choose from several prepackaged ones. I like mistral models.

    Then once you get into it and start wanting to run things more optimized and offloaded on a GPU you can spend a day trying to setup kobold.cpp.

    They both start a local server you can point your phone or other computer on WiFi network to it with local ip address and port forward for access on phone data.





  • To see if it can do it and how accurate its general knowledge is compared to the real data. A locally hosted LLM doesnt leak private data to the internet.

    Most webpages and reddit post in search results are themselves full of LLM generated slop now. At this stage of the internet if your gonna consume slop one way or the other it might as well be on your own terms by self hosting an open weights open license LLM that can directly retrieve information from fact databases like wolframalpha, Wikipedia, world factbook, ect through RAG. Its never going to be perfect but its getting better every year.


  • I’m glad you remember me from our other conversations Bizzle 😎ive enjoyed having conversations with you on here.

    Everyones got their own path on the journey. you’ll get there eventually if and when its meant for you to. Sorry if I bring it up or try to prolytize too much. Its a fun hobby I like to talk about.

    Yeah i just vape dry herb flower and hash concentrates all the time. Completely quit smoking/combustion almost two years ago and never looking back. This month ive been rocking some hash rosin and pure sativa flower which is a rare treat everything on shelf is some indica hybrid now a days.

    All my vapes are electric heated no torches (still an option though!), no hemp wick, no cones, no papers, no filters, no scooby snacks, no butane taste, no ash, no dirty glass spoons and bongs caked in smelly thick tar that takes forever to clean (god help you if you have one or more percolators)

    None of that, just the sweet pure oil and terps heated directly with electric energy turned right into tasty clean high efficency GAS. No emmisions here.

    The flower gets cooked very thoroughly I sometimes wonder if there’s anything left over to make oil with.

    They all have different purposes for usecases and overall variety. Usually when im at home I reach for the desktop ball vape that milks bongs in one hit. Its always on. Fill the screen, hit it, empty flower, repack, repeat until the rimmed screen gets clogged and replace.

    Here’s a video of it in action!

    For hash or on the go outdoor stuff I switch between the portable terp chasers. These replace dugouts. I went on a walk today around the block with the first one here after talking about missing walking with lit joints :)

    About the dynavap last time we talked I mistakenly said you needed a butane torch and that was something you weren’t a fan of. I was wrong, you can use a bic if that’s something holding you up.


  • No shame mrs bizzle I did the same buying preroll cones when I smoked fat L’s. Its one of the few convinence fee that I really found worth it.

    If it were me there’s a 25% chance the top twisty wouldn’t burn in right making it burn lopsided so I would have to first fidget with the flame getting it even while taking some nice hits of air and hemp wick smoke.

    Probably some raw flower specs gets through the cheap folded paper filter too you know how it is lol.

    Then I would burn that L down while taking a walk around the block until the flame heat got to my finger tips.

    Man its been awhile since I took a walk with an L, kind of miss the experience of it. But I don’t miss the black tar coughs and raspy lungs from all that combustion and paper.



  • Smokeydope@lemmy.worldtoweedtime@walledgarden.xyzI'm high
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    9 days ago

    Honestly I dunno. From the grower/biology difference there’s a difference in growth and cold climate resistances which is why almost everything is some indica hybrid.

    From a smoker perspective it’d hard to say. I managed to score a pure sativa strain this month was super excited for it! The high ain’t that much different tbh but maybe if I had a heavy indica strain I could actively compare minute differences. I believe the line between energized and slumped is more to do with overall bud quality and how much you intake + tolerance. A few too many hits turns me from energetic and relaxed to lethargic and spaced out. Terp profile and thca content has a big impact limoline really jives with me.





  • Smokeydope@lemmy.worldtomemes@lemmy.worldI am having an existential crysis about this
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    4
    ·
    edit-2
    11 days ago

    Redditor chud behavior: gets bothered by a single downvote, edits comment to ask why they were down voted turning into a rant about the NPCs and sheeples who disagree with them. Subconsciously worried about karma points and awards.

    Lemming chad behavior: Gets 20 upvotes and 10 down votes, happy 30 people reads their thing and glad to have put a controversial opinion into the world that might make someone think a new way.


  • I still play games but now I have more things to do with computers. I started helping out an open source software project learning how to code basic things in lua, how to contribute using git pushes. make art texture graphics in gimp, mess with sound effects in audacity, clip videos together using kdenlive. I hope to learn how to use blender and do modeling. I test and review fellow devs stuff to try helping them out. As long as I learn new things and contribute it helps me feel like my computer time is more productive.

    Then I got in on the local LLM scene a year ago with the release of llama 3.1. I’m a science nerd who genuinely thinks the study of neural networks is cool. The idea of getting computers to simulate thoughts to help solve problems is a neat thing. Also I wanted to see how far we came from cleverbot days. It inspired me enough to dig out the old unused gaming desktop and really extract the most potential out of my old 1070ti.

    Now I wish I had more vram not for chasing high end graphics in video game entertainment, but because I want my computer to simulate high quality thoughts to help me in daily life.