n7gifmdn@lemmy.ca to Memes@lemmy.mlEnglish · 5 months agoMeta AIimage.nostr.buildimagemessage-square10fedilinkarrow-up149arrow-down10
arrow-up149arrow-down1imageMeta AIimage.nostr.buildn7gifmdn@lemmy.ca to Memes@lemmy.mlEnglish · 5 months agomessage-square10fedilink
minus-squarem-p{3}@lemmy.calinkfedilinkarrow-up0arrow-down1·edit-25 months agoThe quantized model you can run locally works decently and they can’t read any of it, which is nice. I use that one specifically https://huggingface.co/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf If you’re looking for a relatively user-friendly software to use it, you can look at GPT4All (open source) or LM Studio.
minus-squarenialv7@lemmy.worldlinkfedilinkarrow-up0·5 months agoPretty sure LM studio is not open source
minus-squarem-p{3}@lemmy.calinkfedilinkarrow-up0·5 months agoYou’re right, I thought they were but I checked their GitHub and LM Studio itself isn’t.
The quantized model you can run locally works decently and they can’t read any of it, which is nice.
I use that one specifically https://huggingface.co/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf
If you’re looking for a relatively user-friendly software to use it, you can look at GPT4All (open source) or LM Studio.
Pretty sure LM studio is not open source
You’re right, I thought they were but I checked their GitHub and LM Studio itself isn’t.