@[email protected] to [email protected]English • 11 months agoOffline version of Chat GPTlemmy.mlimagemessage-square27fedilinkarrow-up1499arrow-down17
arrow-up1492arrow-down1imageOffline version of Chat GPTlemmy.ml@[email protected] to [email protected]English • 11 months agomessage-square27fedilink
minus-squareNoiseColor linkfedilink12•11 months agoMight be a dvd. 70b ollama llm is like 1.5GB. So you could save many models on one dvd.
minus-square@[email protected]linkfedilinkEnglish8•11 months agoIt is a DVD, can faintly see DVD+R on the left side
minus-squareIgnotumlinkfedilink8•11 months ago70b model taking 1.5GB? So 0.02 bit per parameter? Are you sure you’re not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that’s a lot of DVDs
minus-squareNoiseColor linkfedilink9•11 months agoAh yes probably the Smaler version, your right. Still, a very good llm better than gpt 3
minus-square@[email protected]linkfedilink7•11 months agoLess than half of a BDXL though! The dream still breathes
minus-square@[email protected]linkfedilink5•11 months agoFor some reason, triple layer writable blu-ray exists. 100GB each https://www.verbatim.com/prod/optical-media/blu-ray/bd-r-xl-tl/bd-r-xl-tl/
Might be a dvd. 70b ollama llm is like 1.5GB. So you could save many models on one dvd.
It is a DVD, can faintly see DVD+R on the left side
70b model taking 1.5GB? So 0.02 bit per parameter?
Are you sure you’re not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that’s a lot of DVDs
Ah yes probably the Smaler version, your right. Still, a very good llm better than gpt 3
Less than half of a BDXL though! The dream still breathes
For some reason, triple layer writable blu-ray exists. 100GB each
https://www.verbatim.com/prod/optical-media/blu-ray/bd-r-xl-tl/bd-r-xl-tl/
It does have the label DVD-R