[email protected]
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
@[email protected] to [email protected]English • 11 months ago

Offline version of Chat GPT

lemmy.ml

message-square
27
fedilink
492

Offline version of Chat GPT

lemmy.ml

@[email protected] to [email protected]English • 11 months ago
message-square
27
fedilink
alert-triangle
You must log in or register to comment.
  • @[email protected]
    link
    fedilink
    47•
    edit-2
    11 months ago

    Technically possible with a small enough model to work from. It’s going to be pretty shit, but “working”.

    Now, if we were to go further down in scale, I’m curious how/if a 700MB CD version would work.

    Or how many 1.44MB floppies you would need for the actual program and smallest viable model.

    • @[email protected]
      link
      fedilink
      16•11 months ago

      squints

      That says , “PHILLIPS DVD+R”

      So we’re looking at a 4.7GB model, or just a hair under the tiniest, most incredibly optimized implementation of <INSERT_MODEL_NAME_HERE>

      • @[email protected]
        link
        fedilink
        13•11 months ago

        llama 3 8b, phi 3 mini, Mistral, moondream 2, neural chat, starling, code llama, llama 2 uncensored, and llava would fit.

        • @[email protected]
          link
          fedilink
          1•11 months ago

          Just interested in the topic did you 🔨 offline privately?

          • @[email protected]
            link
            fedilink
            1•11 months ago

            I’m not an expert on them or anything, but feel free

    • NoiseColor
      link
      fedilink
      12•11 months ago

      Might be a dvd. 70b ollama llm is like 1.5GB. So you could save many models on one dvd.

      • Ignotum
        link
        fedilink
        8•11 months ago

        70b model taking 1.5GB? So 0.02 bit per parameter?

        Are you sure you’re not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that’s a lot of DVDs

        • NoiseColor
          link
          fedilink
          9•11 months ago

          Ah yes probably the Smaler version, your right. Still, a very good llm better than gpt 3

        • @[email protected]
          link
          fedilink
          7•11 months ago

          Less than half of a BDXL though! The dream still breathes

        • @[email protected]
          link
          fedilink
          5•11 months ago

          For some reason, triple layer writable blu-ray exists. 100GB each

          https://www.verbatim.com/prod/optical-media/blu-ray/bd-r-xl-tl/bd-r-xl-tl/

      • @[email protected]
        link
        fedilink
        English
        8•11 months ago

        It is a DVD, can faintly see DVD+R on the left side

      • @[email protected]
        link
        fedilink
        English
        5•11 months ago

        It does have the label DVD-R

    • kindenough
      link
      fedilink
      8•
      edit-2
      11 months ago

      Maybe not all that LLM, https://en.wikipedia.org/wiki/ELIZA

    • @[email protected]
      link
      fedilink
      English
      7•11 months ago

      ELIZA was pretty impressive for the 1960s, as a chatbot for psychology.

    • @[email protected]OP
      link
      fedilink
      English
      4•11 months ago

      yes i guess it would be a funny experiment for just a local model

    • veroxii
      link
      fedilink
      3•11 months ago

      pkzip c:\chatgpt*.* a:\chatgpt.zip -&

  • @[email protected]
    link
    fedilink
    33•11 months ago

    Not needed, I’ve got this gem. Encarta 99

    Y’all can look, but don’t touch.

    • @[email protected]
      link
      fedilink
      3•11 months ago

      Mummified corpse killed by Wikipedia

    • @[email protected]
      link
      fedilink
      3•11 months ago

      Wow, I’ve actually never seen this disc. However, funnily enough, I have another disc with that program burned into it. Someone didn’t read the notice, it seems.

    • @[email protected]
      link
      fedilink
      1•11 months ago

      Do you also have a Route99 disc?

  • Sparky
    link
    fedilink
    10•
    edit-2
    11 months ago

    Fun fact: you can download llama3, an llm model made by meta (which is surprisingly good for its size), and it’s only 4.7gb. A dvd can store 4.7 gb of data, meaning you could in theory have an llm on a DVD.

    Model link

    CC BY-NC-SA 4.0

  • @[email protected]
    link
    fedilink
    English
    8•11 months ago

    Thought that said cbatGPT

    • @[email protected]
      link
      fedilink
      11•11 months ago

      Please keep us updated with all future inconsequential misinterpretations.

      -Management

      • @[email protected]
        link
        fedilink
        3•11 months ago

        Dear Management,

        I was just brushing my teeth without my glasses on, anf out of the corner of my eye it sorta looked like Versace.

        Hope this helps, Facebones

  • @[email protected]
    link
    fedilink
    7•11 months ago

    GPT4All

  • @[email protected]
    link
    fedilink
    English
    4•11 months ago

    Seems legit

  • @[email protected]
    link
    fedilink
    1•11 months ago

    …disc 1 of 150

[email protected]

[email protected]

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

Rules:

  1. Be civil and nice.
  2. Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.
  • 1.42K users / day
  • 2.48K users / week
  • 7.03K users / month
  • 22.9K users / 6 months
  • 50.7K subscribers
  • 11.2K Posts
  • 138K Comments
  • Modlog
  • mods:
  • ghost_laptop
  • @[email protected]
  • Cyclohexane
  • Arthur Besse
  • BE: 0.19.3
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org