• @[email protected]
    link
    fedilink
    English
    -424 months ago

    I’m not going to parse this shit article. What does interference mean here? Please and thank you.

    • @[email protected]OP
      link
      fedilink
      English
      424 months ago

      That’s a very toxic attitude.

      Inference is in principle the process of generation of the AI response. So when you run locally and LLM you are using your GPU only for inference.

    • @[email protected]
      link
      fedilink
      English
      134 months ago

      Inference? It’s the actual running of the ai when you use it, as opposed to training.