• FaceDeer
    link
    fedilink
    63 days ago

    Given how dramatically LLMs have improved over the past couple of years I think it’s pretty clear at this point that AI trainers do know something of what they’re doing and aren’t just randomly stumbling around.

    • @[email protected]
      link
      fedilink
      English
      33 days ago

      A lot of the improvement came from finding ways to make it bigger and more efficient. That is running into the inherent limits, so the real work with other models just started.

      • Natanael
        link
        fedilink
        English
        33 days ago

        And from reinforcement learning (specifically, making it repeat tasks where the answer can be computer checked)