• gelberhut@lemdro.id
      link
      fedilink
      English
      arrow-up
      11
      ·
      1 year ago

      GPT is a pretrained model, “pretrained” is part of the name. It assumed to be static.

      • FaceDeer@kbin.social
        link
        fedilink
        arrow-up
        3
        ·
        1 year ago

        It’s possible to apply a layer of fine-tuning “on top” of the base pretrained model. I’m sure OpenAI has been doing that a lot, and including ever more “don’t run through puddles and splash pedestrians” restrictions that are making it harder and harder for the model to think.