• bamboo
    link
    fedilink
    English
    arrow-up
    10
    ·
    9 months ago

    Rather than eliminating the some of the training data, you could add more training data to create an even balance.

    • kromem@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      9 months ago

      Indeed - there’s a very good argument for using synthetic data to introduce diversity as long as you can avoid model collapse.