MemoryCache is an experimental developer project to turn a local desktop environment into an on-device AI agent.

  • vrighter@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    4
    ·
    11 months ago

    but it is not a feature i want. not now, not ever. An inbuilt bullshit generator, now with less training and more bullshit is not something I ever asked for.

    Training one of these ais requires huge datacenters, insanely huge datasets and millions of dollars in resources. And I’m supposed to believe one will be effectively trained by the pittance of data generated by browsing?

    • fruitycoder@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      11 months ago

      Fine tunning is more possible on end user hardware. You also have projects like hive mind and petals that working on distributed training and inference systems to deal with the concentration effects of this you described for base models.