• 0 Posts
  • 46 Comments
Joined 1 month ago
cake
Cake day: December 5th, 2024

help-circle




  • JasminIstMuedeto196Mull rule
    link
    fedilink
    English
    arrow-up
    32
    ·
    9 days ago

    I’m still hoping for a fork sometime in the future, but I guess we’ll see. For now I’m back on fennec. I wish the developer all the best of course, I just wish there had been a bit more warning :/


  • JasminIstMuedetoFuck AI@lemmy.worldYou think?
    link
    fedilink
    English
    arrow-up
    18
    ·
    10 days ago

    As far as I know, the Deepmind paper was actually a challenge of the OpenAI paper, suggesting that models are undertrained and underperform while using too much compute due to this. They tested a model with 70B params and were able to outperform much larger models while using less compute by introducing more training. I don’t think there can be any general conclusion about some hard ceiling for LLM performance drawn from this.

    However, this does not change the fact that there are areas (ones that rely on correctness) that simply cannot be replaced by this kind of model, and it is a foolish pursuit.








  • JasminIstMuedetoRust Programming@lemmy.mlLearning Rust
    link
    fedilink
    English
    arrow-up
    6
    ·
    21 days ago

    When I’m curious about a language, I usually first build some implementation of a perceptron or basic neural network, as well as a (usually very bad) text editor.

    I feel like once I have those behind me, I’ve got some fundamentals and can dive deeper into what makes the specific language actually special :)



  • The fact that OpenAI have waived the threat of using the clause implies to me that they’ve defined it relatively loosely… or just that they’re really stupid, which may also be possible.

    I did a little bit of looking and couldn’t find a figure on how much OpenAI spends on AGI compared to GenAI research, but in looking, I found this interesting:

    https://openai.com/index/scale-the-benefits-of-ai/

    Which begins with the following:

    We are making progress on our mission to ensure that artificial general intelligence benefits all of humanity. Every week, over 250 million people around the world use ChatGPT to enhance their work, creativity, and learning…

    Which seems like a shady placement of two unrelated things next to one another. Makes me wonder if texts like this have the goal of selling GenAI as AGI one day.



  • This is a very good point. It makes me a bit uneasy, even though it is still better than driverless cars. Aside from this, I also have mixed feelings about the fact that every pound being put into development and purchasing of these busses could have been put into the expansion of existing routes…
    And it’s not even something that would drastically improve my experience if it was fully successful. Busses are already one of the safest modes, being safer than trains in several countries. Maybe I’ve missed something and someone can correct me, but this feels like throwing money at technology for technology’s sake.