Martineski@lemmy.fmhy.mlM to

Singularity | Artificial Intelligence (ai), Technology & Futurology@lemmy.fmhy.mlEnglish · 1 year ago

Team develops a faster, cheaper way to train large language models (article from 3.07.2023)

3

cross-posted to:
nev@lemmy.intai.tech

18

Team develops a faster, cheaper way to train large language models (article from 3.07.2023)

Martineski@lemmy.fmhy.mlM to

Singularity | Artificial Intelligence (ai), Technology & Futurology@lemmy.fmhy.mlEnglish · 1 year ago

3

cross-posted to:
nev@lemmy.intai.tech

Team develops a faster, cheaper way to train large language models

A Stanford team has developed Sophia, a new way to optimize the pretraining of large language models that's twice as fast as current approaches.

You must log in or register to comment.

Chat

👁️👄👁️@lemm.ee
link
fedilink
English
arrow-up
3·
1 year ago
Imagine how ahead we’d be if OpenAI was actually open and shared this tech so stuff like this could improve it
- Martineski@lemmy.fmhy.mlOPM
  link
  fedilink
  English
  arrow-up
  1·
  edit-2
  1 year ago
  The tech isn’t even theirs it’s google that shared the paper that they used to develop their model.

Singularity | Artificial Intelligence (ai), Technology & Futurology@lemmy.fmhy.ml

singularity@lemmy.fmhy.ml

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !singularity@lemmy.fmhy.ml

About:

This sublemmy is a place for sharing news and discussions about artificial intelligence, core developments of humanity’s technology and societal changes that come with them. Basically futurology sublemmy centered around ai but not limited to ai only.

Rules:

Posts that don’t follow the rules and don’t comply with them after being pointed out that they break the rules will be deleted no matter how much engagement they got and then reposted by me in a way that follows the rules. I’m going to wait for max 2 days for the poster to comply with the rules before I decide to do this.
No Low-quality/Wildly Speculative Posts.
Keep posts on topic.
Don’t make posts with link/s to paywalled articles as their main focus.
No posts linking to reddit posts.
Memes are fine as long they are quality or/and can lead to serious on topic discussions. If we end up having too much memes we will do meme specific singularity sublemmy.
Titles must include information on how old the source is in this format dd.mm.yyyy (ex. 24.06.2023).
Please be respectful to each other.
No summaries made by LLMs. I would like to keep quality of comments as high as possible.
(Rule implemented 30.06.2023) Don’t make posts with link/s to tweets as their main focus. Melon decided that the content on the platform is going to be locked behind login requirement and I’m not going to force everyone to make a twitter account just so they can see some news.
No ai generated images/videos unless their role is to represent new advancements in generative technology which are not older that 1 month.
If the title of the post isn’t an original title of the article or paper then the first thing in the body of the post should be an original title written in this format “Original title: {title here}”.
Please be respectful to each other.

Related sublemmies:

!auai@programming.dev (Our community focuses on programming-oriented, hype-free discussion of Artificial Intelligence (AI) topics. We aim to curate content that truly contributes to the understanding and practical application of AI, making it, as the name suggests, “actually useful” for developers and enthusiasts alike.)

Note:

My posts on this sub are currently VERY reliant on getting info from r/singularity and other subreddits on reddit. I’m planning to at some point make a list of sites that write/aggregate news that this subreddit is about so we could get news faster and not rely on reddit as much. If you know any good sites please dm me.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
1 user / 6 months
12 local subscribers
12 subscribers
156 Posts
347 Comments
Modlog

mods:
Martineski@lemmy.fmhy.ml