• 0 Posts
  • 60 Comments
Joined 9 months ago
cake
Cake day: April 21st, 2024

help-circle
  • You make a lot of good points in here but I think you are slightly off on a couple key points.

    These are ARM not x64 so they use SVE2 which can technically scale to 2048 rather than 512 of AVX. Did they scale it to that, I’m unsure, existing Grace products are 4x128 so possibly not.

    Second this isn’t meant to be a performant device, it is meant to be a capable device. You can’t easily just make a computer that can handle the compute complexity that this device is able to take on for local AI iteration. You wouldn’t deploy with this as the backend, it’s a dev box.

    Third the CXL and CHI specs have coverage for memory scoped out of the bounds of the host cache width. That memory might not be accessible to the CPU but there are a few ways they could optimize that. The fact that they have an all in a box custom solution means they can hack in some workarounds to execute the complex workloads.

    I’d want to see how this performs versus an i9 + 5090 workstation but even that is going to already go beyond the price point for this device. Currently a 4090 is able to handle ~20b params which is an order of magnitude smaller than what this can handle.


  • It’s not a real problem for a system like this. The system uses CXL. Their rant is just because they didn’t take the time to do a click down into what the specs are.

    The system uses CXL/AMBA CHI specs under NVLink-C2C. This means the memory is linked both to the GPU directly as well as to the CPU.

    All of their complaints are pretty unfounded in that case and they would have to rewrite any concerns taking into account those specs.

    Check https://www.nvidia.com/en-us/project-digits/ which is where I did my next level dive on this.

    EDIT: This is all me assuming they are talking about the bandwidth requirements of allocating all memory as being CPU allocation rather than enabling concepts like LikelyShared vs Unique.



  • Debian tends to be a liiiiitle bit behind Fedora and because gaming on Linux is accelerating in popularity, being ahead can provide big gains in performance.

    Can you manually handle all of that? Sure. I mean I have Mint on my side desktop with a custom Kernel but I recognize that I am dropping a V8 into a Mini Van.







  • I vote for them, they move right. I don’t vote for them, and vote third party, they move right. I join their party and vote in their primary’s for progressive candidates, they move right.

    It’s almost like a bunch of really old, well off, lifetime establishment government folks just actually want to be conservative authoritarians. At BEST they are stuck in a mindset of 1969’s ideas of what progressive politics are because that is when they became politicians.








  • Women are not a monolith and not all admiration of physical attributes is misogyny.

    If you see it as work or effort to not post online about random peoples physical attributes when you see a picture of them, then yea you should look at yourself a bit. It shouldn’t feel like you deserve a reward for not being like that.


  • You are in a theater group and steal a magical princess. Yada Yada Yada, you find out your twin brother is using magic life mist to build an army of dolls… Yada Yada yada, the princess turns a castle into a giant robot to fight the doll army… Yada Yada yada, you go to your alien space ship to find all of your other clones, yada yada yada your clone brother kills you and the only way to realive is to kill Necron the god of death and then the game ends.

    Final Fantasy 9, the pinnacle of FF games doing this.

    Another favorite for me though would be Breath of Fire.

    You are a man, you become a dragon man, you find out you were always a dragon, find the goddess and have to chose between killing her or becoming a dragon god and killing your friends.