With all eyes on Nvidia's new graphics cards (and for good reason - these things are pretty powerful), the company released something that may end up being even bigger news: A personal AI supercomputer called Project Digits (we'll just call it Digits from now on because that's way cooler).
Digits is a tiny, Mac mini-like personal computer that should fit on pretty much every desk. You connect it to a keyboard and a monitor, plug it into power, and you're good to go.
But what's inside makes it pretty special. Digits is powered by Nvidia's new GB10 Grace Blackwell Superchip, which delivers up to 1 petaflop of AI performance, and Nvidia teamed up with MediaTek to make the chip more energy-efficient, meaning that running it requires the kind of power you get from a standard power outlet.
SEE ALSO: CES 2025 highlights: What we've seen so farThe GB10 is paired with 128GB of RAM and up to 4TB of NVMe storage. All of this will enable developers to run up to 200-billion-parameter large language models (LLMs). Using Nvidia ConnectX tech, they'll also be able to to pair two Digits computers to run up to 405-billion-parameter models.
Most of this stuff probably makes little sense to folks who aren't in the AI app development business. But for example, ChatGPT 3.5 had 175 billion parameters (ChatGPT 4 is much larger but we don't know the exact numbers), while Meta's most powerful LLM, Llama 3, has 405 billion parameters). This means you can run a very, very powerful LLM at home instead of relying on cloud infrastructure.
"Placing an AI supercomputer on the desks of every data scientist, AI researcher and student empowers them to engage and shape the age of AI," Jensen Huang, founder and CEO of Nvidia, said in a written statement.
Developers who use Digits will be able to access Nvidia's library of AI software including development kits, orchestration tools, frameworks and models available in the Nvidia NGC catalog and on the Nviia Developer portal. They'll also have access to the Nvidia NeMo framework, and Nvidia RAPIDS libraries.
The biggest news here, perhaps, is the price. Digits will be available in May, starting at $3,000. This sort of money should make it available to a large number of smaller companies and researchers, who will use it to create and test AI apps.
If this still sounds too expensive, you can try Nvidia's Jetson. It's a $249 AI home computer that launched last December, and it can handle up to 8 billion parameters.
Mashable is on the ground live at CES 2025! We’re covering all the wildest and most important developments this week, so please keep checking back inwith us. Want to submit a product you represent for our teams’ consideration as we identify the Best of CES? Here’s more info on how to do it.
Copyright © 2023 Powered by
Nvidia's Digits is a tiny AI supercomputer for your desk-山眉水眼网
sitemap
文章
5165
浏览
1
获赞
49152
I 'walked' Boston Dynamics' robot dog around San Francisco
"What's its name?" "Can I take a photo?""What is that?"The Boston Dynamics robot dog known as Spot sSuperb Owl Sunday is swooping in to save your weekend
We know that the news has been depressing recently. It's been causing a lot of unpleasant feelings.TApple gives older iPhones the gift of FaceTime HD
In October, Apple launched FaceTime HD on its iPhone 12 line of products, meaning users could make vFacebook has blocked millions of ads trying to ‘obstruct voting’
UPDATE: Oct. 19, 2020, 12:46 p.m. BST A Facebook spokesperson reached out to clarify that Facebook hApple will reveal HomePod mini for $99, reliable leaker says
Apple will release a new HomePod at its big event on Tuesday, a new rumor suggests. And this one couJ.K. Rowling says Dumbledore and Grindelwald had a 'love' relationship
Poor Dumbledore. The world's most powerful gay wizard still can't find love on screen.In a feature fS(he) be(lie)ve(d) memes are so extra
Picture this: it's 2009 and you're on MySpace. You're listening to an Avril Lavigne track you downloTeens in MAGA hats sparked outrage at the Indigenous Peoples March
This post has been updated to include statements from a teen and protester featured in the viral vidHow to fix missing data and battery drain in Apple's iOS 14, WatchOS 7
If you've been struggling with a fresh set of technical issues since the mid-September launch of iOSIn defense of sharing music to your Instagram Story
An Ode to... is a weekly column where we share the stuff we're really into in hopes that you'll be rHow to check if your mail
If your mail-in ballot is cast, but no one is around to count it, did it make a sound? The U.S. presAmazon announces new employee tracking tech, and customers are lining up
Amazon-powered employee tracking is coming to a warehouse, and possibly a store, near you. The ecommMelania chose the middle of Mueller's testimony to announce... her Christmas plans
Tis' the season to distract Americans, fa la la la la la la la la.If you're wondering why we're singSuperb Owl Sunday is swooping in to save your weekend
We know that the news has been depressing recently. It's been causing a lot of unpleasant feelings.TThat Dwayne Johnson interview where he bashed PC culture was fake
UPDATED Jan. 12, 2019, 10:43 a.m. ETDwayne Johnson never sat down for an interview where he knocked