In a rare four-hour talk, the reclusive founder reveals an almost Daoist philosophy of AI—AGI as a tide no company can own, he argues China's only real gap with America is compute.
I think it’s important to note that these models are open-WEIGHT and not open-SOURCE. Open-source would mean we could explore the training data itself. Open-weight models are great, but please let’s not call them open-source.
Nemotron Ultra is a open source and already gives DeepSeek R1 performance (admittedly not that good anymore). NVIDIA has open sourced the entire training process, including raw datasets and synthetic data generation. The raw data is mostly curated web crawl data.
I think it’s important to note that these models are open-WEIGHT and not open-SOURCE. Open-source would mean we could explore the training data itself. Open-weight models are great, but please let’s not call them open-source.
Nemotron Ultra is a open source and already gives DeepSeek R1 performance (admittedly not that good anymore). NVIDIA has open sourced the entire training process, including raw datasets and synthetic data generation. The raw data is mostly curated web crawl data.
The EU’s AI Act calls them open source, so that ship has sailed.
Just because a law mislabels something doesn’t mean we need/should follow that.
“See, you can see the code in binary, it is open source” :D
According to EU law carrot is fruit.
Yeah, it’s like an open-source distro that won’t work without an accompanying opaque binary blob.
What distros are like this?
It is more a question of what hardware is like that and if you look up firmware blobs for Linux you’ll find a lot, starting with graphic cards.
That’s the hardware not the distro
Yeah and the hardware is what requires blobs regardless of the distro.