Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe, and that the true power of this technical domain lies in more targeted and bespoke ML model generation and usage.
ML is good and enables - and has enabled - some genuine generational leaps in science and technology. But LLMs are such a fucking waste of the technology’s potential. Not to mention, I’m extremely irritated that (largely due to Nvidia cornering the market) everyone is super gung-ho about a digital approach which amounts to brute-forcing neural nets digitally with shitloads of memory and highly-parallel compute, when it’s obvious to anyone with more than a passing familiarity with electrical engineering that an analog approach is going to be FAR more efficient in terms of resource and energy usage.
Yeah, for 4 and 8 bit quantization at least analog charge buckets or memristor-likes and analog multipliers would dramatically reduce substrate size, reduce power burn and speed up inference. Even better killer drones, here they come. Yay.
I mean… yeah, DARPA will probably be one of the first adopters of that stuff, it’s true. But DARPA is pretty much always a first adopter of any new tech, because they’re basically the research wing of the US military, and they have effectively infinite resources at their disposal (note: I am not debating whether or not that is a good thing here; simply stating that it is a thing). But just because they’ll likely do something military-ish with it first doesn’t mean that it’s a “bad” technology. The internet itself was, after all, initially a project of DARPA’s predecessor, ARPA, and was initially named “ARPAnet”.
Analog as in analog signals vs digital signals. Reductively: circuitry designed to operate in a continuously variable electrical domain, as opposed to circuitry designed to operate in a clocked binary domain.
Analog is (with a LOT of handwaving) way closer to how biological neural nets (that is, actual neurological tissue) operates. This is one of many domains where the exploration of biomimicry could yield some incredible advantages in a lot of areas.
Maybe optimize the LLM to run on less compute?
Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe, and that the true power of this technical domain lies in more targeted and bespoke ML model generation and usage.
ML is good and enables - and has enabled - some genuine generational leaps in science and technology. But LLMs are such a fucking waste of the technology’s potential. Not to mention, I’m extremely irritated that (largely due to Nvidia cornering the market) everyone is super gung-ho about a digital approach which amounts to brute-forcing neural nets digitally with shitloads of memory and highly-parallel compute, when it’s obvious to anyone with more than a passing familiarity with electrical engineering that an analog approach is going to be FAR more efficient in terms of resource and energy usage.
Yeah, for 4 and 8 bit quantization at least analog charge buckets or memristor-likes and analog multipliers would dramatically reduce substrate size, reduce power burn and speed up inference. Even better killer drones, here they come. Yay.
I mean… yeah, DARPA will probably be one of the first adopters of that stuff, it’s true. But DARPA is pretty much always a first adopter of any new tech, because they’re basically the research wing of the US military, and they have effectively infinite resources at their disposal (note: I am not debating whether or not that is a good thing here; simply stating that it is a thing). But just because they’ll likely do something military-ish with it first doesn’t mean that it’s a “bad” technology. The internet itself was, after all, initially a project of DARPA’s predecessor, ARPA, and was initially named “ARPAnet”.
maybe this is personal preference
?
Analog meaning think for yourself or what?
Analog as in analog signals vs digital signals. Reductively: circuitry designed to operate in a continuously variable electrical domain, as opposed to circuitry designed to operate in a clocked binary domain.
Analog is (with a LOT of handwaving) way closer to how biological neural nets (that is, actual neurological tissue) operates. This is one of many domains where the exploration of biomimicry could yield some incredible advantages in a lot of areas.
Don’t worry, Chinese LLM vendors without access to the newest hardware will take care of that.
based,hopefully they use this to optimize local LLMS so i have higher tokens per second.
Stop talking sense when has good sense ever been the solution of choice.
But everything’s computer!
If I was king they would have to run on 100% on-site solar and air cooling.
would be based