

Online models probably use even less than local ones, since they will likely be better optimized, and run on dedicated hardware.


Online models probably use even less than local ones, since they will likely be better optimized, and run on dedicated hardware.


Licenses like GPL were made to destroy copyright from the inside


A desktop cpu and 20gb of ram.


You don’t need a license to look at stuff.


It would need to load every part of the model from disk into ram for every token it generates. This would take ages.
What you can do, however, is quantize the model. If you, for example, quantize a 16-bit model into 4-bit, its storage and ram requirements will go down to 1/4. While the calculations will still be in 16-bit, the weights will lose some accuracy.


To steal data, it needs to be deleted off the target’s computer. DMCA is stealing. Copying is not.


GPL was made to destroy the oppressive bourgeois copyright system from the inside, not to expand copyright even further.
If the corpos ignore the gpl, they delegitimize their own copyright system.


Its already settled. AI training is considered “fair use”, therefore compliant with copyright.
Still, death to copyright.
I have a solution its called china
They have solar panels those neither use water nor produce co2/ch4, they can train the AI (the energy-intensive part)
Then you download the AI from the internet and can use it 100000x and it will use less energy than a washing machine, and neither consume water nor produce co2/ch4