And then, came BERT.
I’d love to be back at BERT levels of transformer networks.
Not even that, it’s an approximation of the next word or words.
No AI is a made up term for statistic models tech Bros used to “train”.
There’s machine learning and a subsidiary of ML are LLMs, same as LDA, Random Forest, Decision Trees and other stochastic models.
The concept of those models isnt even remotely new, the first neural models were hypothesized and trained in the 60’s. Although with only a fraction of the layers of today’s models, since compute power wasn’t remotely close to what it is today.
These models only can exist because we (humanity) got so good at building tiny transistors.
And as a studied Data Scientist it boils my blood whenever some problem is supposed to be solved with “let’s use ai for it”.
Don’t you worry, nobody plays after Trump’s script. Trump plays for money, he doesn’t care where or who it’s from.
Best bang for the buck is a Mac mini with 64gbs memory. But that’s still ~3k€
Depends on your hardware. Apples unified memory system can give near complete access to the ram for their GPU/npu.
Apart from that you don’t need a single bit of vram/gpu to host a model. Then can be run completely on CPU+ram. But that comes with a significant processing penalty.
On top of that there’s new “engines” which can run a LLM from disk storage +system ram/vram, yet again with lots of speed penalities, since you chunk the model into small pieces and load them into ram accordingly. This will also cripple the lifetime of ssds with the sheer amount of read/write cycles.
Then there’s also dedicated systems or extension cards which can be used as accelerator.
None the less we speak about a minimum of 5000€'s for a system which can run llms and (lightweight) games simultaneously.
Tiktok is banned in China, they have their own dedicated filteredversion of it.
Judging from the size of other frontier models on hf, you won’t host it.
The best/biggest you can squeeze on 64gb ram rn is ~70-80B in a Q4 Quant. Going lower with quantization will usually leave you with notable degraded performance.
Thugs want money, thugs want more influence in EU. Thugs are Russia and USA(this term and every other term)
It’s not like any other big social media platform does the same!
But I guess it’s only bad when China does it…
One Shop in Frankfurt after the protest officially ended.
Nothing turned violent, this is a giant nothing-burger.
1 points on I'll never forget how badly the term "AI" nosedived into being uncool in !showerthoughts@lemmy.world ·
I mean politically it has turned way worse in some countries. But if you look at it historically, it’s not the first time the super rich have a stranglehold on most of the society. I also don’t believe that they’ll be able to hold on to it, since (let’s be honest) at least the new American super rich are complete idiots. I also don’t think that the “ai” companies of today will survive as they do at the moment, this will and has to come crashing down again. And as my mom said: “regime change begins at home”.