My Take

I train LLMs for a living. People need to chill the fuck out. Techniques such as quantization, MoE, etc, have been around for a long time in the LLM space. Companies are competing neck and neck. Everyday I get a newsletter describing how some team released a new model that is better in XYZ way. Who cares lol. This release is no surprise to the expert community. It really is an expensive arms race. Do you know who always benefits? The gun seller. That’s capitalism. Now shut up and buy nvidia.