Well, the Mac Studio 512GB is planned for this month (but I guess Meta already has some), but it should be possible to link 4 256GB macs. That would be a $40k cluster, requiring only 4 x 500W of power. In comparison, a single Nvidia GB200 has 384GB of memory, needs 2700W and costs $70k. So maybe Meta is planned to only use macs for its next AI datacenter: just a shed with 2 million macs connected to get a 1GW for only $20B. Or maybe Meta will just lease them for $200/mo each, so for only $400M...
"Together, they mark the next step on our scaling ladder and a major leap toward personal superintelligence." "Two models often have similar benchmark scores, yet one seems to handle a much wider range of unfamiliar tasks." "That’s what complaints of "benchmaxxing" and praise for "big model smell" both get at: a breadth of capability that popular benchmarks in a few domains can’t fully capture." "To quantify this mismatch, we investigate how performance on tasks targeted during post-training...
30 years old and still as kool as ever. It definitely aged better than most people I know...
"In response to user feedback, we’ve removed built-in AI from the open-source versions. AI tools are installed separately." Sane choice. Let's hope it'll stay like this as long as possible, because users should never have to complain for AI to be removed by default.