• The Linux Foundation accepts the first genAI models, RWKV (Receptance Weighted Key Value, a genAI architecture without the attention mechanism of LLMs) – they also announced Generative AI Commons, an organization to advance open-source genAI. - Linux Foundation, RWKV paper
• An AI ‘virtual cell’ could represent every cell state and cell type, increasing the speed and safety of scientific discovery, patient diagnosis, and treatment – the Chan Zuckerberg Initiative will provide data, 1000+ H100 GPUs, and other resources to build it. - MIT
• Swarms of cheap, easily replaceable, AI-powered military drones – that’s the US army’s Replicator initiative in a nutshell, it would be a major step away from traditional military development with long cycles and extremely expensive hardware. - New Yorker
• LLM-assisted white-box testing (=uncovers deeply hidden security vulnerabilities, but work-intensive) – the CI Spark assistant provides 1500% acceleration of onboarding new projects for testing, from several days of work to under three hours. - Code Intelligence
• Microsoft’s AI assistant, Copilot, might already be on your PC because it has just started rolling out to Windows 11, and it’s coming to Bing, Edge, and Microsoft 365 soon – it will “lessen your cognitive load”, plus apps like Paint and Notepad will now have AI features. - Microsoft
• Closed-source AI is easier to use and dominates the mainstream discussion, but open will eventually win – companies building specialized products can extract more benefits and generate more value from open-source models. - Public Experiments
• Despite AI, the demand for programmers will stay higher than the supply, says GitHub CEO – “we have an ever growing number of lines of code we have to manage, an ever-growing number of ideas, and every company is now a software company.” - TechCrunch
• LLMs don’t understand that if ‘A is B’, then ‘B is A’ – this ‘Reversal Curse’ affects all model sizes and families and isn’t solved by updating data, for example GPT-4 can easily answer “Who is Tom Cruise’s mother”, but not “Who is Mary Lee Pfeiffer’s son?”. - GitHub
• New image generator enters the arena – Generative AI by Getty Images, built together with Nvidia, is trained only on the Getty Images library, creators of images used to train it will be compensated, and you can use its creations without any copyright worries at all. - The Verge
