Japan's Supercomputer 🇯🇵 // GitHub x EU AI Law 🇪🇺 // ARB benchmark for LLMs 🧪

Japan's Ministry of Economy, Trade, and Industry is investing heavily in AI development by building a new supercomputer to accelerate progress in AI and reduce Japan's dependence on foreign countries. GitHub and other companies are calling for more open-source support in EU AI law to promote a more open ecosystem for AI innovation. The ARB benchmark presents a more challenging test for large language models, and current models score well below 50% on more demanding tasks. "Predicting Code Coverage without Execution" proposes using Machine Learning to predict code coverage without actual execution, which could lower the cost of code coverage. State-of-the-art LLMs were able to predict code coverage with reasonable accuracy, demonstrating the potential of using Machine Learning for this task. Contact:  [email protected] Timestamps: 00:34 Introduction 01:40 Japan's METI to build new supercomputer to help develop AI at home 03:28 GitHub and others call for more open-source support in EU AI law 05:06 ChatGPT broke the Turing test — the race is on for new ways to assess AI 06:26 Fake sponsor 08:30 ARB: Advanced Reasoning Benchmark for Large Language Models 09:55 Contrastive Example-Based Control 11:16 Predicting Code Coverage without Execution 13:14 Outro