BrokeIt - Trending Repos · All episodes: ↗

5μs JIT, 27B reverse-engineering in 30 mins, NanoGPT speedrun

2026-08-24 · 7 min

Listen · Apple Podcasts Listen · Spotify

Stories covered

Transcript

Intro

Sam: An AI just did a reverse-engineering job in thirty minutes that would take a senior human days. And we're just getting started.

Kai: This is Kai.

Sam: And I'm Sam. It's Monday, August 24th, 2026.

Kai: And we've got three wild stories for you today from the world of open source and dev tools.

Kai: So, a frontier AI model from Alibaba's Qwen team is now doing advanced security work... autonomously.

Sam: We've also got a new contest to see who can train a GPT model the fastest—they're treating ML optimization like a video game speedrun.

Kai: And we're diving into a project that can Just-In-Time compile code faster than a bee flaps its wings. Seriously.

I gave Qwen 3.8 27B a reverse-engineering job and it finished in 30 minutes

Kai: Okay, let's start with that AI reverse engineer. An article on XDA-Developers is blowing up about Qwen 3.8, a 27-billion parameter model.

Sam: Right. So the claim is, they gave it a compiled C binary—no source code—and asked it to spit out the logic in Python.

Kai: And it did it. In 30 minutes, Sam. Thirty!

Sam: Okay, hold on. It was a specific binary: a simple number-guessing game. Impressive, sure, but it's not like it just cracked Photoshop.

Kai: But that's how it starts! This isn't just spitting out boilerplate. It's understanding compiled machine code and translating it back into human-readable logic. That's a huge leap.

Sam: It's also a massive security and intellectual property concern. What happens when someone points this at proprietary firmware? Or malware that security researchers are trying to analyze?

Kai: Or what happens when a defender points this at that same malware and gets an analysis in minutes instead of days? It's a tool, Sam. A tool that accelerates everything.

Sam: A tool that dramatically lowers the bar for sophisticated attacks. You're talking about automating a skill that takes years to develop. Where are the guardrails? What happens when it hallucinates a function and gives a confident but totally wrong analysis? That's arguably worse.

Kai: This is why they call it a 'frontier model'! It's the bleeding edge. For devs, it means your AI pair programmer is about to get way smarter about the code you're running, not just the code you're writing.

Sam: Great. So it can help me debug my webpack config by reverse-engineering the minified bundle. I can't wait.

Kai: Come on! This is a breakthrough. A brand new capability just unlocked for open source models.

NanoGPT Speedrun Frontier

Kai: Alright, let's talk speed. PrimeIntellect AI just launched something they're calling the NanoGPT Speedrun Frontier.

Sam: This is an interesting one. It's not a new model, it's a new 'game'. The goal: train Andrej Karpathy's NanoGPT to a specific loss target, as fast as humanly possible, on a single H100 GPU.

Kai: It's basically competitive overclocking, but for model training. They're optimizing every single part of the stack—data pipelines, kernel fusion, you name it—just to shave off seconds.

Sam: And they're posting their times. The record is already under four minutes. It turns ML optimization into a quantifiable sport, complete with a leaderboard.

Kai: And that's huge for the open source community! Imagine iterating on an idea in four minutes instead of four hours. The pace of innovation just explodes. It makes high-performance ML accessible to anyone who doesn't have a datacenter to play with.

Sam: Okay, but does speedrunning the training produce a good model? Or does it just produce a model that's good at hitting that one specific loss target on that one specific dataset? It feels like optimizing for a test.

Kai: Fair question, but the techniques they're developing are transferable. The point is to build a community and a knowledge base around squeezing every last drop of performance out of your hardware. This is basically a playbook for making your own training runs faster.

Sam: I'll give you that. Documenting and benchmarking these low-level optimizations is genuinely useful. I'm just wary of chasing a single metric at all costs.

JIT Compiling Code in 5μs

Sam: Alright, our last story... we go from minutes down to microseconds. Kai, you are going to love this.

Kai: Hit me.

Sam: It's a blog post from a developer named Malisper, titled 'JIT Compiling Code in 5μs'.

Kai: Wait—five microseconds? Five millionths of a second? That's not real. How?

Sam: By doing almost nothing. [laughs] Seriously. It's a JIT for a toy Lisp dialect, and the trick is, it avoids all the complex parts of a normal compiler. No AST, no IR, no complex register allocation.

Kai: So it's writing machine code directly to memory? That's some old-school hacker stuff. I love it.

Sam: Exactly. It allocates an executable memory page with `mmap`, writes the raw x86-64 bytes, and then just... calls it. The whole post is a masterclass in minimalism.

Kai: The implications here are wild... think high-performance scripting in game engines, dynamic plugins, anywhere you need to generate code on the fly with practically zero latency.

Sam: Or it has incredible implications for security exploits. Writing arbitrary bytes to memory and then making it executable is... let's just call it a 'well-known attack primitive.' You're playing with fire.

Kai: But that's what makes it so cool! It's a sharp tool for experts. It perfectly illustrates the trade-off: you can have safety and complexity, or you can have five-microsecond performance. You don't get both.

Sam: For any developer listening, it is a fantastic read. Just... please, don't ship this technique in your web server's request handler.

Kai: [laughs] It's a beautiful, scary reminder of just how fast computers can be when you get out of their way.

Kai: Alright, quick recap. We've got an AI that can reverse-engineer compiled code in half an hour.

Sam: A new contest is turning ML training into a speedrun.

Kai: And a minimalist compiler is JIT-ing code in a mind-boggling five microseconds.

Sam: So Kai, before we go... a quick search tells me it is, in fact, National Waffle Day.

Kai: Yes! I knew today felt special. I bet there's an open source project for generating waffle recipes with Midjourney prompts for the perfect lattice pattern.

Sam: I'm sure it's written in TypeScript, requires a 2GB download from npm, and has at least three prototype pollution vulnerabilities. Bon appétit.

Kai: [laughs] And that's our show for Monday, August 24th, 2026! We'll be back tomorrow with more from the world of open source.

Sam: See you then. Try not to JIT-compile any breakfast foods.

This show is made with AI: the hosts’ voices are synthetic and the scripts are AI-assisted. Every story links to its original source.