This category is about Agentic and Autonomous Systems
Alright, fellow hardware junkies and algorithm enthusiasts. You know my journey: from building my dual-RTX 4080 rig to wrestling with scaling laws and even trying to birth a local data scientist with AutoMind. Each step has been about pushing the boundaries of what one person can do with local compute. But what if the next … Read more
After spending weeks obsessing over scaling laws and raw TFLOPS, I decided it was time to move up the stack. It’s one thing to have a powerful model; it’s another to have an Agent that knows how to use it. I took the architecture described in my recent overview of AutoMind AI Agent — an adaptive agent for automated … Read more
After building my dual-RTX 4080 rig (which I covered in my previous post), I felt like a kid with a supercar stuck in a school zone. It was time to take it to the track. I decided to reproduce the foundational 2020 OpenAI paper: “Scaling Laws for Language Models.” Why this paper? Because it’s the “Old Testament” … Read more
After publishing my overview of the LLM Scaling Laws, I was left with a nagging question: Does this actually hold up when you aren’t training on a massive cluster? Theoretical comprehension is one thing, but as I’ve discussed in my previous posts, Implementation-First Research requires getting your hands dirty. So, I decided to take my local Ubuntu workstation — … Read more