I found myself looking into the effects of censorship removal from LLMs - particularly the recent popular kid on the block Deepseek R-1. It seems that the model becomes uncooperative against certain topics that don’t align with party doctrine. I came a cross a generic refusals removal repository linked here which made me chuckle - it’s just control vectors fine tuned into the model, which I discussed here.
Blog
(Rapidly) introducing arkaine
Diffusion Models Are Real-Time Game Engines
Your browser does not support the video tag. Google Deepmind recently released Diffusion Models Are Real-Time Game Engines [Site] | [Paper], a fascinating paper wherein a modified Stable Diffusion model acts as the game engine for the …
Read article →Google DeepMind's Grandmaster-Level Chess Without Search
tl;dr Google DeepMind released a paper claiming that, without search, a transformer architecture can be utilized to achieve grandmaster level play in chess. But what does that mean? I’m giving a paper club talk on the subject, so I …
Read article →Representation Engineering and Control Vectors - Neuroscience for LLMs
tl;dr A recent paper studied large language model’s (LLM) reactions to stimuli in a manner similar to neuroscience, revealing an enticing tool for controlling and understanding LLMs. I write here about the paper and perform some …
Read article →Nerd Sniped - Solving for Jumbles and Letter Boxed
tl;dr I got nerd sniped by a problem and wrote a solver for it. You can find it here. The Problem Apparently it’s impossible to determine if someone is capable of coding without asking them arbitrary puzzles that are in no way related …
Read article →Utilizing LLMs as a Task Planning Agent for Robotics
tl;dr For my Master’s capstone project, I demonstrated that not only can LLMs be used to drive robotic task planning for complex tasks given a set of natural language objectives, but also demonstrate some contextual understanding that …
Read article →A Corollary to Conway's Law - Build for The Team You Have
Melvin Conway has a law that I’ve heard thrown about throughout my career building applications and backend systems. Verbatim it states: Organizations which design systems are constrained to produce designs which are copies of the …
Read article →Repeatable Dev Environments for ROS2
tldr ROS/ROS2 environments are notoriously annoying to get into a repeatable, isolated dev environment. I write about my initial look into this problem, and some proposed solutions I tried. I present my imperfect solution using both Docker …
Read article →State of the art in LLMs + Robotics - 2023
tldr I write about some of the more interesting works that shaped my understanding of applying LLMs for AI agents and robotic applications. Introduction What is this LLMs as a fad - a caveat Are LLMs actually going to be useful for …
Read article →Reinforcement Learning with a Pick and Place Robotic Arm
tldr I created a custom robotic arm environment where the arm is rewarded if it sorts shapes a certain way, and then punished if it knocks them off a table. I used OpenAI’s PPO method to be somewhat successful. If you want to skip to …
Read article →Ultralearning
tldr; This post is a bit different, in that it’s more of an info-dump than a discussion of something. This is the notes I took years ago on the book Ultralearning by Scott Young. The bombastic title and promise to learn virtually …
Read article →Evolving a Neural Network Traffic Controller
tldr; I attempted to repeat my success with the evolving race cars by using evolutionary algorithms and neural networks to control simulated traffic flow in a segment of Chicago’s streets. The results were… not so great. You …
Read article →Golang Docker Harness
tldr; Sometimes you just need to call out to a database instead of mocking it; to that end I created this module to allow one to quickly create and dispose of docker containers for tests. The Problem Generally when writing unit or …
Read article →Evolutionary Neural Networks
tldr; I built a neural network controlled race car that evolves via evolutionary algorithms. You can check out the surprisingly effective example here. The Inspiration When I was young, I remember being fascinated by an episode of NOVA …
Read article →