Articles

tldr I created a custom robotic arm environment where the arm is rewarded if it sorts shapes a certain way, and then punished if it knocks them off a table. I used OpenAI’s PPO method to be somewhat successful. If you want to skip to …

tldr; This post is a bit different, in that it’s more of an info-dump than a discussion of something. This is the notes I took years ago on the book Ultralearning by Scott Young. The bombastic title and promise to learn virtually …

tldr; I attempted to repeat my success with the evolving race cars by using evolutionary algorithms and neural networks to control simulated traffic flow in a segment of Chicago’s streets. The results were… not so great. You …

tldr; Sometimes you just need to call out to a database instead of mocking it; to that end I created this module to allow one to quickly create and dispose of docker containers for tests. The Problem Generally when writing unit or …

tldr; I built a neural network controlled race car that evolves via evolutionary algorithms. You can check out the surprisingly effective example here. The Inspiration When I was young, I remember being fascinated by an episode of NOVA …