Last night Adam gave a great presentation at the SDx paper club. The idea of using ODE solvers as an activation function was šŸ¤Æ. It’s heavily used in robotics, so I’ll likely be doing a deep dive at some point; specifically building a neuron that uses the paper’s techniques to better understand the inner workings.