PPO Control with the Standard Open ARM101
Implementation of the Proximal Policy Optimization (PPO) algorithm, tested with the Standard Open ARM101 in IsaacLab and deployed in the real world
Portfolio
Proximal Policy Optimization within IsaacLab
Implementation of the Proximal Policy Optimization (PPO) algorithm, tested with multiple environments within IsaacLab
SO-ARM101 SmolVLA Finetuning
Finetuning SmolVLA for the SO-ARM101 in the real world.
PokerBot
A Texas Hold’em playing Robot
Visual Odometry Pipeline and Visual Slam Pipeline with the KITTI dataset in Python
Visual odometry pipeline, and a visual SLAM pipeline. Both tested with the KITTI dataset 
RRT* with differential-drive dynamics implementation in Python
Implementation of the RRT* algorithm with and without differential-drive dynamics within jupyter notebooks
Proximal Policy Optimization, Deep Reinforcement Learning
Implementation of the Proximal Policy Optimization (PPO) algorithm, tested with the Atari Pong Gymnasium environment
Capstone
Review and Update of Electrical Infrastructure for an Existing Underwater Robot
Advent of Code 2025 Solutions
My solutions in Python to the Advent of Code 2025 challenges.
Proximal Policy Optimization, Deep Reinforcement Learning
Implementation of the Proximal Policy Optimization (PPO) algorithm, tested with the Lunar Lander Gymnasium environment
Animated Julia and Fatou set on an FPGA
Implementation of a VGA driver, and an animated Julia and Fatou set
Deep Q-Network
Implementation of the Deep Q-Network algorithm, tested with the Cart Pole Gymnasium environment
Reinforcment Learning Implementations
Implementations for various reinforcement learning algrotihms for both discrete and continuous state and action spaces