Maker.io main logo

Projects See All

PROJECT
1,074

Adding Object Detection Vision to the XRP Robot

By ShawnHymel

This guide demonstrates how to add a custom object detection machine learning model to the XRP robot.

PROJECT
1,410

Intro to the Google Coral Dev Board Micro: Custom Object Detection

By ShawnHymel

This tutorial demonstrates how to train and deploy a custom object detection model for the Google Coral Dev Board Micro.

PROJECT
1,029

Tiny Reinforcement Learning (TinyRL) for Robotics

By ShawnHymel

This project demonstrates using reinforcement learning to solve the swing-up problem on an inverted pendulum

PROJECT
298

Hyperparameter Optimization with Meta Ax

By ShawnHymel

This tutorial demonstrates hyperparameter tuning using Meta's Ax framework for a common reinforcement learning problem

PROJECT
5,177

How to Tune a PID Controller

By ShawnHymel

In this tutorial, we demonstrate how to manually tune a PID controller.

PROJECT
8,807

Introduction to PID Controllers

By ShawnHymel

In this post, we cover the basic theory behind PID controllers. PID stands for “Proportional, Integral, Derivative," and they are commonly used in industrial settings to control various processes.

Blogs

BLOG
694

Digit: A Wearable Companion Bot with AI Voice Interaction

By ShawnHymel

Digit's AI-powered brain enables local real-time voice conversations using Hopper Chat and Llama 3. Learn how to set it up with NVIDIA Jetson Orin Nano.

Tutorials See All

TUTORIAL
60

Reinforcement Learning for Robotics Part 6: AI-Powered RC Balance Bot

By ShawnHymel

In this episode, we deploy the trained agent to the real robot and build a web-based remote controller.

TUTORIAL
66

Reinforcement Learning for Robotics Part 5: Adding Commands to the Agent

By ShawnHymel

In this post, we demonstrate how to implement domain randomization with reinforcement learning (using the PPO algorithm) to balance a 2-wheel robot.

TUTORIAL
90

Reinforcement Learning for Robotics Part 4: Domain Randomization

By ShawnHymel

In this post, we demonstrate how to implement domain randomization with reinforcement learning (using the PPO algorithm) to balance a 2-wheel robot.

TUTORIAL
137

Reinforcement Learning for Robotics Part 3: Deploy AI Agent to a Robot

By ShawnHymel

In this post, we'll show how to deploy a trained actor neural network from a PPO agent to an ESP32 robot using Arduino.

TUTORIAL
169

Reinforcement Learning for Robotics Part 2: Train a Balance Bot with PPO

By ShawnHymel

In this episode, we develop a Gymnasium environment wrapper for our MuJoCo simulation, implement a custom version of Proximal Policy Optimization (PPO), and use a technique called curriculum learning to train the robot to balance on its own.

TUTORIAL
420

Reinforcement Learning for Robotics Part 1: CAD to MuJoCo Simulator

By ShawnHymel

Reinforcement Learning for Robotics is a hands-on guide to training a real robot using modern RL techniques, from simulation to hardware deployment. By the end of the series, you'll have a working remote-controlled balance bot.