George timmermans
  • About Me
    • Resume
    • Press releases
  • Blog
  • Projects
    • Long Range WiFi Link
    • Embedded Systems >
      • Photo Booth
      • Classroom VU meter
      • USB Media Controller
      • Weather Station
      • Arduino Swimming Pool Controller
      • GRBL Android Controller
      • Arduino Serial Driver
      • Arduino Multitasking
      • 8x8x8 LED Cube
      • Analog -> Digital Geiger Counter
    • 3D Printing >
      • Simplify3d Configuration
      • 3D print repairs
    • Home Brewing >
      • Mead Recipes >
        • Cinnamon Mead
        • Sweet Chili Mead
        • Lemon & Ginger Mead
        • Mead Liqueur
        • Honey Beer
      • Glühwein (Spiced Wine)
      • Limoncello
    • House
    • Toolmaking
    • Laser Cutting
  • Weather Cam
  • Contact

Playing around with AWS DeepRacer

17/11/2020

0 Comments

 
 My workplace organised a AWS DeepRacer competition and a few colleagues and I where keen to give it a go. We received a 30min walkthrough about the basics and which track we where going to race and then left us to our own devices. 
With AWS DeepRacer you train a virtual car to go around a lap by writing a reward function. You either reward or punish certain actions and over time it should learn how to go around the track while acquiring the most reward points. Which hopefully corresponds with a fast lap around the track. We didn't spend a whole lot of time researching on what a great reward function might look like and in the end we used a function that added a few example functions together. It used three metrics. 
  1. lightly reward staying near the centre. 
  2. heavily reward speed.
  3. lightly punish excessive steering. 
Here is a video of our preliminary round. The speed of the car is restricted in the preliminary rounds. ​We ended up second out of 10 teams on this one.
As you can see in the video the car was not driving in a smooth fashion at all. So we ended up adjusting metric 3 and punish steering heavily and train it for another hour. Even though the logs looked very promising, the real world experience was far from great. While the large turn was very smooth, the sharp turn got completely ignored and the car would drive straight into the wall. A great example why I wouldn't want to write mission critical software where lives are at stake. Overall we had a great time and learned a bit more about machine learning. In the end we came fourth place. 
What would I try next time? Apparently the default training parameters weren't particular efficient. Learning more about the training parameters and how to configure them for better results. And probably remove the steering parameter from the reward function. IF trained well, the model should figure out itself to not steer a lot.
0 Comments

    Author

    George Timmermans, Research Toolmaker, Software Engineer and Tinkerer

    View my profile on LinkedIn

    Archives

    January 2021
    November 2020
    July 2020
    May 2020
    November 2019
    August 2019
    January 2019
    October 2018
    January 2018
    November 2017
    October 2017
    August 2017
    June 2017
    May 2017
    April 2017
    March 2017
    January 2017
    December 2016
    November 2016
    October 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    March 2016
    December 2015
    November 2015
    October 2015
    September 2015
    August 2015

    Categories

    All
    3d Printing
    Photobooth
    Wisp

    RSS Feed

Proudly powered by Weebly
  • About Me
    • Resume
    • Press releases
  • Blog
  • Projects
    • Long Range WiFi Link
    • Embedded Systems >
      • Photo Booth
      • Classroom VU meter
      • USB Media Controller
      • Weather Station
      • Arduino Swimming Pool Controller
      • GRBL Android Controller
      • Arduino Serial Driver
      • Arduino Multitasking
      • 8x8x8 LED Cube
      • Analog -> Digital Geiger Counter
    • 3D Printing >
      • Simplify3d Configuration
      • 3D print repairs
    • Home Brewing >
      • Mead Recipes >
        • Cinnamon Mead
        • Sweet Chili Mead
        • Lemon & Ginger Mead
        • Mead Liqueur
        • Honey Beer
      • Glühwein (Spiced Wine)
      • Limoncello
    • House
    • Toolmaking
    • Laser Cutting
  • Weather Cam
  • Contact