(Pictures/videos in linked blog posts.)
I'd like to share an autonomous RC car project I worked on over a longer time.
It started with an RC car, where I modified the remote so I could control it over an Arduino, and attached a Raspberry Pi and camera to it, streaming the video back to a laptop, which then steers the car depending on the current camera frame, using the remote control.
The hardware part was working fine, but due to the delays introduced by streaming and the inferencing (based on a convolutional neural net) being a bit slow, the car would have a lot of steering "noise".
So I switched to simulation, to have more control over the hardware and timing, which allowed for more experiments and was much more precise:
Now I made a reliable self-driving car in the "real world", with a NVIDIA Jetson based car, which has significantly more processing power, so that all can be done locally on the car, which improves latency a lot.
Next week I plan to make a video, when I get the replacement parts I had in warranty.
But comments would still be nice until I can upload a video of the final result