[P] Self-driving AI in GTA V - Just using a ConvNet with decent results update

I've been working on a tutorial series for creating self-driving cars in Grand Theft Auto 5 for a bit now.

The most recent creation is the result of day or so worth of collecting training data, and about 4 days of actual training of the model.

It's currently a 30-layer convolutional neural network, it works purely on a frame-by-frame basis with no preprocessing other than an image resize and grayscale. It makes actions based on the current frame's pixel data, with no memory of what it's been doing. I plan to eventually incorporate some form of memory with something like recurrent layers, but...baby steps at a time!

Right now, the stream is just a stream of the latest model, it's not training itself any further, but I do plan to eventually implement self-training into the model, I just wanted to get the stream to run 24/7 first.

I am streaming the bot 24/7 on Twitch: Python Plays GTA V

Here's a video covering the latest model: self-driving AI update #15

If you want to learn about how it's made: Self Driving Cars in GTA with Python and TensorFlow tutorial series

If you want to just see the base source code: check it out on github

Unfortunately, right now, the stream is kind of touch and go. My internet is failing me on the upload, and the GPU running the game, stream, and neural network is frequently maxed out. I will try to improve it in time, but still somewhat amusing to watch regardless.