Best Neural Network architecture for computer vision of computer games & desktop applications?

Question

I see that convolutional neural networks are used specifically for image recognition and object detection since their hidden layers and nodes are designed to encode features such as 3 dimensionality, shadows, depth, and other common things found in real life images.

My specific interest is computer vision for desktop computer applications and computer games. Screenshots from a computer don't contain all of the same features as real life images, but nevertheless there must be some overlap particularly from games. I'm curious whether convolutional neural networks would be useful for this type of artificial object recognition, or if there is a more appropriate type of neural network architecture? Also would it make a difference in the object detection in computer games whether those games were 2D, 2.5D or 3D in terms of which architecture is best?

Answer 1

Convolutional neural networks are suitable for detecting objects in your computer game application. The only problem is that you cannot probably use the pre-trained models such as VGG, ResNet, etc. which are trained on the real life images from ImageNet (or you can only use the first layers ). You should probably train your own CNN from scratch or try to find a pre-trained model which are trained on the images which are similar to your images. Anyway, you can test the existing pre-trained models such as VGG and try to fine-tune their higher layers based on your images and evaluate their performance in your application.