Deep Rendering Graphics Pipeline

The graphics rendering pipeline is key to generating realistic images, and is a vital process of computational design,modeling, games, and animation. Perhaps the largest limiting factor of rendering is time; the processing requiredfor each pixel inevitably slows down rendering and produces a bottleneck which limits the speed and potential ofthe rendering pipeline. We applied deep generative networks to the complex problem of rendering an animated 3Dscene. Novel datasets of annotated image blocks were used to train an existing attentional generative adversarialnetwork to output renders of a 3D environment. The annotated Caltech-UCSD Birds-200-2011 dataset served asa baseline for comparison of loss and image quality. While our work does not yet generate production qualityrenders, we show how our method of using existing machine learning architectures and novel text and imageprocessing has the potential to produce a functioning deep rendering framework.