Generating Synthetic Data for Deep Learning using VR Digital Twin

ABSTRACT

The ongoing Covid-19 pandemic has made it challenging for large scale data collection, in particular for Convolutional Neural Network (CNN)-based computer vision systems. Additionally, there are numerous circumstances where security, privacy, and limitations pertaining to the accessibility of the required equipment make it arduous to validate computer vision systems with real-world datasets. In this paper, we investigated the possibilities of using synthetic datasets, generated from Virtual Environments (VE) for training and validation of CNN models. We present two use cases where the above-mentioned circumstances play a vital role in preparing the datasets and validating the model with large-scale datasets. By developing and leveraging a three-dimensional Digital Twin (DT), we produce large scale datasets for validating social distancing in workspaces;and in the context of semi-autonomous vehicles, we evaluate how a CNN-based object detection model would perform in an Indian road scenario. © 2021 ACM.