Redid the old sketch with a neural monocular depth model. As long as one keeps the displacements within certain bounds it might work. Since I did not find any prior mention of using this pseudo depth for data augmentation I put it here under a creative commons licence.