L-DAE: Latent Denoising Autoencoder for Self-supervised Pre-training

A potential alternative to MAE for image modeling as pre-training

L-DAE [1]

Unsupervised imaging tasks, e.g. denoising, inpainting, could be utilized to pre-train a computer vision model to improve the performances of downstream tasks. In order to denoise or inpaint the missing part of the image, the model should…