Shuchen DuL-DAE: Latent Denoising Autoencoder for Self-supervised Pre-trainingA potential alternative to MAE for image modeling as pre-training·5 min read·Feb 4, 2024----
Shuchen DuinAI SalonSelf-supervised Visual Model Pre-training for Small DatasetsSelf-supervised learning (SSL) is quite polular pre-training method to resolve label-deficient datasets, in order to get high model…·4 min read·Sep 4, 2023----
Shuchen DuinTowards Data SciencePrompt Context Learning in Vision-Language Fine-tuningA parameter-efficient method for efficient model adaptation·9 min read·Sep 21, 2022--1--1
Shuchen DuinArtificial Intelligence in Plain EnglishObject-level Vision-Language Contrastive Pre-trainingExplicit and implicit methods for aligning object-level vision and language features without human annotations·5 min read·Sep 12, 2022----
Shuchen DuinGeek CultureContrastive Learning without Negative PairsSome methods that make your contrastive pre-training implementation light and simple·4 min read·Jul 28, 2022----
Shuchen DuinTowards Data Science5 Probabilistic Training Data Sampling Methods in Machine LearningAppropriate data sampling methods matter for training a good model·6 min read·Jul 21, 2022----
Shuchen DuinTowards Data ScienceMultiMAE: An Inspiration to Leverage Labeled Data in Unsupervised Pre-trainingBoost your model performance via multimodal masked auto-encoders·5 min read·Jul 17, 2022----
Shuchen DuinTowards Data ScienceContrastive Pre-training of Visual-Language ModelsFully leveraging supervision signals in contrastive perspectives·5 min read·Jul 14, 2022----
Shuchen DuinTowards Data ScienceEnhancing the Performance in Training Tiny Neural NetworksBe aware of the differences in training large and tiny neural networks·4 min read·Apr 15, 2022----
Shuchen DuinTowards Data SciencePixel-level Dense Contrastive LearningDense contrastive learning with active sampling strategy·7 min read·Apr 3, 2022----