딥러닝 분석가 가리

"Learning with Unmasked Tokens Drives Stronger Vision Learners"AbstractMasked image modeling (MIM) pre-trained encoders often exhibit a limited attention span, attributed to MIM's sole focus on regressing masked tokens only, which may impede the encoder's broader context learningTo tackle the limitation, we improve MIM by explicitly incorporating unmasked tokens into the training processSpecific..