技巧

理论基础

  • CLIP

  • ALIGN

  • VILT

自监督

  • MAE

  • DINO

  • MOCO

预训练

  • mlm

  • mfm

  • itm

参考：

  • https://zhuanlan.zhihu.com/p/144268850

  • https://github.com/Sense-X/UniFormer

  • https://github.com/NadirEM/nlp-notebooks/blob/master/Multimodal_product_classification.ipynb

  • https://github.com/pliang279/awesome-multimodal-ml

Previous多模态Next强化学习与优化

Last updated