# 技巧

理论基础

* CLIP
* ALIGN
* VILT

自监督

* MAE
* DINO
* MOCO

预训练

* mlm
* mfm
* itm

参考：

* https://zhuanlan.zhihu.com/p/144268850
* https://github.com/Sense-X/UniFormer
* https://github.com/NadirEM/nlp-notebooks/blob/master/Multimodal\_product\_classification.ipynb
* https://github.com/pliang279/awesome-multimodal-ml
