mshukor/IMA-DePALM

(IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs

• This repo contains the models used in the following paper: [NeurIPS 2024] Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs
• Github code: https://github.com/mshukor/ima-lmms
• Project page: https://ima-lmms.github.io/

Citation

@article{shukor2024implicit,
  title={Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs},
  author={Shukor, Mustafa and Cord, Matthieu},
  journal={arXiv preprint arXiv:2405.16700},
  year={2024}
}