sp26-cs639 lecturemultimodalclipvlmcs639
Lecture 13: Multimodal Models II Lecture 13: Multimodal Models II
Content locked
The catalog is public. Reading this content requires approved access.
Sign in to readLecture 13: Multimodal Models II
Review: Making LLMs Multimodal
Training
Image Embeddings: ViT
ViLT
Variations
Datasets
VLM Variations and Types
Contrastive Vision-Language Models
Contrastive Training
CLIP
How to Use CLIP?
FLAVA
Few-Shot VLMs
Flamingo
Visual Instructions: LLaVA
Closed-source Multimodal Models
Other Modalities and Domains
Audio
Audio + Video + Text
Foundation Models in Robotics
SayCan