OpenAI-Clip

Multi-modal foundational model for vision and language tasks like image/text similarity and for zero-shot image classification.

Contrastive Language-Image Pre-Training (CLIP) uses a ViT like transformer to get visual features and a causal language model to get the text features. Both the text and visual features can then be used for a variety of zero-shot learning tasks.