|
- LLaVA: Large Language and Vision Assistant - GitHub
With additional scaling to LLaVA-1 5, LLaVA-NeXT-34B outperforms Gemini Pro on some benchmarks It can now process 4x more pixels and perform more tasks applications than before
- LLaVA系列——LLaVA、LLaVA-1. 5、LLaVA-NeXT、LLaVA-OneVision
LLaVA是一系列结构极简的多模态大模型。 不同于 Flamingo 的交叉注意力机制、 BLIP系列 的 Q-Former，LLaVA直接 使用简单的线性层将视觉特征映射为文本特征，在一系列的多模态任务上取得了很好的效果。
- LLaVA系列①——LLaVA的快速学习和简单调用（附详细代码+讲解）-CSDN博客
【LLaVA模型介绍】 LLaVA 主要由三部分构成，也就是下图中的：视觉编码器（Vision Encoder）、对齐层（Projection，我喜欢叫它对齐层，虽然直翻是“投影层”）、语言模型（Language Model）。 视觉编码器： 主要是 CLIP 的 ViT 模块。 对齐层： 图像到文本对齐的矩阵
- [2304. 08485] Visual Instruction Tuning - arXiv. org
When fine-tuned on Science QA, the synergy of LLaVA and GPT-4 achieves a new state-of-the-art accuracy of 92 53% We make GPT-4 generated visual instruction tuning data, our model and code base publicly available
- LLaVA
We introduce LLaVA (L arge L anguage- a nd- V ision A ssistant), an end-to-end trained large multimodal model that connects a vision encoder and LLM for general-purpose visual and language understanding
- liuhaotian llava-v1. 5-7b · Hugging Face
Model type: LLaVA is an open-source chatbot trained by fine-tuning LLaMA Vicuna on GPT-generated multimodal instruction-following data It is an auto-regressive language model, based on the transformer architecture
- LLaVA: Large Language and Vision Assistant - Microsoft Research
LLaVA is an open-source project, collaborating with research community to advance the state-of-the-art in AI LLaVA represents the first end-to-end trained large multimodal model (LMM) that achieves impressive chat capabilities mimicking spirits of the multimodal GPT-4
- LLaVA Architecture: From Frozen ViT to Fine-Tuned LLM
A complete technical breakdown of the LLaVA-1 5 multimodal visual assistant Explore its architecture, open-source training data, and how to use the model
|
|
|