[New Model]: Support for Idefics3 8B Llama3

[costelter]

The model to consider.

https://huggingface.co/HuggingFaceM4/Idefics3-8B-Llama3

The closest model vllm already supports.

The model is built on top of two pre-trained models: google/siglip-so400m-patch14-384 and meta-llama/Meta-Llama-3.1-8B-Instruct.

What's your difficulty of supporting the model you want?

As for now no model of the Idefics architectures are supported by vLLM

Idefics3ForConditionalGeneration
Idefics2ForConditionalGeneration

see also #4124

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.