Akib Jawad 2a9febd632 Add support for including in-memory videos (not just files/urls) in apply_chat_template (#39494) ...

* added code for handling video object ,as dictionary of frames and metadata, in chat template

* added new test where videos are passed as objects (dict of frames, metadata) in the chat template

* modified hardcoded video_len check that does not match with increased number of tests cases.

* Modify hardcoded video_len check that fails with increased number of tests

* update documentation of multi-modal chat templating with extra information about including video object in chat template.

* add array handling in load_video()

* temporary test video inlcuded

* skip testing smolvlm with videos that are list of frames

* update documentation & make fixup

* Address review comments

2025-08-04 11:49:42 +02:00

56 KiB

Raw Blame History

View Raw