DAM-3B-Video

Long Lian, Yifan Ding, Yunhao Ge, Sifei Liu, Hanzi Mao, Boyi Li, Marco Pavone, Ming-Yu Liu, Trevor Darrell, Adam Yala, Yin Cui Describe Anything Model 3B Video (DAM-3B-Video) takes inputs of user-specified regions in the form of points/boxes/scribbles/masks within images/videos, and generates detailed localized descriptions of images/videos. DAM integrates full-image/video context with fine-grained local details using a novel focal prompt and a localized vision backbone enhanced with gated cross-attention. The model is for research and development only. This model is ready for non-commercial use. This model is intended to demonstrate and facilitate the understanding and usage of the describe anything models. It should primarily be used for research and non-commercial purposes.

번역 준비 중입니다. 원문을 표시합니다.