Benchmarking Multimodal Knowledge Conflict for Large Multimodal Models
Yonghong Jia, Yuntao Du, Kailin Jiang, Y. T. Liang et autres
Large Multimodal Models (LMMs) face notable challenges when encountering multimodal knowledge conflicts, particularly under retrieval-augmented generation (RAG) frameworks, where the contextual information from external sources may contradict the model’s internal parametric knowledge, leading to unreliable outputs. However, existing benchmarks fail to reflect …
cn, hk (code pays fourni par la source)