Security analysis of multimodal basis fashions usually treats imaginative and prescient and language inputs individually, lacking dangers from joint interpretation the place benign content material turns into dangerous together. Present approaches additionally fail to tell apart clearly unsafe content material from borderline instances, resulting in problematic over-blocking or under-refusal of genuinely dangerous content material. We current Imaginative and prescient Language Security Understanding (VLSU), a complete framework to systematically consider multimodal security via fine-grained severity classification and combinatorial evaluation throughout 17 distinct security patterns. Utilizing a multi-stage pipeline with real-world photographs and human annotation, we assemble a large-scale benchmark of 8,187 samples spanning 15 hurt classes. Our analysis of 11 state-of-the-art fashions reveals systematic joint understanding failures: whereas fashions obtain 90%-plus accuracy on clear unimodal security alerts, efficiency degrades considerably to 20-55% when joint image-text reasoning is required to find out the protection label. Most critically, 34% of errors in joint image-text security classification happen regardless of appropriate classification of the person modalities, additional demonstrating absent compositional reasoning capabilities. Moreover, we discover that fashions battle to stability refusing unsafe content material whereas nonetheless responding to borderline instances that deserve engagement. For instance, we discover that instruction framing can scale back the over-blocking charge on borderline content material from 62.4% to 10.4% in Gemini-1.5, however solely at the price of under-refusing on unsafe content material with refusal charge dropping from 90.8% to 53.9%. Total, our framework exposes weaknesses in joint image-text understanding and alignment gaps in present fashions, and gives a essential take a look at mattress to allow the subsequent milestones in analysis on sturdy vision-language security.
