MedQ-Deg Benchmark

A comprehensive VQA benchmark evaluating 40 MLLMs across 18 degradation types, 7 medical imaging modalities, and 24,894 QA pairs.

5
Categories
18
Degradation Types
7
Modalities
24,894
QA Pairs

Filter by Category

Click to view examples

Artifacts

Limited Angle

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Artifacts

Sparse View

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Artifacts

Bias Field Artifact

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Artifacts

Undersampling Artifact

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Artifacts

Ghosting Artifact

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Artifacts

Blood Cell Artifact

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Artifacts

Dark Spots Artifact

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Motion Interference

Object Rotation

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Motion Interference

Object Movement

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Intensity Jitter

Adjust Brightness

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Intensity Jitter

Exposure

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Intensity Jitter

Reduce Contrast

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Noise

Gaussian Noise

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Noise

Low Dose

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Resolution & Blur

Low Resolution

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Resolution & Blur

Motion Blur

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Resolution & Blur

Gaussian Blur

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Resolution & Blur

Bubble

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Click to view examples

Resolution & Blur

X-ray Motion Blur

L0 L1 L2

L0: Original • L1: Moderate • L2: Severe

View Examples

Category Details

Each category represents a distinct type of image degradation commonly found in medical imaging.

⚠

Artifacts

Limited angle, sparse view, bias field, undersampling, ghosting, blood cell, and dark spots artifacts

7 types
Limited Angle Sparse View Bias Field Artifact Undersampling Artifact Ghosting Artifact Blood Cell Artifact Dark Spots Artifact
⌘

Motion Interference

Object rotation and object movement

2 types
Object Rotation Object Movement
◑

Intensity Jitter

Brightness adjustment, exposure, and contrast reduction

3 types
Adjust Brightness Exposure Reduce Contrast
▥

Noise

Gaussian noise and low dose artifacts

2 types
Gaussian Noise Low Dose
◐

Resolution & Blur

Low resolution, motion blur, Gaussian blur, bubble, and X-ray motion blur

5 types
Low Resolution Motion Blur Gaussian Blur Bubble X-ray Motion Blur