Medical Imaging · Synthetic Data · Deep Learning

Synth-2-Real Transfer in
Microbleed Detection

Luke To-Liang Hsu · Ting-Yu Lai · Ching-Ting Lin · Chun-Hao Huang · Wei-Chun Wang

Artificial Intelligence and Robotics Innovation Center (AIRIC) · China Medical University Hospital · Taiwan

01

Data. Labels. Cleaning.

More often than models, these are what set the performance ceiling in medical AI.

But disease data are scarce.

How do we train a model when we have few—or even no—positive patients?

But expert annotation is expensive.

Can we create useful training targets without labeling every lesion by hand?

Clinician annotating cerebral microbleeds on brain MRI

Suppose we could build a synthetic disease generator.

Could a model learn entirely from fake lesions—and still detect real ones?

02

Cerebral Microbleeds

We chose Cerebral Microbleed as our research target.

Cerebral microbleeds (CMBs) are tiny signs of previous bleeding in the brain. On certain MRI scans, they appear as small, dark spots—often only a few millimeters across.

CMB burden is an important imaging biomarker, but detecting and annotating these lesions remains difficult.

Tiny

Often only a few millimeters in diameter.

Sparse

Positive lesions—and even positive patients—can be relatively scarce.

Easy to mimic

Vessels, calcifications, and susceptibility artifacts can resemble true microbleeds.

Example of cerebral microbleeds on susceptibility-sensitive MRI
Example cerebral microbleeds on susceptibility-sensitive MRI. Source: Radiopaedia.

03

Project Overview

Can synthetic CMBs teach a detector to recognize real ones? We tested this in three steps.

Overview of the synthetic-to-real CMB detection framework

04

Generating Synthetic Microbleeds

Synthetic lesions are parameterized by size, shape, orientation, signal contrast, and boundary appearance, then inserted into real CMB-negative SWAN images.

Synthetic CMB generation pipeline

Real CMB

Real cerebral microbleed example

Synthetic CMB

Synthetic cerebral microbleed example

05

Synthetic → Real Transfer Works

87.7% of real-trained lesion sensitivity retained
83.7% of real-trained Dice retained

A MONAI 3D U-Net trained exclusively on synthetic lesions retained substantial detection performance when evaluated on real CMBs.

06

But Transfer Depends on the Detector

Synthetic-to-real transfer differed substantially between the two evaluated segmentation frameworks. A relatively simple, shallow 3D U-Net transferred well, while the more sophisticated nnU-Net struggled. Why?

MONAI 3D U-Net

0.749

Lesion sensitivity
with synthetic-only training

nnU-Net

0.269

Lesion sensitivity
with synthetic-only training

07

The Synth-2-Real Challenge

Successful transfer may depend not only on the realism of synthetic lesions, but also on how the downstream model learns from the synthetic distribution.

Synthetic-to-real challenge overview

Our experiments demonstrate framework-dependent transfer, but do not identify the specific mechanism responsible for the difference.

08

Takeaways

01

Synthetic supervision works.

Models trained without real positive annotations can still transfer substantially to real CMB detection.

02

Real data remains stronger.

Real-trained models consistently outperformed synthetic-trained models across the evaluated data scales.

03

Transfer is framework-dependent.

It's not just about making synthetic data look real. How the downstream model learns from synthetic data also matters.