IEEE EMBC 2023  ·  Student paper competition, second place

Where on a contour does an edit change the dose?

Using a dose prediction model to estimate, point by point, how much a local change to an organ-at-risk contour would alter the planned dose

Amith Kamath1, Robert Poel1,2, Jonas Willmann3,4, Ekin Ermiş2, Nicolaus Andratschke3, Mauricio Reyes1

1ARTORG Center, University of Bern    2Inselspital, Bern University Hospital    3University Hospital Zurich    4Center for Proton Therapy, PSI

Second place, EMBC 2023 student paper competition.

Summary. A ball of radius 3 voxels is added to a single point on an organ-at-risk contour, the dose is predicted again, and the mean absolute change over the brain is recorded at that point. Repeating this over the surface gives a per-point estimate of how much a local contour change would alter the dose. We report 30 589 such perturbations across 10 test patients and 13 organs at risk, and characterise how the resulting maps relate to distance from the target volume, to the local dose gradient, and to the size of the perturbation.

Two 3-D renders side by side of the same patient anatomy: on the left the target volume in red with the organs at risk in plain grey, on the right the same organs painted with a sensitivity map running from dark for low dose impact to bright for high.
Contours alone, and contours with an estimated dose sensitivity. Left: the target volume and organs at risk as they are reviewed, which carries no information about dose. Right: the same surfaces coloured by the mean absolute change in predicted dose that a local perturbation at each point produces. Brighter regions are those where a contour change has a larger effect on the predicted dose.

Abstract

Radiotherapy planning for glioblastoma begins with manual contours of the tumour target and the surrounding organs at risk. These contours vary between observers, and they are reviewed without information about the dosimetric consequence of any given correction, so review effort is distributed uniformly over a surface where the consequences are not uniform.

We describe ASTRA (atomic surface transformations for radiotherapy quality assurance). A deep-learning dose predictor is evaluated once on the original contours and once for each of several thousand local perturbations, each a ball added at a single point of one organ's surface as a model of local over-segmentation. The mean absolute change in predicted dose over the brain, recorded at the perturbed point, yields a sensitivity map over the surface. On 10 held-out glioblastoma patients and 13 organs at risk, we report the distribution of these values, their correlation with distance to the target volume and with the local dose gradient, and their stability under changes to the perturbation radius. The approach depends on near-instant dose prediction: each map requires on the order of a thousand dose estimates.

Results in brief

30 589perturbations evaluated: 10 test patients × 13 organs at risk, one dose prediction each
0.95 / 0.94correlation between maps of the same organ at perturbation radius 3 vs 5, and 5 vs 7 voxels
−0.74correlation between dose change and distance to the target volume, averaged over the eyes
200×median ratio between the largest and smallest per-organ mean dose change within a patient

Method

An atomic surface transformation is a ball of radius 3 voxels — about 7.5 mm in the axial plane — added to the contour at a single point on its surface. This is chosen to approximate the spatial scale of typical inter-observer disagreement about where a boundary lies.

StepWhat happens
1. BaselinePredict the dose from the original contours: CT, target volume, 13 organ-at-risk masks.
2. SampleTake every fifth voxel of one organ's outer shell — a few hundred points for a small organ, about a thousand for the brainstem.
3. TransformAt each point, add the ball to that organ's mask and predict the dose again.
4. MeasureMean absolute difference from the baseline dose, over the whole brain. Record it at the point.
5. ReadThe result is one scalar per surface point: a map of where an edit would matter.

The dose predictor is the two-level cascaded 3D U-Net from earlier work: 15 input channels at 128³, one continuous output scaled to 0–70 Gy, mean absolute error 0.906 Gy against plans prescribing 60 Gy in 30 fractions. The model is used unmodified; only the input contours change between predictions.

The cost of the procedure is one forward pass per surface point: roughly a thousand dose estimates for one organ, and about 3 000 for a patient's full set of thirteen. This is tractable because the predictor runs in seconds, whereas a treatment planning system takes hours per plan.

Visualisations

Each clip is a rotating 3-D rendering: a near-transparent brain for anatomical context, the target volume in red, and the organs at risk as surfaces, shown either uncoloured or coloured by the sensitivity map. The colour scale is in Gray and reports the mean absolute change in predicted dose over the brain.

The procedure, one perturbation at a timeFifty consecutive points along the brainstem surface. At each, the ball added to the contour is shown in yellow, the dose is re-predicted, and the resulting change is written onto the surface, so the map accumulates over the sequence.
A complex target shapeContours alone on the left, the sensitivity map on the right. The largest estimated dose change is at the edge of the left hippocampus, plausibly because it lies on critical beam angles.
A target close to the hippocampi and the brainstemIn this case the inferior parts of the eye show larger dose changes than the superior parts, which is the reverse of the other cases shown. The spatial pattern therefore depends on the individual plan rather than on the organ alone.
A small target, distant from the organs at riskThe smallest target of the twenty test cases, roughly 3 cm from the organs at risk. The points with the largest dose change are those nearest the target, and the overall scale is small, with a maximum of 0.17 Gy.
A larger targetThe dose change is distributed over more of each surface and the maximum rises to 0.61 Gy. The region of largest change on the brainstem lies away from the target rather than towards it.
Effect of the perturbation radiusThe same brainstem at perturbation radius 3, 5 and 7 voxels, each panel scaled to its own maximum. The magnitude of the dose change increases with radius while the spatial pattern is largely unchanged.

Results

Estimated dose change per organ at risk

Mean absolute change in predicted dose over the brain, in Gray, averaged over every transformation on that organ's surface. Four patients, in order of increasingly demanding target geometry.

PatientBrainstemEye LEye RHippocampus LHippocampus R
small target, far away0.0070.0120.0090.1040.082
larger target0.0160.0490.0590.3740.271
complex target shape0.0100.0420.0290.3090.263
target close to the organs0.0190.0610.0520.3670.315

Down a column, the same organ differs by up to an order of magnitude between patients. Across a row, the hippocampi show 15 to 20 times the dose change of the brainstem in the same patient, despite the brainstem being roughly ten times larger and also close to the target. These values therefore depend on the individual plan and cannot be tabulated once per organ and reused.

Association with distance to the target volume

For each organ at risk, the Pearson correlation over its surface points between the dose change from a perturbation and the Euclidean distance from that point to the target volume. Averaged over the 10 test patients; organs ordered by mean size.

Correlation with distance to the target volume -0.8 -0.4 0 +0.4 +0.8 Brainstem 2,044 Brainstem: -0.43 -0.43 Eye L 609 Eye L: -0.74 -0.74 Eye R 601 Eye R: -0.67 -0.67 Hippocampus R 195 Hippocampus R: -0.16 -0.16 Hippocampus L 181 Hippocampus L: -0.31 -0.31 Lacrimal gland R 77 Lacrimal gland R: -0.05 -0.05 Lacrimal gland L 76 Lacrimal gland L: +0.56 +0.56 Pituitary 60 Pituitary: -0.26 -0.26 Optic nerve R 57 Optic nerve R: +0.25 +0.25 Optic nerve L 54 Optic nerve L: -0.02 -0.02 Chiasm 44 Chiasm: -0.25 -0.25 Cochlea L 9 Cochlea L: -0.08 -0.08 Cochlea R 9 Cochlea R: -0.34 -0.34 organ, and its size in voxels

The three largest organs, the brainstem and both eyes, show negative correlations, strongest for the eyes: on a surface with a near and a far side relative to the target, points on the near side show larger dose changes. The smallest structures — cochleae, optic nerves and chiasm — are near zero, consistent with a structure only a few voxels across having little internal variation in distance. The left lacrimal gland shows a positive correlation, which is consistent with a structure lying outside the high-dose region, where dose is determined more by scatter and beam entry than by proximity to the target.

The values plotted here are recomputed from the archived volumes and differ in one row from those printed in the paper; see the errata.

Discussion

Errata

Every value on this page was recomputed from the archived planning volumes and sensitivity maps rather than copied from the paper. 66 of the 68 numbers the paper reports reproduce; the two that do not, and one methodological clarification, are listed below. The per-claim record is in results/embc_verification.csv in the repository.

Table II, right optic nerve

QuantityPublishedCorrected
Correlation with distance to target−0.15+0.25
Correlation with local dose gradient+0.05−0.11

Both signs are reversed. We could not recover the published pair from any subset of the twelve archived patients, nor under weighted or Fisher-z averaging; the closest any variant comes is 0.23. The remaining twelve organs reproduce to within 0.06. The corrected values place the right optic nerve alongside the left as a structure whose sensitivity is not explained by distance to the target, which does not change any conclusion drawn in the paper.

Table II, basis of the organ-size column

The paper describes an analysis over ten test patients. The published size column reproduces exactly — all thirteen values to within 0.01 voxels — as the mean over the first seven patients (DLDP_081 to DLDP_087) and not over any set of ten. The correlation columns behave the other way round, reproducing over ten patients and not over any subset of seven. The size column should therefore be read as a seven-patient mean; the correlations are unaffected. Sizes over all ten patients are, in the paper's row order: 2044, 44.3, 8.7, 8.6, 609, 601, 181, 195, 76.2, 76.7, 54.1, 57.4, 60.0 voxels.

Citation

@inproceedings{kamath2023astra,
  title        = {ASTRA: Atomic Surface Transformations for Radiotherapy quality Assurance},
  author       = {Kamath, Amith and Poel, Robert and Willmann, Jonas and Ermis, Ekin and Andratschke, Nicolaus and Reyes, Mauricio},
  booktitle    = {45th IEEE Engineering in Medicine and Biology Conference (EMBC)},
  year         = {2023},
  organization = {IEEE}
}