Masked Registration and Autoencoding of CT Images for Predictive Tibia Reconstruction

arXiv ID: 2512.09525v1

Published: 2025-12-10

Authors: Hongyou Zhou, Cederic Aßmann, Alaa Bejaoui, Heiko Tzschätzsch, Mark Heyland, Julian Zierke, Niklas Tuttle, Sebastian Hölzl, Timo Auer, David A. Back, Marc Toussaint

Categories: cs.CV

Relevance Score: 0.98 / 1.00

View on arXiv Download PDF

Summary

This paper presents a novel deep learning framework to predict a patient-specific healthy tibia reconstruction target from a fractured CT scan, addressing a critical challenge in surgical planning. It combines a 3D-adapted Spatial Transformer Network (STN) for neural registration with autoencoders (AEs) to model healthy bone variations, enabling robust prediction even with masked (fractured) input.

Medical Relevance

This research provides a crucial tool for orthopedic surgeons, offering a patient-specific, predictive 3D model of the healthy tibia. This directly supports more precise pre-operative planning for complex fractures, potentially leading to improved surgical accuracy and patient outcomes.

AI Health Application

The AI application involves using neural registration (Spatial Transformer Networks) and autoencoder models to process CT images of fractured tibias. The AI system learns to register these images to a standardized coordinate system and model healthy tibial variations. Its primary application is to predict and generate a patient-specific healthy bone structure from a fractured input, thereby assisting surgeons in visualizing the desired bone alignment for surgical planning and reconstruction.

Key Points

Addresses the difficulty of imagining the desirable 3D bone alignment for complex tibial fractures in surgical planning.
Proposes a two-stage deep learning approach: neural registration using a modified STN and autoencoding healthy bone variations.
A 3D-adapted STN is trained to register raw CTs to a standardized coordinate system of a jointly learned tibia prototype.
Various autoencoder (AE) architectures are trained to model the inherent variations within healthy tibial anatomies.
Both the STN and AE models are specifically designed to be robust to masked input, allowing processing of fractured CTs.
The system decodes predictions of the patient-specific healthy bone structure in standard coordinates from fractured input.
Includes a comparative analysis of different AE architectures for effective bone CT modeling.

Methodology

The methodology integrates a modified 3D Spatial Transformer Network (STN) for global spatial registration and various autoencoder (AE) architectures. The STN maps raw CTs of tibias to a standardized coordinate system defined by a jointly trained tibia prototype. Subsequently, AEs are trained to model the healthy morphological variations of the tibia within this standardized space. A key innovation is designing both the STN and AE models to be robust to 'masked input,' meaning they can process CT scans with fractures or missing bone segments. This allows the system to receive a fractured tibia CT, register it, and then decode a prediction of the patient's specific healthy bone structure in the standard coordinate system.

Key Findings

The paper demonstrates the successful adaptation and implementation of a 3D STN for robust global spatial registration of bone CTs. It also shows that autoencoder models can effectively capture and represent healthy tibial anatomical variations. Crucially, the research confirms the ability of both the registration and autoencoding models to handle masked (fractured) input, enabling accurate predictive generation of healthy bone structures. A comparative analysis of different AE architectures further supports their utility in bone CT modeling.

Clinical Impact

The proposed method has the potential to significantly improve the precision and efficiency of surgical planning for complex tibial fractures. By providing surgeons with an objective, patient-specific 3D reconstruction target for the healthy bone, it can facilitate more accurate pre-operative visualization and planning of bone alignment, potentially leading to better functional outcomes, reduced surgical complications, and optimized operative strategies for patients.

Limitations

The provided abstract does not explicitly state specific limitations of the methodology or the study conducted.

Future Directions

The provided abstract does not explicitly state future research directions.

Medical Domains

Orthopedic Surgery Trauma Surgery Medical Imaging Surgical Planning Radiology

Keywords

Tibia Reconstruction Surgical Planning CT Imaging Neural Registration Spatial Transformer Network Autoencoder Masked Input Bone Fracture

Abstract

Surgical planning for complex tibial fractures can be challenging for surgeons, as the 3D structure of the later desirable bone alignment may be diffi- cult to imagine. To assist in such planning, we address the challenge of predicting a patient-specific reconstruction target from a CT of the fractured tibia. Our ap- proach combines neural registration and autoencoder models. Specifically, we first train a modified spatial transformer network (STN) to register a raw CT to a standardized coordinate system of a jointly trained tibia prototype. Subsequently, various autoencoder (AE) architectures are trained to model healthy tibial varia- tions. Both the STN and AE models are further designed to be robust to masked input, allowing us to apply them to fractured CTs and decode to a prediction of the patient-specific healthy bone in standard coordinates. Our contributions include: i) a 3D-adapted STN for global spatial registration, ii) a comparative analysis of AEs for bone CT modeling, and iii) the extension of both to handle masked inputs for predictive generation of healthy bone structures. Project page: https://github.com/HongyouZhou/repair

Comments

DGM4MICCAI