Fiducial-Free 2D/3D Registration For Robot-Assisted Femoroplasty

Full text links CiteDisplay options Display options Format AbstractPubMedPMID

Abstract

Femoroplasty is a proposed alternative therapeutic method for preventing osteoporotic hip fractures in the elderly. Previously developed navigation system for femoroplasty required the attachment of an external X-ray fiducial to the femur. We propose a fiducial-free 2D/3D registration pipeline using fluoroscopic images for robot-assisted femoroplasty. Intraoperative fluoroscopic images are taken from multiple views to perform registration of the femur and drilling/injection device. The proposed method was tested through comprehensive simulation and cadaveric studies. Performance was evaluated on the registration error of the femur and the drilling/injection device. In simulations, the proposed approach achieved a mean accuracy of 1.26±0.74 mm for the relative planned injection entry point; 0.63±0.21° and 0.17±0.19° for the femur injection path direction and device guide direction, respectively. In the cadaver studies, a mean error of 2.64 ± 1.10 mm was achieved between the planned entry point and the device guide tip. The biomechanical analysis showed that even with a 4 mm translational deviation from the optimal injection path, the yield load prior to fracture increased by 40.7%. This result suggests that the fiducial-less 2D/3D registration is sufficiently accurate to guide robot assisted femoroplasty.

Keywords: 2D/3D Registration; Femur Registration; Robot-Assisted Femoroplasty; X-ray Navigation.

PubMed Disclaimer

Figures

Fig. 1:

Fig. 1:

Top left: An example augmentation…

Fig. 1:

Top left: An example augmentation scheme of the optimized injection pattern (green), practical…

Fig. 1: Top left: An example augmentation scheme of the optimized injection pattern (green), practical injection volume (blue) and line of injection (red) [8]. Bottom left: Components of robot-assisted femoroplasty system. Right: Illustration of the intensity-based 2D/3D registration for the femur and D/I device in the C-arm coordinate frame. The red cross arrows are the coordinate frames of each component; the blue arrows illustrate the transformations; the pink dotted line shows the planned trajectory for femoroplasty.
Fig. 2:

Fig. 2:

Illustration of registration pipeline. Left:…

Fig. 2:

Illustration of registration pipeline. Left: 3D pelvis anatomical landmark locations and an example…

Fig. 2: Illustration of registration pipeline. Left: 3D pelvis anatomical landmark locations and an example of CNN-based 2D landmark detection and bone segmentation. Stages 1-3 show three multi-view intensity-based registrations. The pink arrows correspond to the initialization procedures. The transformations are described in Section III-B.
Fig. 3:

Fig. 3:

Top: Illustrations of the multi-view…

Fig. 3:

Top: Illustrations of the multi-view C-arms, anatomy, patient bed and robot setup. The…

Fig. 3: Top: Illustrations of the multi-view C-arms, anatomy, patient bed and robot setup. The top blue arrows show the C-arm rotations. The first view C-arm frame is shown in RGB cross arrows at the source position. Bottom: An example set of simulated fluoroscopic images. The first row in orange is used for pelvis and femur registration. The second row in blue is used for device registration.
Fig. 4:

Fig. 4:

Registration workflow.

Fig. 4:

Registration workflow.

Fig. 4: Registration workflow.
Fig. 5:

Fig. 5:

Biomechanical analysis workflow: An FE…

Fig. 5:

Biomechanical analysis workflow: An FE model (top right) is created from segmented CT…

Fig. 5: Biomechanical analysis workflow: An FE model (top right) is created from segmented CT scans of the specimen. 3 Step Pre-operative planning (bottom left) was performed on the specimen and evaluated in both optimal drilling path (solid blue) and a path 4mm inferior of the optimal (dotted blue)
Fig. 6:

Fig. 6:

Upper: Overlay example of registration…

Fig. 6:

Upper: Overlay example of registration convergence stage. 2D overlay of multiple input simulation…

Fig. 6: Upper: Overlay example of registration convergence stage. 2D overlay of multiple input simulation X-rays (background) and DRR-derived edges in green. Lower: Coordinate frames and path direction vectors used to report the registration error are marked with RGB cross arrows. Coordinate frames include: PC - Pelvis volume center; FH - Femoral head center; ID - Injection device guide center. Path direction vectors include pfem and pinj, which are described in Section IV-A.
Fig. 7:

Fig. 7:

Left: Cadaver study setup with…

Fig. 7:

Left: Cadaver study setup with injection device, specimen and C-arm. Middle: Two example…

Fig. 7: Left: Cadaver study setup with injection device, specimen and C-arm. Middle: Two example AP view intraoperative fluoroscopic images corresponding to images➀➁ in Fig. 3. Right top: The injected BBs are zoomed. One example BB location is marked with orange circle. Right bottom: Picture of BBs glued on the surface of the injection device for groundtruth injection pose calculation. One example BB is marked with blue circle.
Fig. 8:

Fig. 8:

(a)-(e): Normalized 2D histograms of…

Fig. 8:

(a)-(e): Normalized 2D histograms of pelvis pose ( δT pel ), femur pose…

Fig. 8: (a)-(e): Normalized 2D histograms of pelvis pose (δTpel), femur pose (δTfem), injection device pose (δTinj), C-arm view2 (δTC1C2), C-arm view3 (δTC1C3) error for the simulation studies. (f)-(h): Normalized histogram of l2 distance error in mm of femur entry point (δxC1EP), injection device guide tip (δxC1TIP) and their relative error ( (δxEPTIP)). (i)-(j): Normalized histogram of direction error in degree of femur path vector (δθC1fem) and the injection guide direction vector (δθC1inj).
Fig. 9:

Fig. 9:

Left: Scatter plot of correlation…

Fig. 9:

Left: Scatter plot of correlation matrix between femoral head center translation error and…

Fig. 9: Left: Scatter plot of correlation matrix between femoral head center translation error and pelvis translation error reported in femoral head center. Right: Scatter plot of correlation matrix between femur entry point error and pelvis translation error reported in femoral head center. Correlation coefficients are marked on the right bottom of each plot.
All figures (9) See this image and copyright information in PMC

Similar articles

  • A Surgical Robotic System for Osteoporotic Hip Augmentation: System Development and Experimental Evaluation. Bakhtiarinejad M, Gao C, Farvardin A, Zhu G, Wang Y, Oni JK, Taylor RH, Armand M. Bakhtiarinejad M, et al. IEEE Trans Med Robot Bionics. 2023 Feb;5(1):18-29. doi: 10.1109/tmrb.2023.3241589. Epub 2023 Feb 1. IEEE Trans Med Robot Bionics. 2023. PMID: 37213937 Free PMC article.
  • Intra-operative fiducial-based CT/fluoroscope image registration framework for image-guided robot-assisted joint fracture surgery. Dagnino G, Georgilas I, Morad S, Gibbons P, Tarassoli P, Atkins R, Dogramadzi S. Dagnino G, et al. Int J Comput Assist Radiol Surg. 2017 Aug;12(8):1383-1397. doi: 10.1007/s11548-017-1602-9. Epub 2017 May 4. Int J Comput Assist Radiol Surg. 2017. PMID: 28474269 Free PMC article.
  • Fluoroscopic Navigation for a Surgical Robotic System Including a Continuum Manipulator. Gao C, Phalen H, Sefati S, Ma J, Taylor R, Unberath M, Armand M. Gao C, et al. IEEE Trans Biomed Eng. 2022 Jan;69(1):453-464. doi: 10.1109/TBME.2021.3097631. Epub 2021 Dec 24. IEEE Trans Biomed Eng. 2022. PMID: 34270412 Free PMC article.
  • Iliosacral screw insertion using CT-3D-fluoroscopy matching navigation. Takao M, Nishii T, Sakai T, Yoshikawa H, Sugano N. Takao M, et al. Injury. 2014 Jun;45(6):988-94. doi: 10.1016/j.injury.2014.01.015. Epub 2014 Jan 19. Injury. 2014. PMID: 24507831
  • Clinical Application of Navigation in the Surgical Treatment of a Pelvic Ring Injury and Acetabular Fracture. Takao M, Hamada H, Sakai T, Sugano N. Takao M, et al. Adv Exp Med Biol. 2018;1093:289-305. doi: 10.1007/978-981-13-1396-7_22. Adv Exp Med Biol. 2018. PMID: 30306489 Review.
See all similar articles

Cited by

  • Robot-assisted versus traditional surgery in the treatment of intertrochanteric fractures: a meta-analysis. Shi J, Shen J, Zhang C, Guo W, Wang F. Shi J, et al. J Robot Surg. 2024 May 23;18(1):221. doi: 10.1007/s11701-024-01979-7. J Robot Surg. 2024. PMID: 38780662 Free PMC article.
  • Synthetic data accelerates the development of generalizable learning-based algorithms for X-ray image analysis. Gao C, Killeen BD, Hu Y, Grupp RB, Taylor RH, Armand M, Unberath M. Gao C, et al. Nat Mach Intell. 2023 Mar;5(3):294-308. doi: 10.1038/s42256-023-00629-1. Epub 2023 Mar 20. Nat Mach Intell. 2023. PMID: 38523605 Free PMC article.
  • Comparison of Bone-setting Robots and Conventional Reduction in the Treatment of Intertrochanteric Fracture: A Retrospective Study. Xu Z, Zhang X, Wang Y, Hao X, Liu M, Sun J, Zhao Z. Xu Z, et al. Orthop Surg. 2024 Feb;16(2):312-319. doi: 10.1111/os.13954. Epub 2023 Dec 12. Orthop Surg. 2024. PMID: 38086603 Free PMC article.
  • Fluoroscopy-Guided Robotic System for Transforaminal Lumbar Epidural Injections. Gao C, Phalen H, Margalit A, Ma JH, Ku PC, Unberath M, Taylor RH, Jain A, Armand M. Gao C, et al. IEEE Trans Med Robot Bionics. 2022 Nov;4(4):901-909. doi: 10.1109/tmrb.2022.3196321. Epub 2022 Aug 4. IEEE Trans Med Robot Bionics. 2022. PMID: 37790985 Free PMC article.
  • Towards 2D/3D Registration of the Preoperative MRI to Intraoperative Fluoroscopic Images for Visualization of Bone Defects. Ku PC, Martin-Gomez A, Gao C, Grupp R, Mears SC, Armand M. Ku PC, et al. Comput Methods Biomech Biomed Eng Imaging Vis. 2023;11(4):1096-1105. doi: 10.1080/21681163.2022.2152375. Epub 2022 Dec 15. Comput Methods Biomech Biomed Eng Imaging Vis. 2023. PMID: 37555198 Free PMC article.
See all "Cited by" articles

References

    1. Goldacre MJ, Roberts SE, and Yeates D, “Mortality after admission to hospital with fractured neck of femur: database study,” Bmj, vol. 325, no. 7369, pp. 868–869, 2002. - PMC - PubMed
    1. Teng GG et al., “Mortality and osteoporotic fractures: is the link causal, and is it modifiable?” Clinical and experimental rheumatology, vol. 26, no. 5 0 51, p. S125, 2008. - PMC - PubMed
    1. Dinah A, “Sequential hip fractures in elderly patients,” Injury, vol. 33, no. 5, pp. 393–394, 2002. - PubMed
    1. Land J, Russell L, and Khan S, “Osteoporosis,” Clinical Orthopaedics and Related Research, vol. 372, pp. 139–150, 2000. - PubMed
    1. Basafa E and Armand M, “Subject-specific planning of femoroplasty: a combined evolutionary optimization and particle diffusion model approach,” Journal of biomechanics, vol. 47, no. 10, pp. 2237–2243, 2014. - PMC - PubMed
Show all 36 references

Grants and funding

  • R01 EB023939/EB/NIBIB NIH HHS/United States
  • R21 EB020113/EB/NIBIB NIH HHS/United States

LinkOut - more resources

  • Full Text Sources

    • Europe PubMed Central
    • PubMed Central
  • Other Literature Sources

    • The Lens - Patent Citations Database

Từ khóa » Cong Gao Jhu