SlideShare una empresa de Scribd logo
1 de 19
Descargar para leer sin conexión
Generation of planar radiographs from 3D
   anatomical models using the GPU
             André dos Santos Cardoso
               Supervisor: Jorge M. G. Barbosa




                      University of Porto
         Faculty of Engineering of University of Porto
               andre.cardoso@fe.up.pt, jbarbosa@fe.up.pt




                          July 14, 2010



       André dos Santos Cardoso       DRR Generation       1 / 19
Contents
 1   Introduction
        Context Overview
        Project’s Objective
 2   Why is it Important?
 3   Our Specific Case
 4   What Has Been Done?
      Wrap-Up
 5   Current Solution
 6   What’s expected?
 7   Involved Technologies
        GLSL
        CUDA
 8   Work Plan
 9   Bibliography

                 André dos Santos Cardoso   DRR Generation   2 / 19
Context Overview



   Digitally Reconstructed Radiographs
   (DRRs)
       Taking a radiography from 3D digital
       anatomical models of vertebrae
       Form of depth peeling, using
       ray-casting
   Key component in 2D/3D registration
   process




              André dos Santos Cardoso   DRR Generation   3 / 19
Context Overview



    DRRs are built from vertebrae models represented by 3D
    meshes
        DRR generation as mean to validate and/or refine 3D
        reconstructions of the spine from multi-planar radiography
            Vertebrae Shape Recovery Using 2D/3D Non-Rigid
            Registration

        Important techniques for Scoliosis therapy and follow-ups




             André dos Santos Cardoso   DRR Generation               4 / 19
Project’s Objective



Build Fast DRR Algorithms
   DRR calculation is a bottleneck
       3D reconstruction usage in a
       routine clinical environment
       requires high performances
   Take advantage of processing
   power of new GPUs and APIs
       Common workstations could do
       the job!




              André dos Santos Cardoso   DRR Generation   5 / 19
Why is it Important?

   DRR generation key component
   in many 2D/3D registration
   problems
       Allows to compare/use data
       from different sources and times
       together
       The CAS model versus real-time
       imagery from the patient
       Nonrigid registration
   Many applications in medical area

       CAS, Radiotherapy, Volume
       Recovery
   Known to be a common bottleneck


              André dos Santos Cardoso   DRR Generation   6 / 19
Why is it Important?

   Speed!

       Daily work on the field demands
       on-the-fly results, and high
       accuracy
       Advantages on using GPUs
       versus Hardware solutions
            Cheaper
            More accessible


   General Purpose Computing on
   GPUs gaining increasing interest
   from researchers



              André dos Santos Cardoso   DRR Generation   7 / 19
Our Specific Case

   Where will the Optimized
   Algorithms fit?
        Shape Recovery of human
        spine – attaining a 3D model of
        the spine
        Bi-planar Radiography

        Scoliosis evaluation
        Viable alternative to MRIs and
        CTs – why?
              Expensive, Amount of
              Radiation, Prolonged
              Procedures, Require lying
              down
   Not the scope of this project!!
   Moura, D. et al [6]


                 André dos Santos Cardoso   DRR Generation   8 / 19
What has been done in this area?
 Attenuation Law – monochromatic x-ray radiation
             Nout (E ) = Nin (E ) × e −        µ(E ,ρ(x ),Z (x ))dx
                                                                          (1)




                 Focus on GPU Implementations!

   Monte Carlo Volume                           Shear-Warping
   Rendering                                           Viewing transformations
       Volumetric integral for                  Splatting
       each pixel                                      Throw voxels into the
   Fourier Volume Rendering                            viewing pane
       Inverse 2D Fourier                       Ray Casting
       transform of a slice                            Shoot rays to each pixel

               André dos Santos Cardoso   DRR Generation                          9 / 19
Wrap-Up



   Attenuation law for bone material
   Few Applications of DRR to 3D Meshes (most work on CT
   data – voxels)
   Using OpenGL Shading Language (GLSL)
       Multi Pass Algorithm is available
       Single Pass Algorithm is considered the state of the art, but
       no applied implementation exists
   Compute Unified Device Architecture (CUDA) peeling
   applications exist (but not for computing DRRs)




            André dos Santos Cardoso   DRR Generation                  10 / 19
Current Solution


    Inputs
        CAD model of vertebrae
        Camera position, object positions, object orientation, …
    Outputs
        simulated Radiograph!




              André dos Santos Cardoso   DRR Generation            11 / 19
Current Solution


   Ray Casting
       Multipass Algorithm
       Ray Casting and Depth
       Peeling
       GLSL
   Why use CAD models?
       Problem context requires
       deformations to the 3D
       model
       Faster to deform CAD
       models
       Generally, decreases
       amount of computation



              André dos Santos Cardoso   DRR Generation   12 / 19
What’s expected?




    Enhance the current solution
     1   Modify code to implement the reported single-pass approach
     2   Port solution to CUDA
     3   Test and compare solutions


    Significant speed-ups are expected




              André dos Santos Cardoso   DRR Generation               13 / 19
Technologies – GLSL



   OpenGL Shading
   Language

      Allows the modification
      of fixed functionality of
      the GPU pipeline
      Similar syntax to C/C++
      Modules called Shaders




             André dos Santos Cardoso   DRR Generation   14 / 19
Technologies – CUDA


   Compute Unified Device
   Architecture
      Parallel Computing Architecture
      Allows direct access to parallel
      processors and memory
      Kernel function executed on
      GPU device
           Allows hierarchical
           configuration of threads upon
           kernel launch
      Massive data parallelism
      Allows versatile and more
      controlled programming




             André dos Santos Cardoso   DRR Generation   15 / 19
Work Plan




            André dos Santos Cardoso   DRR Generation   16 / 19
Thank You for Listening!
                    Ask Away!




    André dos Santos Cardoso   DRR Generation   17 / 19
Bibliography
   The opengl shading language.
   Lisa Gottesfeld Brown.
   A survey of image registration techniques.
   ACM Comput. Surv., 24(4):325–376, 1992.
   David B. Kirk and Wen mei W. Hwu.
   Programming Massively Parallel Processors - A Hands-on Approach.
   Morgan Kaufmann, 2010.
   A. Mitulescu, W. Skalli, D. Mitton, and J. A. De Guise.
   Three-dimensional surface rendering reconstruction of scoliotic vertebrae using a non stereo-corresponding
   points technique.
   European Spine Journal, 2002.
   Shinichiro Mori, Masanao Kobayashi, Motoki Kumagai, and Shinichi Minohara.
   Development of a gpu-based multithreaded software application to calculate digitally reconstructed radiographs
   for radiotherapy.
   Radiological Physics and Technology, 2009.
   Daniel C. Moura, Jonathan Boisvert, Jorge G. Barbosa, and João Manuel Tavares.
   Fast 3d reconstruction of the spine using user-defined splines and a statistical articulated model.
   In ISVC ’09: Proceedings of the 5th International Symposium on Advances in Visual Computing, pages
   586–595, Berlin, Heidelberg, 2009. Springer-Verlag.
   Scott D. Roth.
   Ray casting for modeling solids.
   j-CGIP, 18(2), 1982.
   F. P. Vidal, M.Garnier, N. Freud, J. M. Létang, and N.W. John.
   Simulation of x-ray attenuation on the gpu.
   In Proceeding of TCPG’09 - Theory and Practice of Computer Graphics, pages 25–32. Eurographics, 2009.



                        André dos Santos Cardoso           DRR Generation                                           18 / 19
Bibliography




 Full Bibliography Listed in:

  https://dev.andrecardoso.eu/bibtexbrowser.php?bib=
                      thesisbib.bib




                 André dos Santos Cardoso   DRR Generation   19 / 19

Más contenido relacionado

La actualidad más candente

Indoor Point Cloud Processing
Indoor Point Cloud ProcessingIndoor Point Cloud Processing
Indoor Point Cloud ProcessingPetteriTeikariPhD
 
Image Restoration for 3D Computer Vision
Image Restoration for 3D Computer VisionImage Restoration for 3D Computer Vision
Image Restoration for 3D Computer VisionPetteriTeikariPhD
 
AUTO AI 2021 talk Real world data augmentations for autonomous driving : B Ra...
AUTO AI 2021 talk Real world data augmentations for autonomous driving : B Ra...AUTO AI 2021 talk Real world data augmentations for autonomous driving : B Ra...
AUTO AI 2021 talk Real world data augmentations for autonomous driving : B Ra...Ravi Kiran B.
 
Holographic memory system
Holographic memory systemHolographic memory system
Holographic memory systemSanket Mudgal
 
Virtual retinal display
Virtual retinal displayVirtual retinal display
Virtual retinal displayvk7799
 
Point Cloud and its applications
Point Cloud and its applicationsPoint Cloud and its applications
Point Cloud and its applicationsLeonis Wong
 
Shallow introduction for Deep Learning Retinal Image Analysis
Shallow introduction for Deep Learning Retinal Image AnalysisShallow introduction for Deep Learning Retinal Image Analysis
Shallow introduction for Deep Learning Retinal Image AnalysisPetteriTeikariPhD
 
Digital imaging in dentistry / orthodontics courses
Digital imaging in dentistry / orthodontics courses Digital imaging in dentistry / orthodontics courses
Digital imaging in dentistry / orthodontics courses Indian dental academy
 
Multimodal RGB-D+RF-based sensing for human movement analysis
Multimodal RGB-D+RF-based sensing for human movement analysisMultimodal RGB-D+RF-based sensing for human movement analysis
Multimodal RGB-D+RF-based sensing for human movement analysisPetteriTeikariPhD
 
Labeling fundus images for classification models
Labeling fundus images for classification modelsLabeling fundus images for classification models
Labeling fundus images for classification modelsPetteriTeikariPhD
 
Holographic optical data storage jyoti-225
Holographic optical data storage jyoti-225Holographic optical data storage jyoti-225
Holographic optical data storage jyoti-225Charu Tyagi
 
Digital Radiography
Digital RadiographyDigital Radiography
Digital Radiographyricksw78
 
DIGITAL IMAGE TECHNOLOGY
DIGITAL IMAGE TECHNOLOGYDIGITAL IMAGE TECHNOLOGY
DIGITAL IMAGE TECHNOLOGY100677809
 

La actualidad más candente (17)

Indoor Point Cloud Processing
Indoor Point Cloud ProcessingIndoor Point Cloud Processing
Indoor Point Cloud Processing
 
Image Restoration for 3D Computer Vision
Image Restoration for 3D Computer VisionImage Restoration for 3D Computer Vision
Image Restoration for 3D Computer Vision
 
Geometric Deep Learning
Geometric Deep Learning Geometric Deep Learning
Geometric Deep Learning
 
AUTO AI 2021 talk Real world data augmentations for autonomous driving : B Ra...
AUTO AI 2021 talk Real world data augmentations for autonomous driving : B Ra...AUTO AI 2021 talk Real world data augmentations for autonomous driving : B Ra...
AUTO AI 2021 talk Real world data augmentations for autonomous driving : B Ra...
 
Holographic memory system
Holographic memory systemHolographic memory system
Holographic memory system
 
Virtual retinal display
Virtual retinal displayVirtual retinal display
Virtual retinal display
 
Point Cloud and its applications
Point Cloud and its applicationsPoint Cloud and its applications
Point Cloud and its applications
 
Shallow introduction for Deep Learning Retinal Image Analysis
Shallow introduction for Deep Learning Retinal Image AnalysisShallow introduction for Deep Learning Retinal Image Analysis
Shallow introduction for Deep Learning Retinal Image Analysis
 
Digital imaging in dentistry / orthodontics courses
Digital imaging in dentistry / orthodontics courses Digital imaging in dentistry / orthodontics courses
Digital imaging in dentistry / orthodontics courses
 
Multimodal RGB-D+RF-based sensing for human movement analysis
Multimodal RGB-D+RF-based sensing for human movement analysisMultimodal RGB-D+RF-based sensing for human movement analysis
Multimodal RGB-D+RF-based sensing for human movement analysis
 
Labeling fundus images for classification models
Labeling fundus images for classification modelsLabeling fundus images for classification models
Labeling fundus images for classification models
 
Carter chapter 001
Carter chapter 001Carter chapter 001
Carter chapter 001
 
Holographic optical data storage jyoti-225
Holographic optical data storage jyoti-225Holographic optical data storage jyoti-225
Holographic optical data storage jyoti-225
 
Digital Radiography
Digital RadiographyDigital Radiography
Digital Radiography
 
EL.2014.1684
EL.2014.1684EL.2014.1684
EL.2014.1684
 
RGB laser projection
RGB laser projectionRGB laser projection
RGB laser projection
 
DIGITAL IMAGE TECHNOLOGY
DIGITAL IMAGE TECHNOLOGYDIGITAL IMAGE TECHNOLOGY
DIGITAL IMAGE TECHNOLOGY
 

Similar a Generation of planar radiographs from 3D anatomical models using the GPU

3D Printing for Surgical Innovation: A Primer
3D Printing for Surgical Innovation:  A Primer3D Printing for Surgical Innovation:  A Primer
3D Printing for Surgical Innovation: A PrimerNigel Parsad
 
iMinds insights - 3D Visualization Technologies
iMinds insights - 3D Visualization TechnologiesiMinds insights - 3D Visualization Technologies
iMinds insights - 3D Visualization TechnologiesiMindsinsights
 
Understanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdfUnderstanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdfQualcomm Research
 
Role of 3D printing & 3D model in Complex Total Hip Replacement
Role of 3D printing &  3D model in Complex Total Hip Replacement Role of 3D printing &  3D model in Complex Total Hip Replacement
Role of 3D printing & 3D model in Complex Total Hip Replacement Queen Mary Hospital
 
Generating 3 d model in virtual reality and analyzing its performance
Generating 3 d model in virtual reality and analyzing its performanceGenerating 3 d model in virtual reality and analyzing its performance
Generating 3 d model in virtual reality and analyzing its performanceijcsit
 
Radiology lecture 2 CR and DR .pptx
Radiology lecture 2 CR and DR  .pptxRadiology lecture 2 CR and DR  .pptx
Radiology lecture 2 CR and DR .pptxMahrukhMunawar1
 
2D Gaussian Filter for Image Processing A Study.pdf
2D Gaussian Filter for Image Processing  A Study.pdf2D Gaussian Filter for Image Processing  A Study.pdf
2D Gaussian Filter for Image Processing A Study.pdfLisa Riley
 
A Wireless Network Infrastructure Architecture for Rural Communities
A Wireless Network Infrastructure Architecture for Rural CommunitiesA Wireless Network Infrastructure Architecture for Rural Communities
A Wireless Network Infrastructure Architecture for Rural CommunitiesAIRCC Publishing Corporation
 
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrate...
 Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrate... Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrate...
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrate...AIRCC Publishing Corporation
 
COMPLETE END-TO-END LOW COST SOLUTION TO A 3D SCANNING SYSTEM WITH INTEGRATED...
COMPLETE END-TO-END LOW COST SOLUTION TO A 3D SCANNING SYSTEM WITH INTEGRATED...COMPLETE END-TO-END LOW COST SOLUTION TO A 3D SCANNING SYSTEM WITH INTEGRATED...
COMPLETE END-TO-END LOW COST SOLUTION TO A 3D SCANNING SYSTEM WITH INTEGRATED...ijcsit
 
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrated...
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrated...Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrated...
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrated...AIRCC Publishing Corporation
 
Rendering Process of Digital Terrain Model on Mobile Devices
Rendering Process of Digital Terrain Model on Mobile DevicesRendering Process of Digital Terrain Model on Mobile Devices
Rendering Process of Digital Terrain Model on Mobile DevicesWaqas Tariq
 
University of florida 3 d lapidary scanner 110614
University of florida 3 d lapidary scanner 110614University of florida 3 d lapidary scanner 110614
University of florida 3 d lapidary scanner 110614Robert Harker
 
Radiology lecture 2 CR and DR .pptx
Radiology lecture 2 CR and DR  .pptxRadiology lecture 2 CR and DR  .pptx
Radiology lecture 2 CR and DR .pptxMahrukhMunawar1
 
From Sense to Print: Towards Automatic 3D Printing from 3D Sensing Devices
From Sense to Print: Towards Automatic 3D Printing from 3D Sensing DevicesFrom Sense to Print: Towards Automatic 3D Printing from 3D Sensing Devices
From Sense to Print: Towards Automatic 3D Printing from 3D Sensing Devicestoukaigi
 
Development of 3D convolutional neural network to recognize human activities ...
Development of 3D convolutional neural network to recognize human activities ...Development of 3D convolutional neural network to recognize human activities ...
Development of 3D convolutional neural network to recognize human activities ...journalBEEI
 
Real-Time 3D Data Visualization and Analysis of Unlimited Detail
Real-Time 3D Data Visualization and Analysis of Unlimited DetailReal-Time 3D Data Visualization and Analysis of Unlimited Detail
Real-Time 3D Data Visualization and Analysis of Unlimited DetailMerrick & Company
 

Similar a Generation of planar radiographs from 3D anatomical models using the GPU (20)

3D Printing for Surgical Innovation: A Primer
3D Printing for Surgical Innovation:  A Primer3D Printing for Surgical Innovation:  A Primer
3D Printing for Surgical Innovation: A Primer
 
iMinds insights - 3D Visualization Technologies
iMinds insights - 3D Visualization TechnologiesiMinds insights - 3D Visualization Technologies
iMinds insights - 3D Visualization Technologies
 
Understanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdfUnderstanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdf
 
Role of 3D printing & 3D model in Complex Total Hip Replacement
Role of 3D printing &  3D model in Complex Total Hip Replacement Role of 3D printing &  3D model in Complex Total Hip Replacement
Role of 3D printing & 3D model in Complex Total Hip Replacement
 
Generating 3 d model in virtual reality and analyzing its performance
Generating 3 d model in virtual reality and analyzing its performanceGenerating 3 d model in virtual reality and analyzing its performance
Generating 3 d model in virtual reality and analyzing its performance
 
Radiology lecture 2 CR and DR .pptx
Radiology lecture 2 CR and DR  .pptxRadiology lecture 2 CR and DR  .pptx
Radiology lecture 2 CR and DR .pptx
 
3D Article
3D Article3D Article
3D Article
 
MII-800XL_Plus
MII-800XL_PlusMII-800XL_Plus
MII-800XL_Plus
 
2D Gaussian Filter for Image Processing A Study.pdf
2D Gaussian Filter for Image Processing  A Study.pdf2D Gaussian Filter for Image Processing  A Study.pdf
2D Gaussian Filter for Image Processing A Study.pdf
 
A Wireless Network Infrastructure Architecture for Rural Communities
A Wireless Network Infrastructure Architecture for Rural CommunitiesA Wireless Network Infrastructure Architecture for Rural Communities
A Wireless Network Infrastructure Architecture for Rural Communities
 
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrate...
 Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrate... Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrate...
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrate...
 
COMPLETE END-TO-END LOW COST SOLUTION TO A 3D SCANNING SYSTEM WITH INTEGRATED...
COMPLETE END-TO-END LOW COST SOLUTION TO A 3D SCANNING SYSTEM WITH INTEGRATED...COMPLETE END-TO-END LOW COST SOLUTION TO A 3D SCANNING SYSTEM WITH INTEGRATED...
COMPLETE END-TO-END LOW COST SOLUTION TO A 3D SCANNING SYSTEM WITH INTEGRATED...
 
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrated...
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrated...Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrated...
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrated...
 
Rendering Process of Digital Terrain Model on Mobile Devices
Rendering Process of Digital Terrain Model on Mobile DevicesRendering Process of Digital Terrain Model on Mobile Devices
Rendering Process of Digital Terrain Model on Mobile Devices
 
University of florida 3 d lapidary scanner 110614
University of florida 3 d lapidary scanner 110614University of florida 3 d lapidary scanner 110614
University of florida 3 d lapidary scanner 110614
 
Radiology lecture 2 CR and DR .pptx
Radiology lecture 2 CR and DR  .pptxRadiology lecture 2 CR and DR  .pptx
Radiology lecture 2 CR and DR .pptx
 
From Sense to Print: Towards Automatic 3D Printing from 3D Sensing Devices
From Sense to Print: Towards Automatic 3D Printing from 3D Sensing DevicesFrom Sense to Print: Towards Automatic 3D Printing from 3D Sensing Devices
From Sense to Print: Towards Automatic 3D Printing from 3D Sensing Devices
 
Development of 3D convolutional neural network to recognize human activities ...
Development of 3D convolutional neural network to recognize human activities ...Development of 3D convolutional neural network to recognize human activities ...
Development of 3D convolutional neural network to recognize human activities ...
 
Survey of using gpu cuda programming model
Survey of using gpu cuda programming modelSurvey of using gpu cuda programming model
Survey of using gpu cuda programming model
 
Real-Time 3D Data Visualization and Analysis of Unlimited Detail
Real-Time 3D Data Visualization and Analysis of Unlimited DetailReal-Time 3D Data Visualization and Analysis of Unlimited Detail
Real-Time 3D Data Visualization and Analysis of Unlimited Detail
 

Último

Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 

Último (20)

Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 

Generation of planar radiographs from 3D anatomical models using the GPU

  • 1. Generation of planar radiographs from 3D anatomical models using the GPU André dos Santos Cardoso Supervisor: Jorge M. G. Barbosa University of Porto Faculty of Engineering of University of Porto andre.cardoso@fe.up.pt, jbarbosa@fe.up.pt July 14, 2010 André dos Santos Cardoso DRR Generation 1 / 19
  • 2. Contents 1 Introduction Context Overview Project’s Objective 2 Why is it Important? 3 Our Specific Case 4 What Has Been Done? Wrap-Up 5 Current Solution 6 What’s expected? 7 Involved Technologies GLSL CUDA 8 Work Plan 9 Bibliography André dos Santos Cardoso DRR Generation 2 / 19
  • 3. Context Overview Digitally Reconstructed Radiographs (DRRs) Taking a radiography from 3D digital anatomical models of vertebrae Form of depth peeling, using ray-casting Key component in 2D/3D registration process André dos Santos Cardoso DRR Generation 3 / 19
  • 4. Context Overview DRRs are built from vertebrae models represented by 3D meshes DRR generation as mean to validate and/or refine 3D reconstructions of the spine from multi-planar radiography Vertebrae Shape Recovery Using 2D/3D Non-Rigid Registration Important techniques for Scoliosis therapy and follow-ups André dos Santos Cardoso DRR Generation 4 / 19
  • 5. Project’s Objective Build Fast DRR Algorithms DRR calculation is a bottleneck 3D reconstruction usage in a routine clinical environment requires high performances Take advantage of processing power of new GPUs and APIs Common workstations could do the job! André dos Santos Cardoso DRR Generation 5 / 19
  • 6. Why is it Important? DRR generation key component in many 2D/3D registration problems Allows to compare/use data from different sources and times together The CAS model versus real-time imagery from the patient Nonrigid registration Many applications in medical area CAS, Radiotherapy, Volume Recovery Known to be a common bottleneck André dos Santos Cardoso DRR Generation 6 / 19
  • 7. Why is it Important? Speed! Daily work on the field demands on-the-fly results, and high accuracy Advantages on using GPUs versus Hardware solutions Cheaper More accessible General Purpose Computing on GPUs gaining increasing interest from researchers André dos Santos Cardoso DRR Generation 7 / 19
  • 8. Our Specific Case Where will the Optimized Algorithms fit? Shape Recovery of human spine – attaining a 3D model of the spine Bi-planar Radiography Scoliosis evaluation Viable alternative to MRIs and CTs – why? Expensive, Amount of Radiation, Prolonged Procedures, Require lying down Not the scope of this project!! Moura, D. et al [6] André dos Santos Cardoso DRR Generation 8 / 19
  • 9. What has been done in this area? Attenuation Law – monochromatic x-ray radiation Nout (E ) = Nin (E ) × e − µ(E ,ρ(x ),Z (x ))dx (1) Focus on GPU Implementations! Monte Carlo Volume Shear-Warping Rendering Viewing transformations Volumetric integral for Splatting each pixel Throw voxels into the Fourier Volume Rendering viewing pane Inverse 2D Fourier Ray Casting transform of a slice Shoot rays to each pixel André dos Santos Cardoso DRR Generation 9 / 19
  • 10. Wrap-Up Attenuation law for bone material Few Applications of DRR to 3D Meshes (most work on CT data – voxels) Using OpenGL Shading Language (GLSL) Multi Pass Algorithm is available Single Pass Algorithm is considered the state of the art, but no applied implementation exists Compute Unified Device Architecture (CUDA) peeling applications exist (but not for computing DRRs) André dos Santos Cardoso DRR Generation 10 / 19
  • 11. Current Solution Inputs CAD model of vertebrae Camera position, object positions, object orientation, … Outputs simulated Radiograph! André dos Santos Cardoso DRR Generation 11 / 19
  • 12. Current Solution Ray Casting Multipass Algorithm Ray Casting and Depth Peeling GLSL Why use CAD models? Problem context requires deformations to the 3D model Faster to deform CAD models Generally, decreases amount of computation André dos Santos Cardoso DRR Generation 12 / 19
  • 13. What’s expected? Enhance the current solution 1 Modify code to implement the reported single-pass approach 2 Port solution to CUDA 3 Test and compare solutions Significant speed-ups are expected André dos Santos Cardoso DRR Generation 13 / 19
  • 14. Technologies – GLSL OpenGL Shading Language Allows the modification of fixed functionality of the GPU pipeline Similar syntax to C/C++ Modules called Shaders André dos Santos Cardoso DRR Generation 14 / 19
  • 15. Technologies – CUDA Compute Unified Device Architecture Parallel Computing Architecture Allows direct access to parallel processors and memory Kernel function executed on GPU device Allows hierarchical configuration of threads upon kernel launch Massive data parallelism Allows versatile and more controlled programming André dos Santos Cardoso DRR Generation 15 / 19
  • 16. Work Plan André dos Santos Cardoso DRR Generation 16 / 19
  • 17. Thank You for Listening! Ask Away! André dos Santos Cardoso DRR Generation 17 / 19
  • 18. Bibliography The opengl shading language. Lisa Gottesfeld Brown. A survey of image registration techniques. ACM Comput. Surv., 24(4):325–376, 1992. David B. Kirk and Wen mei W. Hwu. Programming Massively Parallel Processors - A Hands-on Approach. Morgan Kaufmann, 2010. A. Mitulescu, W. Skalli, D. Mitton, and J. A. De Guise. Three-dimensional surface rendering reconstruction of scoliotic vertebrae using a non stereo-corresponding points technique. European Spine Journal, 2002. Shinichiro Mori, Masanao Kobayashi, Motoki Kumagai, and Shinichi Minohara. Development of a gpu-based multithreaded software application to calculate digitally reconstructed radiographs for radiotherapy. Radiological Physics and Technology, 2009. Daniel C. Moura, Jonathan Boisvert, Jorge G. Barbosa, and João Manuel Tavares. Fast 3d reconstruction of the spine using user-defined splines and a statistical articulated model. In ISVC ’09: Proceedings of the 5th International Symposium on Advances in Visual Computing, pages 586–595, Berlin, Heidelberg, 2009. Springer-Verlag. Scott D. Roth. Ray casting for modeling solids. j-CGIP, 18(2), 1982. F. P. Vidal, M.Garnier, N. Freud, J. M. Létang, and N.W. John. Simulation of x-ray attenuation on the gpu. In Proceeding of TCPG’09 - Theory and Practice of Computer Graphics, pages 25–32. Eurographics, 2009. André dos Santos Cardoso DRR Generation 18 / 19
  • 19. Bibliography Full Bibliography Listed in: https://dev.andrecardoso.eu/bibtexbrowser.php?bib= thesisbib.bib André dos Santos Cardoso DRR Generation 19 / 19