Applications of 3D reconstruction, Augmented reality and 3D printing in Modern Surgical Education
EAES Academy. Espinola Schulze F. 07/05/22; 363186; P250
Mr. Federico Espinola Schulze
Contributions
Contributions
Abstract
Introduction:
Anatomy is the cornerstone of surgery. A confident grasp over applied surgical anatomy is essential for a surgeon to understand the target structures that need to be resected/repaired/removed and/or replaced, along with preserving the surrounding anatomy and preventing collateral damage. It is important that surgery should be taught as a combination of understanding applied anatomical variations, followed by manual techniques mastering. This allows for safe and appropriate surgical planning, as well as improves the surgeons‘ breadth of experience and knowledge, and their ability to deal with the unexpected situations that may happen intraoperatively. We suggest that more attention should be paid to this aspect of training, that will offer a kind of extra gear in term of enthusiasm and ability to learn the basic methodology of navigating surgical practice.
Patient-specific three-dimensional modelling is a novel tool that helps us understand surgery and also helps teach. Surgical strategy can be discussed using MRI / CT scans, but it can be difficult to translate two-dimensional images into a surgical approach and also difficult to teach students. The use of Virtual and Augmented Reality together with 3D Printing allows to better visualize the anatomy in relation to the surrounding structures in addition to better approximating the size and shape of the abdominal organs. Our goal is to present an affordable solution that can be used in low-income countries also in educational centers.
Methods:
Data are captured from MRI and CT scans, which are processed in various open-source software for smoothing, artefacts removal and decimation to achieve better performance. These images can be visualised in devices such as phones and tablets, taking advantage of native support in modern personal mobile devices, the goal is to superimpose computer-generated (CG) images on a real-world imagery and creating the illusion of AR in an affordable manner instead of video projectors, headsets, or computers.
Applications:
Augmented reality:
AR proved to be a great functional educational tool for medical students and junior surgeons. As regional anatomy has a much value than systematic anatomy in the practice of surgery, AR can use real-time patient-specific anatomical information to allow accurate reconstructions to better demonstrate the anatomy in relation to surrounding structures., It can also beneficially be used within pre, intra, and post operative applications. It helps in the pre-surgical planning, decision making, and the performance of live surgeries. AR gives the ability to navigate patient‘s organs and structures. Allows to analyse the surgery, separate in steps, and practice different approaches. Enables to cut virtually and perform a virtual surgery before the surgery itself. Furthermore, AR can be used as a surgical objective assessment tool to evaluate how successful the surgery was. For example, AR can determine if the surgical objectives were completely accomplished or not, if all the tumour was safely resected, if any iatrogenic injuries happened, and so on. In case the surgical goals have not been, AR can possibly plan the next procedure more effectively.
Surgical Simulation:
Once we have realistic models of the patient's anatomy, it is possible to create VR simulations of surgical procedures. This would allow to practice countless times and also to have several examples of anatomies for training. Besides, Thanks to 3D printing technology, we can create realistic models from the patient. Providing this tactile feedback to the models, adds a layer of realism which would improve the learning experience. Moreover, creating models for each patient before and after surgery to create a model collection for surgical training and minimally invasive procedures practicing.
Conclusion:
It is possible to create realistic patient-specific AR models without proprietary software and to be visualised using low-cost mobile devices. Patient-specific anatomic modelling has several applications in surgery, from surgical planning to education. Augmented Reality in surgery promises to be a feasible way to improve the learning curves and surgical outcomes. However, further advances in artificial intelligence and image methods are still required to expand its capabilities, along with more research is necessary to validate its clinical use in surgical centres.
Anatomy is the cornerstone of surgery. A confident grasp over applied surgical anatomy is essential for a surgeon to understand the target structures that need to be resected/repaired/removed and/or replaced, along with preserving the surrounding anatomy and preventing collateral damage. It is important that surgery should be taught as a combination of understanding applied anatomical variations, followed by manual techniques mastering. This allows for safe and appropriate surgical planning, as well as improves the surgeons‘ breadth of experience and knowledge, and their ability to deal with the unexpected situations that may happen intraoperatively. We suggest that more attention should be paid to this aspect of training, that will offer a kind of extra gear in term of enthusiasm and ability to learn the basic methodology of navigating surgical practice.
Patient-specific three-dimensional modelling is a novel tool that helps us understand surgery and also helps teach. Surgical strategy can be discussed using MRI / CT scans, but it can be difficult to translate two-dimensional images into a surgical approach and also difficult to teach students. The use of Virtual and Augmented Reality together with 3D Printing allows to better visualize the anatomy in relation to the surrounding structures in addition to better approximating the size and shape of the abdominal organs. Our goal is to present an affordable solution that can be used in low-income countries also in educational centers.
Methods:
Data are captured from MRI and CT scans, which are processed in various open-source software for smoothing, artefacts removal and decimation to achieve better performance. These images can be visualised in devices such as phones and tablets, taking advantage of native support in modern personal mobile devices, the goal is to superimpose computer-generated (CG) images on a real-world imagery and creating the illusion of AR in an affordable manner instead of video projectors, headsets, or computers.
Applications:
Augmented reality:
AR proved to be a great functional educational tool for medical students and junior surgeons. As regional anatomy has a much value than systematic anatomy in the practice of surgery, AR can use real-time patient-specific anatomical information to allow accurate reconstructions to better demonstrate the anatomy in relation to surrounding structures., It can also beneficially be used within pre, intra, and post operative applications. It helps in the pre-surgical planning, decision making, and the performance of live surgeries. AR gives the ability to navigate patient‘s organs and structures. Allows to analyse the surgery, separate in steps, and practice different approaches. Enables to cut virtually and perform a virtual surgery before the surgery itself. Furthermore, AR can be used as a surgical objective assessment tool to evaluate how successful the surgery was. For example, AR can determine if the surgical objectives were completely accomplished or not, if all the tumour was safely resected, if any iatrogenic injuries happened, and so on. In case the surgical goals have not been, AR can possibly plan the next procedure more effectively.
Surgical Simulation:
Once we have realistic models of the patient's anatomy, it is possible to create VR simulations of surgical procedures. This would allow to practice countless times and also to have several examples of anatomies for training. Besides, Thanks to 3D printing technology, we can create realistic models from the patient. Providing this tactile feedback to the models, adds a layer of realism which would improve the learning experience. Moreover, creating models for each patient before and after surgery to create a model collection for surgical training and minimally invasive procedures practicing.
Conclusion:
It is possible to create realistic patient-specific AR models without proprietary software and to be visualised using low-cost mobile devices. Patient-specific anatomic modelling has several applications in surgery, from surgical planning to education. Augmented Reality in surgery promises to be a feasible way to improve the learning curves and surgical outcomes. However, further advances in artificial intelligence and image methods are still required to expand its capabilities, along with more research is necessary to validate its clinical use in surgical centres.
Introduction:
Anatomy is the cornerstone of surgery. A confident grasp over applied surgical anatomy is essential for a surgeon to understand the target structures that need to be resected/repaired/removed and/or replaced, along with preserving the surrounding anatomy and preventing collateral damage. It is important that surgery should be taught as a combination of understanding applied anatomical variations, followed by manual techniques mastering. This allows for safe and appropriate surgical planning, as well as improves the surgeons‘ breadth of experience and knowledge, and their ability to deal with the unexpected situations that may happen intraoperatively. We suggest that more attention should be paid to this aspect of training, that will offer a kind of extra gear in term of enthusiasm and ability to learn the basic methodology of navigating surgical practice.
Patient-specific three-dimensional modelling is a novel tool that helps us understand surgery and also helps teach. Surgical strategy can be discussed using MRI / CT scans, but it can be difficult to translate two-dimensional images into a surgical approach and also difficult to teach students. The use of Virtual and Augmented Reality together with 3D Printing allows to better visualize the anatomy in relation to the surrounding structures in addition to better approximating the size and shape of the abdominal organs. Our goal is to present an affordable solution that can be used in low-income countries also in educational centers.
Methods:
Data are captured from MRI and CT scans, which are processed in various open-source software for smoothing, artefacts removal and decimation to achieve better performance. These images can be visualised in devices such as phones and tablets, taking advantage of native support in modern personal mobile devices, the goal is to superimpose computer-generated (CG) images on a real-world imagery and creating the illusion of AR in an affordable manner instead of video projectors, headsets, or computers.
Applications:
Augmented reality:
AR proved to be a great functional educational tool for medical students and junior surgeons. As regional anatomy has a much value than systematic anatomy in the practice of surgery, AR can use real-time patient-specific anatomical information to allow accurate reconstructions to better demonstrate the anatomy in relation to surrounding structures., It can also beneficially be used within pre, intra, and post operative applications. It helps in the pre-surgical planning, decision making, and the performance of live surgeries. AR gives the ability to navigate patient‘s organs and structures. Allows to analyse the surgery, separate in steps, and practice different approaches. Enables to cut virtually and perform a virtual surgery before the surgery itself. Furthermore, AR can be used as a surgical objective assessment tool to evaluate how successful the surgery was. For example, AR can determine if the surgical objectives were completely accomplished or not, if all the tumour was safely resected, if any iatrogenic injuries happened, and so on. In case the surgical goals have not been, AR can possibly plan the next procedure more effectively.
Surgical Simulation:
Once we have realistic models of the patient's anatomy, it is possible to create VR simulations of surgical procedures. This would allow to practice countless times and also to have several examples of anatomies for training. Besides, Thanks to 3D printing technology, we can create realistic models from the patient. Providing this tactile feedback to the models, adds a layer of realism which would improve the learning experience. Moreover, creating models for each patient before and after surgery to create a model collection for surgical training and minimally invasive procedures practicing.
Conclusion:
It is possible to create realistic patient-specific AR models without proprietary software and to be visualised using low-cost mobile devices. Patient-specific anatomic modelling has several applications in surgery, from surgical planning to education. Augmented Reality in surgery promises to be a feasible way to improve the learning curves and surgical outcomes. However, further advances in artificial intelligence and image methods are still required to expand its capabilities, along with more research is necessary to validate its clinical use in surgical centres.
Anatomy is the cornerstone of surgery. A confident grasp over applied surgical anatomy is essential for a surgeon to understand the target structures that need to be resected/repaired/removed and/or replaced, along with preserving the surrounding anatomy and preventing collateral damage. It is important that surgery should be taught as a combination of understanding applied anatomical variations, followed by manual techniques mastering. This allows for safe and appropriate surgical planning, as well as improves the surgeons‘ breadth of experience and knowledge, and their ability to deal with the unexpected situations that may happen intraoperatively. We suggest that more attention should be paid to this aspect of training, that will offer a kind of extra gear in term of enthusiasm and ability to learn the basic methodology of navigating surgical practice.
Patient-specific three-dimensional modelling is a novel tool that helps us understand surgery and also helps teach. Surgical strategy can be discussed using MRI / CT scans, but it can be difficult to translate two-dimensional images into a surgical approach and also difficult to teach students. The use of Virtual and Augmented Reality together with 3D Printing allows to better visualize the anatomy in relation to the surrounding structures in addition to better approximating the size and shape of the abdominal organs. Our goal is to present an affordable solution that can be used in low-income countries also in educational centers.
Methods:
Data are captured from MRI and CT scans, which are processed in various open-source software for smoothing, artefacts removal and decimation to achieve better performance. These images can be visualised in devices such as phones and tablets, taking advantage of native support in modern personal mobile devices, the goal is to superimpose computer-generated (CG) images on a real-world imagery and creating the illusion of AR in an affordable manner instead of video projectors, headsets, or computers.
Applications:
Augmented reality:
AR proved to be a great functional educational tool for medical students and junior surgeons. As regional anatomy has a much value than systematic anatomy in the practice of surgery, AR can use real-time patient-specific anatomical information to allow accurate reconstructions to better demonstrate the anatomy in relation to surrounding structures., It can also beneficially be used within pre, intra, and post operative applications. It helps in the pre-surgical planning, decision making, and the performance of live surgeries. AR gives the ability to navigate patient‘s organs and structures. Allows to analyse the surgery, separate in steps, and practice different approaches. Enables to cut virtually and perform a virtual surgery before the surgery itself. Furthermore, AR can be used as a surgical objective assessment tool to evaluate how successful the surgery was. For example, AR can determine if the surgical objectives were completely accomplished or not, if all the tumour was safely resected, if any iatrogenic injuries happened, and so on. In case the surgical goals have not been, AR can possibly plan the next procedure more effectively.
Surgical Simulation:
Once we have realistic models of the patient's anatomy, it is possible to create VR simulations of surgical procedures. This would allow to practice countless times and also to have several examples of anatomies for training. Besides, Thanks to 3D printing technology, we can create realistic models from the patient. Providing this tactile feedback to the models, adds a layer of realism which would improve the learning experience. Moreover, creating models for each patient before and after surgery to create a model collection for surgical training and minimally invasive procedures practicing.
Conclusion:
It is possible to create realistic patient-specific AR models without proprietary software and to be visualised using low-cost mobile devices. Patient-specific anatomic modelling has several applications in surgery, from surgical planning to education. Augmented Reality in surgery promises to be a feasible way to improve the learning curves and surgical outcomes. However, further advances in artificial intelligence and image methods are still required to expand its capabilities, along with more research is necessary to validate its clinical use in surgical centres.
{{ help_message }}
{{filter}}