{"id":734,"date":"2015-06-18T06:36:49","date_gmt":"2015-06-18T06:36:49","guid":{"rendered":"http:\/\/biomedpharmajournal.org\/?p=734"},"modified":"2016-01-29T08:46:46","modified_gmt":"2016-01-29T08:46:46","slug":"augmented-reality-advancement-x-ray-imaging-medical-reality-scanning","status":"publish","type":"post","link":"https:\/\/biomedpharmajournal.org\/staging\/vol8no1\/augmented-reality-advancement-x-ray-imaging-medical-reality-scanning\/","title":{"rendered":"Augmented Reality Advancement X-Ray Imaging Medical Reality scanning"},"content":{"rendered":"<p><strong>Introduction<\/strong><\/p>\n<p>Augmented reality has been nowadays used for more practical purposes such as medicine which is very trivial ,apart from providing entertaining digital content to the users of smart devices. One such important use of AR is in the field of Ultrasound medical imaging of fetus. This technology is going to play an important role in the future of medicine. It can be hoped that similar\u00a0augmented reality\u00a0products will be developed and will revolutionize the mode of treatment\u00a0 used by doctors in the future. \u00a0The capabilities that this technology has, can be used to make complex surgical procedures easier. Doctors and other healthcare professionals have lauded this innovative reality and its adaptiveness for this ability. With proper platform, doctors can not only perform surgeries easily but also provide postoperative care.<\/p>\n<p>With this AR technology, the ultrasound medical images of pregnant women can be mediated with videos of fetus to provide \u00a0two real time virtual videos. To explain further, this revolutionary wireless technology application in the mobile of a practitioner can be used to display the virtual reality video runs of scanning the womb of a pregnant woman with an ultrasound sensor, generating a 3-D representation of the fetus inside the womb and displaying that in a see-through.The goal is to endow the doctor with the ability to see the moving, kicking fetus lying inside the womb, with the hope that this one day may become a &#8220;3-D stethoscope&#8221; .More recent efforts have focused on a needle biopsy of a breast tumor. AR can be used to show a mockup of a breast biopsy operation, where the virtual objects identify the location of the tumor and guide the needle to its target<\/p>\n<p>Augmented Reality (AR) is a variation of Virtual Environments (VE), or Virtual Reality as it is more commonly called. VE technologies completely immerse a user inside a synthetic environment. While immersed, the user cannot see the real world around him. In contrast, AR allows the user to see the real world, with virtual objects superimposed upon or composited with the real world[3]. Therefore, AR supplements reality, rather than completely replacing it .A overview of Augmented Reality and its mixed mode of reality with virtual and real world is portrayed in Fig 1.1<\/p>\n<p><strong>Need for AR technology<\/strong><\/p>\n<p>The &#8220;paper-less&#8221; office has proven to be a \u00a0myth: not only are office workers still inundated with paper, but they must now handle increasing quantities of electronic information. Worse, they are poorly equipped to bridge the gap between these two overlapping, but separate, worlds. Perhaps it is not surprising that computers have had little or no impact on white collar productivity. The problem is not restricted to office work. Medicine has enjoyed major advances in imaging technology and interactive diagnostic tools. Yet most hospitals still rely on paper and pencil for medical charts next to the patient&#8217;s bed. A recent study of terminally-ill patients in the U.S. concluded that, despite detailed information in their electronic medical charts, doctors were mostly unaware of their patients&#8217; wishes. Despite its importance, the electronic information all too often remains disconnected from the physical world. Fig 1.1. shows Overview of Augmented Reality.<\/p>\n<p><strong>Historical background of Augmented Reality<\/strong><\/p>\n<p>According to the Horizon Report, Augmented reality is older than the term coined by Tom Caudwell in 1992.They say that the first applications actually appeared in the late 1960s and 1970s. Early mobile applications began to appear in 2008 and reality mapping and social tools are now on the market. In 2008-2009, Wikitude came out with AR Travel Guide and AR Navigation System for the Android platform Also in 2009, the AR Toolkit was ported to Adobe Flash which essentially brought AR to the web browser<\/p>\n<p><strong>Use Cases Scenarios<\/strong><\/p>\n<p><strong>AR for ultrasonic Scan Images as motionary videos<\/strong><\/p>\n<p>Augmented Reality addresses problems of stationary images and traditional Scan pictures obtained from Ultrasound, MRI Scan by reintegrating electronic information back into the real world. The various approaches share a common goal: to enable people to take advantage of their existing skills in interacting with objects the everyday world while benefiting from the power of networked computing by superimposing scan images with from simple text to links with video and audio content.<\/p>\n<p><strong>Importance of AR for surgical enhancement<\/strong><\/p>\n<p>Because imaging technology is so pervasive throughout the medical field, especially for surgery it is not surprising that this domain is viewed as one of the more important for augmented reality systems. Most of the medical applications deal with Improvised image guided surgery. Pre-operative imaging studies, such as CT or MRI scans, of the patient provide the surgeon with the necessary view of the internal anatomy. From these images the surgery is planned. Visualization of the path through the anatomy to the affected area where, for example, a tumor must be removed is done by first creating a 3D model from the multiple views and slices in the preoperative study. This is most often done mentally though some systems will create 3D volume visualizations from the image study. Augmented reality can be applied so that the surgical team can see the CT or MRI data correctly registered on the patient in the operating theater while the procedure is progressing. Being able to accurately register the images at this point will enhance the performance of the surgical team and eliminate the need for the painful and cumbersome stereotactic frames that are currently used for registration.<\/p>\n<p><strong>AR for X-ray Images as Informative Images to consultant<\/strong><\/p>\n<p>Augmented Reality can be encumbered with usage of X-rays for medical specialists .X-Rays images, conventional tomography pictures can be mediated with patient photography ,symptoms of the predicted disease, Patient name and necessary audio tracks as shown in Figure 2.1<\/p>\n<p>As per discussion Figure 2.3 shows a normal X-Ray Image against actual Implementation of AR Technology depicting Patient name, Age, Consultant Name embedded in\u00a0 X-\u00a0\u00a0 Ray Image as shown in Figure 2.4 which is a great boon in medical advancement.<\/p>\n<p><strong>AR for 3D holistic view of body as a merger of virtual and physical reality<\/strong><\/p>\n<p>The goal is a system that shows the surgeon a 3D picture of a patient&#8217;s inner body\u00a0along with the instruments needed during the operation. This image is not visible on a separate display but rather can be seen directly while looking at the patient. To ensure the use of this technology the\u00a0system should be user friendly.<\/p>\n<p>The technique is sample portrayed in figure which shows keen pinhole look for the surgeon deep inside the victim as shown in Figure 2.5 depicting realistic Overview of holistic Augmented Virtual Reality.<\/p>\n<p><strong>Importance of AR for C-Arm with enhanced cameras<\/strong><\/p>\n<p>One big step ahead ,yet another development from the chair of Augmented Reality is C-Arm,an enhanced camera for virtual Reality. The researches have enhanced an imaging method, the so-called C-arm, to be used in augmented reality. The technique will be tested in the operation theatre in the yet another few months to come.<\/p>\n<p><strong>Materials And Methods <\/strong><\/p>\n<p><strong>Importance of AR for fetus Ultrasound scanning<\/strong><\/p>\n<p>With this AR technology, the ultrasound medical images of pregnant women can be mediated with videos of fetus to provide\u00a0 two real time virtual videos. To explain further, this revolutionary wireless technology application in the mobile of a practitioner can be used to display the virtual reality video runs of scanning the womb of a pregnant woman with an ultrasound sensor, generating a 3-D representation of the fetus inside the womb and displaying that in a see-through . The goal is to endow the doctor with the ability to see the moving, kicking fetus lying inside the womb.<\/p>\n<p><strong>Reasons \u00a0to Use An AR embedded Ultrasound Image for fetus <\/strong><\/p>\n<p>Depending on your stage of pregnancy, AR Application scan video mediated with the Ultrasound image\u00a0 can:<br \/>\nShow\u00a0 that your baby has body movements, limb fluctuations and breathing gestures.<\/p>\n<p>Depict the real number of babies whether you&#8217;re pregnant with one baby or\u00a0twins or more.<\/p>\n<p>Detect an\u00a0ectopic pregnancy, where the embryo implants outside the womb, usually in the fallopian tube.<\/p>\n<p>Find out size, measurements of your baby.<\/p>\n<p>Assess your baby&#8217;s\u00a0risk of Down&#8217;s syndrome\u00a0by measuring fluid at the back of your baby\u2019s neck at 11 weeks plus two days to 14 weeks plus one day (nuchal translucency (NT) scan).Find out why a\u00a0blood screening test\u00a0was abnormal.<\/p>\n<p>Help with diagnostic tests, such as\u00a0CVS\u00a0or\u00a0amniocentesis, by showing the\u00a0position of the baby and placenta.<\/p>\n<p>Examine you \u00a0baby to see if all his organs are normal.<\/p>\n<p>Diagnose most abnormalities, misconceptions such as\u00a0spinal bifida.<\/p>\n<p>Assess the amount of\u00a0amniotic fluid\u00a0you have and find out where the placenta lies.<\/p>\n<p>Measure your baby&#8217;s\u00a0rate of growth\u00a0over several scans. A scan may show if you are expecting a\u00a0boy or girl revealing the gender of a baby<\/p>\n<p><strong>Operation of AR Technology<\/strong><\/p>\n<p>The basic idea of augmented reality is to superimpose\u00a0graphics, audio and other sensory enhancements over a real-world environment in real time. This concept sound easier.Doctors can examine patients while viewing superimposed medical images children can program their own LEGO constructions; construction engineers can use ordinary paper engineering drawings to communicate with distant colleagues. Rather than immersing people in an artificially created virtual world, the goal is to augment objects in the physical world by enhancing them with a wealth of digital information and communication capabilities.The workflow of fetus Ultrasound Reality scanning\u00a0 using AR technology as implemented in shown in Figure 3.1<\/p>\n<p><strong>Existing System<\/strong><\/p>\n<p>Static X-Ray images and ultrasound photos are a thing of the past. With traditional X-Ray, even though, most experts agree that scans performed by a qualified healthcare professional there will\u00a0 be\u00a0 a chance to misplace patient\u2019s X-Ray images of one with another patient.<br \/>\nThere is no evidence of any Augmented reality mobile application for viewing X-Ray images with patients photograph and symptom names even in multi speciality clinics in our country.<\/p>\n<p>A conventional \u00a0ultrasound scan\u00a0sends sound waves through your womb (uterus). These waves bounce off your baby as echoes which are then turned into an image on a screen that shows your baby\u2019s position and\u00a0movements.<br \/>\nHard tissues, such as bone, reflect the most sound waves and so make the biggest echoes. These appear white in the image, and soft tissues appear grey. Fluids, such as the\u00a0amniotic fluid\u00a0surrounding your baby, appear black. This is because the sound waves go through them with no echoes.<br \/>\nThe person performing the scan (sonographer) will look at these different shades to interpret the images.<br \/>\nBut this can be viewed only for the current movement by the sonographer who captures the scanning video. This motionary pictures and videos are neither available for the consultant doctor nor the parents for future reference.<\/p>\n<p><strong>Proposed System<\/strong><\/p>\n<p>In Our Proposed System, we have used Augmented Reality (AR),a new wireless communication mobile application virtual technology which allows the combination of multiple images, audios, videos to be incorporated together in\u00a0 a single scan Ultrasound Image .Such virtual reality motionary \u00a0videos of fetus inside mother\u2019s womb provides improved medical enhancement by allowing the fetus movements weaved to be watched\u00a0 later\u00a0 by specialist and parents. The\u00a0first scan\u00a0can be very exciting because it gives you a first glimpse and live videos of your baby. Your sonographer may even print out the image of your baby embedded in the mediated motionary video of the baby and give it to you as a keepsake.\u00a0Suddenly this ultrasound advancement is not just a visual offer but it actually allows you to gain parental affection by watching gestures of the baby when desired ,practitioner loyalty and even instant motionary predictions !This has all the benefits of the traditional Ultrasound imaging but it is a dramatic enhancement that offers much more.The System Architecture of placement of augmented reality in shown in Figure 4.1.This Figure 4.1 shown absolute positioning of medical reality scanning.<\/p>\n<p><strong>Challenges and Discussion<\/strong><\/p>\n<p>In general, one can summarize that AR is not more insecure than other related technologies. At present, the AR technology has reached a level where commercial launch preparation can begin and should be established. Reliability and usability of AR applications are probably the most important determinants of the user experience in everyday use of this augmented technology and therefore important keys to its success.<\/p>\n<p><strong>Results and Discussions <\/strong><\/p>\n<p>The next generation Augmented reality technology is designed to make life much easier for medical filed for patients as well as medical consultants .Figure 4.1 clearly portrays how developed application using augmented reality shows all the details of patients including name, diagnosis, age and medical\u00a0 record. For trend setters everywhere, AR technology is, without doubt, the next big thing[3]..Practitioners don\u2019t need to install any apps or commit to any system to engage with AR. It\u2019s all built in as an application. Touch your phone to something, consume content. With these kind of medical advancement the specialists would say in future \u201cI sometimes forget my keys, my ID, my watch, my wallet\u2026 but I NEVER forget my phone which has AR application\u201d<\/p>\n<p><strong>R<\/strong><strong>eferences<\/strong><\/p>\n<p><strong>Journals<\/strong><\/p>\n<ol>\n<li>T. P. Caudell and D. W. Mizell, \u201cAugmented reality: An application of heads-up display technology to manual manufacturing processes,\u201d in System Sciences, 1992. Proceedings of the Twenty-Fifth Hawaii International Conference on, vol. 2. IEEE, 1992, pp. 659\u2013669<\/li>\n<li>H.-Y. Chang, H.-K. Wu, and Y.-S. Hs, \u201cIntegrating a mobile augmented reality activity to contextualize student learning of a socioscientific issue,\u201d British Journal of Educational Technology, vol. 44,2014.<\/li>\n<li>M. de Sa and E. Churchill, \u201cMobile augmented reality: explor- \u00b4 ing design and prototyping techniques,\u201d in Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. ACM, 2012, pp. 221\u2013230.<\/li>\n<li>S. M. Land and H. T. Zimmerman, \u201cSynthesizing perspectives on augmented reality and mobile learning,\u201d TechTrends, vol. 58, no. 1, p. 3, 2014.<\/li>\n<li>D. Van Krevelen and R. Poelman, \u201cA survey of augmented reality technologies, applications and limitations,\u201d International Journal of Virtual Reality, vol. 9, no. 2, p. 1, 2010<\/li>\n<\/ol>\n<p><strong>Chapter In Books<\/strong><\/p>\n<ol>\n<li>R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre, \u201cRecent advances in augmented reality,\u201d Computer Graphics and Applications, IEEE, vol. 21, no. 6, pp. 34\u2013 47, 2001.<\/li>\n<li>R. T. Azuma et al., \u201cA survey of augmented reality,\u201d Presence, vol. 6, no. 4, pp. 355\u2013385, 1997.<\/li>\n<li>O. Bimber, R. Raskar, and M. Inami, Spatial augmented reality. AK Peters Wellesley, 2005<\/li>\n<li>\u00a0A. L. Janin, D. W. Mizell, and T. P. Caudell, \u201cCalibration of head-mounted displays for augmented reality applications,\u201d in Virtual Reality Annual International Symposium, 1993., 1993 IEEE. IEEE, 1993, pp. 246\u2013255.<\/li>\n<li>P. Milgram and F. Kishino, \u201cA taxonomy of mixed reality visual displays,\u201d IEICE TRANSACTIONS on Information and Systems, vol. 77, no. 12, pp. 1321\u20131329, 1994.<\/li>\n<li>W. Piekarski, B. Gunther, and B. Thomas, \u201cIntegrating virtual and augmented realities in an outdoor application,\u201d in Augmented Reality, 1999.(IWAR\u201999) Proceedings. 2nd IEEE and ACM International Workshop on. IEEE, 1999, pp. 45\u201354. [12] S. K. Ong, A. Y. Nee, and S. K. Ong, Virtual Reality and Augmented Reality Applications in Manufacturing. SpringerVerlag, 2004.<\/li>\n<li>\u00a0I. E. Sutherland and C. A. Mead, \u201cMicroelectronics and computer science,\u201d Scientific American, vol. 237, pp. 210\u2013228, 1977.<\/li>\n<li>\u00a0A. Shatte, J. Holdsworth, and I. Lee, \u201cMobile augmented reality based context-aware library management system,\u201d Expert Systems with Applications, vol. 41, no. 5, pp. 2174\u20132185, 2014.<\/li>\n<li>F. Zhou, H. B.-L. Duh, and M. Billinghurst, \u201cTrends in augmented reality tracking, interaction and display: A review of ten years of ismar,\u201d in Proceedings of the 7th IEEE\/ACM International Symposium on Mixed and Augmented Reality. IEEE Computer Society, 2008, pp. 193\u2013202.<\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Introduction Augmented reality has been nowadays used for more practical  [&#8230;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-734","post","type-post","status-publish","format-standard","hentry","category-vol8no1"],"_links":{"self":[{"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/posts\/734","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/comments?post=734"}],"version-history":[{"count":8,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/posts\/734\/revisions"}],"predecessor-version":[{"id":5093,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/posts\/734\/revisions\/5093"}],"wp:attachment":[{"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/media?parent=734"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/categories?post=734"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/tags?post=734"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}