{"id":447793,"date":"2026-02-24T10:37:44","date_gmt":"2026-02-24T09:37:44","guid":{"rendered":"https:\/\/www.unipi.it\/news\/ricerca-realta-aumentata-chirurga\/"},"modified":"2026-03-04T16:14:38","modified_gmt":"2026-03-04T15:14:38","slug":"feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery","status":"publish","type":"news","link":"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/","title":{"rendered":"Feeling with your hands: research into augmented reality applied to surgery"},"content":{"rendered":"<p>Combining vision and touch in augmented reality to support <strong>surgeons in reconstructing complex fractures<\/strong>. This is the focus of a team of researchers from the Department of Information Engineering at the University of Pisa who have<strong> created a prototype<\/strong> and tested it on a displaced knee fracture. The prototype comprises a simple, low-cost tactile device created in the university\u2019s laboratories that complements the augmented reality headset by integrating visual and tactile stimuli. Consisting of two rings applied to the fingers, it generates vibrotactile stimuli. These stimuli provide valuable information, enabling operators to manipulate virtual bone fragments correctly through natural gestures such as pushing, grabbing and aligning.<\/p>\n<p><img fetchpriority=\"high\" decoding=\"async\" class=\"alignnone size-full wp-image-446465\" src=\"https:\/\/www.unipi.it\/wp-content\/uploads\/mani.jpg\" alt=\"\" width=\"900\" height=\"600\" srcset=\"https:\/\/www.unipi.it\/wp-content\/uploads\/mani.jpg 900w, https:\/\/www.unipi.it\/wp-content\/uploads\/mani-300x200.jpg 300w, https:\/\/www.unipi.it\/wp-content\/uploads\/mani-768x512.jpg 768w\" sizes=\"(max-width: 900px) 100vw, 900px\" \/><\/p>\n<p>\u201cFor surgeons, it is not always easy to understand how to arrange the fragments of a fracture,\u201d explains <strong>Vincenzo Ferrari<\/strong>, Professor of Bioengineering at the University of Pisa. \u201cOur system recreates the fracture in augmented reality and uses vision and tactile stimuli to guide the doctor in planning the operation.\u201d<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-446469\" src=\"https:\/\/www.unipi.it\/wp-content\/uploads\/mani1.jpeg\" alt=\"\" width=\"900\" height=\"600\" srcset=\"https:\/\/www.unipi.it\/wp-content\/uploads\/mani1.jpeg 900w, https:\/\/www.unipi.it\/wp-content\/uploads\/mani1-300x200.jpeg 300w, https:\/\/www.unipi.it\/wp-content\/uploads\/mani1-768x512.jpeg 768w\" sizes=\"(max-width: 900px) 100vw, 900px\" \/><\/p>\n<p>\u201cThe device provides <strong>tactile feedback through vibration<\/strong>,\u201d says <strong>Matteo Bianchi<\/strong>, Professor of Robotics at the University of Pisa, \u201c<strong>improving spatial awareness and immersion during surgical training or preoperative planning<\/strong>. The absence of tactile feedback is in fact a significant limitation of virtual and extended reality training systems for surgery because, in common clinical practice, medical staff are largely guided by what they feel with their hands as well as by what they see. This aspect is particularly important when dealing with delicate and hidden anatomical structures. Our results show that tactile feedback significantly improves accuracy and efficiency in fracture fragment reduction tasks in virtual and extended reality contexts. Therefore, the integration of vision and touch will be fundamental in future augmented reality-based surgical training and assistance systems.\u201d<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-446471\" src=\"https:\/\/www.unipi.it\/wp-content\/uploads\/osso.jpeg\" alt=\"\" width=\"902\" height=\"600\" srcset=\"https:\/\/www.unipi.it\/wp-content\/uploads\/osso.jpeg 902w, https:\/\/www.unipi.it\/wp-content\/uploads\/osso-300x200.jpeg 300w, https:\/\/www.unipi.it\/wp-content\/uploads\/osso-768x511.jpeg 768w\" sizes=\"(max-width: 902px) 100vw, 902px\" \/><\/p>\n<p>Research into the medicine of the future is being conducted at the Centre 5.0 of the Department of Information Engineering. This centre is dedicated to developing technologies for society, medicine and next-generation industry. It is working in collaboration with the EndoCAS Centre for computer-assisted surgery, the \u201cE. Piaggio\u201d Research Centre, and the School of Specialisation in Orthopaedics and Traumatology at the University of Pisa.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Integrating vision and tactile stimuli for reconstructing complex fractures improves spatial awareness and immersion during surgical training <\/p>\n","protected":false},"featured_media":446466,"menu_order":4,"template":"","format":"standard","meta":[],"tag-notizie-persone":[2832],"tags_news":[1224],"categorie":[159],"class_list":["post-447793","news","type-news","status-publish","format-standard","has-post-thumbnail","hentry","tag-notizie-persone-vincenzo-ferrari","tags_news-department-of-information-engineering","categorie-unipinews-en"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Feeling with your hands: research into augmented reality applied to surgery ~ UNIPI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Feeling with your hands: research into augmented reality applied to surgery ~ UNIPI\" \/>\n<meta property=\"og:description\" content=\"Integrating vision and tactile stimuli for reconstructing complex fractures improves spatial awareness and immersion during surgical training\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/\" \/>\n<meta property=\"og:site_name\" content=\"UNIPI\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/unipisaofficial\/\" \/>\n<meta property=\"article:modified_time\" content=\"2026-03-04T15:14:38+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.unipi.it\/wp-content\/uploads\/mani.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"900\" \/>\n\t<meta property=\"og:image:height\" content=\"600\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/\",\"url\":\"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/\",\"name\":\"Feeling with your hands: research into augmented reality applied to surgery ~ UNIPI\",\"isPartOf\":{\"@id\":\"https:\/\/www.unipi.it\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.unipi.it\/wp-content\/uploads\/mani.jpg\",\"datePublished\":\"2026-02-24T09:37:44+00:00\",\"dateModified\":\"2026-03-04T15:14:38+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/#primaryimage\",\"url\":\"https:\/\/www.unipi.it\/wp-content\/uploads\/mani.jpg\",\"contentUrl\":\"https:\/\/www.unipi.it\/wp-content\/uploads\/mani.jpg\",\"width\":900,\"height\":600},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\",\"item\":\"https:\/\/www.unipi.it\/en\/home\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"News\",\"item\":\"https:\/\/www.unipi.it\/en\/news\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Feeling with your hands: research into augmented reality applied to surgery\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.unipi.it\/en\/#website\",\"url\":\"https:\/\/www.unipi.it\/en\/\",\"name\":\"UNIPI\",\"description\":\"UNIPI\",\"publisher\":{\"@id\":\"https:\/\/www.unipi.it\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.unipi.it\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.unipi.it\/en\/#organization\",\"name\":\"UNIPI\",\"url\":\"https:\/\/www.unipi.it\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.unipi.it\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.unipi.it\/wp-content\/uploads\/Raggruppa-3020.svg\",\"contentUrl\":\"https:\/\/www.unipi.it\/wp-content\/uploads\/Raggruppa-3020.svg\",\"width\":176,\"height\":64,\"caption\":\"UNIPI\"},\"image\":{\"@id\":\"https:\/\/www.unipi.it\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/unipisaofficial\/\",\"https:\/\/www.instagram.com\/unipisa\/\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Feeling with your hands: research into augmented reality applied to surgery ~ UNIPI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/","og_locale":"en_US","og_type":"article","og_title":"Feeling with your hands: research into augmented reality applied to surgery ~ UNIPI","og_description":"Integrating vision and tactile stimuli for reconstructing complex fractures improves spatial awareness and immersion during surgical training","og_url":"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/","og_site_name":"UNIPI","article_publisher":"https:\/\/www.facebook.com\/unipisaofficial\/","article_modified_time":"2026-03-04T15:14:38+00:00","og_image":[{"width":900,"height":600,"url":"https:\/\/www.unipi.it\/wp-content\/uploads\/mani.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/","url":"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/","name":"Feeling with your hands: research into augmented reality applied to surgery ~ UNIPI","isPartOf":{"@id":"https:\/\/www.unipi.it\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/#primaryimage"},"image":{"@id":"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/#primaryimage"},"thumbnailUrl":"https:\/\/www.unipi.it\/wp-content\/uploads\/mani.jpg","datePublished":"2026-02-24T09:37:44+00:00","dateModified":"2026-03-04T15:14:38+00:00","breadcrumb":{"@id":"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/#primaryimage","url":"https:\/\/www.unipi.it\/wp-content\/uploads\/mani.jpg","contentUrl":"https:\/\/www.unipi.it\/wp-content\/uploads\/mani.jpg","width":900,"height":600},{"@type":"BreadcrumbList","@id":"https:\/\/www.unipi.it\/en\/news\/feeling-with-your-hands-research-into-augmented-reality-applied-to-surgery\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"","item":"https:\/\/www.unipi.it\/en\/home\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/www.unipi.it\/en\/news\/"},{"@type":"ListItem","position":3,"name":"Feeling with your hands: research into augmented reality applied to surgery"}]},{"@type":"WebSite","@id":"https:\/\/www.unipi.it\/en\/#website","url":"https:\/\/www.unipi.it\/en\/","name":"UNIPI","description":"UNIPI","publisher":{"@id":"https:\/\/www.unipi.it\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.unipi.it\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.unipi.it\/en\/#organization","name":"UNIPI","url":"https:\/\/www.unipi.it\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.unipi.it\/en\/#\/schema\/logo\/image\/","url":"https:\/\/www.unipi.it\/wp-content\/uploads\/Raggruppa-3020.svg","contentUrl":"https:\/\/www.unipi.it\/wp-content\/uploads\/Raggruppa-3020.svg","width":176,"height":64,"caption":"UNIPI"},"image":{"@id":"https:\/\/www.unipi.it\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/unipisaofficial\/","https:\/\/www.instagram.com\/unipisa\/"]}]}},"_links":{"self":[{"href":"https:\/\/www.unipi.it\/en\/wp-json\/wp\/v2\/news\/447793","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.unipi.it\/en\/wp-json\/wp\/v2\/news"}],"about":[{"href":"https:\/\/www.unipi.it\/en\/wp-json\/wp\/v2\/types\/news"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.unipi.it\/en\/wp-json\/wp\/v2\/media\/446466"}],"wp:attachment":[{"href":"https:\/\/www.unipi.it\/en\/wp-json\/wp\/v2\/media?parent=447793"}],"wp:term":[{"taxonomy":"tag-notizie-persone","embeddable":true,"href":"https:\/\/www.unipi.it\/en\/wp-json\/wp\/v2\/tag-notizie-persone?post=447793"},{"taxonomy":"tags_news","embeddable":true,"href":"https:\/\/www.unipi.it\/en\/wp-json\/wp\/v2\/tags_news?post=447793"},{"taxonomy":"categorie","embeddable":true,"href":"https:\/\/www.unipi.it\/en\/wp-json\/wp\/v2\/categorie?post=447793"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}