Recent technological developments are changing how people experience physical and virtual environments. Technologies like Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), today, are impacting daily life and are being used in various domains including Cultural Heritage. Applying intelligence to applications using these technologies, through AI and Deep Learning can provide a more immersive user experience. In this paper, we propose the design of a system that realize an avatar with question-answering capabilities, for the specific purpose of giving help in immersive navigation of cultural heritage sites. It is based on a BERT model tailored to the Italian language and will use the Unity platform for the implementation. The system in its current state works as a prototype and will be used soon inside virtual tours of Sicilian Cultural Heritage sites.

Farella, M., Chiazzese, G., Lo Bosco, G. (2022). Question Answering with BERT: designing a 3D virtual avatar for Cultural Heritage exploration. In IEEE Melecon 2022 proceedings (pp. 770-774) [10.1109/MELECON53508.2022.9843028].

Question Answering with BERT: designing a 3D virtual avatar for Cultural Heritage exploration

Farella, Mariella;Chiazzese, Giuseppe;Lo Bosco, Giosue
2022-08-03

Abstract

Recent technological developments are changing how people experience physical and virtual environments. Technologies like Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), today, are impacting daily life and are being used in various domains including Cultural Heritage. Applying intelligence to applications using these technologies, through AI and Deep Learning can provide a more immersive user experience. In this paper, we propose the design of a system that realize an avatar with question-answering capabilities, for the specific purpose of giving help in immersive navigation of cultural heritage sites. It is based on a BERT model tailored to the Italian language and will use the Unity platform for the implementation. The system in its current state works as a prototype and will be used soon inside virtual tours of Sicilian Cultural Heritage sites.
3-ago-2022
Settore INF/01 - Informatica
978-1-6654-4280-0
Farella, M., Chiazzese, G., Lo Bosco, G. (2022). Question Answering with BERT: designing a 3D virtual avatar for Cultural Heritage exploration. In IEEE Melecon 2022 proceedings (pp. 770-774) [10.1109/MELECON53508.2022.9843028].
File in questo prodotto:
File Dimensione Formato  
Question_Answering_with_BERT_designing_a_3D_virtual_avatar_for_Cultural_Heritage_exploration.pdf

Solo gestori archvio

Tipologia: Versione Editoriale
Dimensione 459.4 kB
Formato Adobe PDF
459.4 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10447/566382
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 2
social impact