Multiview video streaming continues to gain popu- larity due to the great viewing experience it offers, as well as its availability which has been enabled by increased network throughput and other recent technical developments. User de- mand for interactive multiview video streaming that provides seamless view switching upon request is also increasing. However, it is a highly challenging task to stream stable and high quality videos that allow real time scene navigation within the bandwidth constraint. In this paper a convolutional neural network (ConvNet) assisted seamless multiview video streaming system is proposed to tackle the challenge. The proposed method solves the problem from two perspectives: first, a ConvNet assisted multiview representation method is proposed, which provides flexible interactivity without compromising on multiview video compression efficiency. Second, a bit allocation mechanism guided by a navigation model is developed to provide seamless navigation and adapt to network bandwidth fluctuations at the same time. These two blocks work closely to provide an optimized viewing experience to users. They can be integrated into any existing multiview video streaming framework to enhance overall performance. Experimental results demonstrate the effectiveness of the proposed method for seamless multiview streaming.

Convolutional Neural Network for Intermediate View Enhancement in Multiview Streaming

GRANGETTO, Marco
2018-01-01

Abstract

Multiview video streaming continues to gain popu- larity due to the great viewing experience it offers, as well as its availability which has been enabled by increased network throughput and other recent technical developments. User de- mand for interactive multiview video streaming that provides seamless view switching upon request is also increasing. However, it is a highly challenging task to stream stable and high quality videos that allow real time scene navigation within the bandwidth constraint. In this paper a convolutional neural network (ConvNet) assisted seamless multiview video streaming system is proposed to tackle the challenge. The proposed method solves the problem from two perspectives: first, a ConvNet assisted multiview representation method is proposed, which provides flexible interactivity without compromising on multiview video compression efficiency. Second, a bit allocation mechanism guided by a navigation model is developed to provide seamless navigation and adapt to network bandwidth fluctuations at the same time. These two blocks work closely to provide an optimized viewing experience to users. They can be integrated into any existing multiview video streaming framework to enhance overall performance. Experimental results demonstrate the effectiveness of the proposed method for seamless multiview streaming.
2018
20
1
15
28
http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=7981388
Multiview video streaming, Multiview navi- gation, Multiview video representation, Convolutional neural network.
Yu, Li; Tillo, Tammam; Xiao, Jimin; Grangetto, Marco
File in questo prodotto:
File Dimensione Formato  
20170614-tmm_4aperto.pdf

Accesso aperto

Tipo di file: POSTPRINT (VERSIONE FINALE DELL’AUTORE)
Dimensione 1.58 MB
Formato Adobe PDF
1.58 MB Adobe PDF Visualizza/Apri
1-07981388.pdf

Accesso riservato

Tipo di file: PDF EDITORIALE
Dimensione 2.42 MB
Formato Adobe PDF
2.42 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/1645309
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 11
  • ???jsp.display-item.citation.isi??? 11
social impact