User-dependent interactive light field video streaming system

Wang, Bing;Peng, Qiang;Wang, Eric;Xiang, Wei;Wu, Xiao

Abstract

The sheer size and complex structure of light field (LF) videos bring new challenges to their compression and transmission. There have been numerous LF video compression algorithms reported in the literature to date. All of these algorithms compress and transmit all the views of an LF video. However, in some interactive or selective applications where users can choose the area of interest to be displayed, these algorithms generate a significant computational load and enormous data redundancies. In this paper, we propose an interaUser-dependent Interactive light field video streaming system eaming system based on a user-dependent view selection scheme and an LF video coding method, which streams only the required data. Specifically, by predicting trajectories and using projection models, the viewing area of users in a limited consecutive number of time slots is firstly calculated, and then a user-dependent view selection method is proposed to determine the selected views of users for streaming. Finally, with the novel LF video sequence formed by only the selected sets of views, an adaptive coding method is presented for different LF video sequences based on users’ gestures. Experimental results illustrate that the proposed interactive LF video streaming system can achieve the best performance compared with other comparison methods.

Journal

Multimedia Tools and Applications

Publication Name

N/A

Volume

ISBN/ISSN

1573-7721

Edition

N/A

Issue

N/A

Pages Count

Location

N/A

Publisher

Springer

Publisher Url

N/A

Publisher Location

N/A

Publish Date

N/A

Url

N/A

Date

N/A

EISSN

N/A

DOI

10.1007/s11042-021-11602-8