Glass-to-glass delay reduction: encoding ...
Document type :
Autre communication scientifique (congrès sans actes - poster - séminaire...): Communication dans un congrès avec actes
Title :
Glass-to-glass delay reduction: encoding rate reduction vs. video frame extrapolation
Author(s) :
Kanj, Hind [Auteur]
COMmunications NUMériques - IEMN [COMNUM - IEMN]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
Trioux, Anthony [Auteur]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
COMmunications NUMériques - IEMN [COMNUM - IEMN]
Université Polytechnique Hauts-de-France [UPHF]
Cagnazzo, Marco [Auteur]
Multimédia [MM]
Département Images, Données, Signal [IDS]
Coudoux, François-Xavier [Auteur]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
Université Polytechnique Hauts-de-France [UPHF]
COMmunications NUMériques - IEMN [COMNUM - IEMN]
Corlay, Patrick [Auteur]
Université Polytechnique Hauts-de-France [UPHF]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
COMmunications NUMériques - IEMN [COMNUM - IEMN]
Kieffer, M. [Auteur]
Laboratoire des signaux et systèmes [L2S]
COMmunications NUMériques - IEMN [COMNUM - IEMN]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
Trioux, Anthony [Auteur]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
COMmunications NUMériques - IEMN [COMNUM - IEMN]
Université Polytechnique Hauts-de-France [UPHF]
Cagnazzo, Marco [Auteur]
Multimédia [MM]
Département Images, Données, Signal [IDS]
Coudoux, François-Xavier [Auteur]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
Université Polytechnique Hauts-de-France [UPHF]
COMmunications NUMériques - IEMN [COMNUM - IEMN]
Corlay, Patrick [Auteur]
Université Polytechnique Hauts-de-France [UPHF]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
COMmunications NUMériques - IEMN [COMNUM - IEMN]
Kieffer, M. [Auteur]
Laboratoire des signaux et systèmes [L2S]
Conference title :
2023 IEEE 25th International Workshop on Multimedia Signal Processing, MMSP
Conference organizers(s) :
IEEE
City :
Poitier
Country :
France
Start date of the conference :
2023-09-27
Publisher :
IEEE
Publication date :
2023
English keyword(s) :
Extrapolation
Telepresence
Delay effects
Robot control
Streaming media
Signal processing
Encoding
Glass-to-glass delay
Low-latency video delivery
Video Frame Extrapolation
Rate reduction
Video quality
Telepresence
Delay effects
Robot control
Streaming media
Signal processing
Encoding
Glass-to-glass delay
Low-latency video delivery
Video Frame Extrapolation
Rate reduction
Video quality
HAL domain(s) :
Physique [physics]
Sciences de l'ingénieur [physics]
Sciences de l'ingénieur [physics]
English abstract : [en]
Applications such as teleoperated driving, remote robot control, and telepresence rely on video services to ensure real-time interaction with a satisfying quality of experience. Reducing the Glass-to-Glass (G2G) delay, ...
Show more >Applications such as teleoperated driving, remote robot control, and telepresence rely on video services to ensure real-time interaction with a satisfying quality of experience. Reducing the Glass-to-Glass (G2G) delay, i.e., the time delay between the acquisition of a video frame and its display on a remote terminal is critical for these applications. Deep learning-based video frame extrapolation before video encoding has been recently considered as an interesting solution to reduce G2G delay, however, the latency introduced by extrapolation has not been taken into account. In this paper, considering the main sources of latency, including extrapolation delay, we examine the benefits and limitations of frame extrapolation at encoder in reducing the G2G delay in a point-to-point video transmission system. To this end, we compare the latency-quality trade-off for two latency compensation methods: encoding rate reduction and video frame extrapolation. Our aim is to determine the G2G delay reduction that may be achieved at the price of a given quality reduction. Our experiments show that extrapolation methods can provide a null perceived G2G delay with an acceptable loss in quality, particularly for applications with video contents with limited temporal information. Such delay reduction is unreachable via encoding rate reduction.Show less >
Show more >Applications such as teleoperated driving, remote robot control, and telepresence rely on video services to ensure real-time interaction with a satisfying quality of experience. Reducing the Glass-to-Glass (G2G) delay, i.e., the time delay between the acquisition of a video frame and its display on a remote terminal is critical for these applications. Deep learning-based video frame extrapolation before video encoding has been recently considered as an interesting solution to reduce G2G delay, however, the latency introduced by extrapolation has not been taken into account. In this paper, considering the main sources of latency, including extrapolation delay, we examine the benefits and limitations of frame extrapolation at encoder in reducing the G2G delay in a point-to-point video transmission system. To this end, we compare the latency-quality trade-off for two latency compensation methods: encoding rate reduction and video frame extrapolation. Our aim is to determine the G2G delay reduction that may be achieved at the price of a given quality reduction. Our experiments show that extrapolation methods can provide a null perceived G2G delay with an acceptable loss in quality, particularly for applications with video contents with limited temporal information. Such delay reduction is unreachable via encoding rate reduction.Show less >
Language :
Français
Peer reviewed article :
Oui
Audience :
Internationale
Popular science :
Non
Source :