Closing the gap: human factors in cross-device media synchronization

Mu Mu, Lyndon Fawcett, Jamie Bird, Jamie Jellico, Steven Simpson, Hans Stokking, Nicholas Race

Research output: Contribution to journalArticleResearch

Abstract

The continuing growth in the mobile phone arena, particularly in terms of device capabilities and ownership is having a transformational impact on media consumption. It is now possible to consider orchestrated multi-stream experiences delivered across many devices, rather than the playback of content from a single device. However, there are significant challenges in realising such a vision, particularly around the management of synchronicity between associated media streams. This is compounded by the heterogeneous nature of user devices, the networks upon which they operate, and the perceptions of users. This paper describes IMSync, an open inter-stream synchronisation framework that is QoE-aware. IMSync adopts efficient monitoring and control mechanisms, alongside a QoE perception model that has been derived from a series of subjective user experiments. Based on an observation of lag, IMSync is able to use this model of impact to determine an appropriate strategy to catch-up with playback whilst minimising the potential detrimental impacts on a users QoE. The impact model adopts a balanced approach: trading off the potential impact on QoE of initiating a re-synchronisation process compared with retaining the current levels of non-synchronicity, in order to maintain high levels of QoE. A series of experiments demonstrate the potential of the framework as a basis for enabling new, immersive media experiences.
Original languageEnglish
JournalIEEE Journal of Selected Topics in Signal Processing
Volume11
Issue number1
DOIs
Publication statusPublished - 12 Dec 2016

Fingerprint

Human engineering
Synchronization
Mobile phones
Experiments
Monitoring

Keywords

  • Multimedia systems
  • human factors
  • multimedia communication

Cite this

Mu, Mu ; Fawcett, Lyndon ; Bird, Jamie ; Jellico, Jamie ; Simpson, Steven ; Stokking, Hans ; Race, Nicholas. / Closing the gap: human factors in cross-device media synchronization. In: IEEE Journal of Selected Topics in Signal Processing. 2016 ; Vol. 11, No. 1.
@article{f9cc0804ecdc4672a98a0c987bc9299e,
title = "Closing the gap: human factors in cross-device media synchronization",
abstract = "The continuing growth in the mobile phone arena, particularly in terms of device capabilities and ownership is having a transformational impact on media consumption. It is now possible to consider orchestrated multi-stream experiences delivered across many devices, rather than the playback of content from a single device. However, there are significant challenges in realising such a vision, particularly around the management of synchronicity between associated media streams. This is compounded by the heterogeneous nature of user devices, the networks upon which they operate, and the perceptions of users. This paper describes IMSync, an open inter-stream synchronisation framework that is QoE-aware. IMSync adopts efficient monitoring and control mechanisms, alongside a QoE perception model that has been derived from a series of subjective user experiments. Based on an observation of lag, IMSync is able to use this model of impact to determine an appropriate strategy to catch-up with playback whilst minimising the potential detrimental impacts on a users QoE. The impact model adopts a balanced approach: trading off the potential impact on QoE of initiating a re-synchronisation process compared with retaining the current levels of non-synchronicity, in order to maintain high levels of QoE. A series of experiments demonstrate the potential of the framework as a basis for enabling new, immersive media experiences.",
keywords = "Multimedia systems, human factors, multimedia communication",
author = "Mu Mu and Lyndon Fawcett and Jamie Bird and Jamie Jellico and Steven Simpson and Hans Stokking and Nicholas Race",
year = "2016",
month = "12",
day = "12",
doi = "10.1109/JSTSP.2016.2638358",
language = "English",
volume = "11",
journal = "IEEE Journal of Selected Topics in Signal Processing",
issn = "1932-4553",
publisher = "Institute of Electrical and Electronics Engineers",
number = "1",

}

Closing the gap: human factors in cross-device media synchronization. / Mu, Mu; Fawcett, Lyndon; Bird, Jamie; Jellico, Jamie; Simpson, Steven; Stokking, Hans; Race, Nicholas.

In: IEEE Journal of Selected Topics in Signal Processing, Vol. 11, No. 1, 12.12.2016.

Research output: Contribution to journalArticleResearch

TY - JOUR

T1 - Closing the gap: human factors in cross-device media synchronization

AU - Mu, Mu

AU - Fawcett, Lyndon

AU - Bird, Jamie

AU - Jellico, Jamie

AU - Simpson, Steven

AU - Stokking, Hans

AU - Race, Nicholas

PY - 2016/12/12

Y1 - 2016/12/12

N2 - The continuing growth in the mobile phone arena, particularly in terms of device capabilities and ownership is having a transformational impact on media consumption. It is now possible to consider orchestrated multi-stream experiences delivered across many devices, rather than the playback of content from a single device. However, there are significant challenges in realising such a vision, particularly around the management of synchronicity between associated media streams. This is compounded by the heterogeneous nature of user devices, the networks upon which they operate, and the perceptions of users. This paper describes IMSync, an open inter-stream synchronisation framework that is QoE-aware. IMSync adopts efficient monitoring and control mechanisms, alongside a QoE perception model that has been derived from a series of subjective user experiments. Based on an observation of lag, IMSync is able to use this model of impact to determine an appropriate strategy to catch-up with playback whilst minimising the potential detrimental impacts on a users QoE. The impact model adopts a balanced approach: trading off the potential impact on QoE of initiating a re-synchronisation process compared with retaining the current levels of non-synchronicity, in order to maintain high levels of QoE. A series of experiments demonstrate the potential of the framework as a basis for enabling new, immersive media experiences.

AB - The continuing growth in the mobile phone arena, particularly in terms of device capabilities and ownership is having a transformational impact on media consumption. It is now possible to consider orchestrated multi-stream experiences delivered across many devices, rather than the playback of content from a single device. However, there are significant challenges in realising such a vision, particularly around the management of synchronicity between associated media streams. This is compounded by the heterogeneous nature of user devices, the networks upon which they operate, and the perceptions of users. This paper describes IMSync, an open inter-stream synchronisation framework that is QoE-aware. IMSync adopts efficient monitoring and control mechanisms, alongside a QoE perception model that has been derived from a series of subjective user experiments. Based on an observation of lag, IMSync is able to use this model of impact to determine an appropriate strategy to catch-up with playback whilst minimising the potential detrimental impacts on a users QoE. The impact model adopts a balanced approach: trading off the potential impact on QoE of initiating a re-synchronisation process compared with retaining the current levels of non-synchronicity, in order to maintain high levels of QoE. A series of experiments demonstrate the potential of the framework as a basis for enabling new, immersive media experiences.

KW - Multimedia systems

KW - human factors

KW - multimedia communication

UR - http://signalprocessingsociety.org/publications-resources/ieee-journal-selected-topics-signal-processing

U2 - 10.1109/JSTSP.2016.2638358

DO - 10.1109/JSTSP.2016.2638358

M3 - Article

VL - 11

JO - IEEE Journal of Selected Topics in Signal Processing

JF - IEEE Journal of Selected Topics in Signal Processing

SN - 1932-4553

IS - 1

ER -