A Self-Similarity Approach to Repairing Large Dropouts of Streamed Music

Jonathan Doherty, Kevin Curran, Paul McKevitt

Research output: Contribution to journalArticle

Abstract

Enjoyment of audio has now become about flexibility and personal freedom. Digital audio content can be acquired from many sources and wireless networking allows digital media devices and associated peripherals to be unencumbered by wires. However, despite recent improvements in capacity and quality of service, wireless networks are inherently unreliable communications channels for the streaming of audio, being susceptible to the effects of range, interference and occlusion. This time-varying reliability of wireless audio transfer introduces data corruption and loss, with unpleasant audible effects that can be profound and prolonged in duration. Traditional communications techniques for error mitigation perform poorly and in a bandwidth-inefficient manner in the presence of such large-scale defects in a digital audio stream. A novel solution that can complement existing techniques takes account of the semantics and natural repetition of music. Through the use of self-similarity meta-data, missing or damaged audio segments can be seamlessly replaced with similar undamaged segments that have already been successfully received. We propose a technology to generate relevant self-similarity meta-data for arbitrary audio material and to utilise this meta-data within a wireless audio receiver to provide sophisticated and real-time correction of large-scale errors. The primary objectives are to match the current section of a song being received with previous sections whilst identifying incomplete sections and determining replacements based on previously received portions of the song. This paper outlines our approach to Forward Error Correction (FEC) technology that is used to ’repair’ a bursty dropout when listening to time-dependent media on a wireless network. Using self-similarity analysis on a music file, we can ’automatically’ repair the dropout with a similar portion of the music already received thereby minimising a listeners discomfort.
LanguageEnglish
Pages20-40
JournalACM Transactions on Multimedia Computing, Communications, and Applications
Volume9
Issue number3
DOIs
Publication statusPublished - 1 Jun 2013

Fingerprint

Metadata
Wireless networks
Repair
Computer peripheral equipment
Digital storage
Forward error correction
Data transfer
Quality of service
Semantics
Wire
Bandwidth
Defects
Communication

Cite this

@article{93f62c202ed1474bad59bee4455f1f33,
title = "A Self-Similarity Approach to Repairing Large Dropouts of Streamed Music",
abstract = "Enjoyment of audio has now become about flexibility and personal freedom. Digital audio content can be acquired from many sources and wireless networking allows digital media devices and associated peripherals to be unencumbered by wires. However, despite recent improvements in capacity and quality of service, wireless networks are inherently unreliable communications channels for the streaming of audio, being susceptible to the effects of range, interference and occlusion. This time-varying reliability of wireless audio transfer introduces data corruption and loss, with unpleasant audible effects that can be profound and prolonged in duration. Traditional communications techniques for error mitigation perform poorly and in a bandwidth-inefficient manner in the presence of such large-scale defects in a digital audio stream. A novel solution that can complement existing techniques takes account of the semantics and natural repetition of music. Through the use of self-similarity meta-data, missing or damaged audio segments can be seamlessly replaced with similar undamaged segments that have already been successfully received. We propose a technology to generate relevant self-similarity meta-data for arbitrary audio material and to utilise this meta-data within a wireless audio receiver to provide sophisticated and real-time correction of large-scale errors. The primary objectives are to match the current section of a song being received with previous sections whilst identifying incomplete sections and determining replacements based on previously received portions of the song. This paper outlines our approach to Forward Error Correction (FEC) technology that is used to ’repair’ a bursty dropout when listening to time-dependent media on a wireless network. Using self-similarity analysis on a music file, we can ’automatically’ repair the dropout with a similar portion of the music already received thereby minimising a listeners discomfort.",
author = "Jonathan Doherty and Kevin Curran and Paul McKevitt",
year = "2013",
month = "6",
day = "1",
doi = "10.1145/2487268.2487273",
language = "English",
volume = "9",
pages = "20--40",
journal = "ACM Transactions on Multimedia Computing, Communications and Applications",
issn = "1551-6857",
number = "3",

}

A Self-Similarity Approach to Repairing Large Dropouts of Streamed Music. / Doherty, Jonathan; Curran, Kevin; McKevitt, Paul.

In: ACM Transactions on Multimedia Computing, Communications, and Applications, Vol. 9, No. 3, 01.06.2013, p. 20-40.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A Self-Similarity Approach to Repairing Large Dropouts of Streamed Music

AU - Doherty, Jonathan

AU - Curran, Kevin

AU - McKevitt, Paul

PY - 2013/6/1

Y1 - 2013/6/1

N2 - Enjoyment of audio has now become about flexibility and personal freedom. Digital audio content can be acquired from many sources and wireless networking allows digital media devices and associated peripherals to be unencumbered by wires. However, despite recent improvements in capacity and quality of service, wireless networks are inherently unreliable communications channels for the streaming of audio, being susceptible to the effects of range, interference and occlusion. This time-varying reliability of wireless audio transfer introduces data corruption and loss, with unpleasant audible effects that can be profound and prolonged in duration. Traditional communications techniques for error mitigation perform poorly and in a bandwidth-inefficient manner in the presence of such large-scale defects in a digital audio stream. A novel solution that can complement existing techniques takes account of the semantics and natural repetition of music. Through the use of self-similarity meta-data, missing or damaged audio segments can be seamlessly replaced with similar undamaged segments that have already been successfully received. We propose a technology to generate relevant self-similarity meta-data for arbitrary audio material and to utilise this meta-data within a wireless audio receiver to provide sophisticated and real-time correction of large-scale errors. The primary objectives are to match the current section of a song being received with previous sections whilst identifying incomplete sections and determining replacements based on previously received portions of the song. This paper outlines our approach to Forward Error Correction (FEC) technology that is used to ’repair’ a bursty dropout when listening to time-dependent media on a wireless network. Using self-similarity analysis on a music file, we can ’automatically’ repair the dropout with a similar portion of the music already received thereby minimising a listeners discomfort.

AB - Enjoyment of audio has now become about flexibility and personal freedom. Digital audio content can be acquired from many sources and wireless networking allows digital media devices and associated peripherals to be unencumbered by wires. However, despite recent improvements in capacity and quality of service, wireless networks are inherently unreliable communications channels for the streaming of audio, being susceptible to the effects of range, interference and occlusion. This time-varying reliability of wireless audio transfer introduces data corruption and loss, with unpleasant audible effects that can be profound and prolonged in duration. Traditional communications techniques for error mitigation perform poorly and in a bandwidth-inefficient manner in the presence of such large-scale defects in a digital audio stream. A novel solution that can complement existing techniques takes account of the semantics and natural repetition of music. Through the use of self-similarity meta-data, missing or damaged audio segments can be seamlessly replaced with similar undamaged segments that have already been successfully received. We propose a technology to generate relevant self-similarity meta-data for arbitrary audio material and to utilise this meta-data within a wireless audio receiver to provide sophisticated and real-time correction of large-scale errors. The primary objectives are to match the current section of a song being received with previous sections whilst identifying incomplete sections and determining replacements based on previously received portions of the song. This paper outlines our approach to Forward Error Correction (FEC) technology that is used to ’repair’ a bursty dropout when listening to time-dependent media on a wireless network. Using self-similarity analysis on a music file, we can ’automatically’ repair the dropout with a similar portion of the music already received thereby minimising a listeners discomfort.

U2 - 10.1145/2487268.2487273

DO - 10.1145/2487268.2487273

M3 - Article

VL - 9

SP - 20

EP - 40

JO - ACM Transactions on Multimedia Computing, Communications and Applications

T2 - ACM Transactions on Multimedia Computing, Communications and Applications

JF - ACM Transactions on Multimedia Computing, Communications and Applications

SN - 1551-6857

IS - 3

ER -