Pattern Matching Techniques for Replacing Missing Sections of Audio Streamed across Wireless Networks

J Doherty, K Curran, P McKevitt

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Streaming media on the Internet can be unreliable. Services such as audio-on-demand drastically increase the loads on networks; therefore, new, robust, and highly efficient coding algorithms are necessary. One method overlooked to date, which can work alongside existing audio compression schemes, is that which takes into account the semantics and natural repetition of music. Similarity detection within polyphonic audio has presented problematic challenges within the field of music information retrieval. One approach to deal with bursty errors is to use self-similarity to replace missing segments. Many existing systems exist based on packet loss and replacement on a network level, but none attempt repairs of large dropouts of 5 seconds or more. Music exhibits standard structures that can be used as a forward error correction (FEC) mechanism. FEC is an area that addresses the issue of packet loss with the onus of repair placed as much as possible on the listener’s device. We have developed a server–client-based framework (SoFI) for automatic detection and replacement of large packet losses on wireless networks when receiving time-dependent streamed audio. Whenever dropouts occur, SoFI swaps audio presented to the listener between a live stream and previous sections of the audio stored locally. Objective and subjective evaluations of SoFI where subjects were presented with other simulated approaches to audio repair together with simulations of replacements including varying lengths of time in the repair give positive results.
LanguageEnglish
Pages25:1-25:38
JournalACM Transactions on Intelligent Systems and Technology (TIST)
Volume6
Issue number2
DOIs
Publication statusPublished - May 2015

Fingerprint

Pattern matching
Pattern Matching
Repair
Wireless Networks
Wireless networks
Packet Loss
Packet loss
Replacement
Forward error correction
Drop out
Error Correction
Music
Music Information Retrieval
Streaming Media
Media streaming
Subjective Evaluation
Swap
Client/server
Self-similarity
Information retrieval

Keywords

  • Streaming media
  • forward error correction
  • audio repair
  • data compaction and compression

Cite this

@article{c80f01901ef847e69ee9157cad019f63,
title = "Pattern Matching Techniques for Replacing Missing Sections of Audio Streamed across Wireless Networks",
abstract = "Streaming media on the Internet can be unreliable. Services such as audio-on-demand drastically increase the loads on networks; therefore, new, robust, and highly efficient coding algorithms are necessary. One method overlooked to date, which can work alongside existing audio compression schemes, is that which takes into account the semantics and natural repetition of music. Similarity detection within polyphonic audio has presented problematic challenges within the field of music information retrieval. One approach to deal with bursty errors is to use self-similarity to replace missing segments. Many existing systems exist based on packet loss and replacement on a network level, but none attempt repairs of large dropouts of 5 seconds or more. Music exhibits standard structures that can be used as a forward error correction (FEC) mechanism. FEC is an area that addresses the issue of packet loss with the onus of repair placed as much as possible on the listener’s device. We have developed a server–client-based framework (SoFI) for automatic detection and replacement of large packet losses on wireless networks when receiving time-dependent streamed audio. Whenever dropouts occur, SoFI swaps audio presented to the listener between a live stream and previous sections of the audio stored locally. Objective and subjective evaluations of SoFI where subjects were presented with other simulated approaches to audio repair together with simulations of replacements including varying lengths of time in the repair give positive results.",
keywords = "Streaming media, forward error correction, audio repair, data compaction and compression",
author = "J Doherty and K Curran and P McKevitt",
year = "2015",
month = "5",
doi = "10.1145/2663358",
language = "English",
volume = "6",
pages = "25:1--25:38",
journal = "ACM Transactions on Intelligent Systems and Technology",
issn = "2157-6904",
number = "2",

}

Pattern Matching Techniques for Replacing Missing Sections of Audio Streamed across Wireless Networks. / Doherty, J; Curran, K; McKevitt, P.

In: ACM Transactions on Intelligent Systems and Technology (TIST), Vol. 6, No. 2, 05.2015, p. 25:1-25:38.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Pattern Matching Techniques for Replacing Missing Sections of Audio Streamed across Wireless Networks

AU - Doherty, J

AU - Curran, K

AU - McKevitt, P

PY - 2015/5

Y1 - 2015/5

N2 - Streaming media on the Internet can be unreliable. Services such as audio-on-demand drastically increase the loads on networks; therefore, new, robust, and highly efficient coding algorithms are necessary. One method overlooked to date, which can work alongside existing audio compression schemes, is that which takes into account the semantics and natural repetition of music. Similarity detection within polyphonic audio has presented problematic challenges within the field of music information retrieval. One approach to deal with bursty errors is to use self-similarity to replace missing segments. Many existing systems exist based on packet loss and replacement on a network level, but none attempt repairs of large dropouts of 5 seconds or more. Music exhibits standard structures that can be used as a forward error correction (FEC) mechanism. FEC is an area that addresses the issue of packet loss with the onus of repair placed as much as possible on the listener’s device. We have developed a server–client-based framework (SoFI) for automatic detection and replacement of large packet losses on wireless networks when receiving time-dependent streamed audio. Whenever dropouts occur, SoFI swaps audio presented to the listener between a live stream and previous sections of the audio stored locally. Objective and subjective evaluations of SoFI where subjects were presented with other simulated approaches to audio repair together with simulations of replacements including varying lengths of time in the repair give positive results.

AB - Streaming media on the Internet can be unreliable. Services such as audio-on-demand drastically increase the loads on networks; therefore, new, robust, and highly efficient coding algorithms are necessary. One method overlooked to date, which can work alongside existing audio compression schemes, is that which takes into account the semantics and natural repetition of music. Similarity detection within polyphonic audio has presented problematic challenges within the field of music information retrieval. One approach to deal with bursty errors is to use self-similarity to replace missing segments. Many existing systems exist based on packet loss and replacement on a network level, but none attempt repairs of large dropouts of 5 seconds or more. Music exhibits standard structures that can be used as a forward error correction (FEC) mechanism. FEC is an area that addresses the issue of packet loss with the onus of repair placed as much as possible on the listener’s device. We have developed a server–client-based framework (SoFI) for automatic detection and replacement of large packet losses on wireless networks when receiving time-dependent streamed audio. Whenever dropouts occur, SoFI swaps audio presented to the listener between a live stream and previous sections of the audio stored locally. Objective and subjective evaluations of SoFI where subjects were presented with other simulated approaches to audio repair together with simulations of replacements including varying lengths of time in the repair give positive results.

KW - Streaming media

KW - forward error correction

KW - audio repair

KW - data compaction and compression

U2 - 10.1145/2663358

DO - 10.1145/2663358

M3 - Article

VL - 6

SP - 25:1-25:38

JO - ACM Transactions on Intelligent Systems and Technology

T2 - ACM Transactions on Intelligent Systems and Technology

JF - ACM Transactions on Intelligent Systems and Technology

SN - 2157-6904

IS - 2

ER -