The Multi-Recurrent Neural Network for State-Of-The-Art Time-Series Processing

Oluwatamilore Orojo, Jonathan Tepper, T.M. McGinnity, Mufti Mahmud

Research output: Contribution to journalArticlepeer-review

49 Downloads (Pure)

Abstract

Innovations in recurrent neural networks (RNNs) for time-series modelling has enabled effective prediction of sequence data prevalent in real-world dynamic processes. For example, problem domains such as speech and language modelling, weather prediction, financial forecasting and patient healthcare monitoring have all significantly benefited from developments in RNNs over the last 20 years. Today's vast availability of data has enabled models to learn from higher quality historical information, identify loopholes, and better understand and contextualise evolving information in real-time. This is arguably extremely important as access to fast reliable predictive information empowers decision makers to prepare for and effectively respond to future opportunities or crises. Also, the simpler the forecasting model, the more amenable it is to residing on multiple mobile platforms improving accessibility of predictive power. Given this, we comparatively assess the importance of the Multi-recurrent Neural Network (MRN) with a single hidden layer against current state-of-the-art models using a range of real-world problem domains from oil price prediction to predicting the spread and mortality rate of COVID-19. We find strong evidence that the simple and shallow MRN consistently offers superior performance over the Long Short-term Memory model (LSTM), the current state-of-the-art RNN and Support Vector Machines (SVM), a more traditional statistical approach. The MRN required much fewer adjustable parameters than the LSTM to learn the task and generalise competitively. This suggests that the simpler architecture offers significant value with respect to computational resources and effective predictive abilities for real-world applications which is particularly useful given the current ubiquitous shift towards the use of Internet of Things devices.
Original languageEnglish
Pages (from-to)488-498
Number of pages11
JournalProcedia Computer Science
Volume222
Early online date31 Aug 2023
DOIs
Publication statusPublished (in print/issue) - 31 Aug 2023

Bibliographical note

Funding Information:
The authors thank Nottingham Trent University for supporting this research with the Vice Chancellor Scholarship.

Publisher Copyright:
© 2023 The Authors. Published by Elsevier B.V.

Keywords

  • Time-series modelling
  • Predictive analysis
  • Multi-Recurrent Network
  • MRN

Fingerprint

Dive into the research topics of 'The Multi-Recurrent Neural Network for State-Of-The-Art Time-Series Processing'. Together they form a unique fingerprint.

Cite this