A dual-scale transformer-based remaining useful life prediction model in industrial Internet of Things

Li, J., Wang, K., Hou, X., Lan, D., Wu, Y., Wang, H., Liu, L. and Mumtaz, S. ORCID: 0000-0001-6364-6149, 2024. A dual-scale transformer-based remaining useful life prediction model in industrial Internet of Things. IEEE Internet of Things Journal. ISSN 2327-4662

[img]
Preview
Text
1877636_Mumtaz.pdf - Post-print

Download (5MB) | Preview

Abstract

With recent advents of industrial Internet of Things (IIoT), the connectivity and data collection capabilities of industrial equipment have be significantly enhanced, yet bringing new challenges for the remaining useful life (RUL) prediction. To fulfill the RUL predicting demand in multivariate time series, this work proposes an encoder-decoder model termed as dual-scale transformer model (DSFormer), built upon the Transformer architecture. First, in the encoder part, a dual-attention module is designed for the weight feature extraction from both dimensions of the sensor and time series, aiming to compensate for the diverse impacts of different sensors on the prediction. Next, a temporal convolutional network (TCN) module is introduced to capture sequence features and alleviate the loss of positional information incurred by stacking blocks. Then, the feature decomposition module is integrated into the decoder for trend feature extraction from sequences, providing the model with additional sequence information. Finally, compared to existing models, the proposed method can obtain the superior performance in terms of the root mean square error (RMSE) and Score metrics on the FD001, FD002 and FD003 subsets of the C-MAPSS dataset, with an average improvement of 3.2% and 2.5% respectively. In particular, the ablation experiment further validates the effectiveness of proposed modules in handling multivariate time series and extracting features.

Item Type: Journal article
Publication Title: IEEE Internet of Things Journal
Creators: Li, J., Wang, K., Hou, X., Lan, D., Wu, Y., Wang, H., Liu, L. and Mumtaz, S.
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Date: 18 March 2024
ISSN: 2327-4662
Identifiers:
NumberType
10.1109/jiot.2024.3376706DOI
1877636Other
Rights: © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Divisions: Schools > School of Science and Technology
Record created by: Laura Ward
Date Added: 25 Mar 2024 10:36
Last Modified: 25 Mar 2024 10:36
URI: https://irep.ntu.ac.uk/id/eprint/51147

Actions (login required)

Edit View Edit View

Views

Views per month over past year

Downloads

Downloads per month over past year