RECCE: Deep reinforcement learning for joint routing and scheduling in time-constrained wireless networks

dc.contributor.authorChilukuri, Shantien
dc.contributor.authorPesch, Dirken
dc.contributor.funderHorizon 2020en
dc.contributor.funderScience Foundation Irelanden
dc.date.accessioned2023-03-31T14:25:26Z
dc.date.available2023-03-31T14:25:26Z
dc.date.issued2021-09-22en
dc.description.abstractTime Division Multiple Access-based Medium Access Control protocols tend to be the choice for wireless networks that require deterministic delay guarantees, as is the case in many Industrial Internet of Things (IIoT) applications. As the optimal joint scheduling and routing problem for multi-hop wireless networks is NP-hard, heuristics are generally used for building schedules. However, heuristics normally result in sub-optimal schedules, which may result in packets missing their deadlines. In this paper, we present RECCE, a deep REinforcement learning method for joint routing and sCheduling in time-ConstrainEd networks with centralised control. During training, RECCE considers multiple routes and criteria for scheduling in any given time slot and channel in a multi-channel, multi-hop wireless network. This allows RECCE to explore and learn routes and schedules to deliver more packets within the deadline. Simulation results show that RECCE can reduce the number of packets missing the deadline by as much as 55% and increase schedulability by up to 30%, both relative to the best baseline heuristic. RECCE can deal well with dynamic network conditions, performing better than the best baseline heuristic in up to 74% of the scenarios in the training set and in up to 64% of scenarios not in the training set.en
dc.description.statusPeer revieweden
dc.description.versionPublished Versionen
dc.format.mimetypeapplication/pdfen
dc.identifier.citationChilukuri, S. and Pesch, D. (2021) 'RECCE: Deep reinforcement learning for joint routing and scheduling in time-constrained wireless networks', IEEE Access, 9, pp. 132053-132063. doi: 10.1109/ACCESS.2021.3114967.en
dc.identifier.doi10.1109/access.2021.3114967en
dc.identifier.eissn2169-3536en
dc.identifier.endpage132063en
dc.identifier.journaltitleIEEE Accessen
dc.identifier.startpage132053en
dc.identifier.urihttps://hdl.handle.net/10468/14349
dc.identifier.volume9en
dc.language.isoenen
dc.publisherInstitute of Electrical and Electronics Engineers (IEEE)en
dc.relation.projectinfo:eu-repo/grantAgreement/EC/H2020::MSCA-COFUND-FP/713567/EU/Cutting Edge Training - Cutting Edge Technology/EDGEen
dc.relation.projectinfo:eu-repo/grantAgreement/SFI/SFI Research Centres/13/RC/2077/IE/CONNECT: The Centre for Future Networks & Communications/en
dc.relation.projectinfo:eu-repo/grantAgreement/SFI/SFI Spokes Programme::Fixed Call/16/SP/3804/IE/ENABLE: Connecting communities to smart urban environments through the Internet of Things/en
dc.rights© 2021, the Authors. This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0en
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/en
dc.subjectRouting and schedulingen
dc.subjectMultihop networksen
dc.subjectDeep reinforcement learningen
dc.subjectTime constraintsen
dc.subjectIIoTen
dc.titleRECCE: Deep reinforcement learning for joint routing and scheduling in time-constrained wireless networksen
dc.typeArticle (peer-reviewed)en
oaire.citation.volume9en
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
RECCE_Deep_Reinforcement_Learning_for_Joint_Routing_and_Scheduling_in_Time-Constrained_Wireless_Networks.pdf
Size:
4.93 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
2.71 KB
Format:
Item-specific license agreed upon to submission
Description: