Abstract
Multi-access edge computing (MEC) and ultra-dense networking (UDN) are recognized as two promising paradigms for future mobile networks that can be utilized to improve the spectrum efficiency and the quality of computational experience (QoCE). In this paper, we study the task offloading problem in an MEC-enabled UDN architecture with the aim to minimize the task duration while satisfying the energy budget constraints. Due to the dynamics associated with the environment and parameter uncertainty, designing an optimal task offloading algorithm is highly challenging. Consequently, we propose an online task offloading algorithm based on a state-of-the-art deep reinforcement learning (DRL) technique: asynchronous advantage actor-critic (A3C). It is worthy of remark that the proposed method requires neither instantaneous channel state information (CSI) nor prior knowledge of the computational capabilities of the base stations. Simulations show that the our method is able to learn a good offloading policy to obtain a near-optimal task allocation while meeting energy budget constraints of mobile devices in the UDN environment.
- [1] . 2019. Video stream analysis in clouds: An object detection and classification framework for high performance video analytics. IEEE Transactions on Cloud Computing 7, 4 (2019), 1152–1167. Google Scholar
Cross Ref
- [2] . 2018. Task offloading for mobile edge computing in software defined ultra-dense network. IEEE Journal on Selected Areas in Communications 36, 3 (2018), 587–597. Google Scholar
Cross Ref
- [3] . 2019. Optimized computation offloading performance in virtual edge computing systems via deep reinforcement learning. IEEE Internet of Things Journal 6, 3 (2019), 4005–4018.
arxiv:1805.06146 Google ScholarCross Ref
- [4] . 2019. Multi-tenant cross-slice resource orchestration: A deep reinforcement learning approach. IEEE Journal on Selected Areas in Communications 37, 10 (2019), 2377–2392. Google Scholar
Cross Ref
- [5] . March 2020. Cisco annual internet report (2018–2023) white paper. (March 2020).Google Scholar
- [6] . 2016. Optimal workload allocation in fog-cloud computing toward balanced delay and power consumption. IEEE Internet of Things Journal 3, 6 (
Dec 2016), 1171–1181. Google ScholarCross Ref
- [7] . 2017. Offloading in mobile edge computing: Task allocation and computational frequency scaling. IEEE Transactions on Communications 65, 8 (2017), 3571–3584. Google Scholar
Cross Ref
- [8] . 2016. Mobile Edge Computing: Technical Requirements. (
Mar. 2016).Google Scholar - [9] . 2012. Neural networks for machine learning lecture 6a overview of mini-batch gradient descent. Cited on 14, 8 (2012).Google Scholar
- [10] . 2019. Deep reinforcement learning for online computation offloading in wireless powered mobile-edge computing networks. IEEE Transactions on Mobile Computing 518060 (2019), 1–1.
arxiv:1808.01977 Google ScholarCross Ref
- [11] . 2019. Joint subcarrier assignment with power allocation for sum rate maximization of D2D communications in wireless cellular networks. IEEE Transactions on Vehicular Technology 68, 5 (2019), 4748–4759. Google Scholar
Cross Ref
- [12] . 2018. Wireless networks for mobile edge computing: Spatial modeling and latency analysis. IEEE Transactions on Wireless Communications 17, 8 (
Aug. 2018), 5225–5240. Google ScholarDigital Library
- [13] . 2020. An online incentive mechanism for collaborative task offloading in mobile edge computing. IEEE Transactions on Wireless Communications 19, 1 (2020), 624–636. Google Scholar
Cross Ref
- [14] . 2019. Dynamic task offloading and resource allocation for ultra-reliable low-latency edge computing. IEEE Transactions on Communications 67, 6 (2019), 4132–4150.
arxiv:1812.08076 Google ScholarCross Ref
- [15] . 2019. Applications of deep reinforcement learning in communications and networking: A survey. IEEE Communications Surveys and Tutorials 21, 4 (2019), 3133–3174.
arxiv:1810.07862 Google ScholarDigital Library
- [16] . 2016. Dynamic computation offloading for mobile-edge computing with energy harvesting devices. IEEE Journal on Selected Areas in Communications 34, 12 (
Dec 2016), 3590–3605. Google ScholarDigital Library
- [17] . 2017. Joint task offloading scheduling and transmit power allocation for mobile-edge computing systems. In 2017 IEEE Wireless Communications and Networking Conference (WCNC). 1–6. Google Scholar
Digital Library
- [18] . 2017. Stochastic joint radio and computational resource management for multi-user mobile-edge computing systems. IEEE Transactions on Wireless Communications 16, 9 (
Sept. 2017), 5994–6009. Google ScholarDigital Library
- [19] . 2011. SP 800-145. The NIST definition of cloud computing. (2011).Google Scholar
- [20] . 2016. Asynchronous methods for deep reinforcement learning. CoRR abs/1602.01783 (2016).
arxiv:1602.01783 http://arxiv.org/abs/1602.01783.Google Scholar - [21] . 2016. D2D fogging: An energy-efficient and incentive-aware task offloading framework via network-assisted D2D collaboration. IEEE Journal on Selected Areas in Communications 34, 12 (2016), 3887–39014. Google Scholar
Digital Library
- [22] . 2018. Latency optimization for resource allocation in mobile-edge computation offloading. IEEE Transactions on Wireless Communications 17, 8 (2018), 5506–5519.
arxiv:1704.00163 Google ScholarDigital Library
- [23] . 2017. EMM: Energy-aware mobility management for mobile edge computing in ultra dense networks. IEEE Journal on Selected Areas in Communications 35, 11 (
Nov 2017), 2637–2646. Google ScholarCross Ref
- [24] . 2017. Computation offloading and resource allocation in wireless cellular networks with mobile edge computing. IEEE Transactions on Wireless Communications 16, 8 (2017), 4924–4938. Google Scholar
Digital Library
- [25] . 2020. Optimal energy allocation and task offloading policy for wireless powered mobile edge computing systems. IEEE Transactions on Wireless Communications 1276, c (2020), 1–1.
arxiv:1907.07565 Google ScholarCross Ref
- [26] . 2020. A game-based computation offloading method in vehicular multi-access edge computing networks. IEEE Internet of Things Journal (2020), 1–1. Google Scholar
Cross Ref
- [27] . 2017. Secure content delivery with edge nodes to save caching resources for mobile users in green cities. IEEE Transactions on Industrial Informatics (2017), 1–1. Google Scholar
Cross Ref
- [28] . 2020. A multi-user mobile computation offloading and transmission scheduling mechanism for delay-sensitive applications. IEEE Transactions on Mobile Computing 19, 1 (2020), 29–43. Google Scholar
Digital Library
- [29] . 2020. Mobility-aware multi-user offloading optimization for mobile edge computing. IEEE Transactions on Vehicular Technology 69, 3 (2020), 3341–3356. Google Scholar
Cross Ref
- [30] . 2020. Mobility-aware multi-user offloading optimization for mobile edge computing. IEEE Transactions on Vehicular Technology 69, 3 (2020), 1–1. Google Scholar
Cross Ref
- [31] . 2020. A deep reinforcement learning based offloading game in edge computing. IEEE Trans. Comput. 9340, c (2020), 1–14. Google Scholar
Cross Ref
- [32] . 2020. Contracts for joint downlink and uplink traffic offloading with asymmetric information. 8716, c (2020), 1–13. Google Scholar
Cross Ref
- [33] . 2017. Computing resource allocation in three-tier IoT fog networks: A joint optimization approach combining Stackelberg game and matching. IEEE Internet of Things Journal 4, 5 (
Oct 2017), 1204–1215. Google ScholarCross Ref
- [34] . 2020. Dynamic task offloading and resource allocation for mobile edge computing in dense cloud RAN. IEEE Internet of Things Journal 4662, c (2020), 1–1. Google Scholar
Cross Ref
- [35] . 2020. MDP-based task offloading for vehicular edge computing under certain and uncertain transition probabilities. IEEE Transactions on Vehicular Technology 9545, c (2020), 1–1. Google Scholar
Cross Ref
- [36] . 2019. Dynamic computation offloading for mobile cloud computing: A stochastic game-theoretic approach. IEEE Transactions on Mobile Computing 18, 4 (2019), 771–786. Google Scholar
Digital Library
Index Terms
AI-Enabled Task Offloading for Improving Quality of Computational Experience in Ultra Dense Networks
Recommendations
Task Offloading with Task Classification and Offloading Nodes Selection for MEC-Enabled IoV
The Mobile Edge Computing (MEC)-based task offloading in the Internet of Vehicles (IoV) scenario, which transfers computational tasks to mobile edge nodes and fixed edge nodes with available computing resources, has attracted interest in recent years. The ...
Task offloading for vehicular edge computing with edge-cloud cooperation
AbstractVehicular edge computing (VEC) is emerging as a novel computing paradigm to meet low latency demands for computation-intensive vehicular applications. However, most existing offloading schemes do not take the dynamic edge-cloud computing ...
Agent-enabled task offloading in UAV-aided mobile edge computing
AbstractWith the appearance of various mobile applications, such as automatic driving and augmented reality, it is difficult for the power and computing ability of mobile terminals to satisfy user demands. Therefore, an increasing number of ...






Comments