skip to main content
research-article

DRL based Joint Affective Services Computing and Resource Allocation in ISTN

Authors Info & Claims
Published:31 October 2022Publication History
Skip Abstract Section

Abstract

Affective services will become a research hotspot in artificial intelligence (AI) in the next decade. In this paper, a novel service paradigm combined with wireless communication in integrated satellite-terrestrial network (ISTN) is proposed. On this basis, an affective services computing offloading and transmission network (ASCTN) with a three-tier computation architecture is proposed, which is able to assist users to obtain affective computing services and regulate emotions. The optimization problem is investigated in the ASCTN, which is a discrete, non-linear, and non-convex problem with the limitation of computation ability of satellite and transmit power. Specifically, with the objective to minimize the cost utility related to latency and energy consumption, a joint affective services tasks computing offloading strategy, sub-channel, and power allocation algorithm based on dueling deep Q-network (Dueling-DQN) is proposed, which is in possession of better stability. The simulation results reveal the effectiveness of the optimization algorithm in terms of the cost utility in the ASCTN system.

REFERENCES

  1. [1] Arti M. K.. 2016. Channel estimation and detection in satellite communication systems. IEEE Transactions on Vehicular Technology 65, 12 (2016), 1017310179. Google ScholarGoogle ScholarCross RefCross Ref
  2. [2] Cambria Erik. 2016. Affective computing and sentiment analysis. IEEE Intelligent Systems 31, 2 (2016), 102107. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. [3] Chen Min, Zhang Yin, Li Yong, Hassan Mohammad Mehedi, and Alamri Atif. 2015. AIWAC: Affective interaction through wearable computing and cloud technology. IEEE Wireless Communications 22, 1 (2015), 2027. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. [4] Chen Shanzhi, Sun Shaohui, and Kang Shaoli. 2020. System integration of terrestrial mobile communication and satellite communication—the trends, challenges and key technologies in B5G and 6G. China Communications 17, 12 (2020), 156171. Google ScholarGoogle ScholarCross RefCross Ref
  5. [5] Chen Xu. 2015. Decentralized computation offloading game for mobile cloud computing. IEEE Transactions on Parallel and Distributed Systems 26, 4 (2015), 974983. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] Chu Jianhang, Chen Xiaoming, Zhong Caijun, and Zhang Zhaoyang. 2021. Robust design for NOMA-based multibeam LEO satellite Internet of Things. IEEE Internet of Things Journal 8, 3 (2021), 19591970. Google ScholarGoogle ScholarCross RefCross Ref
  7. [7] Cui Gaofeng, Long Yating, Xu Lexi, and Wang Weidong. 2021. Joint offloading and resource allocation for satellite assisted vehicle-to-vehicle communication. IEEE Systems Journal 15, 3 (2021), 39583969. Google ScholarGoogle ScholarCross RefCross Ref
  8. [8] Doan Khai Nguyen, Vaezi Mojtaba, Shin Wonjae, Poor H. Vincent, Shin Hyundong, and Quek Tony Q. S.. 2020. Power allocation in cache-aided NOMA systems: Optimization and deep reinforcement learning approaches. IEEE Transactions on Communications 68, 1 (2020), 630644. Google ScholarGoogle ScholarCross RefCross Ref
  9. [9] Feng Jie, Yu F. Richard, Pei Qingqi, Chu Xiaoli, Du Jianbo, and Zhu Li. 2020. Cooperative computation offloading and resource allocation for blockchain-enabled mobile-edge computing: A deep reinforcement learning approach. IEEE Internet of Things Journal 7, 7 (2020), 62146228. Google ScholarGoogle ScholarCross RefCross Ref
  10. [10] Fu Bo, Staehle Dirk, Kunzmann Gerald, Steinbach Eckehard, and Kellerer Wolfgang. 2015. QoE-based SVC layer dropping in LTE networks using content-aware layer priorities. ACM Trans. Multimedia Comput. Commun. Appl. 12, 1, Article 7 (Aug. 2015), 23 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. [11] Gokhale Vineet, Nair Jayakrishnan, and Chaudhuri Subhasis. 2017. Congestion control for network-aware telehaptic communication. ACM Trans. Multimedia Comput. Commun. Appl. 13, 2, Article 17 (Mar. 2017), 26 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. [12] Hu Shenghong, Xu Min, Zhang Haimin, Xiao Chunxia, and Gui Chao. 2019. Affective content-aware adaptation scheme on QoE optimization of adaptive streaming over HTTP. ACM Trans. Multimedia Comput. Commun. Appl. 15, 3s, Article 100 (Dec. 2019), 18 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. [13] Huang Liang, Bi Suzhi, and Zhang Ying-Jun Angela. 2020. Deep reinforcement learning for online computation offloading in wireless powered mobile-edge computing networks. IEEE Transactions on Mobile Computing 19, 11 (2020), 25812593. Google ScholarGoogle ScholarCross RefCross Ref
  14. [14] Jia Jia, Zhou Suping, Yin Yufeng, Wu Boya, Chen Wei, Meng Fanbo, and Wang Yanfeng. 2019. Inferring emotions from large-scale internet voice data. IEEE Transactions on Multimedia 21, 7 (2019), 18531866. Google ScholarGoogle ScholarCross RefCross Ref
  15. [15] Jiang Chunxiao and Zhu Xiangming. 2020. Reinforcement learning based capacity management in multi-layer satellite networks. IEEE Transactions on Wireless Communications 19, 7 (2020), 46854699. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. [16] Jiao Jian, Sun Yunyu, Wu Shaohua, Wang Ye, and Zhang Qinyu. 2020. Network utility maximization resource allocation for NOMA in satellite-based Internet of Things. IEEE Internet of Things Journal 7, 4 (2020), 32303242. Google ScholarGoogle ScholarCross RefCross Ref
  17. [17] Krishnan Prabhakar, Jain Kurunandan, Jose Pramod George, Achuthan Krishnashree, and Buyya Rajkumar. 2021. SDN enabled QoE and security framework for multimedia applications in 5G networks. ACM Trans. Multimedia Comput. Commun. Appl. 17, 2, Article 39 (Apr. 2021), 29 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. [18] Liu Xiangnan, Zhang Haijun, Long Keping, Nallanathan Arumugam, and Leung Victor C. M.. 2021. Deep dyna-reinforcement learning based on random access control in LEO satellite IoT networks. IEEE Internet of Things Journal (2021), 11. Google ScholarGoogle ScholarCross RefCross Ref
  19. [19] Mai Sijie, Xing Songlong, and Hu Haifeng. 2020. Locally confined modality fusion network with a global perspective for multimodal human affective computing. IEEE Transactions on Multimedia 22, 1 (2020), 122137. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. [20] Qiu Chao, Yao Haipeng, Yu F. Richard, Xu Fangmin, and Zhao Chenglin. 2019. Deep Q-learning aided networking, caching, and computing resources allocation in software-defined satellite-terrestrial networks. IEEE Transactions on Vehicular Technology 68, 6 (2019), 58715883. Google ScholarGoogle ScholarCross RefCross Ref
  21. [21] Tang Qingqing, Fei Zesong, Li Bin, and Han Zhu. 2021. Computation offloading in LEO satellite networks with hybrid cloud and edge computing. IEEE Internet of Things Journal 8, 11 (2021), 91649176. Google ScholarGoogle ScholarCross RefCross Ref
  22. [22] Hasselt Hado van, Guez Arthur, and Silver David. 2015. Deep reinforcement learning with double Q-learning. CoRR abs/1509.06461 (2015). arXiv:1509.06461 http://arxiv.org/abs/1509.06461.Google ScholarGoogle Scholar
  23. [23] Wang Anqi, Hu Haifeng, and Yang Liang. 2018. Image captioning with affective guiding and selective attention. ACM Trans. Multimedia Comput. Commun. Appl. 14, 3, Article 73 (Jul. 2018), 15 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. [24] Wang Anyue, Lei Lei, Lagunas Eva, Pérez-Neira Ana I., Chatzinotas Symeon, and Ottersten Björn. 2021. NOMA-enabled multi-beam satellite systems: Joint optimization to overcome offered-requested data mismatches. IEEE Transactions on Vehicular Technology 70, 1 (2021), 900913. Google ScholarGoogle ScholarCross RefCross Ref
  25. [25] Wang Lina, Wu Yanan, Zhang Haijun, Choi Sunghyun, and Leung Victor C. M.. 2021. Resource allocation for NOMA based space-terrestrial satellite networks. IEEE Transactions on Wireless Communications 20, 2 (2021), 10651075. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. [26] Wang Shangfei, Chen Shiyu, and Ji Qiang. 2019. Content-based video emotion tagging augmented by users’ multiple physiological responses. IEEE Transactions on Affective Computing 10, 2 (2019), 155166. Google ScholarGoogle ScholarCross RefCross Ref
  27. [27] Wang Xiaohui, Jia Jia, Tang Jie, Wu Boya, Cai Lianhong, and Xie Lexing. 2015. Modeling emotion influence in image social networks. IEEE Transactions on Affective Computing 6, 3 (2015), 286297. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. [28] Wang Ziyu, Schaul Tom, Hessel Matteo, Hasselt Hado Van, Lanctot Marc, and Freitas Nando De. 2016. Dueling network architectures for deep reinforcement learning. In Proceedings of the 33rd International Conference on Machine Learning- Volume 48 (ICML’16). JMLR.org, 19952003.Google ScholarGoogle Scholar
  29. [29] Wu Dapeng, Han Xiaojuan, Yang Zhigang, and Wang Ruyan. 2021. Exploiting transfer learning for emotion recognition under cloud-edge-client collaborations. IEEE Journal on Selected Areas in Communications 39, 2 (2021), 479490. Google ScholarGoogle ScholarCross RefCross Ref
  30. [30] Xie Renchao, Tang Qinqin, Wang Qiuning, Liu Xu, Yu F. Richard, and Huang Tao. 2020. Satellite-terrestrial integrated edge computing networks: Architecture, challenges, and open issues. IEEE Network 34, 3 (2020), 224231. Google ScholarGoogle ScholarCross RefCross Ref
  31. [31] Yu Shuai, Gong Xiaowen, Shi Qian, Wang Xiaofei, and Chen Xu. 2021. EC-SAGINs: Edge computing-enhanced space-air-ground integrated networks for internet of vehicles. IEEE Internet of Things Journal (2021), 11. Google ScholarGoogle ScholarCross RefCross Ref
  32. [32] Yu Shuai, Langar Rami, Fu Xiaoming, Wang Li, and Han Zhu. 2018. Computation offloading with data caching enhancement for mobile edge computing. IEEE Transactions on Vehicular Technology 67, 11 (2018), 1109811112. Google ScholarGoogle ScholarCross RefCross Ref
  33. [33] Zeng Zhihong, Pantic Maja, Roisman Glenn I., and Huang Thomas S.. 2009. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 1 (2009), 3958. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. [34] Zhang Haijun, Duan Yanan, Long Keping, and Leung Victor C. M.. 2021. Energy efficient resource allocation in terahertz downlink NOMA systems. IEEE Transactions on Communications 69, 2 (2021), 13751384. Google ScholarGoogle ScholarCross RefCross Ref
  35. [35] Zhang Haijun, Zhang Haisen, Long Keping, and Karagiannidis George K.. 2020. Deep learning based radio resource management in NOMA networks: User association, subchannel and power allocation. IEEE Transactions on Network Science and Engineering 7, 4 (2020), 24062415. Google ScholarGoogle ScholarCross RefCross Ref
  36. [36] Zhang Yin, Mao Deqing, Zhang Yongchao, Huang Yulin, and Yang Jianyu. 2017. Multi-beam doppler beam sharpening approach for airborne forward-looking radar imaging. In 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). 61426145. Google ScholarGoogle ScholarCross RefCross Ref
  37. [37] Zhang Yin, Zhang Qiping, Li Changlin, Zhang Yongchao, Huang Yulin, and Yang Jianyu. 2019. Sea-surface target angular superresolution in forward-looking radar imaging based on maximum a posteriori algorithm. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12, 8 (2019), 28222834. Google ScholarGoogle ScholarCross RefCross Ref
  38. [38] Zhang Zhenjiang, Zhang Wenyu, and Tseng Fan-Hsun. 2019. Satellite mobile edge computing: Improving QoS of high-speed satellite-terrestrial networks using edge computing techniques. IEEE Network 33, 1 (2019), 7076. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. [39] Zhao Sicheng, Wang Shangfei, Soleymani Mohammad, Joshi Dhiraj, and Ji Qiang. 2019. Affective computing for large-scale heterogeneous multimedia data: A survey. ACM Trans. Multimedia Comput. Commun. Appl. 15, 3s, Article 93 (Dec. 2019), 32 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. [40] Zheng Gan, Chatzinotas Symeon, and Ottersten Bjorn. 2012. Generic optimization of linear precoding in multibeam satellite systems. IEEE Transactions on Wireless Communications 11, 6 (2012), 23082320. Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. DRL based Joint Affective Services Computing and Resource Allocation in ISTN

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Multimedia Computing, Communications, and Applications
        ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 18, Issue 3s
        October 2022
        381 pages
        ISSN:1551-6857
        EISSN:1551-6865
        DOI:10.1145/3567476
        • Editor:
        • Abdulmotaleb El Saddik
        Issue’s Table of Contents

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 31 October 2022
        • Online AM: 10 September 2022
        • Accepted: 1 September 2022
        • Revised: 18 July 2022
        • Received: 5 December 2021
        Published in tomm Volume 18, Issue 3s

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      View Full Text

      HTML Format

      View this article in HTML Format .

      View HTML Format
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!