Yazar "Zhang, Yue" seçeneğine göre listele

Listeleniyor 1 - 2 / 2
  • Küçük Resim Yok
    Öğe
    Energy-Efficient Satellite Range Scheduling Using a Reinforcement Learning-Based Memetic Algorithm
    (Institute of Electrical and Electronics Engineers Inc., 2024) Song, Yanjie; Suganthan, Ponnuthurai Nagaratnam; Pedrycz, Witold; Yan, Ran; Fan, Dongming; Zhang, Yue
    The rapid expansion of the satellite industry has presented numerous opportunities across various sectors and significantly transformed people's daily lives. However, the high energy consumption resulting from frequent task execution poses challenges for satellite management. Energy consumption has become an important factor to be considered in the design of future satellite management systems. The energy-efficient satellite range scheduling problem (EESRSP) aims to optimize task sequencing profits within the satellite management system while simultaneously conserving energy. To address this problem, a mixed-integer scheduling model is constructed, taking into account the energy consumption of ground stations during telemetry, tracking, and command (TT&C) operations. Then, we propose a reinforcement learning-based memetic algorithm (RL-MA) that incorporates a heuristic initialization method (HIM). The HIM enables the algorithm to rapidly generate high-quality initial solutions by leveraging task features associated with EESRSRP. RL-MA employs both population search and local search (LS) techniques to explore the satellite TT&C task plan. RL-MA incorporates two genetic operators, crossover and mutation, into the population-based search. In the LS stage, multiple random and heuristic LS operators are incorporated through an ensemble LS strategy. To improve search performance, Q-learning, a classical class of reinforcement learning (RL) methods tailored to problem characteristics, is utilized for selecting effective operators. RL dynamically adjusts LS operators based on strategy performance. Experimental results demonstrate that the proposed RL-MA can effectively generate sound solutions for EESRSP with varying task scales. Furthermore, the improvement strategies employed in the algorithm are validated to enhance the scheduling performance of RL-MA. This study reveals that integrating RL with an ensemble of LS operators can significantly enhance the algorithm's exploit capability. Moreover, this LS approach applies to solving other types of satellite scheduling problems. © 1965-2011 IEEE.
  • Küçük Resim Yok
    Öğe
    Generalized Model and Deep Reinforcement Learning-Based Evolutionary Method for Multitype Satellite Observation Scheduling
    (Ieee-Inst Electrical Electronics Engineers Inc, 2024) Song, Yanjie; Ou, Junwei; Pedrycz, Witold; Suganthan, Ponnuthurai Nagaratnam; Wang, Xinwei; Xing, Lining; Zhang, Yue
    Multitype satellite observation, including optical observation satellites, synthetic aperture radar (SAR) satellites, and electromagnetic satellites, has become an important direction in integrated satellite applications due to its ability to cope with various complex situations. In the multitype satellite observation scheduling problem (MTSOSP), the constraints involved in different types of satellites make the problem challenging. This article proposes a mixed-integer programming model and a generalized profit representation method in the model to effectively cope with the situation of multiple types of satellite observations. To obtain a suitable observation plan, a deep reinforcement learning-based genetic algorithm (DRL-GA) is proposed by combining the learning method and genetic algorithm. The DRL-GA adopts a solution generation method to obtain the initial population and assist with local search. In this method, a set of statistical indicators that consider resource utilization and task arrangement performance are regarded as states. By using deep neural networks to estimate the $Q$ value of each action, this method can determine the preferred order of task scheduling. An individual update strategy and an elite strategy are used to enhance the search performance of DRL-GA. Simulation results verify that DRL-GA can effectively solve the MTSOSP and outperforms the state-of-the-art algorithms in several aspects. This work reveals the advantages of the proposed generalized model and scheduling method, which exhibit good scalability for various types of observation satellite scheduling problems.