CV - CLOUDUH

Research Interests

Near-Space Solar-Powered Unmanned Aerial Vehicle Energy Storage Management

Storage battery modeling and state estimation.
Health-aware battery charge/discharge strategy optimization.
Deep reinforcement learning for energy management.
Imitation learning from expert demonstrations.

Education & Awards

School of Electrical and Information Engineering, Tianjin University

Ph.D. student in Control Science and Engineering (Program for Successive M.E. and Ph.D.)

Supervisor: Prof. Zhiqiang Zuo, Director of the Tianjin Key Laboratory of IUSTS
Responsibilities: Class Monitor; CAA Tianjin University Student Branch Executive Member.
Awards: Three-Good Student Award; Outstanding Paper Award at the CAA Doctoral Academic Forum; First-Class Graduate Scholarship.

Aug 2021 – Present

Tianjin, China

School of Vehicles and Energy, Yanshan University

B.E. in Vehicle Engineering (Program for Excellent Engineers)

Grades: GPA 3.6/4.0, ranked 1st of 59 in comprehensive evaluation.
Responsibilities: Class Monitor; Student Union President; Yan Xiang Racing Team Leader.
Awards: China National Scholarship; China National Encouragement Scholarship; Provincial Three-Good Student Award; Outstanding Graduate; First-Class Graduate Scholarship.
Recommended for direct admission to a master’s program.

Aug 2017 – Jun 2021

Hebei, China

Publications

[1] Yunhao Du, Zhicheng Zhang, Zhiqiang Zuo, Yijing Wang, Lithium Battery Charging Optimization via Multi-Stage Combined Charging Strategy in Solar-Powered Vehicles, Journal of Energy Storage, 83: 110716, 2024.

Keywords: multi-objective charging optimization; battery coupling model; custom charging anxiety index.

[2] Yunhao Du, Zhiqiang Zuo, Zhicheng Zhang, Peng Li, Yijing Wang, Rui Zhao, Zheng Li, Task-Oriented Energy Storage Management for Solar-Powered UAVs: An Enhanced Multi-Objective Deep Reinforcement Learning Approach, 64th IEEE Conference on Decision and Control (CDC), 2025. [Accepted]

Keywords: three-dimensional battery model; multi-objective energy management; deep reinforcement learning.

[3] Zhiqiang Zuo, Yunhao Du, Yijing Wang, Zhicheng Zhang, Peng Li, State-of-Charge Balancing Control for Battery Energy Storage Systems of Near-Space Vehicles with an Electric-Thermal-Aging Coupling Model, 2023 42nd Chinese Control Conference (CCC), 2023: 1853–1858.

Keywords: state-of-charge balancing; battery coupling model; receding horizon control.

[4] Yunhao Du, Zhiqiang Zuo, Zhicheng Zhang, Peng Li, Health- and Dynamics-Constrained Energy Management for Solar-Powered UAVs based on Enhanced TD3 from Demonstrations. [Under Review]

Keywords: exponential-dilated multi-step TD3; reinforcement learning from demonstrations; gravity energy storage.

Projects

Electric Formula Vehicle Design, Manufacture, and Control

Formula Student Electric China, Yan Xiang Racing Team, Team Leader

Dec 2017 – Nov 2020

2018 & 2019 Formula Student Electric China National Third Prize; 2019 Challenge Cup Competition of Science Achievement National Third Prize.
Led a student team to design, build, and race an electric formula car.
Owned electrical system architecture and design: sensor and control harnesses, battery pack, and high-voltage traction components.
Developed battery management strategies and traction control algorithms, and analyzed telemetry to support mechanical tuning and performance validation.

Distributed Autonomous Energy Supply System Collaboration and Scheduling

13th Five-Year Plan Equipment Pre-Research Project, Core Researcher

Nov 2020 – Apr 2023

Designed the system communications architecture, including CAN, NI-VISA, and TCP/IP protocols and the network topology.
Built a PyQt-based MVC host application for system monitoring, data acquisition, device control, and deployment of custom algorithms.
Developed an adaptive energy scheduling algorithm that prioritizes node energy states to meet real-time requirements and balance load, and quickly isolates fault nodes to maintain system stability and availability.

DRL-Based Energy Flow Scheduling and Hardware Implementation

Research Project Funded by National Government Agency, Project Manager

Oct 2022 – Mar 2025

Participated in many business projects and the application work for the NSFC programs.
Integrated near-space UAV flight environmental simulation into the hardware to emulate solar irradiance and propulsion loads.
Deployed deep reinforcement learning on a Huawei Atlas module (comparable to an NVIDIA Jetson Nano) with PyTorch and Stable-Baselines3, enabling continuous day and night energy-storage management.
Ran over one month of uninterrupted simulation testing to validate algorithm feasibility and robustness.

Energy Storage Scheduling and Cooperative Control for Near-Space UAVs

National Natural Science Foundation (NSFC) Key Program, Core Researcher

Aug 2021 – Dec 2024

Established a laboratory battery test platform, completed battery HPPC and cycle charge-discharge tests under different operating conditions, and thereby established a three-dimensional coupled battery model.
Proposed a combined charging strategy under photovoltaic constraints to improve charging efficiency while reducing the aging speed of the battery.
Developed a health-aware multi-node energy balancing algorithm that balances state-of-charge balancing speed and battery aging speed.

Skills & Experience

Language: CET-4 475 | CET-6 530

Hardware: STM32 | DSP | RapidECU | NVIDIA Jetson | ESXi Server

Work: CAA TJU Student Branch Member | Shandong Doctoral Students Association Deputy Minister | The 18th Research Institute of China Electronics Technology Group Corporation Limited intern

Experience: Organized multiple large-scale academic events | Managed team publicity and social media accounts

Hobbies: Sports | Photography | HomeLab