[1] N. Elmeseiry, N. Alshaer, T. Ismail, "A Detailed Survey and Future Directions of Unmanned Aerial Vehicles (UAVs) with Potential Applications," Aerospace, vol. 8, no. 12, 2021.
[2] M. A. Tahir, I. Mir, T. U. Islam, "A Review of UAV Platforms for Autonomous Applications: Comprehensive Analysis and Future Directions," IEEE Access, vol. 11, pp. 52540-52554, 2023.
[3] S. A. H. Mohsan, M. A. Khan, F. Noor, I. Ullah, M. H. Alsharif, "Towards the Unmanned Aerial Vehicles (UAVs): A Comprehensive Review," Drones, vol. 6, no. 6, 2022.
[4] D. J. Yeong, G. Velasco-Hernandez, J. Barry, J. Walsh, "Sensor and Sensor Fusion Technology in Autonomous Vehicles: A Review," Sensors, vol. 21, no. 6, 2021.
[5] K. Telli et al., "A Comprehensive Review of Recent Research Trends on Unmanned Aerial Vehicles (UAVs)," Systems, vol. 11, no. 8, 2023.
[6] S. Campbell et al., "Sensor Technology in Autonomous Vehicles : A review," 2018, pp. 1-4.
[7] M. Kim, J. Kim, M. Jung, H. Oh, "Towards monocular vision-based autonomous flight through deep reinforcement learning," Expert Systems with Applications, vol. 198, p. 116742, 2022.
[8] J. Li, X. Xiong, Y. Yan, Y. Yang, "A Survey of Indoor UAV Obstacle Avoidance Research," IEEE Access, vol. 11, pp. 51861-51891, 2023.
[9] S. Rezwan, W. Choi, "Artificial Intelligence Approaches for UAV Navigation: Recent Advances and Future Challenges," IEEE Access, vol. 10, pp. 26320-26339, 2022.
[10] B. Mahdipour, S. H. Zahiri, I. Behravan, "An Intelligent Two and Three Dimensional Path Planning, Based on a Metaheuristic Method," Journal of Electrical and Computer Engineering Innovations (JECEI), vol. 13, no. 1, pp. 93-116, 2025.
[11] S. Y. Choi, D. Cha, "Unmanned aerial vehicles using machine learning for autonomous flight; state-of-the-art," Advanced Robotics, vol. 33, no. 6, pp. 265-277, 2019.
[12] A. Carrio, C. Sampedro, A. Rodriguez-Ramos, P. Campoy, "A Review of Deep Learning Methods and Applications for Unmanned Aerial Vehicles," Journal of Sensors, vol. 2017, no. 1, p. 3296874, 2017.
[13] Y. Chang, Y. Cheng, U. Manzoor, J. Murray, "A review of UAV autonomous navigation in GPS-denied environments," Robotics and Autonomous Systems, vol. 170, p. 104533, 2023.
[14] R. S. Sutton, "Reinforcement learning: An introduction," A Bradford Book, 2018.
[15] H. Taheri, S. Rasoul Hosseini, M. A. Nekoui, "Deep Reinforcement Learning with Enhanced PPO for Safe Mobile Robot Navigation," arXiv e-prints, p. arXiv:2405.16266, 2024.
[16] A. S. Sadr, M. S. Khojasteh, H. Malek, A. Salimi-Badr, "An Efficient Planning Method for Autonomous Navigation of a Wheeled-Robot based on Deep Reinforcement Learning," in 2022 12th International Conference on Computer and Knowledge Engineering (ICCKE), 2022, pp. 136-141.
[17] S. Mashhouri, M. Rahmati, Y. Borhani, E. Najafi, "Reinforcement Learning based Sequential Controller for Mobile Robots with Obstacle Avoidance," in 2022 8th International Conference on Control, Instrumentation and Automation (ICCIA), 2022, pp. 1-5.
[18] S. Sabzekar, M. Samadzad, A. Mehditabrizi, A. N. Tak, "A Deep Reinforcement Learning Approach for UAV Path Planning Incorporating Vehicle Dynamics with Acceleration Control," Unmanned Systems, vol. 12, no. 03, pp. 477-498, 2024.
[19] H. S. M. Mahalegi, A. Farhadi, G. Molnár, E. Nagy, "Enhancing UAV Autonomous Navigation in Indoor Environments Using Reinforcement Learning and Convolutional Neural Networks," in 2024 IEEE 22nd Jubilee International Symposium on Intelligent Systems and Informatics (SISY), 2024, pp. 000091-000100.
[20] M. Ramezani, M. A. Amiri Atashgah, A. Rezaee, "A Fault-Tolerant Multi-Agent Reinforcement Learning Framework for Unmanned Aerial Vehicles–Unmanned Ground Vehicle Coverage Path Planning," Drones, vol. 8, no. 10, p. 537, 2024.
[21] P. R. Gervi, A. Harati, S. K. Ghiasi-Shirazi, "Vision-Based Obstacle Avoidance in Drone Navigation using Deep Reinforcement Learning," in 2021 11th International Conference on Computer Engineering and Knowledge (ICCKE), 2021, pp. 363-368.
[22] م. دین پرست, ع. رودباری, "کنترل لندینگ پهپاد با دینامیک نامشخص با استفاده از یادگیری تقویتی," بیست و یکمین کنفرانس ملی مهندسی برق،کامپیوتر و مکانیک, 1403.
[23] ج. روشنی یان, ف. خواجه محمدی, "تبیین و پیاده سازی 4 روش یادگیری تقویتی هوش مصنوعی (برنامه ریزی پویا، مونت کارلو، تفاضلات زمانی (سارسا و یادگیری Q)) برای مسیریابی یک کوادروتور در حضور موانع در صفحه با فرض گسسته سازی," بیست و دومین کنفرانس بین المللی انجمن هوافضای ایران, 1402.
[24] م. خاکباز, م. انجیدنی, "یادگیری مسیر مناسب و هدایت اتوماتیک کوادروتور," پنجمین همایش ملی فناوریهای نوین در مهندسی برق، کامپیوتر و مکانیک ایران, 1401.
[25] ا. شریفی, آ. الستی, "طراحی کنترل PID خودتنظیم با یک ساختار عصبی مبتنی بر عملگر-منتقد برای کنترل وضعیت و ارتفاع کوادروتور," سی امین همایش سالانه بین المللی انجمن مهندسان مکانیک ایران, 1401.
[26] H. Alvarez, L. M. Paz, J. Sturm, D. Cremers, "Collision Avoidance for Quadrotors with a Monocular Camera," in Experimental Robotics: The 14th International Symposium on Experimental Robotics, M. A. Hsieh, O. Khatib, and V. Kumar Eds. Cham: Springer International Publishing, 2016, pp. 195-209.
[27] G. Cho, J. Kim, H. Oh, "Vision-Based Obstacle Avoidance Strategies for MAVs Using Optical Flows in 3-D Textured Environments," Sensors, vol. 19, no. 11, p. 2523, 2019.
[28] W. E. Green, P. Y. Oh, "Optic-Flow-Based Collision Avoidance," IEEE Robotics & Automation Magazine, vol. 15, no. 1, pp. 96-103, 2008.
[29] A. Eresen, N. İmamoğlu, M. Önder Efe, "Autonomous quadrotor flight with vision-based obstacle avoidance in virtual environment," Expert Systems with Applications, vol. 39, no. 1, pp. 894-905, 2012.
[30] S. Aggarwal, N. Kumar, "Path planning techniques for unmanned aerial vehicles: A review, solutions, and challenges," Computer Communications, vol. 149, pp. 270-299, 2020.
[31] س. م. حسینی رستمی, ح. خالوزاده, م. کمارجی, "اجتناب از موانع ربات سیار با استفاده از الگوریتم میدان پتانسیل مجازی اصلاح شده," علوم رایانشی, جلد ۲، شماره ۱، صفحات ۴۵-۳۴، ۲۰۱۷.
[32] B. Y. Li, H. Lin, H. Samani, L. Sadler, T. Gregory, B. Jalaian, "On 3D autonomous delivery systems: Design and development," 2017, pp. 1-6.
[33] A. Puente-Castro, D. Rivero, A. Pazos, E. Fernandez-Blanco, "A review of artificial intelligence applied to path planning in UAV swarms," Neural Computing and Applications, vol. 34, no. 1, pp. 153-170, 2022.
[34] J. Gao, Y. Zheng, K. Ni, Q. Mei, B. Hao, L. Zheng, "Fast Path Planning for Firefighting UAV Based on A-Star algorithm," Journal of Physics: Conference Series, vol. 2029, no. 1, p. 012103, 2021.
[35] L. Liu, X. Wang, X. Yang, H. Liu, J. Li, P. Wang, "Path planning techniques for mobile robots: Review and prospect," Expert Systems with Applications, vol. 227, p. 120254, 2023.
[36] K. N. McGuire, G. C. H. E. de Croon, K. Tuyls, "A comparative study of bug algorithms for robot navigation," Robotics and Autonomous Systems, vol. 121, p. 103261, 2019.
[37] N. Mahdian, S. H. Attarzadeh-Niaki, A. Salimi-Badr, "A Systematic Embedded Software Design Flow for Robotic Applications," in 2021 11th International Conference on Computer Engineering and Knowledge (ICCKE), 2021, pp. 217-222.
[38] M. Vazirpanah, S. H. Attarzadeh-Niaki, A. Salimi-Badr, "ROS-Based Co-Simulation for Formal Cyber-Physical Robotic System Design," in 2022 27th International Computer Conference, Computer Society of Iran (CSICC), 2022, pp. 1-5.
[39] Y. Guo, X. Liu, X. Liu, Y. Yang, W. Zhang, "FC-RRT*: An Improved Path Planning Algorithm for UAV in 3D Complex Environment," ISPRS International Journal of Geo-Information, vol. 11, no. 2, 2022.
[40] T. Elmokadem, A. V. Savkin, "Towards Fully Autonomous UAVs: A Survey," Sensors, vol. 21, no. 18, p. 6223. 2021.
[41] ف. مولایی, ع. موسوی, م. دولتشاهی, "طراحی پهپاد مسیریاب هوشمند با استفاده از یادگیری عمیق و منطق فازی," سیستم های فازی و کاربردها, جلد ۷، شماره ۱، صفحات ۲۰۷-۱۸۹، ۲۰۲۴.
[42] S. Y. Shin, Y. W. Kang, Y. G. Kim, "Automatic Drone Navigation in Realistic 3D Landscapes using Deep Reinforcement Learning," in 2019 6th International Conference on Control, Decision and Information Technologies (CoDIT), 2019, pp. 1072-1077.
[43] S. Chehelgami, E. Ashtari, M. A. Basiri, M. Tale Masouleh, A. Kalhor, "Safe deep learning-based global path planning using a fast collision-free path generator," Robotics and Autonomous Systems, vol. 163, p. 104384, 2023.
[44] R. J. Alitappeh, N. Mahmoudi, M. R. Jafari, A. Foladi, "Autonomous Robot Navigation: Deep Learning Approaches for Line Following and Obstacle Avoidance," in 2024 20th CSI International Symposium on Artificial Intelligence and Signal Processing (AISP), 2024, pp. 1-6.
[45] L. O. Rojas-Perez, J. Martinez-Carranza, "DeepPilot: A CNN for Autonomous Drone Racing," Sensors, vol. 20, no. 16, p. 4524, 2020.
[46] S. Daftry, S. Zeng, J. A. Bagnell, M. Hebert, "Introspective perception: Learning to predict failures in vision systems," in 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, pp. 1743-1750.
[47] A. V. R. Katkuri, H. Madan, N. Khatri, A. S. H. Abdul-Qawy, K. S. Patnaik, "Autonomous UAV navigation using deep learning-based computer vision frameworks: A systematic literature review," Array, vol. 23, p. 100361, 2024.
[48] Z. Xue, T. Gonsalves, "Vision Based Drone Obstacle Avoidance by Deep Reinforcement Learning," AI, vol. 2, no. 3, pp. 366-380, 2021.
[49] F. AlMahamid, K. Grolinger, "Autonomous Unmanned Aerial Vehicle navigation using Reinforcement Learning: A systematic review," Engineering Applications of Artificial Intelligence, vol. 115, p. 105321, 2022.
[50] A. K. Shakya, G. Pillai, S. Chakrabarty, "Reinforcement learning algorithms: A brief survey," Expert Systems with Applications, vol. 231, p. 120495, 2023.
[51] ع. مهرابی, م. شهبازی خجسته, ع. ا. صدری, ج. دلدارشیخی, "مسیریابی و هدایت دسته جمعی مجموعه ای از پهپاد ها در محیط های ناشناخته به منظور هدف یابی با هوش تجمعی خودمختار," اولین همایش ملی علوم و فناوری های نوظهور و شالوده شکن در حوزه دفاعی, 1403.
[52] A. P. Kalidas, C. J. Joshua, A. Q. Md, S. Basheer, S. Mohan, S. Sakri, "Deep Reinforcement Learning for Vision-Based Navigation of UAVs in Avoiding Stationary and Mobile Obstacles," Drones, vol. 7, no. 4, p. 245, 2023.
[53] M. S. Khojasteh, A. Salimi-Badr, "Autonomous Quadrotor Path Planning Through Deep Reinforcement Learning With Monocular Depth Estimation," IEEE Open Journal of Vehicular Technology, vol. 6, pp. 34-51, 2025.
[54] A. Singla, S. Padakandla, S. Bhatnagar, "Memory-Based Deep Reinforcement Learning for Obstacle Avoidance in UAV With Limited Environment Knowledge," IEEE Trans. Intell. Transport. Syst., vol. 22, no. 1, pp. 107-118, 2021.
[55] Y. Chen, N. González-Prelcic, R. W. Heath, "Collision-Free UAV Navigation with a Monocular Camera Using Deep Reinforcement Learning," 2020, pp. 1-6.
[56] C. Wang, J. Wang, Y. Shen, X. Zhang, "Autonomous Navigation of UAVs in Large-Scale Complex Environments: A Deep Reinforcement Learning Approach," IEEE Transactions on Vehicular Technology, vol. 68, no. 3, pp. 2124-2136, 2019.
[57] L. Graesser, W. L. Keng, Foundations of deep reinforcement learning: theory and practice in Python. Addison-Wesley Professional, 2019.
[58] J. Schulman, F. Wolski, P. Dhariwal, A. Radford, O. Klimov, "Proximal policy optimization algorithms," arXiv preprint arXiv:1707.06347, 2017.
[59] J. Schulman, P. Moritz, S. Levine, M. Jordan, P. Abbeel, "High-dimensional continuous control using generalized advantage estimation," arXiv preprint arXiv:1506.02438, 2015.
[60] S. Shah, D. Dey, C. Lovett, A. Kapoor, "AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles," Cham, 2018: Springer International Publishing, in Field and Service Robotics, pp. 621-635.
[61] B. Kabas, "Autonomous UAV Navigation via Deep Reinforcement Learning Using PPO," in 2022 30th Signal Processing and Communications Applications Conference (SIU), 2022, pp. 1-4.
