(School of Computer Science and Engineering, Vellore Institute of Technology, Tamil Nadu, India)(2) * Chandra Mohan Balasubramanian
(School of Computer Science and Engineering, Vellore Institute of Technology, Tamil Nadu, India)*corresponding author
AbstractThe increasing trend of autonomous driving vehicles in smart cities emphasizes the need for safe travel. However, the presence of obstacles, potholes, and complex road environments, such as poor illumination and occlusion, can cause blurred road images that may impact the accuracy of maneuver prediction in visual perception systems. To address these challenges, a novel ensemble model named ABHO-based deep CNN-BiLSTM has been proposed for traffic sign detection. This model combines a hybrid convolutional neural network (CNN) and bidirectional long short-term memory (BiLSTM) with the alarming-based hunting optimization (ABHO) algorithm to improve maneuver prediction accuracy. Additionally, a modified hough-enabled lane generative adversarial network (ABHO based HoughGAN) has been proposed, which is designed to be robust to blurred images. The ABHO algorithm, inspired by the defending and social characteristics of starling birds and Canis kojot, allows the model to efficiently search for the optimal solution from the available solutions in the search space. The proposed ensemble model has shown significantly improved accuracy, sensitivity, and specificity in maneuver prediction compared to previously utilized methods, with minimal error during lane detection. Overall, the proposed ensemble model addresses the challenges faced by autonomous driving vehicles in complex and obstructed road environments, offering a promising solution for enhancing safety and reliability in smart cities.
KeywordsDeep learning; Autonomous vehicle driving; Traffic sign detection; Lane prediction; Controller optimization
|
DOIhttps://doi.org/10.26555/ijain.v9i2.1048 |
Article metricsAbstract views : 533 | PDF views : 169 |
Cite |
Full Text Download
|
References
[1] T. Liu et al., “Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning,” IET Electr. Syst. Transp., vol. 10, no. 4, pp. 417–424, Dec. 2020, doi: 10.1049/IET-EST.2020.0044.
[2] P. Hang, X. Chen, and F. Luo, “LPV/H Controller Design for Path Tracking of Autonomous Ground Vehicles Through Four-Wheel Steering and Direct Yaw-Moment Control,” Int. J. Automot. Technol., vol. 20, no. 4, pp. 679–691, Aug. 2019, doi: 10.1007/S12239-019-0064-1.
[3] P. Hang, C. Lv, Y. Xing, C. Huang, and Z. Hu, “Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach,” IEEE Trans. Intell. Transp. Syst., vol. 22, no. 4, pp. 2076–2087, Apr. 2021, doi: 10.1109/TITS.2020.3036984.
[4] P. Hang, C. Lv, C. Huang, J. Cai, Z. Hu, and Y. Xing, “An Integrated Framework of Decision Making and Motion Planning for Autonomous Vehicles Considering Social Behaviors,” IEEE Trans. Veh. Technol., vol. 69, no. 12, pp. 14458–14469, Dec. 2020, doi: 10.1109/TVT.2020.3040398.
[5] C. Hatipoglu, Ü. Özguner, and K. A. Redmill, “Automated lane change controller design,” IEEE Trans. Intell. Transp. Syst., vol. 4, no. 1, pp. 13–22, Mar. 2003, doi: 10.1109/TITS.2003.811644.
[6] Y. Guo, Q. Sun, R. Fu, and C. Wang, “Improved Car-Following Strategy Based on Merging BehaviorBehavior Prediction of Adjacent Vehicle from Naturalistic Driving Data,” IEEE Access, vol. 7, pp. 44258–44268, 2019, doi: 10.1109/ACCESS.2019.2908422.
[7] X. Gu, Y. Han, and J. Yu, “A novel lane-changing decision model for autonomous vehicles based on deep autoencoder network and XGBoost,” IEEE Access, vol. 8, pp. 9846–9863, 2020, doi: 10.1109/ACCESS.2020.2964294.
[8] W. Schwarting, J. Alonso-Mora, and D. Rus, “Planning and Decision-Making for Autonomous Vehicles,” Annual Review of Control, Robotics, and Autonomous Systems, vol. 1, pp. 187–210, May 2018, doi: 10.1146/annurev-control-060117-105157.
[9] C. Hubmann, M. Becker, D. Althoff, D. Lenz, and C. Stiller, “Decision making for autonomous driving considering interaction and uncertain prediction of surrounding vehicles,” IEEE Intell. Veh. Symp. Proc., pp. 1671–1678, Jul. 2017, doi: 10.1109/IVS.2017.7995949.
[10] K. Tu, S. Yang, H. Zhang, and Z. Wang, “Hybrid A based motion planning for autonomous vehicles in unstructured environment,” Proc. - IEEE Int. Symp. Circuits Syst., vol. 2019-May, pp. 1-4, 2019, doi: 10.1109/ISCAS.2019.8702779.
[11] G. Li, Y. Yang, S. Li, X. Qu, N. Lyu, and S. E. Li, “Decision making of autonomous vehicles in lane change scenarios: Deep reinforcement learning approaches with risk awareness,” Transp. Res. Part C Emerg. Technol., vol. 134, p. 103452, Jan. 2022, doi: 10.1016/J.TRC.2021.103452.
[12] J. Guanetti, Y. Kim, and F. Borrelli, “Control of connected and automated vehicles: State of the art and future challenges,” Annu. Rev. Control, vol. 45, pp. 18–40, Jan. 2018, doi: 10.1016/J.ARCONTROL.2018.04.011.
[13] S. Kuutti, S. Fallah, K. Katsaros, M. Dianati, F. Mccullough, and A. Mouzakitis, “A Survey of the State-of-the-Art Localization Techniques and Their Potentials for Autonomous Vehicle Applications,” IEEE Internet Things J., vol. 5, no. 2, pp. 829–846, Apr. 2018, doi: 10.1109/JIOT.2018.2812300.
[14] Y. Fu, C. Li, F. R. Yu, T. H. Luan, and Y. Zhang, “A Decision-Making Strategy for Vehicle Autonomous Braking in Emergency via Deep Reinforcement Learning,” IEEE Trans. Veh. Technol., vol. 69, no. 6, pp. 5876–5888, Jun. 2020, doi: 10.1109/TVT.2020.2986005.
[15] R. Zheng, C. Liu, and Q. Guo, “A decision-making method for autonomous vehicles based on simulation and reinforcement learning,” Proc. - Int. Conf. Mach. Learn. Cybern., vol. 1, pp. 362–369, 2013, doi: 10.1109/ICMLC.2013.6890495.
[16] L. Li, K. Ota, and M. Dong, “Humanlike Driving: Empirical Decision-Making System for Autonomous Vehicles,” IEEE Trans. Veh. Technol., vol. 67, no. 8, pp. 6814–6823, Aug. 2018, doi: 10.1109/TVT.2018.2822762.
[17] G. Guo and W. Yue, “Autonomous platoon control allowing range-limited sensors,” IEEE Trans. Veh. Technol., vol. 61, no. 7, pp. 2901–2912, 2012, doi: 10.1109/TVT.2012.2203362.
[18] M. Di Bernardo, P. Falcone, A. Salvi, and S. Santini, “Design, Analysis, and Experimental Validation of a Distributed Protocol for Platooning in the Presence of Time-Varying Heterogeneous Delays,” IEEE Trans. Control Syst. Technol., vol. 24, no. 2, pp. 413–427, Mar. 2016, doi: 10.1109/TCST.2015.2437336.
[19] X. Guo, J. Wang, F. Liao, and R. S. H. Teo, “Distributed Adaptive Integrated-Sliding-Mode Controller Synthesis for String Stability of Vehicle Platoons,” IEEE Trans. Intell. Transp. Syst., vol. 17, no. 9, pp. 2419–2429, Sep. 2016, doi: 10.1109/TITS.2016.2519941.
[20] M. Kothari and I. Postlethwaite, “A probabilistically robust path planning algorithm for UAVs using rapidly-exploring random trees,” J. Intell. Robot. Syst. Theory Appl., vol. 71, no. 2, pp. 231–253, Aug. 2013, doi: 10.1007/S10846-012-9776-4.
[21] H. Wang, Y. Huang, A. Khajepour, Y. Zhang, Y. Rasekhipour, and D. Cao, “Crash Mitigation in Motion Planning for Autonomous Vehicles,” IEEE Trans. Intell. Transp. Syst., vol. 20, no. 9, pp. 3313–3323, 2019, doi: 10.1109/TITS.2018.2873921.
[22] M. Deveci, D. Pamucar, and I. Gokasar, “Fuzzy Power Heronian function based CoCoSo method for the advantage prioritization of autonomous vehicles in real-time traffic management,” Sustain. Cities Soc., vol. 69, p. 102846, Jun. 2021, doi: 10.1016/J.SCS.2021.102846.
[23] G. Li et al., “Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections,” Automot. Innov., vol. 3, no. 4, pp. 374–385, Dec. 2020, doi: 10.1007/S42154-020-00113-1.
[24] H. Wang, Y. Huang, A. Khajepour, D. Cao, and C. Lv, “Ethical Decision-Making Platform in Autonomous Vehicles with Lexicographic Optimization Based Model Predictive Controller,” IEEE Trans. Veh. Technol., vol. 69, no. 8, pp. 8164–8175, Aug. 2020, doi: 10.1109/TVT.2020.2996954.
[25] S. Jaiswal and B. C. Mohan, “An Efficient Real Time Decision Making System for Autonomous Vehicle Using Timber Chased Wolf Optimization Based Ensemble Classifier,” J. Eng. Sci. Technol. Rev., vol. 16, no. 1, pp. 75–84, 2023, doi: 10.25103/JESTR.161.10.
[26] Z. Li, C. Lu, Y. Yi, and J. Gong, “A Hierarchical Framework for Interactive Behavior Prediction of Heterogeneous Traffic Participants Based on Graph Neural Network,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 7, pp. 9102–9114, Jul. 2022, doi: 10.1109/TITS.2021.3090851.
[27] K. Muhammad, A. Ullah, J. Lloret, J. Del Ser, and V. H. C. De Albuquerque, “Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions,” IEEE Trans. Intell. Transp. Syst., vol. 22, no. 7, pp. 4316–4336, Jul. 2021, doi: 10.1109/TITS.2020.3032227.
[28] S. Grigorescu, B. Trasnea, T. Cocias, and G. Macesanu, “A survey of deep learning techniques for autonomous driving,” J. F. Robot., vol. 37, no. 3, pp. 362–386, Apr. 2020, doi: 10.1002/ROB.21918.
[29] J. Pierezan and L. Dos Santos Coelho, “Coyote Optimization Algorithm: A New Metaheuristic for Global Optimization Problems,” 2018 IEEE Congr. Evol. Comput. CEC 2018 - Proc., pp. 1-8, Sep. 2018, doi: 10.1109/CEC.2018.8477769.
[30] J. Xue and B. Shen, “A novel swarm intelligence optimization approach: sparrow search algorithm,” Systems Science & Control Engineering, vol. 8, no. 1, pp. 22–34, Jan. 2020, doi: 10.1080/21642583.2019.1708830.
[31] L. A. Tran and M. H. Le, “Robust u-net-based road lane markings detection for autonomous driving,” Proc. 2019 Int. Conf. Syst. Sci. Eng. ICSSE 2019, pp. 62–66, Jul. 2019, doi: 10.1109/ICSSE.2019.8823532.
[32] J. Dou, J. Xue, and J. Fang, “SEG-VoxelNet for 3D vehicle detection from RGB and LiDAR data,” Proc. - IEEE Int. Conf. Robot. Autom., vol. 2019-May, pp. 4362–4368, May 2019, doi: 10.1109/ICRA.2019.8793492.
[33] J. P. T. Yusiong and P. C. Naval, “Unsupervised monocular depth estimation of driving scenes using siamese convolutional LSTM networks,” Int. J. Innov. Comput. Inf. Control, vol. 16, no. 1, pp. 91–106, Feb. 2020, doi: 10.24507/IJICIC.16.01.91.
[34] M. Tanveer, T. Rajani, R. Rastogi, Y. H. Shao, and M. A. Ganaie, “Comprehensive review on twin support vector machines,” Ann. Oper. Res., pp. 1–46, Mar. 2022, doi: 10.1007/S10479-022-04575-W.
[35] V. Veerasamy et al., “LSTM Recurrent Neural Network Classifier for High Impedance Fault Detection in Solar PV Integrated Power System,” IEEE Access, vol. 9, pp. 32672–32687, 2021, doi: 10.1109/ACCESS.2021.3060800.
[36] C. A. Hamm et al., “Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI,” Eur. Radiol. 2019 297, vol. 29, no. 7, pp. 3338–3347, Apr. 2019, doi: 10.1007/S00330-019-06205-9.
[37] L. Jianhua and W. Zhiheng, “A hybrid sparrow search algorithm based on constructing similarity,” IEEE Access, vol. 9, pp. 117581-117595, 2021, doi: 10.1109/ACCESS.2021.3106269.
[38] S. Gupta and K. Deep, “A novel Random Walk Grey Wolf Optimizer,” Swarm Evol. Comput., vol. 44, pp. 101–112, Feb. 2019, doi: 10.1016/J.SWEVO.2018.01.001.
[39] M. Azizi, S. Talatahari, and A. H. Gandomi, “Fire Hawk Optimizer: a novel metaheuristic algorithm,” Artif. Intell. Rev., vol. 56, no. 1, pp. 287–363, Jan. 2023, doi: 10.1007/S10462-022-10173-W.
[40] Y. Cheng, K. Hu, J. Wu, H. Zhu, and X. Shao, “A convolutional neural network based degradation indicator construction and health prognosis using bidirectional long short-term memory network for rolling bearings,” Adv. Eng. Informatics, vol. 48, p. 101247, Apr. 2021, doi: 10.1016/J.AEI.2021.101247.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
___________________________________________________________
International Journal of Advances in Intelligent Informatics
ISSN 2442-6571 (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: info@ijain.org (paper handling issues)
andri.pranolo.id@ieee.org (publication issues)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0