Navigation and Object Detection for Blind Persons Based on Neural Network
Main Article Content
Keywords
Blind persons, Neural network, LiDAR
Abstract
Tools for blind people with mobility activities in pedestrian pathways have been widely launched, approved and patented. However, there are still shortcomings that can be done only for pedestrian paths or nearby destinations. In this study, both a camera (detection of the pedestrian path) and LiDAR (detection of surrounding objects) sensors to help disability activities. The first stage of image data from the preparatory camera from RGB to XYZ, color filters, close morphology, resizing, learning and testing of neural networks. Bring up 3 voice attitudes information. Attitudes are perpendicular, left tilted, right tilted, or not reversed to the pedestrian yellow path. The second stage of the LiDAR distance points data is processed into 2D array geometry, learning, and testing of neural networks. Bring up the information 8 voice attitudes. Detection of the cycle and distance of objects right side, front, left, right-front, right-left, front-left, right-front-left, not captured. The test results approximately at lux <15000 got 89.7% accuracy for pedestrian path detection and 87.5% for object detection.
Downloads
References
Andhare, S., Pise, A., Gopanpale, S. 2016. Automated Mobility and Orientation System for Blind. International Research Journal of Engineering and Technology (IRJET), 1762-1765.
Dhananjeyan, S., Sundaram, K., Kalaiyarasi, A., Kuppusamy, P. 2016. Design and Development of Blind Navigation System using GSM and RFID Technology. Indian Journal of Science and Technology, 9(2)1-9(2)5.
Sukhdeep, B., Akansha, P., Anindita, R., Arpan, D. 2016. Blind Navigation System. 3rd International Conference on Recent Trends in Engineering Science and Management (ICRTESM), 780-785.
Ganguli, A., Pushp, D., Chaudhary, A. 2016. Electronic Travel Aids ETA for Blind Assistance. International Journal of Engineering Science and Computing (IJESC), 2672-2675.
Gassert, R., and Team. 2013. White Cane With Integrated Electronic Travel AD Using 3D TOF Sensor. The United States Patent Application Publication, US2013/0220392A1.
Le, M., Phung, S. Lam. & Bouzerdoum, A. 2012. Pedestrian lane detection for assistive navigation of blind people. 21st International Conference on Pattern Recognition (ICPR), 2594-2597.
Le, M., Phung, S., Bouzerdoum, A. 2014. Pedestrian Lane Detection in Unstructured Environments for Assistive Navigation. International Conference on Digital Image Computing: Techniques and Applications (DICTA), 1-8.
Mocanu, I., Clapton, C. 2018. Multimodal Convolutional Neural Network for Object Detection Using RGB-D Images. 41st International Conference on Telecommunications and Signal Processing (TSP), Athens, 1-5.
Rao, K., Jyothi, K., Mahamood, S. 2015. Secure Navigation for the Blind People by Using RFID. International Journal Of Innovative Research In Electrical Electronics Instrumentation and Control Engineering (IJIREEICE ), 132-135.
Setiadi, B., Supriyadi, T. 2017. Development Of Visual Sensory Aids Using Embedded System for Blind Person. Proceeding the-6 International Seminar ASAIS- Politeknik Negeri Jakarta, 1-6.
Setiadi, B., Supriyadi, T., Nugroho, H. 2018. Development Of Navigation Visual Sensory Aids For Blind Persons Using Camera. Proceeding ICSTR-Jakarta Universitas Al Azhar Jakarta.
Wahab, M., Talib, A., Kadir, H., Johari, A., Noraziah, A., Sidek, M., Mutalib, A. 2011. Smart cane: assistive cane for visually impaired people. International Journal of Computer Science Issues (IJCSI), 21-27.
Wang, S., Tian, Y. 2012. Detecting Stairs and Pedestrian Crosswalks for the Blind by RGBD Camera. IEEE International Conference on Bioinformatics and Biomedicine Workshops, Philadelphia, 732-739.
Wenlong, S., Yupeng, C., Xuefu, C. 2016. The Design of a Guide Device with Multi-Function to Aid Travel for Blind Person. International Journal of Smart Home (IJSH), 77-86.
Ye, C., Qian, X. 2018. 3-D Object Recognition of a Robotic Navigation Aid for the Visually Impaired. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 441-450.
Yi, C., Tian, Y., Arditi, A. 2014. Portable Camera-Based Assistive Text and Product Label Reading From Hand-Held Objects for Blind Persons. IEEE/ASME Transactions on Mechatronics, 808-817.