A scene perception system for visually impaired based on object detection and classification using CNN

¹ Assistant professor, Xavier Institute of Engineering, Mumbai, India
² Student of Electronics and Telecommunication Department, Xavier Institute of Engineering, Mumbai, India
³ Student of Electronics and Telecommunication Department, Xavier Institute of Engineering, Mumbai, India
⁴ Student of Electronics and Telecommunication Department, Xavier Institute of Engineering, Mumbai, India

Abstract

In this paper we have developed a system for visually impaired people using OCR and machine learning. Optical Character Recognition is an automated data entry tool. To convert handwritten, typed or printed text into data that can be edited on a computer, OCR software is used. The paper documents are scanned on simple systems with an image scanner. Then, the OCR program looks at the image and compares letter shapes to stored letter images. OCR in English has evolved over the course of half a century to a point that we have established application that can seamlessly recognize English text. This may not be the case for Indian languages, as they are much more complex in structure and computation compared to English. Therefore, creating an OCR that can execute Indian languages as suitably as it does for English becomes a must. Devanagari is one of the Indian languages spoken by more than 70% of people in Maharashtra, so some attention should be given to studying ancient scripts and literature. The main goal is to develop a Devanagari character recognition system that can be implemented in the Devanagari script to recognize different characters, as well as some words.