Research Information System
Signal, Image and Video Processing, vol.19, no.4, 2025 (SCI-Expanded)
As the variety of cosmetic products increases day by day, the controllability of their ingredients decreases. It is becoming difficult for users to obtain information about the potential risks of the products they purchase. The main reasons for this are that ingredients that can cause health problems, such as allergens and harmful chemicals in cosmetic products, have complicated names on their labels, and the text on the labels is difficult to read. This makes it difficult for consumers to accurately assess potential health risks. The aim of this project is to identify harmful ingredients in cosmetic products and to inform the user about the potential risks of these products. Our project includes a mobile application developed as a solution to the difficulties of making informed choices in the cosmetics industry. Users can use the application by taking photos of the labels of cosmetic products with their smartphones. These photos pass through an OCR engine in the background. The OCR engine detects the text on the label and converts it into digital text format. This text data is sent to a pre-trained LSTM-based information extraction model. Thus, the information extraction model identifies the ingredients from all the text on the label. This list of detected ingredients is compared against a database of harmful ingredients using a word similarity algorithm. The database consists of harmful ingredients identified in light of reports and articles previously published by various organizations. After all these steps, the user is provided with information about the harmful ingredients in the product, the potential risks associated with these substances, and the names of all the ingredients found in the product. As a result of the project, an application developed for smartphones allows users to learn the ingredients of cosmetic products instantly by taking a photo. The application identifies ingredients with high accuracy rates and detects harmful ingredients. In this way, the objective is to protect consumers from potential health risks in cosmetic products by making informed choices.