Intent Detection Using Contextualized Deep SemSpace


ORHAN U., Tosun E. G., Ozkaya O.

ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, cilt.48, sa.2, ss.2009-2020, 2023 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 48 Sayı: 2
  • Basım Tarihi: 2023
  • Doi Numarası: 10.1007/s13369-022-07016-9
  • Dergi Adı: ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, zbMATH
  • Sayfa Sayıları: ss.2009-2020
  • Anahtar Kelimeler: Natural language understanding, Intent detection, Generalized SemSpace, Synset vectors, Bidirectional long short-term memory, WordNet
  • Çukurova Üniversitesi Adresli: Evet

Özet

In this study, a new approach called Contextualized Deep SemSpace is proposed for intent detection. First, the synset vectors are determined by training the generalized SemSpace method with the WordNet 3.1 data. Then, each word in an intent dataset is transformed into a synset vector by a contextualized approach, and finally, the synset vectors are trained with a deep learning model using BLSTM. Since the proposed approach adapts the contextualized semantic vectors to the dataset with a deep learning model, it treats like one of contextualized deep embeddings like BERT, ELMo, and GPT-3 methods. In order to measure the success of the proposed approach, some experiments have been carried out on six well-known intent detection benchmark datasets (ATIS, Snips, Facebook, Ask Ubuntu, WebApp, and Chatbot). Although the dependence of its vocabulary on WordNet causes a serious number of out of vocabulary problems, results showed that the proposed approach is the most successful intent classifier in the literature. According to these results, it can be said that deep learning-based contextualized synset vectors can be used successfully in many problems.