Intelligent System to Transformer Slang Words into Formal Words

Authors

  • Ahmed Abdulstar Ibrahim Northern Technical University
  • Ban Shareef Mustafa University of Mosul / College of Computer Science and Mathematics / Department of Computer Science

DOI:

https://doi.org/10.56286/ntujet.v2i2.689

Keywords:

NLP, NLP task, Transformer, slang words, facebook/bart-base, slang to formal words

Abstract

Understanding and utilizing informal words not recognized in standard dictionaries poses challenges for users. These words are specific to certain communities, hindering comprehension for those outside. Natural language processing tasks, like translation and summarization, struggle with informal vocabulary and local dialects. Although existing models can translate informal words, comprehensive solutions are elusive due to regional and contextual variations. Developing natural language processing models that consider informal words and local dialects is crucial for future research. This paper presents an updated dataset of informal English words tailored to current usage. Multiple models from the Transformer core library on the Hugging Face platform were trained and evaluated, with the facebook/bart-base model demonstrating high accuracy (training data loss: 0.05299). Continued research and innovation in this field are imperative for effective cross-cultural and intercommunity communication

Additional Files

Published

2023-10-17

Issue

Section

Articles

How to Cite

[1]
“Intelligent System to Transformer Slang Words into Formal Words ”, NTU-JET, vol. 2, no. 2, Oct. 2023, doi: 10.56286/ntujet.v2i2.689.