Fine-Tuning IndoBERTweet for Sentiment Analysis of Indonesian Restaurant App Reviews: A Case Study of McDonald's Indonesia

Hafiz Mahardika; Dhian Sweetania; Bambang Yulianto

doi:10.63956/jitar.v2i1.75

Authors

Hafiz Mahardika Gunadarma University
Dhian Sweetania Gunadarma University
Bambang Yulianto Gunadarma University

DOI:

https://doi.org/10.63956/jitar.v2i1.75

Keywords:

IndoBERTweet; Sentiment Analysis; Google Play Store; Mobile Application Reviews; Restaurant Applications

Abstract

The increasing adoption of mobile applications in the restaurant industry has generated large volumes of user reviews that provide valuable insights into customer satisfaction and application performance. However, manually analyzing thousands of reviews is inefficient, highlighting the need for automated sentiment analysis techniques. This study aims to develop and evaluate a fine-tuned IndoBERTweet model for sentiment analysis of user reviews of the McDonald's Indonesia mobile application on Google Play Store while identifying dominant complaint patterns that can support application improvement. A total of 4,000 Indonesian-language reviews were collected using Google Play Scraper. After removing boycott-related reviews and performing text preprocessing, 3,897 reviews were retained for analysis. Sentiment labels were automatically assigned based on star ratings, and the training dataset was balanced using Random Oversampling and class-weighted optimization. The IndoBERTweet model was fine-tuned using an 80:20 train–test split for three training epochs in Google Colaboratory. Model performance was evaluated using accuracy, precision, recall, F1-score, and confusion matrix analysis, while negative reviews were further examined through unigram and bigram frequency analysis. The proposed model achieved an accuracy of 85.38%, with a weighted precision of 88.16%, a weighted recall of 85.38%, and a weighted F1-score of 86.64%. Negative sentiment was classified most accurately (F1-score = 91.72%), whereas neutral sentiment remained challenging because of severe class imbalance. Complaint analysis revealed that the most common user issues involved login authentication, application errors, slow performance, device compatibility, promotions, and loyalty-point redemption. These findings demonstrate that fine-tuned IndoBERTweet is effective for analyzing Indonesian restaurant application reviews and can provide actionable insights for improving digital service quality and user experience.

References

Alvin, F., & Winarsih, N. A. S. (2025). Perbandingan kinerja model IndoBERT, IndoBERTweet, dan algoritma klasik pada analisis sentimen isu Indonesia Gelap. Building of Informatics, Technology and Science, 7(3), 1601–1613. https://doi.org/10.47065/bits.v7i3.8636

Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of NAACL-HLT 2019 (pp. 4171–4186)

Dewi, B. E. S. (2025). Sentiment analysis model on electric vehicles using IndoBERTweet and IndoBERT algorithm. Antivirus: Jurnal Ilmiah Teknik Informatika, 19(2), 192–202. https://doi.org/10.35457/w5r3g517

Jayadianti, H., Kaswidjanti, W., Utomo, A. T., Saifullah, S., Dwiyanto, F. A., & Drezewski, R. (2022). Sentiment analysis of Indonesian reviews using fine-tuning IndoBERT and R-CNN. ILKOM Jurnal Ilmiah, 14(3), 348–354. https://doi.org/10.33096/ilkom.v14i3.1505.348-354

Koto, F., Lau, J. H., & Baldwin, T. (2021). IndoBERTweet: A pretrained language model for Indonesian Twitter with effective domain-specific vocabulary initialization. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 10660–10668. https://doi.org/10.18653/v1/2021.emnlp-main.833

Setiawan, J. C., Lhaksmana, K. M., & Bunyamin. (2023). Sentiment analysis of Indonesian TikTok review using LSTM and IndoBERTweet algorithm. JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika), 8(3), 774–780. https://doi.org/10.29100/jipi.v8i3.3911

Tarwoto, Nugroho, R., Azka, N., & Graha, W. S. R. (2025). Analisis sentimen ulasan aplikasi Mobile JKN di Google Play Store menggunakan IndoBERT. Jurnal JTIK (Jurnal Teknologi Informasi dan Komunikasi), 9(2), 495–505. https://doi.org/10.35870/jtik.v9i2.3340

Aldhy, F., Salsabila, N. A., & Purwarianti, A. (2023). Sentiment analysis for Indonesian online reviews using IndoBERT and deep learning approaches. Journal of Information Systems Engineering and Business Intelligence, 9(2), 181–192. https://doi.org/10.20473/jisebi.9.2.181-192

Cambria, E., Das, D., Bandyopadhyay, S., & Feraco, A. (2017). A practical guide to sentiment analysis. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-55394-8

Liu, B. (2020). Sentiment analysis: Mining opinions, sentiments, and emotions (2nd ed.). Cambridge, UK: Cambridge University Press. https://doi.org/10.1017/9781108630016

Sun, C., Qiu, X., Xu, Y., & Huang, X. (2019). How to fine-tune BERT for text classification? In China National Conference on Chinese Computational Linguistics (pp. 194–206). Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-32381-3_16

Zhang, L., Wang, S., & Liu, B. (2018). Deep learning for sentiment analysis: A survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 8(4), e1253. https://doi.org/10.1002/widm.1253