[2A6-GS-10] AI application: Marketing

[2A6-GS-10-02] Evaluation of classification task for inappropriate sentences in SNS using ChatGPT

Syota Yanachi¹, Hayato Okada¹, Keisuke Yoneda¹, 〇Daisaburo Yoshioka¹ (1. Sojo University)

Keywords:ChatGPT, SNS

In this report, we evaluate classification tasks for inappropriate sentences in SNS using ChatGPT. It is shown that only prompts including Zero-shot CoT and Few-shot learning do not result in high performance compared with a fine-tuned BERT model. Our result also shows that a fine-tuned ChatGPT achieves an accuracy of over 90%, which is comparable in performance to BERT.