[2A1-GS-10] AI application:

[2A1-GS-10-02] Advanced Support System Applying LLM to Daily Tasks in Japan's Diplomacy vis-à-vis DPRK.

〇Harada Takeo¹ (1. Institute for International Strategy and Information Analysis, Inc.)

Keywords:LLM, diplomacy, DPRK

In the midst of the current declining population in Japan, the GOJ has been urged to make use of AI in various daily tasks carried out in its diplomatic service. Picking up daily work in Japan’s diplomacy vis-à-vis DPRK, the author presents a novel support system using GPT-4o with a corpus originated from the “North Korea Fax News”, a well-qualified information source of DPRK’s public announcements published by the Radio Press in Tokyo. The support system is capable of not only accomplishing typical daily tasks of desk officers in charge of DPRK issues, but also evaluating its own performance based on the 7 metrics for the retrieval augmented generation (RAG) in connection with the LLM. Despite the fact the system is still partly dependent on human evaluation and supervision as well, it is able to dramatically decrease the growing burden for unexperienced and unskilled young desk officers in the MOFA.