arrow
Return

Enterprise E-Mail Classification Using Instruction-Following Large Language Models

delete2026-02-24
delete0
delete
OA
AI
S
Sariyildiz, Ahmet Cagri
D
Durukan-Odabasi, Safak *
DOI:10.3390/app16052173delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Enterprise e-mail corpora contain heterogeneous and domain-specific content that poses challenges for conventional supervised Natural Language Processing (NLP) approaches due to class imbalance, evolving terminology, and limited labeled data. This study examines the use of instruction-following Large Language Models (LLMs) for enterprise e-mail classification under realistic operational conditions. The study evaluates instruction-based classification and semantic enrichment derived from distributional similarity as two complementary approaches for distinguishing technical from nontechnical messages. The approaches are assessed on a large-scale enterprise e-mail corpus and validated using a manually annotated subset. The results indicate that instruction-following LLMs provide stable contextual reasoning across diverse message structures, while semantic enrichment improves coverage of previously unseen technical expressions. Overall, the study presents an applied NLP framework for enterprise e-mail classification, with attention to interpretability, scalability, and robustness in real-world organizational settings.
Keywords:
natural language processing
enterprise e-mail classification
large language models
instruction-following models
applied machine learning

Journal

A
Applied Sciences-Basel
IF:
2.5
Papers:
7.3K
Citations:
4

Organization

B
Bahcesehir University
Scholars:
1.3K
Papers: 1.6K
Citations: 26
I
istanbul university - cerrahpasa
Scholars:
5.9K
Papers: 4.2K
Citations: 4