Varparser Reveals How LLM Log Parsing Benefits From Variable Data

Log parsing, the process of transforming unstructured log data into a structured format, remains a vital task for diagnosing failures within large online systems. Researchers Jinrui Sun, Tong Jia, Minghua He, and Ying Li from Peking University present a novel approach, VarParser, which addresses a significant limitation in current large language model (LLM)-based log parsers: their neglect of variable components within log messages. This work is significant because it moves beyond a constant-centric strategy, demonstrating that actively utilising variable data improves log grouping, reduces LLM processing costs, and crucially, preserves valuable system information often lost in traditional parsing methods. VarParser employs variable contribution sampling, a…

Source link

Leave a Comment