Skip to content
OpenSmartRoute

LLMs1 min read

CrisisKD: Knowledge Distillation for Aspect-Level Analysis

CrisisKD is a five-stage knowledge distillation framework using Qwen2.5-7B to perform aspect-level sentiment and emotion analysis on crisis discourse data. The open-source system improves performance and reduces inference costs compared to the teacher model.

By OpenSmartRoute editorial · written through the router by writer-small

From arXiv cs.CL - “CrisisKD: Five-Stage Knowledge Distillation for Aspect-Level Sentiment and Emotion Analysis in Crisis Discourse”

A new framework, CrisisKD, was announced for aspect-level sentiment and emotion analysis in crisis situations. The framework utilizes a teacher LLM to generate aspect-level labels and reasoning traces, which supervise a smaller student model. The process involves aspect extraction, syntactic parsing, opinion extraction, sentiment classification, and emotion classification. A dataset of 50,615 aspect-level labels was created and released as open-source resources. The student model, based on Qwen2.5-7B, demonstrates improved performance on several tasks.

On a 500-tweet gold set, the student model achieved a 7.9 F1 point improvement on aspect extraction, a 17.0 point improvement on emotion accuracy, and a 6.5 point improvement on sentiment accuracy compared to the untuned model. Furthermore, the CrisisKD system improved the Qwen2.5-7B ICL baseline on the ABEA benchmark by 2.8 F1 points on ATE and 3.8 F1 points on joint ATE+AEC.

This framework offers a method for reducing inference costs while maintaining accuracy in analyzing complex textual data. The open-source nature of the dataset and scripts allows for further research and development in this area. The system’s performance suggests potential applications in understanding public concerns during crisis events.

Source: https://arxiv.org/abs/2609.05757

Published Sep 9, 2026 · updated Sep 9, 2026 · 185 words

Keep reading

Related posts

More in LLMs

LLMs1 min read

Query Rewriting Enhances RAG Performance Through Complementarity

Research found that combining query rewriting strategies with a strong RAG baseline yields significant improvements in retrieval accuracy, primarily driven by complementarity rather than increased retrieval budget. A cost-aware router further optimizes this approach.

LLMs1 min read

Intra-Prompt Parallel Decoding for CCQA

A new inference method, Intra-Prompt Parallel Decoding (IPPD), achieves up to 7x throughput in common-context question answering by decoding multiple questions within a single prompt. This approach overcomes GPU memory bottlenecks and outperforms existing techniques like prefix caching.

LLMs1 min read

ModularPhaseNet: Discretized Phase Geometry for Transformers

ModularPhaseNet introduces a classical, integer-computable discretization of complex phase geometry, offering a new approach to Transformer architecture. It utilizes cyclic group operations for phase representation, aiming to improve semantic hierarchy and contextual consistency.