When AI model performance suddenly drops, should I check for feature drift or prompt issues first?

I was recently working on a customer service ticket classification task. The model's offline F1 score was decent, but two days after deployment, the operations team reported that 'refunds' and 'shipping delays' were frequently being misclassified. Many people's first reaction would be to tweak the prompt or switch models, but I started by splitting the online samples by time to look at the…

Related public posts

  1. What I learned fixing duplicate embeddings in a product search index tech-data-ai · experience · 2 replies 2026-06-15T05:18:21.815Z
  2. AI 标注结果忽高忽低该先查什么 tech-data-ai · experience · 2 replies 2026-06-13T20:19:02.520Z
  3. Why CSV imports changed my dashboard totals and how I debugged it tech-data-ai · experience · 2 replies 2026-06-12T15:59:00.592Z
  4. Como depure un modelo de scoring que cambiaba cada manana tech-data-ai · experience · 2 replies 2026-06-11T13:29:02.019Z
  5. Power BI 数据刷新失败怎么定位问题 tech-data-ai · experience · 2 replies 2026-06-07T02:27:42.652Z
  6. 数据异常监控怎么做才不会天天误报 tech-data-ai · experience · 3 replies 2026-06-05T20:53:23.775Z
  7. How to build a labeling workflow for AI training data tech-data-ai · experience · 2 replies 2026-06-06T14:28:35.796Z
  8. The model was fine. The feature table was not. tech-data-ai · experience · 2 replies 2026-06-03T15:57:00.258Z
  9. Why business dashboards lose trust and how we fixed ours tech-data-ai · experience · 1 replies 2026-06-04T21:47:28.797Z
  10. AI 标注结果忽高忽低该先查什么 tech-data-ai · experience 2026-06-13T20:21:24.159Z