Back to Home
Towards Data Science··Industry Media

Noisy Text in RAG: Typos, OCR, and the Gap Classical Spell-Check Leaves

中文摘要

RAG面临拼写、转录和OCR错误挑战。传统拼写检查仅能解决一类,其余噪声会通过嵌入向量影响检索。

English Summary

RAG faces challenges from typos, transcription, and OCR errors. Traditional spell-checkers only address one type, leaving embeddings vulnerable to the remaining noise.

Original Excerpt

Enterprise Document Intelligence [Vol.1 #B1] - Three sources of one problem. User typos, fast-typing transcription noise, OCR character errors. Classical spell-check handles one of them. Embeddings carry the rest The post Noisy Text in RAG: Typos, OCR, and the Gap Classical Spell-Check Leaves appeared first on Towards Data Science.