Noisy Text in RAG: Typos, OCR, and the Gap Classical Spell-Check Leaves
中文摘要
RAG面临拼写、转录和OCR错误挑战。传统拼写检查仅能解决一类,其余噪声会通过嵌入向量影响检索。
English Summary
RAG faces challenges from typos, transcription, and OCR errors. Traditional spell-checkers only address one type, leaving embeddings vulnerable to the remaining noise.
Original Excerpt
Enterprise Document Intelligence [Vol.1 #B1] - Three sources of one problem. User typos, fast-typing transcription noise, OCR character errors. Classical spell-check handles one of them. Embeddings carry the rest The post Noisy Text in RAG: Typos, OCR, and the Gap Classical Spell-Check Leaves appeared first on Towards Data Science.