SIGN IN SIGN UP
infiniflow / ragflow UNCLAIMED

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

0 0 176 Python

fix(mineru): skip page chrome blocks to prevent duplicate chunks (#15387)

## Summary
- Skip MinerU `header`, `footer`, and `page_number` blocks when
converting `content_list.json` into sections.
- Ignore unsupported block types explicitly so future MinerU output
types cannot re-emit the previous text block.

Fixes duplicate text in General/naive chunks when parsing PDFs via
MinerU (reported with repeated page headers and body text in slices).

Closes #15335

## Test plan
- [x] `pytest test/unit_test/deepdoc/parser/test_mineru_parser.py -v`
(4/4 passed)
M
monsterDavid committed
d398d617caf9d639d5a0a57e67970bc7cb9bb698
Parent: f0e4f2d
Committed by GitHub <noreply@github.com> on 6/1/2026, 12:15:04 PM