Carry the heading down
Prepend the section heading to every chunk in that section. Now a chunk says which section it belongs to, and a question naming that section matches strongly. That one change fixes most weak retrieval.
Keep the chunk id
Every chunk needs a stable identifier and a pointer back to the document. Without it you cannot cite the source, and a citation is what makes the answer checkable.