Reviewed 2026-08-28
Recovering Partial NDJSON Imports
Commit valid records in bounded groups while recording exact failed lines.
Example input
{"id":1}
BROKEN
{"id":3}Expected output
line 2 failed; lines 1 and 3 retained
Reproducible method
- Preserve the original and create the smallest representative sample.
- Run a strict parse or validation before transformation.
- Record options, compare counts and structure, then test in the receiving system.
Common error
Stopping on the first malformed line discards later valid records.
Reduce a failure while retaining the problematic structure; this separates malformed input from unsupported behavior.
Technical limitation
Recovery cannot make a malformed record trustworthy.
A successful preview does not remove format ambiguity or downstream requirements.
Security and privacy
Log line numbers and hashes rather than sensitive record bodies.
Local processing reduces transfer risk but cannot protect a compromised browser, unsafe extensions, clipboard history, or later misuse.
Verification checklist
- Check field, record, page, or byte counts.
- Review edge cases and error output.
- Retain the original until acceptance.
- Document assumptions for automation.