Skip to content

CSV Chunk Parsing — 50K rows < 350ms

Re‑engineered bulk SKU import using Web Workers + file chunking (PapaParse) in Angular; from >8s on 100KB files to ~350ms on 1MB.

Impact

  • Parsing performance improved by orders of magnitude
  • Non‑blocking UI with progress updates and error buckets
  • Reduced import failures by validating schema per chunk

Approach

  • Chunked reads, streamed to a dedicated Worker
  • Backpressure control; batch commits to API
  • Virtualized error table; instant filter/sort

Stack

Angular, TypeScript, Web Workers, PapaParse

GitHub
LinkedIn
Medium
Email
Phone