NDJSON
NDJSON (Newline Delimited JSON) is a convenient format for storing or streaming structured data that may be processed one record at a time. Each line in an NDJSON file is a valid JSON object, separated by a newline character.
This format is particularly useful for handling large datasets, as it allows for easy parsing and processing of data line by line without loading the entire file into memory.
Key Features
- Each line is a self-contained JSON object
- Simple to read and write sequentially
- Ideal for streaming and logging applications
- Supports partial processing of large datasets
NDJSON is commonly used in data pipelines, log processing, and scenarios where you need to append new data to existing files without modifying the entire structure.