Apache Avro is a row-oriented remote procedure call and data serialization framework developed within Apache's Hadoop project. It uses JSON for defining data types and protocols, and serializes data in a compact binary format.
Avro is designed to support complex nested data structures and enables efficient querying and manipulation of specific columns without reading the entire dataset.
Comma-separated values (CSV) is a simple and widely used format for storing tabular data. It is human-readable and easy to generate and parse.
The row delimiter is the character used to separate each row in the CSV data. This is usually a new line character (LF), or a carriage return plus a new line character (CRLF).
We will automatically detect this and parse the rows correctly.
The value separator is the character used to separate each value inside a row.
For CSV files, as the name implies it is usually a comma, but it can be different depending on the software used to generate the CSV file, we support the following separators:
,\t|#;Depending on what software you used to generate the CSV file, it might have a different character encoding
If no character encoding is specified we will automatically try to guess it, so you don't have to worry about it if you're unsure.