Convert XLS to Avro

XLS files are Excel files that use the Binary Interchange File Format (BIFF). This was the default format for Excel versions 97-2003.

XLS files can have multiple sheets, and each sheet can contain multiple rows and columns of data. They support various data types, including text, numbers, dates, and formulas.

Key features of XLS files include:

• Works with older versions of Excel and other spreadsheet software
• Can store formatting information, charts, and macros
• Smaller file size compared to newer formats like XLSX
• Limited to 65,536 rows and 256 columns per sheet

While XLS files are still widely used, they're gradually being replaced by the more modern XLSX format.

Avro is a row-based data serialization system developed within Apache's Hadoop project. It provides rich data structures and a compact, fast binary data format.

Technical Details

Avro uses JSON for defining data schemas, which are stored with the data. This enables schema evolution while maintaining compatibility. The data itself is stored in a compact binary format.

Advantages

• Compact binary serialization
• Schema definition included with the data
• Support for schema evolution
• Dynamic typing and code generation

Limitations

• Not human-readable without special tools
• Less widely supported than formats like JSON or CSV
• More complex to implement than simpler formats
• Less efficient for columnar queries than Parquet