File
Description
File data sources are files on disk or on S3. Currently only Parquet files are supported.
FileSource is meant for development purposes only and is not optimized for production use.
Example
The full set of configuration options is available here.
Supported Types
File data sources support all eight primitive types and their corresponding array types. For a comparison against other batch data sources, please see here.
Last updated