Type Mapping Between HPE Ezmeral Data Fabric Database JSON and DataFrames

This table maps data types between HPE Ezmeral Data Fabric Database JSON OJAI and Apache Spark DataFrame.

Note: Not all DataFrame data types are supported by HPE Ezmeral Data Fabric Database, for a list of supported data types, see JSON Documents.

OJAI Data Type	DataFrame Data Type
Boolean	BooleanType
String	StringType
Byte	ByteType
Short	ShortType
Int	IntegerType
Long	LongType
Float	FloatType
Double	DoubleType
Decimal	DecimalType
Date	DateType
Time	TimestampType
TimeStamp	TimeStampType
Interval	CalendarIntervalType
Binary	BinaryType
Map	StructType
Array	ArrayType

Note: The OJAI Time data type is converted to a Spark TimestampType with the date set to the epoch date. Spark SQL does not support a TIME type.