Sorry, very new. I am using pandas to read parquet. A column in my dataset is mapped. I would to filter based on the mapped value, returning only rows which meet my condition. My data looks like this:...

I have a parquet file which is partitioned by YEAR/MONTH/DAY. From what i know, I can read it thay way for a specific date : sqlContext .read .option("basePath", "file:///path...

I have JSON files with null arrays (array (nullable = true) and element: (containsNull = true)) that I'd like to convert to parquet files. These null fields are dropped automatically, while all other ...

I want to convert my pandas df to parquet format in memory (without saving it as tmp file somewhere) and send it further over http request. df.to_parquet method in pandas says that path can be str or ...