Questions about apache-spark-sql
Read more about apache-spark-sql
python (12.9k questions)
javascript (9.2k questions)
reactjs (4.7k questions)
java (4.2k questions)
java (4.2k questions)
c# (3.5k questions)
c# (3.5k questions)
html (3.3k questions)
Is it possible to define recursive DataType in PySpark Dataframe?
I want to create a schema like this example:
friendSchema = StructType([ \
StructField("firstname",StringType(),True), \
StructField("middlename",StringType(),True), \
...
Omid
Votes: 0
Answers: 4
You may get a different result due to the upgrading of Spark 3.0: Fail to parse 'JUN 2001' in the new parser
I'm working on converting a string to date in SparkSQL. The string format is "Jun 2001', I tried to convert to date format as 'MMMyyyy' by using the query below
SELECT
TO_DATE(CAST('JUN 2...
Rosa Xue
Votes: 0
Answers: 0
Spark batch processing on driver
I have a set of parquet files which I want to load onto a database which is an unsupported sink in spark. The object to communicate with the database, cannot be used within a spark function such as fo...
Blaze
Votes: 0
Answers: 1
Spark SQL FIRST() function equivalence in Presto
What is the equivalence of the FIRST Spark SQL function in Presto?
WITH test (
select 2 as id,
'something 2' as name
union
select
3 as id,
'something 3' as name
union
select 1 as id,...
dim_user
Votes: 0
Answers: 1