Questions about apache-spark
Read more about apache-spark
python (12.9k questions)
javascript (9.2k questions)
reactjs (4.7k questions)
java (4.2k questions)
java (4.2k questions)
c# (3.5k questions)
c# (3.5k questions)
html (3.3k questions)
How to use Hikari pool connection in spark dataset jdbc
Is there any way to read database oracle with spark implementing a pool of connection with hikari datasource?
I'm using java
// How to execute the query below using a pool of connection?
Dataset&l...
Dilermando Lima
Votes: 0
Answers: 0
Is it possible to define recursive DataType in PySpark Dataframe?
I want to create a schema like this example:
friendSchema = StructType([ \
StructField("firstname",StringType(),True), \
StructField("middlename",StringType(),True), \
...
Omid
Votes: 0
Answers: 4
Type arguments do not conform to trait type parameter bounds
I am using a library which is written by amazon in scala here
The trait goes like this :
trait Analyzer[S <: State[_], +M <: Metric[_]]
I am trying to make a case object to store some informati...
Shiv
Votes: 0
Answers: 1
Is there a monitoring endpoint for Spark Structured streaming?
In Spark's official docs, we see that there are monitoring endpoints for DStream like
/streaming/statistics
However, there does not seem to be ones for structured streaming mentioned here. I'm look...
yeskarthik
Votes: 0
Answers: 0