Questions about rdd
Read more about rdd
python (12.9k questions)
javascript (9.2k questions)
reactjs (4.7k questions)
java (4.2k questions)
java (4.2k questions)
c# (3.5k questions)
c# (3.5k questions)
html (3.3k questions)
Spark Flatmap - what is the usage of evidence$4
I happeneed to see the javadoc of flatmap function and come across "evidence$4" - what is the purpose of it.
public <U> RDD<U> flatMap(scala.Function1<T,scala.collection.Trave...
Nag
Votes: 0
Answers: 0
pyspark- how to add a column to spark dataframe from a list
I'm looking for a way to add a new column in a Spark DF from a list. In pandas approach it is very easy to deal with it but in spark it seems to be relatively difficult. Please find an examp
#pandas a...
sebikooo
Votes: 0
Answers: 1
pyspark reduceByKey not subscriptable error
during practice pyspark
from pyspark import SparkConf, SparkContext
conf = SparkConf().setMaster("local").setAppName("PopularMovies_Repartition")
sc = SparkContext.getOrCreate(co...
pei
Votes: 0
Answers: 1
Finding the minimum value of a column using PySpark Map Reduce
I'm looking to find out how I can use the map and reduce functions on a PySpark RDD to determine the smallest value in each of my RDD columns.
I understand that the agg function can be used on datafra...
rossca
Votes: 0
Answers: 2