Questions about sparklyr
Read more about sparklyr
python (12.9k questions)
javascript (9.2k questions)
reactjs (4.7k questions)
java (4.2k questions)
java (4.2k questions)
c# (3.5k questions)
c# (3.5k questions)
html (3.3k questions)
How do you use sdf_checkpoint to break spark table lineage in sparklyr?
I'm attempting to manipulate a Spark RDD via sparklyr with a dplyr mutate command to construct a large number of variables, and each time this seems to fail with an error message regarding Java memory...
math_stats051
Votes: 0
Answers: 0
In dplyr/sparklyr, when the variable names are Chinese, the `dplyr::copy_to` failed
In dplyr/sparklyr, when the variable names are Chinese, the dplyr::copy_to failed? Anyone can help? Thanks!
library(sparklyr)
library(tidyverse)
sc <- spark_connect(master='local')
#the variable n...
anderwyang
Votes: 0
Answers: 0
in sparklyr ,how to drop a existing object (table ) thanks
In R/Sparklyr,there is a spark table 'iris_csv', i want to drop it, but dplyr::db_drop_table(sc,'iris_csv') failed, anyone can help? Thanks!
Here is the error message as attached image .
anderwyang
Votes: 0
Answers: 0
sparklyr spark_read_table from a specific database
My database admin has moved my tables from default to another database (named marketing).
my query below no longer works.
this is what was done.
CREATE OR REPLACE VIEW marketing.scv_snap AS select * f...
Choc_waffles
Votes: 0
Answers: 1
