Questions about spark-streaming
Read more about spark-streaming
python (12.9k questions)
javascript (9.2k questions)
reactjs (4.7k questions)
java (4.2k questions)
java (4.2k questions)
c# (3.5k questions)
c# (3.5k questions)
html (3.3k questions)
Empty RDD while consuming messages from Rabbitmq in sparks scala
Below is the spark streaming code to consume messages from RabbitMQ.
import java.io.{ BufferedReader, InputStreamReader }
import java.net.Socket
import java.nio.charset.StandardCharsets
import org.ap...
SanjanaSanju
Votes: 0
Answers: 1
Unable to connect to RabbitMQ in spark scala
Below is the code used for testing the Rabbitmq connection in spark scala.
import com.rabbitmq.client.ConnectionFactory
def getRabbitMQConnection()={
val factory = new ConnectionFactory()
fact...
SanjanaSanju
Votes: 0
Answers: 1
Databricks Autoloader is getting stuck and does not pass to the next batch
I have a simple job scheduled every 5 min. Basically it listens to cloudfiles on storage account and writes them into delta table, extremely simple. The code is something like this:
df = (spark
.rea...
Maksym
Votes: 0
Answers: 1
databricks Structured Streaming: Where are the reliable receivers on streaming architecture
All, trying to understand the Databricks Structured Streaming architecture.
Is this architecture diagram relevant for Structured Streaming as well?
If so here are my questions:
Q1: I see here the con...
SriramN
Votes: 0
Answers: 1