Questions about apache-beam
Read more about apache-beam
python (12.9k questions)
javascript (9.2k questions)
reactjs (4.7k questions)
java (4.2k questions)
java (4.2k questions)
c# (3.5k questions)
c# (3.5k questions)
html (3.3k questions)
Apache Beam Performance Between Python Vs Java Running on GCP Dataflow
We have Beam data pipeline running on GCP dataflow written using both Python and Java. In the beginning, we had some simple and straightforward python beam jobs that works very well. So most recently ...
Jie Zhang
Votes: 0
Answers: 1
Apache beam KafkaIO commit offset behaviour
In KafkaIO.expand method, I noticed that the offsets are committed as a separated branched pipeline step. Won't it lead to dropped data? For example, the kafka records may be consumed by a downstream ...
sha
Votes: 0
Answers: 1
Correct Apache beam windowing strategy for joining two streams of data
I have a use case where I need to read data from two streams and join them by a key. One stream contains a send record and the other stream contains an acknowledgement to this send. So I will find exa...
user2881080
Votes: 0
Answers: 1
Serialize JSON String to AVRO Apache Beam KafkaIO
I have a JSON String that needs to be serialized to AVRO format so that I can publish that to a Kafka topic that has an Avro schema with schema validation on it. Below is what I have tried so far but ...
turingMan
Votes: 0
Answers: 1