Questions about aws-glue
Read more about aws-glue
python (12.9k questions)
javascript (9.2k questions)
reactjs (4.7k questions)
java (4.2k questions)
java (4.2k questions)
c# (3.5k questions)
c# (3.5k questions)
html (3.3k questions)
AWS Glue (Spark) very slow
I've inherited some code that runs incredibly slowly on AWS Glue.
Within the job it creates a number of dynamic frames that are then joined using spark.sql. Tables are read from a MySQL and Postgres ...
Mat Richardson
Votes: 0
Answers: 3
AWS Glue Job to install Python wheel that depends on another wheel specified in --extra-py-files
I have a Glue Job that is started from a Lambda that is triggered by an S3 put event. This Glue Job has a some proprietary dependencies, that when using them locally are normally available via a priva...
drrkmcfrrk
Votes: 0
Answers: 1
Understanding Segments in AWS Glue and its usage on Presto/Trino
I read the docs for AWS Glue GetPartitionsAPI and noticed that it has "Segment" parameter:
"Segment": {
"SegmentNumber": number,
"TotalSegments"...
vdmx
Votes: 0
Answers: 0
ListBucket vs ListObjects
Recently I have checked my AWS billing details in the CSV file. I was charged for the ListBucket operation. I have enabled CLoudTrail to understand who is making ListBucket requests. Using CloudTrail ...
Surya
Votes: 0
Answers: 1