Questions about dask-distributed
Read more about dask-distributed
python (12.9k questions)
javascript (9.2k questions)
reactjs (4.7k questions)
java (4.2k questions)
java (4.2k questions)
c# (3.5k questions)
c# (3.5k questions)
html (3.3k questions)
Scattering data to dask cluster workers: unknown address scheme 'gateway'
I am following the code found on the accepted answer to this SO question (the "Chunk then scatter" part) and I get a strange error while trying to scatter a pandas.DataFrame to the workers.
...
duff18
Votes: 0
Answers: 1
How to configure two servers with different IP in different networks into one cluster in Dask?
I'm trying to set up Dask cluster with docker containers of nodes in different networks.
Here is my simplified configurations with one worker. (public IP is randomly written)
Node configurations
1. No...
Dongjin Yoon
Votes: 0
Answers: 0
msgpack could not serialize large numpy ndarrays
I trying to send large numpy ndarrays through client.scatter(np_ndarray). The np_ndarray is about 10GB; I am getting this error msgpack Could not serialize object of type ndarray.
I used alternatively...
Mitchou
Votes: 0
Answers: 3
How to change dask job_name to SGECluster
I am using dask_jobqueue.SGECluster() and when I submit jobs to the grid they are all listed as dask-worker. I want to have different names for each submitted job.
Here is one example:
futures = []
fo...
IvanV
Votes: 0
Answers: 1