python (12.9k questions)

javascript (9.2k questions)

reactjs (4.7k questions)

java (4.2k questions)

java (4.2k questions)

c# (3.5k questions)

c# (3.5k questions)

html (3.3k questions)

Questions - msgpack

msgpack could not serialize large numpy ndarrays

I trying to send large numpy ndarrays through client.scatter(np_ndarray). The np_ndarray is about 10GB; I am getting this error msgpack Could not serialize object of type ndarray. I used alternatively...
test-img

Mitchou

python

dask

numpy-ndarray

dask-distributed

msgpack

Votes: 0

Answers: 3

Latest Answer

To answer your other three questions: Is msgpack always used when data is sent by scatter, or dask decides about the protocol depending on the data type? Yes, Dask does select a default serializer d...
test-img

pavithraes

Posts

Questions

Blogs

Jobs