python (12.9k questions)

javascript (9.2k questions)

reactjs (4.7k questions)

java (4.2k questions)

java (4.2k questions)

c# (3.5k questions)

c# (3.5k questions)

html (3.3k questions)

Questions - kubeflow

Specifying Machine Type in Vertex AI Pipeline

I have a pipeline component defined like this: data_task = run_ssd_data_op( labels_path=input_labels, data_config=config_task.outputs["output_data_config"], training_...
test-img

James

google-cloud-platform

kubeflow

google-cloud-vertex-ai

Votes: 0

Answers: 1

Latest Answer

The machine type is defined by the amount of CPU and memory on it for example the type n1-highmem-32 has 32vCPUs and minimum 208GB of ram. In general the Vertex AI will allocate a machine automaticall...
test-img

ewertonvsilva

Dask clients running in Kubeflow cannot communicate

I am using to following snippet to start an ephemeral Dask cluster within a node of a Kubeflow pipeline: from dask_kubernetes import KubeCluster from distributed import Client cluster = KubeCluster(p...
test-img

Marek Grzenkowicz

dask

istio

kubeflow

Votes: 0

Answers: 1

Latest Answer

Try this: In worker has a label with this: sidecar.istio.io/inject=false
test-img

henrry vargas

Kubeflow VS generic workflow orchestrator?

i am struggling understanding the functional role of Kubeflow (KF) compared with other (generic) workflow orchestrator. I know KF is oriented to ML tasks, and is built on top of Argo. Two questions: ...
test-img

lordcenzin

airflow

workflow

kubeflow

argo-workflows

Votes: 0

Answers: 1

Latest Answer

Yes, you can create a python function/ general containers with code baked in which executes whatever task you like. pre-defined component - https://www.kubeflow.org/docs/components/pipelines/sdk-v2...
test-img

amitg1

kubeflow pipeline Failed to execute component: unable to get pipeline with PipelineName

Install follow https://github.com/kubeflow/manifests in v1.4.1 KFP version: 1.7.0 KFP SDK version: build version dev_local k3s Kubernetes 1.19 use demo example to add pipline kfp 1.8.10 kfp-pipeline-s...
test-img

wyx

kubeflow

kubeflow-pipelines

Votes: 0

Answers: 0

Posts

Questions

Blogs

Jobs