kubernetes - Compilation of Elyra-Pipelines to Tekton based Kubeflow fails

Question

I've installed a kubernetes cluster running kubeflow pipelines based on tekton on top of KIND using the following instructions

Now I'm getting the following error message from the Elyra pipelines editor. Running against an argo based kfp cluster works fine.

Is the kfp compiler somehow not supporting tekton? Can someone please shine some light on this?

HTTP response body:

{"error_message":"Error creating pipeline: Create pipeline failed: 
Failed to get parameters from the pipelineRun: Invalid input error: 
Unsupported argo version. 
Expected: tekton.dev/v1beta1.
Received: argoproj.io/v1alpha1",
"error_details":"Error creating pipeline: Create pipeline failed: 
Failed to get parameters from the pipelineRun: Invalid input error: 
Unsupported argo version. Expected: tekton.dev/v1beta1. 
Received: argoproj.io/v1alpha1"}

question from:https://stackoverflow.com/questions/65832799/compilation-of-elyra-pipelines-to-tekton-based-kubeflow-fails

Answer 1

There are different aspects to consider here:

There is a need to perform a custom deployment to enable Kubeflow Pipelines to integrate/use a Tekton environment. As you mentioned the steps are described here.

Now, related to compiling and executing the Kubeflow Pipeline on a Tekton environment, Elyra is currently using the KFP SDK python package and the regular compiler to compile and generate the default ARGO YAML (see code here). In order to support Tekton, we will need to use a different python package (kfp-tekton==0.3.0) and there is also a need for a different code path during compilation (see example).

Another aspect is that it seems that there are some incompatibilities between the two pipelines as described in the migration path.

Regarding support, the Elyra project would welcome contributions.