Skip to main content

Pipelines

A Pipeline represents a data processing workflow or DAG within a Pipeline Service. It contains tasks that define individual steps in the pipeline.
Entity schema follows the OpenMetadata Standard.

Entity Hierarchy

Pipelines belong to a Pipeline Service:
PipelineService
└── Pipeline (this page)
    └── Tasks (inline)

Fully Qualified Name

The FQN format for a pipeline is:
service.pipelineName
For example: sample_airflow.dbt_analytics_customers

API Endpoints

MethodEndpointDescription
PUT/v1/pipelinesCreate or update a pipeline
POST/v1/pipelinesCreate a pipeline (POST variant)
GET/v1/pipelinesList pipelines
GET/v1/pipelines/{id}Get by ID
GET/v1/pipelines/name/{fqn}Get by FQN
PATCH/v1/pipelines/{id}Update by ID
PATCH/v1/pipelines/name/{fqn}Update by name
DELETE/v1/pipelines/{id}Delete by ID
DELETE/v1/pipelines/name/{fqn}Delete by name
PUT/v1/pipelines/restoreRestore soft-deleted pipeline
GET/v1/pipelines/{id}/versionsList versions
GET/v1/pipelines/{id}/versions/{version}Get specific version
PUT/v1/pipelines/{id}/followersAdd follower
DELETE/v1/pipelines/{id}/followers/{userId}Remove follower
PUT/v1/pipelines/{id}/voteAdd/update vote