Create a Pipeline Service
Create a new pipeline service connection to a platform such as Airflow, Dagster, or Fivetran.
Body Parameters
Name of the pipeline service. Must be unique across all pipeline services.
Type of pipeline service (e.g., Airflow, GluePipeline, Airbyte, Dagster, Fivetran, DBTCloud, Nifi, DomoPipeline, CustomPipeline, Flink, KafkaConnect, SplineProducer, OpenLineage).
Connection configuration specific to the service type. Service-specific connection configuration (e.g., host, port, authentication for Airflow).
Human-readable display name for the pipeline service.
Description of the pipeline service in Markdown format.
Array of owner references (users or teams) to assign to the service. UUID of the owner entity.
Type of owner entity (e.g., user, team).
Name of the owner entity.
Fully qualified name of the domain to assign for governance purposes.
Array of classification tags to apply to the pipeline service. Fully qualified name of the tag.
Type of label (e.g., Manual, Derived, Propagated).
State of the tag (e.g., Suggested, Confirmed).
POST /v1/services/pipelineServices
import requests
base_url = "https://your-company.getcollate.io/api"
headers = {
"Authorization" : "Bearer your-jwt-token" ,
"Content-Type" : "application/json"
}
payload = {
"name" : "sample_airflow" ,
"displayName" : "Sample Airflow" ,
"serviceType" : "Airflow" ,
"description" : "Production Airflow pipeline orchestrator" ,
"connection" : {
"config" : {
"type" : "Airflow" ,
"hostPort" : "http://localhost:8080" ,
"connection" : {
"type" : "Backend"
}
}
}
}
response = requests.post(
f " { base_url } /v1/services/pipelineServices" ,
json = payload,
headers = headers
)
service = response.json()
print ( f "Created: { service[ 'fullyQualifiedName' ] } " )
{
"id" : "daa58a49-df05-48a3-a417-45dfd12eacf5" ,
"name" : "sample_airflow" ,
"fullyQualifiedName" : "sample_airflow" ,
"serviceType" : "Airflow" ,
"description" : "Production Airflow pipeline orchestrator" ,
"version" : 0.1 ,
"updatedAt" : 1769982621418 ,
"updatedBy" : "admin" ,
"href" : "http://localhost:8585/api/v1/services/pipelineServices/daa58a49-df05-48a3-a417-45dfd12eacf5" ,
"connection" : {
"config" : {
"type" : "Airflow" ,
"hostPort" : "http://localhost:8080" ,
"connection" : {
"type" : "Backend"
}
}
},
"owners" : [],
"tags" : [],
"deleted" : false ,
"domains" : []
}
Returns
Returns the created pipeline service object with all specified properties and system-generated fields.
Response
Unique identifier for the pipeline service (UUID format).
Fully qualified name of the service.
Human-readable display name.
Description of the pipeline service in Markdown format.
Type of pipeline service (e.g., Airflow, Dagster, Fivetran).
Connection configuration for the service. Service-specific connection configuration.
List of owners assigned to the pipeline service. UUID of the owner entity.
Type of owner entity (e.g., user, team).
Name of the owner entity.
Fully qualified name of the assigned domain.
Classification tags applied to the pipeline service. Fully qualified name of the tag.
Type of label (e.g., Manual, Derived, Propagated).
State of the tag (e.g., Suggested, Confirmed).
Version number for the entity (starts at 0.1).
Create or Update (PUT)
Use PUT /v1/services/pipelineServices instead of POST to perform an upsert. If a pipeline service with the same fullyQualifiedName already exists, it will be updated; otherwise, a new service is created. The request body is the same as POST.
curl -X PUT "{base_url}/api/v1/services/pipelineServices" \
-H "Authorization: Bearer {access_token}" \
-H "Content-Type: application/json" \
-d '{ ... same body as POST ... }'
PUT will not return a 409 conflict error if the entity already exists — it will update the existing entity instead.
Bulk Create or Update (PUT)
Use PUT /v1/services/pipelineServices/bulk to create or update multiple pipeline services in a single request. The request body is an array of create request objects.
curl -X PUT "{base_url}/api/v1/services/pipelineServices/bulk" \
-H "Authorization: Bearer {access_token}" \
-H "Content-Type: application/json" \
-d '[
{ "name": "airflow_prod", "serviceType": "Airflow", "connection": { "config": {} } },
{ "name": "dagster_prod", "serviceType": "Dagster", "connection": { "config": {} } }
]'
Error Handling
Code Error Type Description 400BAD_REQUESTInvalid request body or missing required fields 401UNAUTHORIZEDInvalid or missing authentication token 403FORBIDDENUser lacks permission to create pipeline services 409ENTITY_ALREADY_EXISTSPipeline service with same name already exists (POST only)