Run Ingestion Pipeline Via CLI with Basic Auth

Collate comes with a Username & Password Login Mechanism.

Basic Authentication

From 0.12.1 Collate has changed the default no-auth to Basic auth, So to run any ingestion pipeline from CLI you will have to pass the jwtToken and authProvider in the securityConfig.

Obtain JWT Token

Note: The Bots tile under Settings is only visible to users with Admin privileges. If you don’t see it, ask your organization’s Collate Admin to generate a bot token for you or grant you Admin access.

1. Go to the settings page from the activity bar Section. Click on the Bots and you will see the list of bots, then click on the ingestion-bot.

Search and select ingestion-bot.
Copy the Collate JWT token and save it for later use.

Add JWT Token into the Workflow Config

Now Paste the copied JWT Token into your pipeline securityConfig, So your final workflow config will look like this.

AuthProvider Should be openmetadata i.e authProvider: openmetadata

workflowConfig:
  openMetadataServerConfig:
    hostPort: http://localhost:8585/api
    authProvider: openmetadata
    securityConfig:
      jwtToken: 'eyJraWQiO...'

Now you can run the pipeline by running.

metadata ingest -c ./pipeline_name.yaml

⌘I

​Run Ingestion Pipeline Via CLI with Basic Auth

Basic Authentication

​Obtain JWT Token

​Add JWT Token into the Workflow Config

Run Ingestion Pipeline Via CLI with Basic Auth

Obtain JWT Token

Add JWT Token into the Workflow Config