Learn to build custom sink connectors for Collate using Python SDK. Step-by-step guide with code examples to integrate and stream metadata efficiently.
The Sink will get the event emitted by the source, one at a time. It can use this record to make external service calls to store or index etc.For OpenMetadata we have MetadataRestTablesSink.
class Sink(ReturnStep, ABC): """All Sinks must inherit this base class.""" # From the parent - Just to showcase @abstractmethod def _run(self, record: Entity) -> Either: """ Main entrypoint to execute the step """
_run this method is called for each record coming down in the workflow chain and can be used to store the record in external services etc.