Overview
Sinks are plugins that receive records and push them to destination systems. Each record contains an entity and a list of edges representing relationships such as ownership and lineage.
To use a sink, add a sinks block to your recipe:
sinks:
- name: compass
config:
host: https://compass.example.comSupported sinks
| Sink | Description | Output |
|---|---|---|
azure_blob | Write records as NDJSON to a blob in an Azure Blob Storage container. | Azure Blob Storage blob |
compass | Send entities and edges to Raystack Compass over HTTP. | Compass catalog service |
console | Print each record to standard output as JSON or Markdown. | Standard output |
file | Write records to a local file as NDJSON or YAML. | Local file |
gcs | Write records as NDJSON to an object in a Google Cloud Storage bucket. | GCS object |
http | Send each record as JSON to an HTTP endpoint, with an optional Tengo script for custom payloads. | HTTP endpoint |
kafka | Publish each record as JSON to a Kafka topic. | Kafka topic |
s3 | Write records as NDJSON to an object in an Amazon S3 bucket or an S3-compatible store. | S3 object |
stencil | Convert table columns into JSON Schema or Avro and send them to Raystack Stencil. | Stencil schema registry |