Enricher

Setup

Get started with OpenSnowcat Enricher

The OpenSnowcat enricher is service responsible for validating collected data against schemas and enriching it.

Running the OpenSnowcat Enricher using Docker

Terminal
docker run -it --rm \
  -v $PWD:/opensnowcat \
  opensnowcat/opensnowcat-enrich-kafka:latest \
  --enrichments /opensnowcat/enrichments \
  --iglu-config /opensnowcat/resolver.json \
  --config /opensnowcat/config.enrich.hocon

Please create a directory named opensnowcat with the contents of the opensnowcat folder from DevKit. For complete module reference visit Snowplow's docs.

Sample Configuration

Note: Assuming you are using OpenSnowcat DevKit with Enricher Kafka module.

enricher config hocoon
{
  "input": {
    "topicName": "collected-good"
    "bootstrapServers": "warp:9092"
  }

  "output": {
    "good": {
      "topicName": "enriched-good"
      "bootstrapServers": "warp:9092"
    }

    "bad": {
      "topicName": "enriched-bad"
      "bootstrapServers": "warp:9092"
    }
  }

  # Optional. Configuration for experimental/preview features
  "experimental": {
    "customOutputFormat": {
       "type": "EventbridgeJson"
       "payload": true
       "collector": true
    }
  }

  "monitoring": {
    "metrics": {
      # Optional. Log to stdout using Slf4j
      "stdout": {
        "period": "30 seconds"
      }
    }
  }
}