Using PostgreSQL pgoutput Plugin for Change Data Capture With Debezium

4 years ago dzone.com

Summary: This is a summary of an article originally published by the source. Read the full original article here →

by Change Data Capture Architecture Using Debezium, Postgres, and Kafkawas a tutorial on how to use Debezium for change data capture from Azure PostgreSQL and send them to Azure Event Hubs for Kafka - it used the wal2json output plugin.

I will not be repeating a lot of details and use containerized versions (using Docker Compose) of Kafka connect, Kafka (and Zookeeper) to keep things simple.

Update the connector config file (pg-source-connector.json) with details of your Azure PostgreSQL instance and then create the connector

As I mentioned earlier, you need to work around this by creating the publication manually for specific tables only

DevOps Articles