Change data capture with Kafka: Setting SASL Mechanism

dmai
Thu, 22 Apr 2021 16:32:01 +0000
Dgraph

Experience Report for Feature Request

Note: Feature requests are judged based on user experience and modeled on Go Experience Reports. These reports should focus on the problems: they should not focus on and need not propose solutions.

What you wanted to do

For managed Kafka services (e.g., MSK), SASL authentication requires the SCRAM-SHA-512 mechanism. So, I want to push Dgraph changes via change data capture (CDC) to that Kafka using SASL.

What you actually did

In Dgraph v21.03.0, only SASL plaintext or cert authentication are available. There’s no option to set the mechanism.

Why that wasn’t great, with examples

I wasn’t able to connect CDC with Kafka because there’s no way to set the SASL mechanism.

Any external references to support your case

AWS MSK requiring SASL mechanism SCRAM-SHA-512: Using Username and Password Authentication with AWS Secrets Manager - Amazon Managed Streaming for Apache Kafka

1 post - 1 participant