Load data to dgraph with kafka

(hisense2019) #1

Hi,all
We have some key-value data from Kafka, and we would load data from Kafka to Dgraph. However, we only find the kafka connector for Neo4J databases in coufluent.io. How could we get the connector for Dgraph or what steps should we follow to load data from kafka.

Thanks

(Aman Mangal) #2

Hi,

We currently do not have a Kafka connector. But we do have live and bulk loader that accept json data. For now, you could just dump data from kafka to json files and then use either live/bulk loader to push data to Dgraph. Also, please create a feature request on GitHub and upvote it. If there is enough demand, we could consider adding this to our roadmap. Let us know if you have more questions.

Thanks

(Manish R Jain) #3

Agreed. Sounds like a good connector to build.

(Aman Mangal) #4

Created a GitHub issue for this https://github.com/dgraph-io/dgraph/issues/3967