Spark Connector for dgraph

(Eshwar) #21

Thanks @amanmangal
Let me know if you need any help from my side.

(Aman Mangal) #22

Alright, so for now, I just asked sbt to choose a particular guava dependency -

libraryDependencies += “” % “guava” % “16.0.1” force()

The current code works, but then, Dgraph4J is not happy with this version of guava. I am working on building a shadow jar that allows you keep two versions of guava.

(Aman Mangal) #23

I have raised a PR on dgraph4J repo for shading dependencies causing conflicts. We will add more when we find the issues, going forward. It will take us a couple of days to get it on maven central. You can manually point to this jar by following the steps below -

You will have to compile Dgraph4J locally by running the following command from root folder -

./gradlew shadoJar -x test

and then, point to local shadow jar in your project by modifying the line -

libraryDependencies += “io.dgraph” % “dgraph4j” % “1.7.3” from “path to shadow jar”

(Eshwar) #24

Yeah sure, let me try doing this.

Let me know once the jar is available in mvn central I shall start using that instead.

Thanks a lot for the help.
– Eshwar

(护群神兽之点赞狂魔) #25

hi, I also need a spark connector for dgraph, if you finished your spark connector , could you share your code?