How about a graph compute engine based on dgraph except for spark?

Users Dgraph
1

dgraph is a graph database. How about a graph compute engine?
Does Spark go best with dgraph?
Does anybody create a native graph compute engine based on dgraph, is it valuable?

2

Agree this would be a very handy feature. If you google e.g. “DGraph PageRank” you will find some attemps to do this, but being unnofficial, the repositories tend to go stale. Would be amazing to have something more official.

My company did indeed go down the spark route for this for now. You are probably aware already but there is a very useful spark DGraph connector here GitHub - G-Research/spark-dgraph-connector: A connector for Apache Spark and PySpark to Dgraph databases.

1 Like
3

Thanks very much!

4

you can read graph data from dgraph ,then load it to spark graphx as RDD,then do some computing jobs, then rewrite it back to dgraph.

In neo4j, it has a graph-loader to load data into memory,if you are able to write a graph-loader for dgraph, then you can use neo4j 's algorithm.

Also, there is a graph api in nvidia 's CUDA package. you can read your data from dgraph ,then call the API to compute .

5

thanks very much!