A given predicate always belongs to same group, i.e will always go same node (and its replicas) So this node/server will eventually fill-up and there is no way to horizontally scale the storage. Has any work been done on splitting the predicate into multiple groups? ( https://docs.dgraph.io/design…

Vik - Thanks for starting thread and capturing all of my notes in a one sentence succinct fashion. Here’s my unabridged questions and notes from Slack, a little tuned up. Please let me know if I misunderstand the magnitude of a predicate being restricted to a single server. Are the predicates sto…

We still do not shard the predicate across multiple groups but we plan to add this feature into Dgraph in the year of 2020. We are also working on releasing a paper that provides details of the internals of Dgraph, keep an eye out.

Do you have any suggestions for back-of-napkin math on how to know what the right size of RAM and SSD drive is for the amount of predicates?

As far as I understand, RAM requirements depend on how often you query (read or write) into the database. Disk requirements are tricky to calculate beforehand, it really depends on your dataset. We perform various encoding and compression of the data that we store and that could vary from dataset t…

I am not sure I follow everything in the slides, but more details are available here https://docs.dgraph.io/deploy/#understanding-dgraph-cluster . As far as I understand, we have groups and each group can contain one or more than one predicates which will be replicated to each alpha in the group depe…

We still do not shard the predicate across multiple groups but we plan to add this feature into Dgraph in the year of 2020 Any update on this? Don’t recall seeing it in the most recent upgrades.

@matthewmcneely this was discussed in the roadmap discussion for 2021, and is put on hold for now to accommodate for other priority features in Dgraph. We considered the request from users but we haven’t received many request for supporting use cases requiring large predicates ( requiring more than …

@hardik - In the not-too-distant future, my team and I are going to be building a search engine that will be caching all the publicly available web pages on the net (i.e. like Google / Bing do). In addition, the plan is to try to add in the URLs from the Way Back Machine. From here , we could tenta…

Splitting predicates into multiple groups

Users Dgraph

rahst12 (Ryan) January 16, 2020, 4:57am 8

Does this reflect how Predicates, Groups, and Shards relate on a node?

Topic		Replies	Views
Split predicates into multiple groups Dgraph dgraph , kind:enhancement , status:accepted	1	652	February 13, 2020
Dgraph Scalability Users	4	543	January 6, 2020
Idea - Shard predicate / Edge across groups Dgraph rfc	2	1093	April 20, 2021
Whether Predicate Group Splitting has been implemented in Graph or not? Dgraph	1	541	February 8, 2019
Does Dgraph have a scalability problems with graphs having single heavy predicate? Dgraph	8	203	December 11, 2024

Splitting predicates into multiple groups

Related topics