Dgraph Summer Update

[rahst12 (Ryan)]

I’d ask that splitting predicates into multiple groups be reviewed again for inclusion.

@rahst12

Questions:

1. When you run out of space on a server, due to one predicate - how do you add a new node and rebalance the shards?
2. How do you calculate an estimated size for a predicate group, such that you can size a server to handle the anticipated growth of a predicate group.
3. How do you calculate the size of a node to accommodate the size of the predicate
4. Specifically, I’m looking for more details on the sharding for part of a cluster design - If I design small economy sized nodes and need to add more in the future, how do the predicate groups split themselves to accommodate more data than initially planned for? How do you calculate an estimation of how large the predicate group will be?

How to prevent RAM usage of Alpha node from growing?

@seanlaff - your links are helping me a lot understanding the problem better, thanks very much! I may try time-series again when the ludicrous fix is in. Hope this also somehow fixes the read-errors-due-to-ongoing-re-indexing issues.

Split predicates into multiple groups