How many nodes can i insert at most

Users
1

how many nodes can i insert at most? in other words, how many uids dgraph can provide?

2

Check this out: [WIP] Performance bottleneck on 1 TB data

3

  • Version
    – v21.12.0

  • Cluster Zeros: 3
    – Leader config: 32 core, 256 GB, 8 TB
    – Follower config: 8 Core, 64 GB, 2 TB SSD

  • Dataset -1
    – Count of Data Files: 1044
    – Size of each file: 30 MB (compressed)
    – Result: Bulk loader hung after 36 hours

  • Dataset -2
    – Count of Data Files: 5622
    – Size of each file: 30 MB (compressed)
    – Result: Bulk loader hung after 14 hrs

Below is how I launched the bulk loader:

kubectl exec -it <zero_leader_pod_name> -n K8S_namespace /bin/sh

dgraph bulk -f /coldstart/data -s /coldstart/schema/my_schema.rdf --replace_out --num_go_routines=20 --reducers=2 --format=rdf --store_xids --map_shards=9 --reduce_shards=3 > check.log &