Live Loder: Error while mutating While proposing error: raft proposal dropped

Users Dgraph
1

Hi.
I am trying to import a batch of data into the Dgraph k8s Cluster(3 zero and 3 Alpah)
There are about 100 rdf files, and the “dgraph live” command is called cyclically.
After the script has been running for a while，

RDF data

 <0xaca62>  <scsm/t_ord_order_bank> "true"  .   #
 <0xaca62>  <scsm/t_ord_order_bank/id>  "2190"   .   #
 <0xaca62>  <scsm/t_ord_order_bank/order_no>  "18080922142259"   .   #
 <0xaca62>  <scsm/t_ord_order_bank/parent_no>  "18080922142259"   .   #

kubenetes pod alpha logs

Raft.Ready took too long to process: Timer Total: 291ms. Breakdown: [{sync 290ms} {disk 0s} {proposals 0s} {advance 0s}] Num entries: 1. MustSync: true

CONTAINER ID        NAME                                                                        CPU %               MEM USAGE / LIMIT   MEM %               NET I/O             BLOCK I/O           PIDS
c885179a4e21        k8s_alpha_dgraph-2-alpha-1_default_6deafe37-98b0-11e9-a38e-c4544463e3c8_0   924.01%               12.03GiB / 32GiB    37.58%              0B /0B             40.3GB / 159GB      169

console log

[19m10s] Txns: 50 RDFs: 50000 RDFs/sec:    43 Aborts: 9130
[19m12s] Txns: 50 RDFs: 50000 RDFs/sec:    43 Aborts: 9209
[19m14s] Txns: 50 RDFs: 50000 RDFs/sec:    43 Aborts: 9264
[19m16s] Txns: 50 RDFs: 50000 RDFs/sec:    43 Aborts: 9286
[19m18s] Txns: 50 RDFs: 50000 RDFs/sec:    43 Aborts: 9361
[19m20s] Txns: 50 RDFs: 50000 RDFs/sec:    43 Aborts: 9367
[19m22s] Txns: 51 RDFs: 51000 RDFs/sec:    44 Aborts: 9453
[19m24s] Txns: 51 RDFs: 51000 RDFs/sec:    44 Aborts: 9500
[19m26s] Txns: 51 RDFs: 51000 RDFs/sec:    44 Aborts: 9527
[19m28s] Txns: 51 RDFs: 51000 RDFs/sec:    44 Aborts: 9596
[19m30s] Txns: 51 RDFs: 51000 RDFs/sec:    44 Aborts: 9624
[19m32s] Txns: 52 RDFs: 52000 RDFs/sec:    44 Aborts: 9668
[19m34s] Txns: 52 RDFs: 52000 RDFs/sec:    44 Aborts: 9707
[19m36s] Txns: 52 RDFs: 52000 RDFs/sec:    44 Aborts: 9755
[19m38s] Txns: 52 RDFs: 52000 RDFs/sec:    44 Aborts: 9758
[19m40s] Txns: 52 RDFs: 52000 RDFs/sec:    44 Aborts: 9758
Error while mutating Only leader can decide to commit or abort
Error while mutating No connection exists
Error while mutating While proposing error: raft proposal dropped
2

Did you ever figure this out? We’re getting a similar error.

3

Is Dgraph Zero running? It sounds like there’s an issue with the connection to the Dgraph Zero leader. Seeing the cluster logs of all the Dgraph instances would help.

4

We got this error when the alpha node was low on disk space.
Hope this helps someone.