DGraph server not able to start after bulk data load via dgraph live

I am getting this error when trying to start dgraph server -
draft.go:881: Skipping snapshot at index: 11591. Insufficient discard entries: 0. MinPendingStartTs: 8455
What could be the issue here?

Can you show the whole log? including commands and other details.

Command to run dgraph server and logs -

23:30 $ docker exec -it dgraph dgraph server --lru_mb 4096 --zero localhost:5080

Dgraph version   : v1.0.9
Commit SHA-1     : 22c13fce
Commit timestamp : 2018-10-02 16:45:53 -0700
Branch           : HEAD

For Dgraph official documentation, visit https://docs.dgraph.io.
For discussions about Dgraph     , visit https://discuss.dgraph.io.
To say hi to the community       , visit https://dgraph.slack.com.

Licensed under Apache 2.0 + Commons Clause. Copyright 2015-2018 Dgraph Labs, Inc.


2018/10/19 18:02:58 Replaying from value pointer: {Fid:0 Len:45 Offset:157194957}
2018/10/19 18:02:58 Iterating file id: 0
2018/10/19 18:02:59 Iteration took: 790.6608ms
2018/10/19 18:03:03 Replaying from value pointer: {Fid:0 Len:0 Offset:0}
2018/10/19 18:03:03 Iterating file id: 9
2018/10/19 18:03:06 Iteration took: 3.055369s
2018/10/19 18:03:06 Iterating file id: 12
2018/10/19 18:03:08 Iteration took: 2.2574136s
2018/10/19 18:03:08 Iterating file id: 13
2018/10/19 18:03:11 Iteration took: 2.5657409s
2018/10/19 18:03:11 Iterating file id: 14
2018/10/19 18:03:13 Iteration took: 2.4258652s
2018/10/19 18:03:13 Iterating file id: 15
2018/10/19 18:03:13 Iteration took: 242.4143ms
2018/10/19 18:03:13 gRPC server started.  Listening on port 9080
2018/10/19 18:03:13 HTTP server started.  Listening on port 8080
2018/10/19 18:03:13 worker.go:85: Worker listening at address: [::]:7080
2018/10/19 18:03:13 groups.go:80: Current Raft Id: 1
2018/10/19 18:03:13 pool.go:108: == CONNECTED ==> Setting localhost:5080
2018/10/19 18:03:13 groups.go:107: Connected to group zero. Assigned group: 0
2018/10/19 18:03:13 draft.go:61: Node ID: 1 with GroupID: 1
2018/10/19 18:03:13 draft.go:959: Restarting node for group: 1
2018/10/19 18:03:13 raft.go:567: INFO: 1 became follower at term 21
2018/10/19 18:03:13 raft.go:315: INFO: newRaft 1 [peers: [1], term: 21, commit: 12569, applied: 11591, lastindex: 12569, lastterm: 21]
2018/10/19 18:03:17 raft.go:749: INFO: 1 is starting a new election at term 21
2018/10/19 18:03:17 raft.go:594: INFO: 1 became pre-candidate at term 21
2018/10/19 18:03:17 raft.go:664: INFO: 1 received MsgPreVoteResp from 1 at term 21
2018/10/19 18:03:17 raft.go:580: INFO: 1 became candidate at term 22
2018/10/19 18:03:17 raft.go:664: INFO: 1 received MsgVoteResp from 1 at term 22
2018/10/19 18:03:17 raft.go:621: INFO: 1 became leader at term 22
2018/10/19 18:03:17 node.go:301: INFO: raft.node: 1 elected leader 1 at term 22
2018/10/19 18:03:31 groups.go:507: Got address of a Zero server: localhost:5080
2018/10/19 18:06:14 draft.go:881: Skipping snapshot at index: 11591. Insufficient discard entries: 0. MinPendingStartTs: 8455

Command for bulk upload that I used previously

docker exec -it dgraph dgraph live -r mydata/ssv_custRating.rdf --zero localhost:5080 -c 1 --xidmap xidmap

Failure log I got while uploading -

2018/10/19 17:34:42 transport is closing
github.com/dgraph-io/dgraph/x.Fatalf
	/ext-go/1/src/github.com/dgraph-io/dgraph/x/error.go:100
github.com/dgraph-io/dgraph/dgraph/cmd/live.handleError
	/ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/cmd/live/batch.go:130
github.com/dgraph-io/dgraph/dgraph/cmd/live.(*loader).request
	/ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/cmd/live/batch.go:168
github.com/dgraph-io/dgraph/dgraph/cmd/live.(*loader).makeRequests
	/ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/cmd/live/batch.go:180
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1333

So the issue is with Live load? Why do you use --xidmap?

I use --xidmap so that it can read/write from/to xid->uid mapping.

Do the following, go to Releases · dgraph-io/dgraph · GitHub
Download the binarie version for your system.
Run localy that bin, with this command you used. Pointing to the IP or addr of the docker machine.

I hope it’s a first ingestion. But, can you explaing what you did to reproduce the thing? Isn’t a first ingestion? are you able to export the data? How did you create that RDF file? Can you show parts of that RDF file?

Seems to me, that the error is with Live Load only. Can be related to your RDF or something else related to Docker.

The logs you’ve shown are normal. Only the Live Load has error.

Yeah this is first ingestion. But I was running ingestion in batches with multiple rdf files. One file per predicate.
I am not sure how to export RDF.

I tried running dgraph server from binary as you mentioned. I am getting following error

08:52 $ ./dgraph server --lru_mb 4096 --zero localhost:5080

Dgraph version   : v1.0.9
Commit SHA-1     : 22c13fce
Commit timestamp : 2018-10-02 16:45:53 -0700
Branch           : HEAD

For Dgraph official documentation, visit https://docs.dgraph.io.
For discussions about Dgraph     , visit https://discuss.dgraph.io.
To say hi to the community       , visit https://dgraph.slack.com.

Licensed under Apache 2.0 + Commons Clause. Copyright 2015-2018 Dgraph Labs, Inc.


2018/10/22 08:53:24 Replaying from value pointer: {Fid:0 Len:0 Offset:0}
2018/10/22 08:53:24 Iterating file id: 0
2018/10/22 08:53:24 Iteration took: 30.829µs
2018/10/22 08:53:24 Replaying from value pointer: {Fid:0 Len:0 Offset:0}
2018/10/22 08:53:24 Iterating file id: 0
2018/10/22 08:53:24 Iteration took: 18.815µs
2018/10/22 08:53:24 groups.go:80: Current Raft Id: 0
2018/10/22 08:53:24 gRPC server started.  Listening on port 9080
2018/10/22 08:53:24 HTTP server started.  Listening on port 8080
2018/10/22 08:53:24 worker.go:85: Worker listening at address: [::]:7080
2018/10/22 08:53:24 pool.go:108: == CONNECTED ==> Setting localhost:5080
2018/10/22 08:53:24 groups.go:97: Error while connecting with group zero: rpc error: code = Unknown desc = Invalid address
2018/10/22 08:53:24 groups.go:97: Error while connecting with group zero: rpc error: code = Unknown desc = Invalid address
2018/10/22 08:53:24 groups.go:97: Error while connecting with group zero: rpc error: code = Unknown desc = Invalid address
2018/10/22 08:53:24 groups.go:97: Error while connecting with group zero: rpc error: code = Unknown desc = Invalid address
2018/10/22 08:53:24 groups.go:97: Error while connecting with group zero: rpc error: code = Unknown desc = Invalid address
2018/10/22 08:53:25 groups.go:97: Error while connecting with group zero: rpc error: code = Unknown desc = Invalid address
2018/10/22 08:53:27 groups.go:97: Error while connecting with group zero: rpc error: code = Unknown desc = Invalid address

I was able to successfully bulk upload after setting -j 1. Thanks to @amanmangal for helping me out.
Some error message would have been helpful.

The binaries were to run Live load (bulk) locally. Dgraph zero and Server/Alpha could be run as they were already being executed.

Sorry above reply for another thread - 2 BHK Flats for Rent in Gurgaon - 2 BHK Rental Flats in Gurgaon

It was a mistake.
Update the other thread.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.