what does this error mean?
should I pay attention for it? i know that there were problems with this issue in 1.0.7/8, but I still get it on 1.0.9 while just inserting data in batches of 1000.
This error has already been worked since version v1.0.8. Do the following. Create a new test instance (from scratch) with the latest RC version of Dgraph. (v1.0.10-rc1) - And try to Fetch this same error in this instance. If So see it persists tell us.
More details about your settings are also interesting to know.
Chek this commit:
https://github.com/dgraph-io/dgraph/commit/87790666d254f05e27f54c4647a0f8c869bbee59
was something changed related to this error in 1.0.10-rc1 comparing to 1.0.9?
I used fresh install of 1.0.9 dgraph
btw, what does this error actually mean?
Not sure but is related to etcd raft, not Dgraph directly.
And in the commit we have this comment from Manish.
– A Tick missed to fire, caused due to the repeated calling of
raft Storage.FirstIndex(). This was causing Badger to create an iterator every time, which was expensive. Now we cache the first index, to avoid repeatedly looking it up.
I was having this issue as well on 1.0.9. Most transactions were failing as a result (trying to do about 40/sec)
To resolve I changed my code to run transactions sequentially instead of simultaneously on up to 10 go routines.
Hope that this bug can get fixed soon though.
Can you try with v1.0.10?
I actually upgraded to 1.0.11-rc1 yesterday and had the issue again, except the line number is different. It’s now:
node.go:86] A tick missed to fire. Node blocks too long!
How bad is it? Can you share your full log? (Use -v=2 flag, and either --logtostderr, or tar gzip the log directory where glog is outputting the logs.)
It generally ends with:
groups.go:807] No longer the leader of group 1. Exiting
groups.go:758] Error in oracle delta stream. Error: rpc error: code = Canceled desc = context canceled
E1114 20:59:02.848681 1 mutation.go:56] MutateOverNetwork Error: context canceled....
And after a few seconds transactions continue at a normal pace until the same thing happens again in a couple minutes.
If the load isn’t heavy, there’s no issues.
I’ll see if I can capture a full log for you at -v=2 as well.
Me too. , I get it on v1.0.11
I1223 21:28:06.580989 6191 pool.go:217] Connection established with xxx.xxx.xxx.xxx:7080
W1223 21:28:06.748675 6191 node.go:85] A tick missed to fire. Node blocks too long!
Dgraph version : v1.0.11-rc4-12-gb0742078
Commit SHA-1 : b0742078
Commit timestamp : 2018-12-12 15:10:22 -0800
Branch : master
Go version : go1.11
Tick missed to fire... happens. Nothing to be worried about.