V1.0.7 - Inconsistent query results between dgraph servers in same group

We’re seeing inconsistent results being returned for the same query from all dgraph server in a particular group. We’re using K8s HA for our setup on AWS.

Issue went away when we rebooted all 3 dgraph server pods (in a particular group) separately. Let us know what other information would be helpful to debug this issue. Thanks!

Can you try without k8s and run Dgraph directly on host, so we know that this is not a k8s config issue?

Do you guys have a cloudformation template for HA dgraph setup? That will make it easy to deploy to AWS.

Thanks!

this one serves? https://docs.dgraph.io/deploy#multi-host-setup

https://docs.dgraph.io/deploy#run-using-docker-compose-on-single-aws-instance

@coolguru: Can you put together steps to reproduce this, and file a Github issue? I’ll look into it.

@mrjn Inconsistent query results between dgraph servers in same group · Issue #2503 · dgraph-io/dgraph · GitHub Please let me know if more info is needed. thanks again!

@mrjn wondering if you were able to repro the issue. Please let me know if there is anything I can do to help out, thanks!

I’m out on vacation. Will be back next week and look into this.

Btw, could you try with v1.0.4-rc4? Someone else in another topic said they didn’t see the inconsistency with that version.

Come on Manish, stop slacking off dude! You’ve a bigger responsibility here! Just kidding…I appreciate you taking time during your vacation to respond to this thread. I’ll try out rc4 and update back.

1 Like

I saw something similar and increasing RAM/CPU allocation seemed to improve things a lot in that case.
I can see you are already using m5.xlarge, but depending on your use case and budget it may be worth a try