I Want to Do
My company is looking to move from Neo4j to an alternative graph database for our internal systems, as well as client systems. We’ve tried testing Dgraph via Docker, as well as locally, however, both attempts have failed.
What I Did
Following the Dgraph documentation, we used the official Dgraph image:
docker pull dgraph/dgraph:latest
We then tried the following command:
docker run --rm -it -p 8080:8080 -p 9080:9080 -p 8000:8000 -v ~/dgraph:/dgraph dgraph/standalone:v20.11
This simply returns:
Unable to find image 'dgraph/standalone:v20.11' locally
docker: Error response from daemon: manifest for dgraph/standalone:v20.11 not found: manifest unknown: manifest unknown.
We then tried:
docker run --rm -it -p 8080:8080 -p 9080:9080 -p 8000:8000 -v ~/dgraph:/dgraph dgraph/standalone:latest
But this does not work and offers only a broken link to what might be the problem (manifest related issue).
2021/01/20 21:06:35 Listening on :8000...
[Decoder]: Using assembly version of decoder
[Decoder]: Using assembly version of decoder
Page Size: 4096
[Sentry] 2021/01/20 21:06:35 Integration installed: ContextifyFrames
[Sentry] 2021/01/20 21:06:35 Integration installed: Environment
[Sentry] 2021/01/20 21:06:35 Integration installed: Modules
[Sentry] 2021/01/20 21:06:35 Integration installed: IgnoreErrors
Page Size: 4096
[Sentry] 2021/01/20 21:06:35 Integration installed: ContextifyFrames
[Sentry] 2021/01/20 21:06:35 Integration installed: Environment
[Sentry] 2021/01/20 21:06:35 Integration installed: Modules
[Sentry] 2021/01/20 21:06:35 Integration installed: IgnoreErrors
[Decoder]: Using assembly version of decoder
[Decoder]: Using assembly version of decoder
Page Size: 4096
[Sentry] 2021/01/20 21:06:35 Integration installed: ContextifyFrames
[Sentry] 2021/01/20 21:06:35 Integration installed: Environment
[Sentry] 2021/01/20 21:06:35 Integration installed: Modules
[Sentry] 2021/01/20 21:06:35 Integration installed: IgnoreErrors
Page Size: 4096
[Sentry] 2021/01/20 21:06:35 Integration installed: ContextifyFrames
[Sentry] 2021/01/20 21:06:35 Integration installed: Environment
[Sentry] 2021/01/20 21:06:35 Integration installed: Modules
[Sentry] 2021/01/20 21:06:35 Integration installed: IgnoreErrors
I0120 21:06:35.671205 37 sentry_integration.go:48] This instance of Dgraph will send anonymous reports of panics back to Dgraph Labs via Sentry. No confidential information is sent. These reports help improve Dgraph. To opt-out, restart your instance with the --enable_sentry=false flag. For more info, see https://dgraph.io/docs/howto/#data-handling.
I0120 21:06:35.707197 48 sentry_integration.go:48] This instance of Dgraph will send anonymous reports of panics back to Dgraph Labs via Sentry. No confidential information is sent. These reports help improve Dgraph. To opt-out, restart your instance with the --enable_sentry=false flag. For more info, see https://dgraph.io/docs/howto/#data-handling.
I0120 21:06:35.707626 48 util_ee.go:126] KeyReader instantiated of type <nil>
I0120 21:06:35.816568 37 init.go:107]
Dgraph version : v20.11.0
Dgraph codename : tchalla
Dgraph SHA-256 : 8acb886b24556691d7d74929817a4ac7d9db76bb8b77de00f44650931a16b6ac
Commit SHA-1 : c4245ad55
Commit timestamp : 2020-12-16 15:55:40 +0530
Branch : HEAD
Go version : go1.15.5
jemalloc enabled : true
For Dgraph official documentation, visit https://dgraph.io/docs/.
For discussions about Dgraph , visit http://discuss.dgraph.io.
Licensed variously under the Apache Public License 2.0 and Dgraph Community License.
Copyright 2015-2020 Dgraph Labs, Inc.
I0120 21:06:35.816622 37 run.go:185] Setting Config to: {bindall:true portOffset:0 nodeId:1 numReplicas:1 peer: w:zw rebalanceInterval:480000000000 tlsClientConfig:<nil>}
I0120 21:06:35.816665 37 run.go:98] Setting up grpc listener at: 0.0.0.0:5080
I0120 21:06:35.816850 37 run.go:98] Setting up http listener at: 0.0.0.0:6080
I0120 21:06:35.817020 37 log.go:295] Found file: 1 First Index: 1
I0120 21:06:35.817095 37 storage.go:132] Init Raft Storage with snap: 0, first: 1, last: 1
I0120 21:06:35.817448 37 node.go:152] Setting raft.Config to: &{ID:1 peers:[] learners:[] ElectionTick:20 HeartbeatTick:1 Storage:0xc0000aa370 Applied:0 MaxSizePerMsg:262144 MaxCommittedSizePerReady:67108864 MaxUncommittedEntriesSize:0 MaxInflightMsgs:256 CheckQuorum:false PreVote:true ReadOnlyOption:0 Logger:0x2dffcb8 DisableProposalForwarding:false}
I0120 21:06:35.821026 37 node.go:321] Found hardstate: {Term:1 Vote:0 Commit:1 XXX_unrecognized:[]}
I0120 21:06:35.821858 37 node.go:326] Group 0 found 1 entries
I0120 21:06:35.821875 37 raft.go:542] Restarting node for dgraphzero
I0120 21:06:35.821912 37 log.go:34] 1 became follower at term 1
I0120 21:06:35.821929 37 log.go:34] newRaft 1 [peers: [], term: 1, commit: 1, applied: 0, lastindex: 1, lastterm: 1]
I0120 21:06:35.822135 37 run.go:303] Running Dgraph Zero...
I0120 21:06:35.822717 37 node.go:189] Setting conf state to nodes:1
I0120 21:06:35.822884 37 raft.go:878] Done applying conf change at 0x1
E0120 21:06:35.823247 37 raft.go:484] While proposing CID: Not Zero leader. Aborting proposal: cid:"04805f0c-0996-4973-a3f4-aca6529f236c" . Retrying...
I0120 21:06:35.851961 48 init.go:107]
Dgraph version : v20.11.0
Dgraph codename : tchalla
Dgraph SHA-256 : 8acb886b24556691d7d74929817a4ac7d9db76bb8b77de00f44650931a16b6ac
Commit SHA-1 : c4245ad55
Commit timestamp : 2020-12-16 15:55:40 +0530
Branch : HEAD
Go version : go1.15.5
jemalloc enabled : true
For Dgraph official documentation, visit https://dgraph.io/docs/.
For discussions about Dgraph , visit http://discuss.dgraph.io.
Licensed variously under the Apache Public License 2.0 and Dgraph Community License.
Copyright 2015-2020 Dgraph Labs, Inc.
I0120 21:06:35.851980 48 run.go:696] x.Config: {PortOffset:0 QueryEdgeLimit:1000000 NormalizeNodeLimit:10000 MutationsNQuadLimit:1000000 PollInterval:1s GraphqlExtension:true GraphqlDebug:false GraphqlLambdaUrl:}
I0120 21:06:35.852009 48 run.go:697] x.WorkerConfig: {TmpDir:t ExportPath:export NumPendingProposals:256 Tracing:0.01 MyAddr: ZeroAddr:[localhost:5080] TLSClientConfig:<nil> TLSServerConfig:<nil> RaftId:0 WhiteListedIPRanges:[{Lower:0.0.0.0 Upper:255.255.255.255}] MaxRetries:-1 StrictMutations:false AclEnabled:false AbortOlderThan:5m0s SnapshotAfter:10000 ProposedGroupId:0 StartTime:2021-01-20 21:06:35.415510071 +0000 UTC m=+0.022208782 LudicrousMode:false LudicrousConcurrency:2000 EncryptionKey:**** LogRequest:0 HardSync:false}
I0120 21:06:35.852049 48 run.go:698] worker.Config: {PostingDir:p PostingDirCompression:1 PostingDirCompressionLevel:0 WALDir:w MutationsMode:0 AuthToken: PBlockCacheSize:697932185 PIndexCacheSize:375809638 WalCache:0 HmacSecret:**** AccessJwtTtl:0s RefreshJwtTtl:0s CachePercentage:0,65,35,0 CacheMb:0}
I0120 21:06:35.852211 48 log.go:295] Found file: 6 First Index: 0
I0120 21:06:35.853508 48 storage.go:132] Init Raft Storage with snap: 0, first: 1, last: 0
I0120 21:06:35.853538 48 server_state.go:76] Setting Posting Dir Compression Level: 0
I0120 21:06:35.853548 48 server_state.go:120] Opening postings BadgerDB with options: {Dir:p ValueDir:p SyncWrites:false NumVersionsToKeep:2147483647 ReadOnly:false Logger:0x2dffcb8 Compression:1 InMemory:false MemTableSize:67108864 BaseTableSize:2097152 BaseLevelSize:10485760 LevelSizeMultiplier:10 TableSizeMultiplier:2 MaxLevels:7 ValueThreshold:1024 NumMemtables:5 BlockSize:4096 BloomFalsePositive:0.01 BlockCacheSize:697932185 IndexCacheSize:375809638 NumLevelZeroTables:5 NumLevelZeroTablesStall:15 ValueLogFileSize:1073741823 ValueLogMaxEntries:1000000 NumCompactors:4 CompactL0OnClose:false ZSTDCompressionLevel:0 VerifyValueChecksum:false EncryptionKey:[] EncryptionKeyRotationDuration:240h0m0s BypassLockGuard:false ChecksumVerificationMode:0 DetectConflicts:false managedTxns:false maxBatchCount:0 maxBatchSize:0}
[Sentry] 2021/01/20 21:06:35 Sending fatal event [323cb2927f964fd38f867d6831e3ee1b] to o318308.ingest.sentry.io project: 1805390
2021/01/20 21:06:35 manifest has unsupported version: 7 (we support 8).
Please see https://github.com/dgraph-io/badger/blob/master/README.md#i-see-manifest-has-unsupported-version-x-we-support-y-error on how to fix this.
Error while creating badger KV posting store
github.com/dgraph-io/dgraph/x.Checkf
/ext-go/1/src/github.com/dgraph-io/dgraph/x/error.go:51
github.com/dgraph-io/dgraph/worker.(*ServerState).initStorage
/ext-go/1/src/github.com/dgraph-io/dgraph/worker/server_state.go:124
github.com/dgraph-io/dgraph/worker.InitServerState
/ext-go/1/src/github.com/dgraph-io/dgraph/worker/server_state.go:54
github.com/dgraph-io/dgraph/dgraph/cmd/alpha.run
/ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/cmd/alpha/run.go:700
github.com/dgraph-io/dgraph/dgraph/cmd/alpha.init.2.func1
/ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/cmd/alpha/run.go:94
github.com/spf13/cobra.(*Command).execute
/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:830
github.com/spf13/cobra.(*Command).ExecuteC
/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:914
github.com/spf13/cobra.(*Command).Execute
/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:864
github.com/dgraph-io/dgraph/dgraph/cmd.Execute
/ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/cmd/root.go:71
main.main
/ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/main.go:102
runtime.main
/usr/local/go/src/runtime/proc.go:204
runtime.goexit
/usr/local/go/src/runtime/asm_amd64.s:1374
We then tried to install Dgraph locally with the following command:
curl https://get.dgraph.io -sSf | bash
This appeared to work, however, in referencing additional installation guides it appeared the Dgraph documentation was/is lacking. We followed the steps in the following guide, however, the dgraph.service fails and provides almost no information on how to resovle the issue:
https://medium.com/ruralscript/installing-dgraph-on-ubuntu-the-simple-way-9f1634935a6
The following is from journalctl.
Jan 20 12:47:32 dan-development systemd[1]: Started dgraph.io data server.
Jan 20 12:47:32 dan-development dgraph[484748]: [Decoder]: Using assembly version of decoder
Jan 20 12:47:33 dan-development dgraph[484748]: Page Size: 4096
Jan 20 12:47:33 dan-development dgraph[484748]: [Sentry] 2021/01/20 12:47:33 Integration installed: ContextifyFrames
Jan 20 12:47:33 dan-development dgraph[484748]: [Sentry] 2021/01/20 12:47:33 Integration installed: Environment
Jan 20 12:47:33 dan-development dgraph[484748]: [Sentry] 2021/01/20 12:47:33 Integration installed: Modules
Jan 20 12:47:33 dan-development dgraph[484748]: [Sentry] 2021/01/20 12:47:33 Integration installed: IgnoreErrors
Jan 20 12:47:33 dan-development dgraph[484805]: [Decoder]: Using assembly version of decoder
Jan 20 12:47:33 dan-development dgraph[484805]: Page Size: 4096
Jan 20 12:47:33 dan-development dgraph[484805]: [Sentry] 2021/01/20 12:47:33 Integration installed: ContextifyFrames
Jan 20 12:47:33 dan-development dgraph[484805]: [Sentry] 2021/01/20 12:47:33 Integration installed: Environment
Jan 20 12:47:33 dan-development dgraph[484805]: [Sentry] 2021/01/20 12:47:33 Integration installed: Modules
Jan 20 12:47:33 dan-development dgraph[484805]: [Sentry] 2021/01/20 12:47:33 Integration installed: IgnoreErrors
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.597084 484805 sentry_integration.go:48] This instance of Dgraph will send anonymous reports of panics back to Dgraph Labs via Sentry. No confidential information is sent. These reports help improve Dgraph. To opt-out, restart your instance with the --enable_sentry=fal>
Jan 20 12:47:33 dan-development dgraph[484748]: W0120 12:47:33.597408 484805 run.go:573] --lru_mb is deprecated, use --cache_mb instead
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.597722 484805 util_ee.go:126] KeyReader instantiated of type <nil>
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.748423 484805 init.go:107]
Jan 20 12:47:33 dan-development dgraph[484748]: Dgraph version : v20.11.0
Jan 20 12:47:33 dan-development dgraph[484748]: Dgraph codename : tchalla
Jan 20 12:47:33 dan-development dgraph[484748]: Dgraph SHA-256 : 8acb886b24556691d7d74929817a4ac7d9db76bb8b77de00f44650931a16b6ac
Jan 20 12:47:33 dan-development dgraph[484748]: Commit SHA-1 : c4245ad55
Jan 20 12:47:33 dan-development dgraph[484748]: Commit timestamp : 2020-12-16 15:55:40 +0530
Jan 20 12:47:33 dan-development dgraph[484748]: Branch : HEAD
Jan 20 12:47:33 dan-development dgraph[484748]: Go version : go1.15.5
Jan 20 12:47:33 dan-development dgraph[484748]: jemalloc enabled : true
Jan 20 12:47:33 dan-development dgraph[484748]: For Dgraph official documentation, visit https://dgraph.io/docs/.
Jan 20 12:47:33 dan-development dgraph[484748]: For discussions about Dgraph , visit http://discuss.dgraph.io.
Jan 20 12:47:33 dan-development dgraph[484748]: Licensed variously under the Apache Public License 2.0 and Dgraph Community License.
Jan 20 12:47:33 dan-development dgraph[484748]: Copyright 2015-2020 Dgraph Labs, Inc.
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.748441 484805 run.go:696] x.Config: {PortOffset:0 QueryEdgeLimit:1000000 NormalizeNodeLimit:10000 MutationsNQuadLimit:1000000 PollInterval:1s GraphqlExtension:true GraphqlDebug:false GraphqlLambdaUrl:}
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.748469 484805 run.go:697] x.WorkerConfig: {TmpDir:t ExportPath:export NumPendingProposals:256 Tracing:0.01 MyAddr: ZeroAddr:[localhost:5080] TLSClientConfig:<nil> TLSServerConfig:<nil> RaftId:0 WhiteListedIPRanges:[] MaxRetries:-1 StrictMutations:false AclEnabled:fals>
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.748504 484805 run.go:698] worker.Config: {PostingDir:/var/run/dgraph/p PostingDirCompression:1 PostingDirCompressionLevel:0 WALDir:/var/run/dgraph/w MutationsMode:0 AuthToken: PBlockCacheSize:1395864371 PIndexCacheSize:751619276 WalCache:0 HmacSecret:**** AccessJwtTtl>
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.748617 484805 log.go:295] Found file: 6 First Index: 0
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.749426 484805 storage.go:132] Init Raft Storage with snap: 0, first: 1, last: 0
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.749457 484805 server_state.go:76] Setting Posting Dir Compression Level: 0
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.749470 484805 server_state.go:120] Opening postings BadgerDB with options: {Dir:/var/run/dgraph/p ValueDir:/var/run/dgraph/p SyncWrites:false NumVersionsToKeep:2147483647 ReadOnly:false Logger:0x2dffcb8 Compression:1 InMemory:false MemTableSize:67108864 BaseTableSize:>
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.759108 484805 log.go:34] All 0 tables opened in 0s
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.759206 484805 log.go:34] Discard stats nextEmptySlot: 0
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.759255 484805 log.go:34] Set nextTxnTs to 0
Jan 20 12:47:33 dan-development dgraph[484748]: I0120 12:47:33.759447 484805 log.go:34] Deleting empty file: /var/run/dgraph/p/000005.vlog
Jan 20 12:47:33 dan-development dgraph[484805]: [Sentry] 2021/01/20 12:47:33 Sending fatal event [a6199c5473e74cf397426d6191310b67] to o318308.ingest.sentry.io project: 1805390
Jan 20 12:47:33 dan-development dgraph[484748]: 2021/01/20 12:47:33 mkdir t: permission denied
Jan 20 12:47:33 dan-development dgraph[484748]: github.com/dgraph-io/dgraph/x.Check
Jan 20 12:47:33 dan-development dgraph[484748]: /ext-go/1/src/github.com/dgraph-io/dgraph/x/error.go:42
Jan 20 12:47:33 dan-development dgraph[484748]: github.com/dgraph-io/dgraph/worker.(*ServerState).initStorage
Jan 20 12:47:33 dan-development dgraph[484748]: /ext-go/1/src/github.com/dgraph-io/dgraph/worker/server_state.go:130
Jan 20 12:47:33 dan-development dgraph[484748]: github.com/dgraph-io/dgraph/worker.InitServerState
Jan 20 12:47:33 dan-development dgraph[484748]: /ext-go/1/src/github.com/dgraph-io/dgraph/worker/server_state.go:54
Jan 20 12:47:33 dan-development dgraph[484748]: github.com/dgraph-io/dgraph/dgraph/cmd/alpha.run
Jan 20 12:47:33 dan-development dgraph[484748]: /ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/cmd/alpha/run.go:700
Jan 20 12:47:33 dan-development dgraph[484748]: github.com/dgraph-io/dgraph/dgraph/cmd/alpha.init.2.func1
Jan 20 12:47:33 dan-development dgraph[484748]: /ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/cmd/alpha/run.go:94
Jan 20 12:47:33 dan-development dgraph[484748]: github.com/spf13/cobra.(*Command).execute
Jan 20 12:47:33 dan-development dgraph[484748]: /go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:830
Jan 20 12:47:33 dan-development dgraph[484748]: github.com/spf13/cobra.(*Command).ExecuteC
Jan 20 12:47:33 dan-development dgraph[484748]: /go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:914
Jan 20 12:47:33 dan-development dgraph[484748]: github.com/spf13/cobra.(*Command).Execute
Jan 20 12:47:33 dan-development dgraph[484748]: /go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:864
Jan 20 12:47:33 dan-development dgraph[484748]: github.com/dgraph-io/dgraph/dgraph/cmd.Execute
Jan 20 12:47:33 dan-development dgraph[484748]: /ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/cmd/root.go:71
Jan 20 12:47:33 dan-development dgraph[484748]: main.main
Jan 20 12:47:33 dan-development dgraph[484748]: /ext-go/1/src/github.com/dgraph-io/dgraph/dgraph/main.go:102
Jan 20 12:47:33 dan-development dgraph[484748]: runtime.main
Jan 20 12:47:33 dan-development dgraph[484748]: /usr/local/go/src/runtime/proc.go:204
Jan 20 12:47:33 dan-development dgraph[484748]: runtime.goexit
Jan 20 12:47:33 dan-development dgraph[484748]: /usr/local/go/src/runtime/asm_amd64.s:1374
Jan 20 12:47:33 dan-development systemd[1]: dgraph.service: Main process exited, code=exited, status=1/FAILURE
Jan 20 12:47:33 dan-development systemd[1]: dgraph.service: Failed with result 'exit-code'.
We are hoping someone can assist us with this as we have heard good things about Dgraph, however, our experience thus far has been quite bad.
For reference, we are attempting to install Dgraph on Ubuntu 20.04.1 LTS.
Thank you,
Dan