I went through the post how to import 4 billion rdf to dgraph quickly · Issue #1323 · dgraph-io/dgraph · GitHub and I found my situation is very similar with it except I already tried dgraph-bulk-loader. I have a personal server with 32 core CPU and 64G memory and 1.5 T SSD and the data is around 3…

Problem solved, I guess (just guess, I have no idea how to verify) the problem is mainly related to the strategy of OS memory management, then the second factor is number of go routines. My personal server(64G, 32 core, 480G+1T SSD) previous installed with centOS 7, and I found once the memory req…

Bulk loader becomes slow when memory gets full

Users

system (system) Closed December 17, 2017, 8:06am 22

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Fatal error: runtime: out of memory when bulk loader Dgraph bulkloader	13	1803	August 10, 2020
OOM during bulk loading Dgraph bulkloader	5	827	October 18, 2021
Inconsistent bulk loader failures Dgraph dgraph , status:accepted , kind:bug , area:bulk-loader	14	913	January 27, 2021
Bulk loader taking more than 100G virtual memory for 5.4G of data Dgraph mutation	8	1148	March 18, 2019
Loading close to 1M edges/sec into Dgraph - Dgraph Blog Blog	3	1494	November 15, 2018

Bulk loader becomes slow when memory gets full

Related topics