I went through the post how to import 4 billion rdf to dgraph quickly · Issue #1323 · dgraph-io/dgraph · GitHub and I found my situation is very similar with it except I already tried dgraph-bulk-loader. I have a personal server with 32 core CPU and 64G memory and 1.5 T SSD and the data is around 3…

Problem solved, I guess (just guess, I have no idea how to verify) the problem is mainly related to the strategy of OS memory management, then the second factor is number of go routines. My personal server(64G, 32 core, 480G+1T SSD) previous installed with centOS 7, and I found once the memory req…

Bulk loader becomes slow when memory gets full

Users

Topic		Replies	Views
Fatal error: runtime: out of memory when bulk loader Dgraph bulkloader	13	1882	August 10, 2020
OOM during bulk loading Dgraph bulkloader	5	849	October 18, 2021
Inconsistent bulk loader failures Dgraph dgraph , status:accepted , kind:bug , area:bulk-loader	13	970	January 27, 2021
Bulk loader taking more than 100G virtual memory for 5.4G of data Dgraph mutation	8	1172	March 18, 2019
Loading close to 1M edges/sec into Dgraph - Dgraph Blog Blog	3	1525	November 15, 2018

Bulk loader becomes slow when memory gets full

Related topics