Hi, if we have large amount of data in google cloud storage do we need to download it to a mounted drive or can we directly import it using dgraph bulk loader? It seems the former but with large amounts of data would be nice
Currently, Dgraph supports only live loader and bulk loader to import large datasets into Dgraph. Both of these require the data to be present on the disk. We do have distributed bulk loader in our roadmap but nothing related to providing APIs which can directly import from cloud storage.
Thanks!
1 Like