I have been modifying
.travis.yml(in travis-e2e branch) to run the
dgraphassigner and the
dgraphloader on the Freebase data. Have got things into a working state. Had some doubts here.
The idea here is to
- Load data from Freebase into Dgraph.
- Run the Dgraph server with
- Run throughput test for a minute from the benchmark repository.
- Upload memory and cpu profiles to S3 maybe.
So travis has a 50 minute limit on each job and if we try to load the
names data, it exceeds the limit on their 2 core, 8 GB ram machine. See here https://travis-ci.org/dgraph-io/dgraph/builds/152890454.
So can we isolate a smaller dataset? If we can do that, then maybe we can run the full test even on feature branches. That is if we can bring it to under 10-15 mins. Or else maybe we run it only on master/release branches. Any advice about this @minions?