Performance issues with v24.0.2

Users Dgraph
21

I’m looking at the published docker images: https://hub.docker.com/r/dgraph/dgraph/tags
Typically there are two architectures built:

OS/ARCH:

  • linux/amd64
  • linux/arm64/v8

We use linux/amd64, but 24.0.3 only has linux/arm64/v8.

Will there be another one published?

Thanks,
Ryan

22

Hi Ryan,
We are in the process of releasing a new patch and the ARM image got published prematurely.
We should have the images for both architectures for the new patch soon.

In the meantime, you can go ahead with using 24.0.2 which has amd/arm images published.
Sorry for the confusion.
Thanks
-Megha

1 Like
23

@RJKeevil Thanks a lot for testing it. Yeah mutation speed is unaffected by this, but we are working on that too separately.

1 Like
24

I’ve been lurking on these PRs the last few days:

Those benchmark stats look incredible:

BenchmarkTestCache-8     1673727               751.5 ns/op  (Main without risteretto cache)
BenchmarkTestCache-8     2333268               501.3 ns/op  (Main with risteretto branch)
BenchmarkTestCache-8     3668409               319.3 ns/op  (The PR's improvements)

Running 24.0.4, with the query cache set at 10% (of 256gb ram), we see about 30% improvement. This was with live data ingest stopped. When it’s on, the improvement is less significant. We’re looking forward to the fruits of these PRs to get even fasters!

2 Likes
25

Thanks @rahst12 for the enthusiasm. The old risteretto cache, couldn’t handle when there were updates. At every update the cache is invalidated. The new cache that we are implementing updates the cache instead. So hopefully when your live data ingest is on, the new cache would still perform good.
In the new PR, even the ristretto cache is almost as fast as the new cache, signifying in general performance improvements with cache. The new cache is jepsen tested and till now we haven’t seen any consistency issues by using it. Hopefully we get these PRs soon, we are still in the process of fine tuning.

26

If a beta is released with the new PRs, we’ll test it and provide feedback.

27

@rahst12 That’s great to hear. The beat would be out soon :slight_smile:
If you want to try out right now, You could try out the branch harshil-goel/shared-map. It’s the latest that we have.