# Filter performance **URL:** \ **Category:** Dgraph\ **Created:** [March 24, 2020, 5:57pm UTC](https://discuss.dgraph.io/t/filter-performance/6175 "2020-03-24T17:57:39Z")\ **Posts on this page:** 16\ **Page:** 1
**Author:** ![luke.daugherty](https://avatars.discourse-cdn.com/v4/letter/l/f17d59/32.png) [@luke.daugherty](https://discuss.dgraph.io/u/luke.daugherty)\ **Post date:** [March 24, 2020, 5:57pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/1 "2020-03-24T17:57:39Z")
I have a very simple query that is using an index: { q(func: eq(name, “Aqualung”)) { uid } } According to the response this runs in about 2,102,000ns. However if I add a filter on the type: { q(func: eq(name, “Aqualung”)) @filter(type(Album)) { uid } } It takes 1,066,956,371ns. That’s about 500x slower. It’s as if the name index is not being used. Is that correct? Why would it not use the index and then filter the results? I am using the latest docker images and querying through the web client. 2 million vertexes are loaded. ---
**Author:** ![acastle](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/acastle/32/2643_2.png) [@acastle](https://discuss.dgraph.io/u/acastle)\ **Post date:** [March 24, 2020, 9:12pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/2 "2020-03-24T21:12:33Z")
I’m not qualified to answer this, but out of curiousity what is the index type: term, fulltext, hash, or exact? And “Aqualung” has the dgraph.type set to “Album”? ---
**Author:** ![luke.daugherty](https://avatars.discourse-cdn.com/v4/letter/l/f17d59/32.png) [@luke.daugherty](https://discuss.dgraph.io/u/luke.daugherty)\ **Post date:** [March 24, 2020, 9:37pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/3 "2020-03-24T21:37:24Z")
Yes, index is exact: ` : string @index(exact) .` and the dgraph.type is “Album”. There are 2 items with different types with name “Aqualung” (Album and Track) and this returns just the Album. The query works just incredibly slow… ---
**Author:** ![MichelDiz](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/micheldiz/32/11873_2.png) [@MichelDiz](https://discuss.dgraph.io/u/MichelDiz)\ **Post date:** [March 25, 2020, 2:12am UTC](https://discuss.dgraph.io/t/filter-performance/6175/4 "2020-03-25T02:12:33Z")
Hi, I have a theory but I don’t have the dataset to test it. In all latest releases, we have this new feature [Support filtering on nonindexed predicate by animesh2049 · Pull Request #4531 · dgraph-io/dgraph · GitHub](https://github.com/dgraph-io/dgraph/pull/4531) which allows you to filter on non-indexed predicate. And it is set by default as you can see in this line [Support filtering on nonindexed predicate by animesh2049 · Pull Request #4531 · dgraph-io/dgraph · GitHub](https://github.com/dgraph-io/dgraph/pull/4531/files#diff-f64c7e5420debf6d23a76b241e871afeR274) At least I think it is set by default. I’m not sure. If you export your dataset. And import it to a new instance of v1.1.1 and a new instance of the latest one. And compare the performance of both. Well, my theory is right. But, it is important to export and create both new instances. To not have a bias. If this comes to be true, well please open an issue requesting a way to make this optional. If I had a dataset that I could compare and get the same numbers as yours, I would do the tests myself. Cheers. ---
**Author:** ![luke.daugherty](https://avatars.discourse-cdn.com/v4/letter/l/f17d59/32.png) [@luke.daugherty](https://discuss.dgraph.io/u/luke.daugherty)\ **Post date:** [March 25, 2020, 2:50pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/5 "2020-03-25T14:50:57Z")
If name is indexed and we anchor on that it seems the additional filter (especially in this case where only a few items are returned for the name lookup) should be pretty fast. Again, it looks like the addition of the filter is disabling the initial index lookup against name. I am speculating here but the numbers seem to backup it up. If so something seems off with that approach. ---
**Author:** ![luke.daugherty](https://avatars.discourse-cdn.com/v4/letter/l/f17d59/32.png) [@luke.daugherty](https://discuss.dgraph.io/u/luke.daugherty)\ **Post date:** [March 25, 2020, 3:12pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/6 "2020-03-25T15:12:45Z")
I switched to 1.1.1 and performance seems to be the same. ```auto { q(func: eq(name, "Aqualung")) { uid dgraph.type } } ``` Results ```auto { "data": { "q": [ { "uid": "0xc95b1", "dgraph.type": [ "Album" ] }, { "uid": "0x13a823", "dgraph.type": [ "Track" ] } ] }, "extensions": { "server_latency": { "parsing_ns": 100900, "processing_ns": 1052200, "encoding_ns": 13200, "assign_timestamp_ns": 570200, "total_ns": 1794500 }, "txn": { "start_ts": 8019 }, "metrics": { "num_uids": { "dgraph.type": 2, "name": 0, "uid": 2 } } } } ``` ```auto { q(func: eq(name, "Aqualung")) @filter(type(Track)) { uid dgraph.type } } ``` Results ```auto { "data": { "q": [ { "uid": "0x13a823", "dgraph.type": [ "Track" ] } ] }, "extensions": { "server_latency": { "parsing_ns": 62300, "processing_ns": 549921231, "encoding_ns": 8800, "assign_timestamp_ns": 654200, "total_ns": 550743131 }, "txn": { "start_ts": 8023 }, "metrics": { "num_uids": { "dgraph.type": 2, "name": 0, "uid": 1 } } } } ``` ---
**Author:** ![orlandoco](https://avatars.discourse-cdn.com/v4/letter/o/0ea827/32.png) [@orlandoco](https://discuss.dgraph.io/u/orlandoco)\ **Post date:** [March 26, 2020, 1:57pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/7 "2020-03-26T13:57:49Z")
As far as I remember this it’s a very old topic, look at this [post](http://discuss.hypermode.com/t/wrong-filter-section-design/3461/10). It seems that every filter you add will look at the entire index list, so I even if your main filter returns one node, consecutive filters will hit the index table. ---
**Author:** ![luke.daugherty](https://avatars.discourse-cdn.com/v4/letter/l/f17d59/32.png) [@luke.daugherty](https://discuss.dgraph.io/u/luke.daugherty)\ **Post date:** [March 26, 2020, 2:39pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/8 "2020-03-26T14:39:57Z")
The linked post is about filtering on edge facets and indicates this was fixed in 1.2, so this is not likely the same scenario unless I am missing something. ---
**Author:** ![luke.daugherty](https://avatars.discourse-cdn.com/v4/letter/l/f17d59/32.png) [@luke.daugherty](https://discuss.dgraph.io/u/luke.daugherty)\ **Post date:** [March 26, 2020, 2:43pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/9 "2020-03-26T14:43:32Z")
@mrjn or @dmai it would be nice to get an explanation of why this operations is so slow. I am willing to share my data and schema if it helps. Note I am currently evaluating Dgraph for a project at my company. This seems like a simple query that should perform. If I cannot figure out what is wrong soon we would pass on Dgraph. ---
**Author:** ![mrjn](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/mrjn/32/775_2.png) [@mrjn](https://discuss.dgraph.io/u/mrjn)\ **Post date:** [March 26, 2020, 4:13pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/10 "2020-03-26T16:13:10Z")
I suspect that type(Track) has a lot of nodes. So, perhaps try this: ```auto { var(func: eq(name, "Aqualung")) { t as dgraph.type } q(func: eq(val(t), "Track")) { uid val(t) } } ``` ---
**Author:** ![luke.daugherty](https://avatars.discourse-cdn.com/v4/letter/l/f17d59/32.png) [@luke.daugherty](https://discuss.dgraph.io/u/luke.daugherty)\ **Post date:** [March 26, 2020, 4:27pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/11 "2020-03-26T16:27:12Z")
Thanks. I will try this and report results back (loading data now). Still confused as to why the initial index lookup would not take precedence. Yes there are a lot of tracks (1 million+) but the index lookup against name returns 2 nodes 1 of which is a Track. I will admit I am new to Dgraph, RDF, and GraphQL. I however have extensive experience using Gremlin and Cypher. ---
**Author:** ![luke.daugherty](https://avatars.discourse-cdn.com/v4/letter/l/f17d59/32.png) [@luke.daugherty](https://discuss.dgraph.io/u/luke.daugherty)\ **Post date:** [March 26, 2020, 5:32pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/12 "2020-03-26T17:32:55Z")
Thanks. This query does perform much better. I am still curious why my original would not hit the name index and then filter by type. ---
**Author:** ![dmai](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/dmai/32/1254_2.png) [@dmai](https://discuss.dgraph.io/u/dmai)\ **Post date:** [March 26, 2020, 7:50pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/13 "2020-03-26T19:50:50Z")
The query is run exactly how it was written. The original query would use the name index to get the nodes matched by `"Aqualung"` (`eq(name, "Aqualung"))`, then use another index to get the nodes of type Album (`type(Album)`), and then intersect these two lists of UIDs to perform the filter. Once there’s a query planner in place (TBD on the [2020 Dgraph roadmap](https://github.com/dgraph-io/dgraph/issues/4724)) Dgraph can be smarter about executing your original query. ---
**Author:** ![orlandoco](https://avatars.discourse-cdn.com/v4/letter/o/0ea827/32.png) [@orlandoco](https://discuss.dgraph.io/u/orlandoco)\ **Post date:** [March 26, 2020, 8:47pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/14 "2020-03-26T20:47:02Z")
The filtering on edge facets it’s a workaround for the main issue that it’s similar to yours… ---
**Author:** ![luke.daugherty](https://avatars.discourse-cdn.com/v4/letter/l/f17d59/32.png) [@luke.daugherty](https://discuss.dgraph.io/u/luke.daugherty)\ **Post date:** [March 26, 2020, 10:13pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/15 "2020-03-26T22:13:34Z")
Your right Orlando. I’ll echo a comment from that post that seems applicable more then a year later: > anyway, it looks like a timebomb, because a lot of people who use filters don’t understand how they actually works, and it works well only while they have small amount of data. ---
**Author:** ![luke.daugherty](https://avatars.discourse-cdn.com/v4/letter/l/f17d59/32.png) [@luke.daugherty](https://discuss.dgraph.io/u/luke.daugherty)\ **Post date:** [March 27, 2020, 3:24pm UTC](https://discuss.dgraph.io/t/filter-performance/6175/16 "2020-03-27T15:24:09Z")
I do want to say that I do appreciate the effort of the Dgraph team and am continuing my evaluation. The above issue is relatively small in the grand scheme of things and you all provided a working solution. So thanks guys.