Benchmarks fail to run; AssertTrue failing and many files not found errors

What version of Go are you using (go version)?

$ go version
go1.17 and above

What operating system are you using?

Darwin AMD64 and Linux AMD64

What version of Badger are you using?

Latest at master

Does this issue reproduce with the latest master?

Yes

Steps to Reproduce the issue

Run: go test -run=^$ -bench=. ./…

What Badger options were set?

Irrelevant

What did you do?

Ran go test -run=^$ -bench=. ./…

What did you expect to see?

Benchmarks running successfully

What did you see instead?

Failures such as at Bencher

or inlined below

Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 266MB
Badger DB Size = 266MB
Badger DB Size = 266MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 138MB
Badger DB Size = 266MB
Badger DB Size = 266MB
Badger DB Size = 266MB
Badger DB Size = 266MB
Badger DB Size = 271MB
Badger DB Size = 271MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 266MB
Badger DB Size = 266MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 266MB
Badger DB Size = 266MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 266MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 261MB
Badger DB Size = 266MB
Badger DB Size = 266MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 133MB
Badger DB Size = 4MB
goos: darwin
goarch: amd64
pkg: github.com/dgraph-io/badger/v3
cpu: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz
BenchmarkDbGrowth-8                 	       1	2662133998 ns/op
BenchmarkIteratePrefixSingleKey/Key_lookups-8         	   20538	     60202 ns/op
--- BENCH: BenchmarkIteratePrefixSingleKey/Key_lookups-8
    iterator_test.go:389: Inner b.N: 1
    iterator_test.go:389: Inner b.N: 100
    iterator_test.go:389: Inner b.N: 10000
    iterator_test.go:389: Inner b.N: 20538
--- FAIL: BenchmarkReadWrite/0.1,0064
    value_test.go:999: Benchmark Read: file with ID: 0 not found
--- FAIL: BenchmarkReadWrite/0.2,0064
    value_test.go:999: Benchmark Read: file with ID: 0 not found
--- FAIL: BenchmarkReadWrite/0.5,0064
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/1.0,0064-8                         	 1681110	       679.4 ns/op
--- FAIL: BenchmarkReadWrite/0.1,0128
    value_test.go:999: Benchmark Read: file with ID: 0 not found
--- FAIL: BenchmarkReadWrite/0.2,0128
    value_test.go:999: Benchmark Read: file with ID: 0 not found
--- FAIL: BenchmarkReadWrite/0.5,0128
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/1.0,0128-8                         	 1693291	       821.5 ns/op
--- FAIL: BenchmarkReadWrite/0.1,0256
    value_test.go:999: Benchmark Read: file with ID: 0 not found
--- FAIL: BenchmarkReadWrite/0.2,0256
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/0.5,0256-8                         	--- FAIL: BenchmarkReadWrite/0.5,0256-8
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/1.0,0256-8                         	 1444701	       838.2 ns/op
--- FAIL: BenchmarkReadWrite/0.1,0512
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/0.2,0512-8                         	--- FAIL: BenchmarkReadWrite/0.2,0512-8
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/0.5,0512-8                         	--- FAIL: BenchmarkReadWrite/0.5,0512-8
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/1.0,0512-8                         	 1000000	      1028 ns/op
--- FAIL: BenchmarkReadWrite/0.1,1024
    value_test.go:999: Benchmark Read: file with ID: 0 not found
--- FAIL: BenchmarkReadWrite/0.2,1024
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/0.5,1024-8                         	--- FAIL: BenchmarkReadWrite/0.5,1024-8
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/1.0,1024-8                         	  730362	      1599 ns/op
--- FAIL: BenchmarkReadWrite/0.1,2048
    value_test.go:999: Benchmark Read: file with ID: 0 not found
--- FAIL: BenchmarkReadWrite/0.2,2048
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/0.5,2048-8                         	--- FAIL: BenchmarkReadWrite/0.5,2048-8
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/1.0,2048-8                         	  728871	      1619 ns/op
--- FAIL: BenchmarkReadWrite/0.1,4096
    value_test.go:999: Benchmark Read: file with ID: 0 not found
--- FAIL: BenchmarkReadWrite/0.2,4096
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/0.5,4096-8                         	--- FAIL: BenchmarkReadWrite/0.5,4096-8
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/1.0,4096-8                         	  810337	      1443 ns/op
--- FAIL: BenchmarkReadWrite/0.1,8192
    value_test.go:999: Benchmark Read: file with ID: 0 not found
--- FAIL: BenchmarkReadWrite/0.2,8192
    value_test.go:999: Benchmark Read: file with ID: 0 not found
--- FAIL: BenchmarkReadWrite/0.5,8192
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/1.0,8192-8                         	  608974	      3093 ns/op
--- FAIL: BenchmarkReadWrite/0.1,16384
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/0.2,16384-8                        	--- FAIL: BenchmarkReadWrite/0.2,16384-8
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/0.5,16384-8                        	--- FAIL: BenchmarkReadWrite/0.5,16384-8
    value_test.go:999: Benchmark Read: file with ID: 0 not found
BenchmarkReadWrite/1.0,16384-8                        	  413230	      5424 ns/op
--- FAIL: BenchmarkReadWrite
FAIL
exit status 1
FAIL	github.com/dgraph-io/badger/v3	24.698s
?   	github.com/dgraph-io/badger/v3/badger	[no test files]
PASS
ok  	github.com/dgraph-io/badger/v3/badger/cmd	0.185s
?   	github.com/dgraph-io/badger/v3/fb	[no test files]
?   	github.com/dgraph-io/badger/v3/integration/testgc	[no test files]
?   	github.com/dgraph-io/badger/v3/options	[no test files]
PASS
ok  	github.com/dgraph-io/badger/v3/pb	0.125s
goos: darwin
goarch: amd64
pkg: github.com/dgraph-io/badger/v3/skl
cpu: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz
BenchmarkReadWrite/frac_0-8         	 3406040	       592.4 ns/op
BenchmarkReadWrite/frac_1-8         	 3862806	       538.2 ns/op
BenchmarkReadWrite/frac_2-8         	 3675747	       449.2 ns/op
BenchmarkReadWrite/frac_3-8         	 4236542	       439.5 ns/op
BenchmarkReadWrite/frac_4-8         	 4333861	       481.5 ns/op
BenchmarkReadWrite/frac_5-8         	 4962127	       437.8 ns/op
BenchmarkReadWrite/frac_6-8         	 4705632	       391.7 ns/op
BenchmarkReadWrite/frac_7-8         	 5508822	       381.5 ns/op
BenchmarkReadWrite/frac_8-8         	 6713448	       371.4 ns/op
BenchmarkReadWrite/frac_9-8         	 9627369	       286.1 ns/op
BenchmarkReadWrite/frac_10-8        	75438462	        19.25 ns/op
BenchmarkReadWriteMap/frac_0-8      	 2072919	       619.9 ns/op
BenchmarkReadWriteMap/frac_1-8      	 2122689	       659.0 ns/op
BenchmarkReadWriteMap/frac_2-8      	 2581789	       550.6 ns/op
BenchmarkReadWriteMap/frac_3-8      	 2666620	       579.6 ns/op
BenchmarkReadWriteMap/frac_4-8      	 2620176	       459.6 ns/op
BenchmarkReadWriteMap/frac_5-8      	 3492739	       466.9 ns/op
BenchmarkReadWriteMap/frac_6-8      	 3408771	       429.2 ns/op
BenchmarkReadWriteMap/frac_7-8      	 3092889	       381.4 ns/op
BenchmarkReadWriteMap/frac_8-8      	 3651278	       388.6 ns/op
BenchmarkReadWriteMap/frac_9-8      	 5022050	       316.3 ns/op
BenchmarkReadWriteMap/frac_10-8     	27253212	        45.83 ns/op
BenchmarkWrite-8                    	 2539417	       485.4 ns/op
BenchmarkSortedWrites/builder-8     	14127122	        81.66 ns/op
BenchmarkSortedWrites/skiplist-8    	 2876838	       428.7 ns/op
BenchmarkSortedWrites/buffer-8      	11663541	        96.54 ns/op
PASS
ok  	github.com/dgraph-io/badger/v3/skl	57.185s
goos: darwin
goarch: amd64
pkg: github.com/dgraph-io/badger/v3/table
cpu: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz
BenchmarkBuilder/no_compression-8         	       6	 178909954 ns/op	 465.04 MB/s
BenchmarkBuilder/encryption-8             	       5	 202071472 ns/op	 411.74 MB/s
BenchmarkBuilder/zstd_compression/level_1-8         	       5	 218277258 ns/op	 381.17 MB/s
BenchmarkBuilder/zstd_compression/level_3-8         	       5	 233518275 ns/op	 356.29 MB/s
BenchmarkBuilder/zstd_compression/level_15-8        	       5	 210951725 ns/op	 394.40 MB/s
2021/09/02 16:55:40 Assert failed
github.com/dgraph-io/badger/v3/y.AssertTrue
	/Users/emmanuelodeke/go/src/github.com/dgraph-io/badger/y/error.go:55
github.com/dgraph-io/badger/v3/table.(*Table).blockCacheKey
	/Users/emmanuelodeke/go/src/github.com/dgraph-io/badger/table/table.go:664
github.com/dgraph-io/badger/v3/table.(*Table).block
	/Users/emmanuelodeke/go/src/github.com/dgraph-io/badger/table/table.go:567
github.com/dgraph-io/badger/v3/table.(*Iterator).seekToLast
	/Users/emmanuelodeke/go/src/github.com/dgraph-io/badger/table/iterator.go:240
github.com/dgraph-io/badger/v3/table.(*Iterator).Rewind
	/Users/emmanuelodeke/go/src/github.com/dgraph-io/badger/table/iterator.go:417
github.com/dgraph-io/badger/v3/table.(*Table).initBiggestAndSmallest
	/Users/emmanuelodeke/go/src/github.com/dgraph-io/badger/table/table.go:433
github.com/dgraph-io/badger/v3/table.OpenTable
	/Users/emmanuelodeke/go/src/github.com/dgraph-io/badger/table/table.go:332
github.com/dgraph-io/badger/v3/table.CreateTable
	/Users/emmanuelodeke/go/src/github.com/dgraph-io/badger/table/table.go:270
github.com/dgraph-io/badger/v3/table.getTableForBenchmarks
	/Users/emmanuelodeke/go/src/github.com/dgraph-io/badger/table/table_test.go:858
github.com/dgraph-io/badger/v3/table.BenchmarkRead
	/Users/emmanuelodeke/go/src/github.com/dgraph-io/badger/table/table_test.go:706
testing.(*B).runN
	/Users/emmanuelodeke/go/src/go.googlesource.com/go/src/testing/benchmark.go:192
testing.(*B).run1.func1
	/Users/emmanuelodeke/go/src/go.googlesource.com/go/src/testing/benchmark.go:232
runtime.goexit
	/Users/emmanuelodeke/go/src/go.googlesource.com/go/src/runtime/asm_amd64.s:1446
exit status 1
FAIL	github.com/dgraph-io/badger/v3/table	12.762s
PASS
ok  	github.com/dgraph-io/badger/v3/trie	0.154s
goos: darwin
goarch: amd64
pkg: github.com/dgraph-io/badger/v3/y
cpu: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz
BenchmarkBuffer/bytes-buffer-8         	  947842	      1128 ns/op
BenchmarkBuffer/page-buffer/page-size-1024-8         	 4220737	       413.0 ns/op
PASS
ok  	github.com/dgraph-io/badger/v3/y	3.591s
FAIL

Thanks for reporting this. It should be fixed by https://github.com/dgraph-io/badger/pull/1741