Question: Badger num of versions for a key - how to fetch versions back?

asad-awadia · October 30, 2020, 5:03pm

I see badger allows keeping multiple versions for a key which is a very cool feature

but how do I get the different versions when I fetch the key again? Get returns an item and a single version method? How do I access all the versions available for a given key?

Naman · November 4, 2020, 12:05pm

Hi @asad-awadia, great that you like the multiple versions feature.
In iterator options, you would have to set iterator’s allVersions=true. You can have a look at this test as an example.

github.com

dgraph-io/badger/blob/71b5e58a107d98b66a078af5ab3e1346a6677513/txn_test.go#L630-L691


func TestIteratorAllVersionsWithDeleted(t *testing.T) {
	test := func(t *testing.T, db *DB) {
		// Write two keys
		err := db.Update(func(txn *Txn) error {
			require.NoError(t, txn.SetEntry(NewEntry([]byte("answer1"), []byte("42"))))
			return txn.SetEntry(NewEntry([]byte("answer2"), []byte("43")))
		})
		require.NoError(t, err)

		// Delete the specific key version from underlying db directly
		err = db.View(func(txn *Txn) error {
			item, err := txn.Get([]byte("answer1"))
			require.NoError(t, err)
			err = txn.db.batchSet([]*Entry{
				{
					Key:  y.KeyWithTs(item.key, item.version),
					meta: bitDelete,
				},
			})
			require.NoError(t, err)

This file has been truncated. show original

TheCzzZ · November 23, 2020, 2:52am

Hi, Thanks for your answer! I have a question, since bagder is a versioned kv store, is it possible to design a version control system for dgraph on top of that? or at least support some kind of snapshot retrieval?

Another question is that is allVersions is set to true? wouldn’t there be a lot of versions such that they incur a large storage cost?

Thanks for your answer again!!!

Naman · November 23, 2020, 9:49am

Hi @TheCzzZ,

Not sure about the full fledged version control system, but a basic one can be. In managed mode, you can run transactions at specified timestamp and get a view of DB at that point. Badger provides Snapshot Isolation gaurantees. Dgraph uses badger in managed mode and leverages some sort of versioning.
See badger/managed_db.go at 5a96b2cfcb6fcbbd63c2908c6e492bf3b33e5249 · dgraph-io/badger · GitHub

You can SetDiscardTs(). It will clear all the entries below the mentioned ts from the LSM as well as value log files.

Luscha · November 23, 2020, 7:58pm

is it versioning a feature of Cete or it has been implemented only in Badger?

Topic		Replies	Views
Using badger for multiple version store Badger	6	1547	April 9, 2019
3D Access (Key-Value-Versions) Badger / Dgraph Dgraph	1	649	April 6, 2020
Fetch versions of data updated multiple times in badger Users	3	586	April 19, 2018
Get values in key order Badger	0	549	February 3, 2021
Badger keeping n+1 versions when using WithNumVersionsToKeep(n) Badger	3	528	November 23, 2020

Question: Badger num of versions for a key - how to fetch versions back?

Related topics