Lux IO is a small performant key value storage. It is B+-tree based and is quite space efficient and fast for large data sets. I tested it on my laptop with 20 million strings.

Installation

Install python-luxio

Test

1 million string puts on my notebook…

Troubleshooting

1. LuxIO Installation Errors
Problem:

Solution:
Add the following line to util.h additional to the other import lines

Automatically 🙂

2. Python Library Debugging

Problem:

Solution:
Manually download the luxio python library from github as above

3. Pip install does not work

fix: install library from github

4.LuxIO Library Import Error

Solution:

References

1. http://luxio.sourceforge.net/
– Is LuxIO faster than Tokyo Cabinet ?
2. http://d.hatena.ne.jp/antipop/20090512/1242126238
– LuxIO as a storage engine for kyoto Tycoon
3. http://alpha.mixi.co.jp/blog/?p=847
– CDB
4. http://cr.yp.to/cdb.html

About Gugulethu Ncube

IT enthusiast getting things done.