Turbocharging Kdb+ HDB

https://learninghub.kx.com/forums/topic/turbocharging-kdb-hdb

Dear Kx Community,

I am Colin Zhu, a software developer in the computer storage industry. While I’m a relatively recent entrant into the world of Kdb+ and the q language, I’ve authored an article where I propose a novel method. It involves intercepting system calls made by q and redirecting them to a user-mode NVMe driver. This method effectively bypasses the costly kernel-user mode context switch, and the results seems impressive, over 800% performance improvement in a simple HDB query.

You can find the details of this approach in my Medium article titled Turbocharging Kdb+ HDB: Unleashing the Power of High-Speed Mirroring for Optimal Performance | by Colin Zhu | May, 2023 | Medium

The source code for this project is available on GitHub at https://github.com/StorWav/ssnq.git. Considering it’s still in the early stages of development, I encourage you to experiment with it and share your valuable feedback.

I look forward to hearing your thoughts.

Thank you,

Colin Zhu