This month we hosted a superb lineup of speakers at the KX Community Meetup in the Millennium Management offices in New York.
In case you missed it, we had Aaron Davies demonstrating how to use q to deconstruct metadata in cellular images:
Next up, Jack Kiernan demonstrated application development using Python on kdb:
Followed by Phineas Porter using PyKX and q to solve vector challenges:
And lastly, we had a fantastic demo from Ian O’Dwyer walking through the pro-code deployment of kdb Insights, using YAML files and Docker Compose:
We’d like to thank everyone for attending and following up the demos with such great and interesting questions.
If you’d like to join us at a KX Community Meetup, subscribe to this events page to be notified when you can register for future Meetups, and keep an eye on Community Meetups | KX to see where else we’re planning to visit this year.
Looking forward to seeing you at a KX Community Meetup near you!
I would like to comment on the topic of binary parsing. I also had a use case for this and started writing parsers directly in q, but I ran into performance issues when trying to read large files with thousands of variable-length records, as well as when needing to parse lots of incoming messages in real time. So I decided to switch to C, and I also expanded on the idea so now I have a library that can be customized with a DSL that describes the structure of the file and can turn a byte stream into a q object and vice versa. It has some extra features like variable-length arrays with a size field, arrays with a terminator rather than a size field, and case fields which have a different schema depending on the value of another field. It can be found here: gyorokpeter/qbinparse: Customizable binary data parser (github.com)
I have added the outlines of the PNG and zip formats as examples.