Reducing RAM usage when re-enumerating symbol columns

Community Support
,
1

https://learninghub.kx.com/forums/topic/reducing-ram-usage-when-re-enumerating-symbol-columns

Hi,

Is there a method to re-enumerate symbol columns in a splayed table without loading in the entire column file? This is part of a data copy between two HDBs, and we want to avoid pulling the entire column into memory if possible. Looked at using 1: (File Binary | Reference | kdb+ and q documentation - Kdb+ and q documentation (kx.com)) to load, re-enumerate and write the column in chunks but haven’t managed to get it working.

Thanks,

Eoghan

2

This might be of use - be sure to test first

https://github.com/jfealy/q/blob/master/mergeHdb.q