Question on sorting a large partitioned table

Community Support
1

Hello,

Currently, I would like to sort a partitioned table by its column colA and colB. I simple perform the following actions:

{ t:colAcolB xasc select from `:<dir_source>/<date>/<trade>;

  (`:<dir_destination>/<date>/<trade>;17;2;6) set t} for each dates

However, the q service was killed occasionally due to memory usage, as some the table data is very large.

Is there anyway to reduce the memory usage, and prevent the killing?

 

Thanks,

Jacky

2

You can sort the table column by column using iasc. This approach is described here - see function disksort.

https://code.kx.com/q/wp/intraday-writedown/#wq