Can't read splayed tables bigger than 38 GB

Community Support
1

Have folder structure: C:/dir/2014.01.01/exampleTable C:/dir/2014.01.01/sym … do \cd dir/2014.01.01 exampleTable:get:`exampleTable If folder less than 38 GB typing exapleTable or a more specific query will work, else get +… error. Is there a way to further splay / partition the table to reduce size?

2

>C:/dir/2014.01.01/exampleTable
>C:/dir/2014.01.01/sym

is unusual; you should have just the one sym file at the root

C:/dir/sym

or you’ll run into other problems later.

And rather than loading tables in the same way as several emails ago, just use

\l c:/dir

and then query using

select … from exampleTable where date=2014.01.01

You can have partitions split into segments -

http://code.kx.com/wiki/JB:KdbplusForMortals/segments

For 32bit, you need to get each table in each partition to less than ~500MB.

3

Thank you. There seems to be no imediately obvious way we can segment it to 500 mb. A single instrument on a single day may have more data than that :(

4

* immediate