Cannot allocate memory

Community Support
1

Hi,

When I create splayed table with large column of list, it occurs “Cannot allocate memory” error like below.

q) meta Depthk){if[~.d=*f:!x:-1!x;:f!x f];f:x.d;+f!$["/"~*|$x;x;x f]}'./2014.12.15/Depth/askQuantities#: Cannot allocate memory@:./2014.12.15/DepthtimesymbidPriceaskPricebidQuantityaskQuantitybidNumOrderaskNumOrderbidPricesaskPricesbidQuantitiesaskQuantitiesbidNumOrdersaskNumOrdersupdateTypeupdateNoserialNo

[My Question]
This error occurres when column size is bigger.
Is there limit for column size for free version?

The correct meta result will be below. If column size is not so big, it looks error isn’t occurred.

q) meta Depthc | t f a-------------| -----date | d time | n sym | s bidPrice | f askPrice | f bidQuantity | j askQuantity | j bidNumOrder | j askNumOrder | j bidPrices | F askPrices | F bidQuantities| J askQuantities| J bidNumOrders | J askNumOrders | J updateType | s updateNo | i serialNo | j

[kdb version]
KDB+ 3.2 2014.12.05 Copyright (C) 1993-2014 Kx Systems
l32/ 4()core 15869MB kdb xxxxxxxx 255.255.255.255 NONEXPIRE 

[size of cols]

[kdb@xxxxxxxx 2014.12.15]$ du -hs Depth/*32M Depth/askNumOrder32M Depth/askNumOrders606M Depth/askNumOrders#32M Depth/askPrice32M Depth/askPrices606M Depth/askPrices#32M Depth/askQuantities606M Depth/askQuantities#32M Depth/askQuantity32M Depth/bidNumOrder32M Depth/bidNumOrders597M Depth/bidNumOrders#32M Depth/bidPrice32M Depth/bidPrices597M Depth/bidPrices#32M Depth/bidQuantities597M Depth/bidQuantities#32M Depth/bidQuantity32M Depth/serialNo16M Depth/sym32M Depth/time16M Depth/updateNo16M Depth/updateType

Thank you.

Naoki

2

Yes, meta maps ALL columns at once for the last partition. Regardless of meta, ideally you should have 3-4x free address space of the size of data in the largest partition.

3

Hi Charles,

Thank you very much.
I think data allocation again.

Regards,

Naoki