newbie questions about kdb

Community Support
1

I’m a complete newbie to kdb. As a hobby, I am currently developingmy own analysis software using a SQL server backend. I have roughly120 GB worth of tick data.I’ve been reading good things about kdb, so I decided to check it out,and if it works better I was thinking of migrating to it.. Idownloaded the trial software, but the website is rather sparse…also, it seems to be tiny, less than 1 MB and only a form of CLI.Did I download the right software?If so, will the trial software allow me to import 120 GB of data?Thanks in advance,Ken

2

That’s the right software, it’s runnable as a REPL or an interpreter
for script files. The trial version has some limitations, which I
don’t remember off the top of my head; I’m not sure whether they’ll
affect you.

100GB will almost certainly need to be stored as a partitioned
database (details in the wiki at code.kx.com), and you’ll probably
need to write some sort of ETL program to get your data into the right
format. (It should be about 10 lines.)

3

Hello Ken,

Further to Aaron’s advice, the trial software is only available in
32-bit, so you’ll have the RAM restriction imposed by 32-bit
addressability, which could inhibit your data import. If you search
through this group you’ll find the other trial software restrictions.

The following link may be of use to you when importing the data:

https://code.kx.com/trac/wiki/KdbplusForMortals/dotQ\_utilities#a1.5.5.Q.fs

user/pass:anonymous/anonymous

Regards,

Fintan.

4

Great, thanks to both of you for the info! I will look this upfurther and try to get it up and running.On Oct 21, 5:28?pm, Fintan Quill <fint…> wrote:> Hello Ken,>> Further to Aaron’s advice, the trial software is only available in> 32-bit, so you’ll have the RAM restriction imposed by 32-bit> addressability, which could inhibit your data import. If you search> through this group you’ll find the other trial software restrictions.>> The following link may be of use to you when importing the data:>> https://code.kx.com/trac/wiki/KdbplusForMortals/dotQ_utilities#a1.5.5...&gt;&gt; user/pass:anonymous/anonymous>> Regards,>> Fintan.>>>> On Thu, Oct 21, 2010 at 8:11 PM, Aaron Davies <aaron.dav…> wrote:> > That’s the right software, it’s runnable as a REPL or an interpreter> > for script files. The trial version has some limitations, which I> > don’t remember off the top of my head; I’m not sure whether they’ll> > affect you.>> > 100GB will almost certainly need to be stored as a partitioned> > database (details in the wiki at code.kx.com), and you’ll probably> > need to write some sort of ETL program to get your data into the right> > format. (It should be about 10 lines.)>> > On Thursday, October 21, 2010, kjackson <kjackson…> wrote:> >> I’m a complete newbie to kdb. ?As a hobby, I am currently developing> >> my own analysis software using a SQL server backend. ?I have roughly> >> 120 GB worth of tick data.>> >> I’ve been reading good things about kdb, so I decided to check it out,> >> and if it works better I was thinking of migrating to it.. ?I> >> downloaded the trial software, but the website is rather sparse…> >> also, it seems to be tiny, less than 1 MB and only a form of CLI.> >> Did ?I download the right software?>> >> If so, will the trial software allow me to import 120 GB of data?>> >> Thanks in advance,>> >> Ken>> >> –> >>

Submitted via Google Groups</kjackson…></aaron.dav…></fint…>