Get table data form a website.

Community Support
1

Hi Gurus, 

Is there any way I could come to a website like this: https://www.instituteforsupplymanagement.org/ismreport/mfgrob.cfm?SSO=1 and pull data the “MANUFACTURING AT A GLANCE” table or the whole table from that website? I guess I somehow need to load the webpage through KDB and use SSR function? 

Or where can I find info on how to use KDB for pulling data using http requests? 

Regards, VA

2

the url is https, so you could look up how to setup TLS in q.  or…

here’s a start (on linux/mac at least):

q)\c 30 1000

q)system(“(curl https://www.instituteforsupplymanagement.org/ismreport/mfgrob.cfm?SSO=1 >mf.txt)”)

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current

                                 Dload  Upload   Total   Spent    Left  Speed

100 90496    0 90496    0     0  35438      0 --:–:--  0:00:02 --:–:-- 35433

q)(first where {count ss[x;“MANUFAC”]}each x)_x:read0`:mf.txt

“<th class="f2" valign="top" colspan="7">MANUFACTURING AT A GLANCE<br />”

“May 2017</th>”

“</tr>”

“<tr>”

“<th class="f2" valign="top" align="left"><br /><br />Index</th>”

“<th class="f2" valign="top">Series<br />Index<br />May</th>”

“<th class="f2" valign="top">Series<br />Index<br />Apr</th>”

“<th class="f2" valign="top">Percentage<br />Point<br />Change</th>”

“<th class="f2" valign="top"><br /><br />Direction</th>”

“<th class="f2" valign="top">Rate<br />of<br />Change</th>”

“<th class="f2" valign="top"><br />Trend*<br />(Months)</th>”

“</tr>”

“<tr>”

“<td class="f2" valign="top"><strong>PMI<sup>®</sup></strong></td>”

“<td class="f2" valign="top" align="center">54.9</td>”

“<td class="f2" valign="top" align="center">54.8</td>”

“<td class="f2" valign="top" align="center">+0.1</td>”

“<td class="f2" valign="top" align="center">Growing</td>”

“<td class="f2" valign="top" align="center">Faster</td>”

“<td class="f2" valign="top" align="center">9</td>”

“</tr>”

“<tr>”

“<td class="f2" valign="top"><strong>New Orders</strong></td>”

“<td class="f2" valign="top" align="center">59.5</td>”

“<td class="f2" valign="top" align="center">57.5</td>”

“<td class="f2" valign="top" align="center">+2.0</td>”

“<td class="f2" valign="top" align="center">Growing</td>”

..