Showing posts with label Data. Show all posts
Showing posts with label Data. Show all posts

Monday, December 10, 2012

YQL for Web Data

The web is your own personal database.  All the information is out there, you simply need an efficient way to access it.  YQL is the Yahoo Query Language and goes a long way toward bring your data directly to you in a well structured format.

So how do you get started in YQL and do you need to be a programmer?  Let's start here: try grabbing some stock quotes.  Sure, it looks a little imposing with angle brackets and keyword tags, but play around with it -- test it, give it a go.

Yes, the data is out there and someone might already have your data in a YQL table -- check it out.

The old way of downloading web information used what is called a screen scrapper or some other form of parsing the HTML from a web page.  The problem here, if the web page changes, the data access is broken.  Or you could grab a spreadsheet like format, like the Yahoo stock quotes in CSV format and use a programming environment like the Windows .NET framework to parse the data in a proprietary fashion.

Now you can get the stock data using a standard YQL approach.

Other sources of information:






Thursday, November 29, 2012

Statistics - Signal versus Noise


Prediction is very difficult, especially about the future.
-- Niels Bohr


Just happen to be reading both The Signal and The Noise by Nate Silver and The Only Three Questions That Still Count by Ken Fisher and find the overlap on statistics quite serendipitous.


From Baseball to Investing to Earthquakes and TED Talks, statistics can be used as an effective tool to uncover the elusive.

Nate Silver, Ken Fisher and Sebastian Wernicke all use the science of learning from data with great success.  Nate Silver began his journey into data analysis as a young baseball fan.  Ken Fisher wanted to find out what no other investors knew.  And Sebastian Wernicke wanted the perfect TED Talk.

Twitter: @_wernicke @fivethirtyeight @fisherinvest