Hi! We've renamed ScraperWiki.
The product is now QuickCode and the company is The Sensible Code Company.

Blog

Views part 1 – Canadian weather stations

(This is the first of two posts announcing ScraperWiki “views”. A new feature that Julian, Richard and Tom worked away and secretly launched a couple of months ago. Once you’ve scraped your data, how can you get it out again in just the form you want? See also: Views part 2 – Lincoln Council committees)

Canadian weather stations

Clear Climate Code is a timely project to reimplement the software of climate science academics in nicely structured and commented Python. David Jones has been using ScraperWiki views to find out which areas of the world they don’t have much surface temperature data for, so they can look for more sources.

Take a look at his scraper Canada Climate Sources. If you scroll down, there’s a section “Views using this data from this scraper”. That’s where you can make new views – small pieces of code that output the data the way you want. Think of them as little CGI scripts you can edit in your browser. This is a screenshot of the Canada Weather Station Map view.

It’s a basic Google Map, made for you from a template when you choose “create new view”. But David then edited it, to add conditional code to change the colours and letters on the pins according to the status of the stations.

This is the key powerful thing about ScraperWiki views – even if you start with a standard chart or map, you have the full power of the visualisation APIs you are using, and of HTML, Javascript and CSS, to do more interesting things later.

There’s more about ScraperWiki and the Canada weather stations in the posts Canada and Analysis of Canada Data on the Clear Climate Code blog.

Next week – part 2 will be about how to use views to output your data in the machine readable format that you want.

Tags: , ,

Trackbacks/Pingbacks

  1. Views part 1 – Canadian weather stations | Scraperwiki Data Blog | SegnalaFeed.com - Rss Aggregator - December 3, 2010

    […] the rest here: Views part 1 – Canadian weather stations | Scraperwiki Data Blog Posted in […]

  2. Views part 2 – Lincoln Council committees | Scraperwiki Data Blog - January 4, 2011

    […] Views part 2 – Lincoln Council committees Posted on January 4, 2011 by frabcus (This is the second of two posts announcing ScraperWiki “views”. A new feature that Julian, Richard and Tom worked away and secretly launched a couple of months ago. Once you’ve scraped your data, how can you get it out again in just the form you want? See also: Views part 1 – Canadian weather stations.) […]

  3. Sometimes you only need HTML / Javascript | Scraperwiki Data Blog - March 2, 2011

    […] a while now, you’ve been able to create views, to get your data out of ScraperWiki just how you want, in Python, Ruby and […]

We're hiring!