[googleapps domain=”docs” dir=”a/scraperwiki.com/present/embed” query=”id=dcfvj9d_360fd4wwzc8″ width=”410″ height=”342″ /]

We were honoured to be amongst an outstanding line-up of speakers. We also ran a workshop the week of the conference and you can see the German data we scraped into ScraperWiki on the OKCon2011 tag.

What was most interesting about the workshop is that we see the same types of data needed for similar projects wherever we go. Tobias Escher wants to do something similar to AlphaGov for Germany called Meine Demokratie. A lot of very simple little scrapers can go a long way and if there’s anyone looking to play around with scraping and ScraperWiki, or who would like to lend a coding hand to a worthy cause please to click the above link.

‘The Julian’ was also looking for a scraping challenge and the workshop gnomes found Berlin schools data. I showed those in attendance one of my favourite sites made from scrapers:  Schooloscope. So Julian is scraping the data for Berlin schools in various stages and the hope is to get all the data for schools in Germany to make a German schooloscope.

We have one lovely lady very interested in getting this project on its way so if you are willing, if you speak German and if you know where to find them maybe you can scrape German schools data.

So watch out useful things to know in Germany including schools – you’re being ScraperWikied!

(As ScraperWiki is being used for better and better things, this will just get harder for me…)

This year’s Open Knowledge Conference takes place in Berlin. While the conference proper starts tomorrow, during the last two days ScraperWiki ran a workshop to scrape and visualise German data. It has drawn a sizeable community of people, from novices to experienced coders, working on a variety of scrapers. Julian stunned everybody by giving a tour-de-force of just how much is possible by combining ScraperWiki scrapers and views – offering help (and consolation) once the participants tried to achieve just a bit of this themselves.

meine-demokratie.de (myDemocracy)

We have been there to get more data for our project meine-demokratie.de (literally myDemocracy).  This is a not-for-profit endeavour by German NGO Netzdemokraten to make it easy for citizens to find ways on how to have their say in politics and local affairs. In its simplest form, it is a search engine for participation opportunities such as elections, MP surgeries, demonstrations, planning applications, citizen referenda, petitions, consultations, etc. But its much more than that:

1. its focused on the local level, giving citizens tangible opportunities (on a map) to make an impact in their neighbourhood
2. it aggregates various disparate sources of information to make them accessible
3. it makes the data available in a standardised format, enhanced with geographical and administrative information

Why we use ScraperWiki

We have been using SraperWiki for some time because it offers a number of key benefits to our needs:

1. its a simple way to host code and share it with other collaborators
2. we don’t have to care about how to store the data
3. it provides a simple interface to the data – exporting is easy as is creating customised output formats
4. its easy to schedule periodic scraping

There is a more detailed description of how we make use of ScraperWiki at our blog, but basically we look for scrapers to cover many more practical opportunities for citizens to get involved in politics and have their say.The scraping workshop has been a great success for us because we managed to scrape data on future election dates as well as past ones (because the platform is also meant as an archive). What is more, we now also feature information collected by German NGO Mehr Demokratie e.V. on citizen referenda (visualised here) in German states – and there is more to come.

Data on political engagement opportunities – meine-demokratie’s wishlist

However, there is much more data out there, but it is is dispersed and in multiple formats.

Can you help us to get some more of this information in a standardised form – to make it searchable and accessible via meine-demokratie.de?

Here is a list of stuff that could be useful. Its all in German but please do get in touch (on our site or via Twitter) and we bring you up to speed. Also, if you have other sources in mind we would love to hear about them!!!