Election Monitoring with SMS: Lightweight Mobile Data Collection Meets Powerful Mapping Analytics

Posted by KatrinVerclas on Feb 25, 2010

As we are getting ready for our event in Washington DC tomorrow that will focus on New Tools for Better Elections, we are excited to see that more open source options for mobile data collection and analysys are becoming available than ever sbefore.  Development Seed, one of the most promising Drupal development shops around right now, has been an innovator in developing platforms for data analysis, in particular.
This article describes the latest release of its open-source platform Managing News, and its integration with a low-cost SMS gateway for mobile data collection. It was written by Development Seed's Robert Soden and is republished here with permission.

We can now dynamically map and visualize real-time SMS messages in Managing News using the new SlingshotSMS feature. All the code is available on github.

This release is particularly exciting for us because it ties together two of our core projects in such a way that each is made better. SlingshotSMS is a lightweight SMS gateway that can be run off of a USB drive, needing only a GSM modem and an internet connection to act as a bridge between mobile phones and the web. Managing News is a powerful data aggregator and visualization tool that lets distributed teams work together to make large amounts of information useful. Together, they provide an extensible framework for teams conducting mobile data collection projects in the field.

Extensibility is key here because we need this to meet a wide variety of use cases in order for it to be useful. We have been particularly focused on use cases related to election monitoring, but this is just one of many possible applications. Here's a graphic that Saman made illustrating how the system works:

 Using SlingshotSMS with your team  

This technology is meant to accompany your existing processes of data collection. You have people in the field, they have cellphones, you have a phone back in headquarters, and they can text in messages to you that are then relayed to a visualization space, which helps keep you and your team on the same page.

 Setting Up SlingShotSMS Since SlingshotSMS runs on a USB drive, you just plug it in, plug in your phone, and set up what website you want to have the SMS messages sent to. The SMS messages are turned into RSS 2.0 and PUSHed, like as a fat ping. You computer just needs internet to send these messages.

 SlingshotSMS in the field

Going back to this election monitoring example, here you see the election monitor is texting in that the polling station is closed. You'll notice that the text message contains a few things: a polling station ID, the word "closed", and the word "security." These are key terms we are going to want to look for on the Managing News side to flag.

 SlingshotSMS integration with Managing News  

SlingshotSMS just pushes the data up to Managing News. The Managing News site will have a custom parser that will break up this text message, pulling out key words and numbers.

Customizing SMS parsing for each project

Out of the box, the Managing News/SlingshotSMS bridge simply accepts the SMS and incorporates it into the default Managing News workflow, ignoring important information in this example like the fact the polling station is closed and there is a security issue. This is where the pluggable nature of Managing News proves its worth. It is simple to write a custom parser that replaces the default parser that ships with Managing News. With some creative use of the Drupal taxonomy system to filter incoming results into Managing News channels and some very basic regex, you can quickly have a system that is able to capture this data and let Managing News users react to it. We'll publish a blog post soon explaining exactly how to do this.

Authentication

Authentication of incoming SMS messages is vital in these situations, and we took extra care to make sure the Managing News Slingshot feature will only receive data from authorized sources. The framework is dependent on the Drupal KeyAuth module which allows signed messages to pass between a SlingshotSMS installation and Managing News. When setting up the Managing News Slingshot feature, users are given public and private keys that they then copy into the SlingshotSMS configuration file. In the future we are considering switching to an OAuth based solution.

To get set up, you'll need the following:

Editors Note: We will test-run Managing News and Slingshot in an upcoming software review but meanwhile congratulate Development Seed on the ongoing efforts in building better open source tools for mobile data collection and analysis.

Election Monitoring with SMS: Lightweight Mobile Data Collection Meets Powerful Mapping Analytics data sheet 6989 Views
Countries: Afghanistan

Excellent.

Excellent work you did, I was thinking about this approach to do in Pakistan for same assignment.

 

Shahnawaz Chachar

Program Manager

Democratic Governance Program

 

 

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd><p><br> <b><i><blockquote>
  • Lines and paragraphs break automatically.

More information about formatting options