Really, having technical tickets (issues, bugs, features and pull requests) and commits in the same place will help with the two big things: transparency and collaboration. We want to make it easier for you to see what we are working on, submit a ticket and lend a hand when you can. If you are busy creating great code, we’d like to know about it and be able to incorporate it into the core. Or, make it more visible for others to use your code for their Ushahidi-related projects. Git Issues is directly connected to our GitHub – Ushahidi. (E.g. Ushahidi core issues live under https://github.com/ushahidi/Ushahidi_Web/issues).

Migration Help and Schedule:

Our team has reviewed the Red Mine and have flagged issues to be migrated.

Please add a comment to any items that you think need to be migrated to Git Issues. We’ve added the document to our new beta wiki for your review. Every coders eyes will help us capture the active tickets/issues. Ping Hleson at ushahidi dot com if you have a questions.

Migration Schedule:

• Community Feedback on Issues to be migrated: February 8 – 15, 2012
• Migration Freeze on RedMine: Februay 15 – xxx
• Ushahidi Community Developer Skype Chat (time to be announced) Wednesday, February. 15, 2012
• Deprecate Redmine. February 29th, 2012
• Team cleans out the Github store procuring all the sweet Github Octocat hoodies. March 1st, 2012

Getting Help:

Tool soup is confusing. Duplication is less fun than collecting Nyan Cat mash-ups. Here’s a cheat sheet:

Forums: “How do I….”, “I’m troubleshooting”, “General Support”
Wiki: “Where are the documentation, best practices” and “How do I…”. Bonus points: document and share your knowledge
GitIssues: “Houston, we have a problem.” “Nyan, Ushahidi would rock it if…” (Issue/bug/feature)
Github: Commit, Pull Changes, Fork
Contact: General questions (eg. Erik’s favourite ihub story, business endeavours, events, press etc.)

Steps to get help:

Technical Issues:

1. Search the wiki or forums.
2. Collaborate with the community skype or dev mailing list. (This is a real-time stream of global chatter)
3. Search Git Issues for existing issues.
4. Add a Git Issue: (bug or feature) request.

Non-Technical Issues:

1. Search the wiki or forums.
2. Add a forum post for questions.
3. Share your knowledge on the wiki.
4. Collaborate with the Channel for Academics, Researchers and Community Skype Chat or mailing lists.
5. To ask general non-technical tickets, you can drop us a Contact note (http://ushahidi.com/contact-us).

We will review all Git issues weekly and assign priorities. The priorities could include assigning to a team member or requesting community help. More details as we get closer to launch.

To sum up: GitIssues, flag your tickets for migration, Octocat hoodies and Nyan Cat.

These badges are broken down into “badge packs”. For example, the Locations pack is a simple grouping of badges that follow a travel theme, with badges highlighting landmarks from countries around the world. The Ushahidi pack is a group of generic badges that the Ushahidi team has put together. New packs are expected soon, with contributions from the community and designers from other projects as well.

How can you use this as an Ushahidi administrator? Deployers of newer versions of the Ushahidi Platform and current users of Crowdmap have access to all of these badges already. Simply log into your admin panel and browse to the Manage->Badges settings page to get started. As an example, you may award the 25 Star badge to a user who has sent in 25 approved reports. This can be a manual process where you assign badges to users or set up Action Triggers to do this automatically. Just experiment with the platform to come up with interesting achievements to award your users.

We need your help! This collection of open source badges belongs to the community. If you’re a designer, developer or just interested in all things badgy, you can support this initiative. Your efforts will impact a multitude of projects, ranging from projects that crowdsource information in crisis and disaster situations to projects that reward people for submitting delicious pictures of cheeseburgers. Please check out our badge site for more information.

We’re really excited to see what everyone comes up with. We hope to see the badge image repository grow so other projects can get some value out of our open source badge initiative. Let us know in the comments what you come up with!

Okay, so what does that mean to regular folks? How about: We care about our communities and the world around us. So, we need to protect and improve it. How can we know more and be actively involved in the real changes, even at a incremental level?

Call to Map it, Change it.

The UN has stacks of resources about RIO+20. The Future We Want is an initiative focused on opening up the process to: Share your ideas. The UN’s Sustainable Future site includes a list of organizations and movements who demonstrate the power of: What Can You Do?

We invite you to join the fray: What can you map? There are countless local and global stories related to sustainable development. Take map aim at an issue that you care about to highlight the need for real change.

Mapsters in Action

At the recent United States Rio +20 pre-event, Ushahidi had a chance to feature the work of amazing deployers trying to share, understand and change their world. These examples should get your mind spinning on some of the untold map stories that you could activate. Citizen crowdsourcing can elevate and visualize your subject. And, you may be surprised who you hear from and how you can collaborate.

The Cost of Chicken project works with kids from around the world to collect data on local food conditions. It uses Crowdmap to track and share information ranging from the cost of chicken, water, and, even, candy. Learn more from Olga Werby, mapster advocate:

Can those kids be any more inspiring in their search to understand and connect with each other over food production? Thanks to each one of them for sharing their passion for change.

Take a World Tour:

Deployers around the globe are mapping about sustainability. These are some examples we shared at USRio+20:

• Global Energy Shortages This map includes a layer of Ajay Kumar’s project Powercuts.in.
• Find Fuel in Nairobi, Kenya
• Ministry of Agriculture, Irrigation and Livestock: Nangarhar Agriculture, Irrigation and Livestock ( DAIL ) (Afghanistan). More on this project: “A Moment of Discovery and Awe“.
• iWitness Pollution (Louisiana, USA)
• Spotting Fair Trade in North America (supporting sustainable products) (USA)
• Agrotestigo: Mapping Agricultural Social Networks (building collective resources about agricultural technologies) in Argentina
• Qiantang River Water Map 钱塘江水地图: A Collaborative Interactive Water Map for Qiantang River (China)

If you have more examples of great maps, please share them in the comments or add them to our Deployments Map.

And, when you create a new map, be sure to tweet to @UN_Rioplus20 and @ushahidi. Use the hashtags #futurewewant. We’d be happy to feature your map story on our blog. Simply drop us a line.

More Resources:

• Official United Nations Conference on Sustainable Development (UNCSD)
• UN Sustainable Future site
• United States Rio+20 Conference
• The Future We Want

Thank you: USRio20 participants and organizing team

Thank you to Noel Dickover, Richard Boly and Sarah Jessup for inviting Nat Manning and I to participate in USRio20. Special thanks to Carmelle Terborgh, ESRI, for supporting our participation.

We were delighted to meet participants and to brainstorm, learn and Speed Geek [video] about these important topics.

Thanks!

Heather L.

The first 72 hours of the SomaliaSpeaks deployment were particularly intense. The purpose of this joint write-up with Al Jazeera and partners is to share some of our early lessons learned in this novel collaboration.  Every deployment teaches us a multitude of lessons, so our partners at Al Jazeera, Souktel and Crowdflower joined us in this effort to share these. We look forward to future collaborations with them as we share this story with you.

This purpose of this pilot project was to let Somalis speak for themselves. For the first time ever, a prominent news organization, Al-jazeera, used crowdsourcing and SMS to let thousands of Somalis express for themselves how the crisis has been effecting their daily lives. More than 4,000 text messages were received within just a few days. Of these, over 1,000 were translated from Somali into English by about 80 translators. The resulting map of Somali voices received over 25,000 page views.

Before reviewing our lessons learned, we first wanted to thank K’naan and Sol for the initial inspiration behind this project. They got in touch with Ushahidi last year because they wanted to use the platform to help amplify Somali voices and show how capable the Somali people are. The initial version of this project was a prototype that was not activated. But thanks to Al- jazeera, Souktel and Crowdflower, we were able to revive the project to help amplify Somali voices in the international media.

Despite being a pilot, the project exemplified valid use cases in the application of pervasive technologies such as the web and mobile phone to news and information gathering. Somalia being a country run down by decades of neglect and war as well being rife with insecurity  provides one of the most challenging operational environments. Within a very short time we were able to curate information traversing through different parts of Somalia. This would have proved futile if not overly expensive or impossible had it been done using traditional news gathering techniques. Furthermore the information collected provides more insight on the realities of life in Somalia.

Projects like this involve a lot of effort and goodwill from the community and a chain is only as strong as its weakest link. Therefore, building a strong community around the project goes a long way to solving problems and mitigating challenges. The community goes beyond the volunteer translators. We saw lots of support from the Somali blogging community, technology and media enthusiasts as well as innovators or innovation centric minds across the globe who all narrated or reported the Somalia Speaks project in their own ways. Having a strong community and inculcating a community ethos in  project operations and goals goes a long way influencing success. Without the community backing and promoting this project, it would have only been another temporary spotlight on Somalia.

The project worked as follows. Al-jazeera editorial selected the following question for interview:

“Al Jazeera would like to know — how has the Somalia Conflict affected your life? Please also include the name of your hometown in the response. Thanks.”

Our colleagues at Souktel distributed the question via text message to 5,000 of their SMS subscribers across Somalia. The responses were then forwarded from Souktel’s SMS platform to a customized Crowdflower micro-tasking platform. There, Somali-speaking volunteers translated and geo-located the text messages which were then manually uploaded to Al-jazeera’s Ushahidi platform.

There are three points worth highlighting in terms of lessons learned:

1. Messaging

While the question that was posed via SMS in no way asked for individuals to reply with their personal names, a small number of responders still added their names; some even added their full names. So these were deleted as quickly as possible. (Note that the numbers posted in the title of initial reports were not phone numbers but an assigned sequential number generated by the Crowdflower plugin). In hindsight, the SMS sent out with the question should have specifically asked that responders not include personal identifiers in their SMS replies.

2. Volunteer translation

While we had recruited a small number of trusted volunteers to translate the incoming text messages using a Crowdflower plugin, a decision was subsequently made to make the call for volunteers public to cope with the 2,500+ SMS replies received. This means that anonymous volunteers could see the original text messages, some of which initially  included personal identifiers. So we immediately reached out to Crowdflower for guidance to take the plug-in offline. We then began to manually delete several dozen text messages inside the Crowdflower plug-in that contained personal identifiers. Our colleagues at Al-jazeera took over this process and set up their own micro-tasking platform, removing all personal identifiers from the text messages awaiting translation and geo-location.

3. Security

One of Ushahidi’s community members tested the platform and identified a search security issue on Friday, December 9th. We quickly fixed this on the deployment. And, we issued a security patch to all deployers. (http://security.ushahidi.com)

In the future, for this type of “The People Speak” project,  we recommend taking the following steps:

1. On large multi-partner deployments: Global organizations work in multiple timezones, so communications plans need to include 24/7 points of contacts for each organization.
2. Text potential interviewees to ask whether they agree to be interviewed and to have their responses made public before sending out the main question.
3. Text those individuals who have consented to being interviewed with the desired question and ask them to include the name of their town but not their personal names.
4. Recruit trusted translation volunteers well in advance and ensure that the micro-tasking translation platform has no personal identifiers.
5. Stagger the launch of the text messages and the live map. That is, start with the SMS broadcast and spend however many days/weeks doing the bulk of the translation with vetted volunteers. The system that holds the raw text messages should obviously be fully secure. When the majority of text messages are processed, launch the live map and gradually add the already translated text messages to grow the map steadily over a period of days/weeks.

At Ushahidi, we’ve also made some plans to help all deployers in our community:

• We’re building a program for privacy and security education for our users in 2012. (Blog posts, webinars, videos and meet-ups.)
• Best practices for security and privacy will be included as essential documentation on our soon to be re-launched wiki.
• Ushahidi is open source and the community is a large part of what makes it work.  We’ll build a security working group focused on our software, but it’ll take your participation to make it work.
• Alongside our partners within the CrisisMappers community, we will participate in a security and privacy working group. This field is growing and collective lessons can only improve each map action.

Crisis mapping and journalism are both in the nascent stages of collaborating on real-time news connecting diaspora and citizens alike. Al-Jazeera is leading the fray in testing and implementing live maps into their fast-moving news cycle toolkit. We are thankful for all their efforts and look forward to further collaboration.

In September, I began teaching my first upper-level University course at Grant MacEwan University. Having taken some (and heard about some other) lack-lustre undergrad Software Engineering courses, I really wanted to make this course practical, project-based and interesting for the students. One inspiration was the Undergraduate Capstone Open Source Project (UCOSP) where final-year students select a project and are mentored by faculty across Canada to work on an open-source project for course credit. I also loved the practical approach of the Software Carpentry course taught by Greg Wilson and Paul Lu, which I was involved in a few Summers back and frankly preferred to some of the “Ivory Tower” Software Engineering that is common in undergrad courses.

It was Greg Wilson that pointed me to Ushahidi, and I felt Ushahidi’s humanitarian focus would be a great added benefit to my students. Computer science is so often focused on science, business, marketing and advertising that I felt this was an opportunity to show my students how a small group of dedicated people can use software to make a difference in humanitarian way. There were other great projects suggested too, such as the Sahana Foundation, but I made up my mind to go with Ushahidi once I was introduced to Heather Leson and got to peak in on a Ushahidi hack-a-thon from Nairobi via Skype. The energy of the group was obvious and very exciting.

Organizing the Curriculum

With much enthusiasm, I jumped into trying to build a course using Ushahidi as the core project component. The first major hurdle was that 3rd year computer science students have minimal system administration experience. Except for a few exceptions, they haven’t run a database or a web server on their own. Moreover, PHP is not part of a course curriculum. The sysadmin challenges were answered by using Harvard’s CS50 Virtual appliance. This VM is based on Fedora Linux and comes with PHP, Apache and MySQL already installed. The VM runs on VirtualBox, which is free so students could install it on their laptop (this is how most students ran it). As for PHP, I felt that PHP was accessible to undergrads coming from a Java background. It’s syntax and object-oriented are quite similar to Java.

Our courses at Grant MacEwan involve a weekly three-hour lab component. The first lab was used to introduce PHP with some sample programs. The second lab was used to introduce Kohana and the MVC framework. After the second lab, the first assignment was given. The first assignment consisted of 4 simple tasks

• Apply a patch to get Ushahidi to work with non-clean URLs
• Change the site name and tagline on the admin page to match the main page
• Modify the labels in the API stream
• Add a ‘’pirate’’ response type to the API

These assignments helped the students become familiar with how MVC web servers work. I also felt that the API was an important concept for them to understand well. In the end, this assignment was a bit too easy in some ways. In general, it’s very challenging to judge the level of difficulty when working with an existing code base. To this point, most of my students would have only written programs from scratch (similar to most undergrad CS courses).

It was also to determine what kind of hints to give. For example, problem #4 from above become quite trivial once you show students how to search (using grep) through a code base. Without that hint, students will try to trace the code manually and search manually. So the dividing line between dozens of hours of work and 10 minutes is literally the knowledge of how to use grep effectively. Once the students had completed the first assignment, it was time to throw them head first into Ushahidi on some more significant projects.

Picking the Projects

One advantage I had was that there were only 10 students, which enabled students to work on separate projects based on their interests. Mistakes with a course of 10 students are much more fixable on the fly than with, say, 40 students.

In trying to gather project ideas, I searched the feature requests on the Ushahidi development site and also I asked the Ushahidi community for ideas for projects. Projects from the feature request list included selecting multiple categories and multi-coloured dots. Others came from the Ushahidi group, such as 2-way SMS communication, OpenStreetMap integration and white-labeling the J2ME app. Some were my own creation, such as the SQlite back-end.

In general, is very difficult to carve 10 appropriate projects from an actively developed open-source project like Ushahidi for the following reasons:

• Ushahidi developers are focused on moving the project forward, adding real features that users care about. As such, they are typically not willing to risk those features not being developed by leaving them to an undergrad.
  Course projects are in 3 month blocks whereas actual development in the project focuses on small increments or “many months away”, so carving off a piece that fits nicely into a 2-3 month course project is hard because that is not how developers think. Developers, from what I gather, focus on the next few week or two, or they may focus on large scale goals (significant re-writes of subsystems) which again are difficult to break down into course projects.
• The knowledge gap – real developers know the code, my students do not. This gaps adds to the difficulty of developers creating projects that can be handed off to an inexperienced student to complete.

Even with the above challenges, our results show that it is possible and extremely valuable to use real software in an undergraduate course project. I believe that our projects on Ushahidi went as well as I could have expected for three main reasons:

The Ushahidi developers cared enough to try and suggest projects. Some projects were fine just as suggested while others could at least give me ideas that I could try and distill into projects. In the end, my responsibility is determining and setting the educational goals, so this worked well. The developers were of a great help, quick to respond to questions and supportive of the students, and I can’t thank them enough for this. My students were willing to accept the “ups and downs” of this kind of project. They knew the alternative was a canned, built-from-scratch project that no recruiter would care about. I was able to convince them that saying they had worked on (and got patches accepted to) a real software project would be of at least some merit over a typical SE course project.

There were certainly some bumps in the road in terms of some projects being too easy (to which I would assign further work) or too hard (a completely working project was not required in some cases). In then end, the students were able to make significant progress on some real problems that the Ushahidi community cared about.

Student Project Review

All that said, let’s talk about the projects, cause they’re really cool.

Dale Douglas (code) added the ability to allow reports to be edited on the main display. His implementation was not secure by any stretch, so may not be deployment ready, but was an interesting project. Dale wished that plugins could overwrite system files so that he wouldn’t have to modify the main Ushahidi codebase.

Brett McKay (code) white-labelled the J2ME app. He also discovered that the J2ME app was in the middle of re-write. So he added the functionality to the new re-write version to add a deployment site and fetch reports. This an example where a student had to take on additional tasks once his initial task (white-labelling) was complete. Brett was challenged in there is actually no documentation of the J2ME app at all

Richard Laan (code) added the ability to select multiple categories on the main map page. Richard’s learning curve was even steeper in that he had to learn Javascript for this project. In the end, a very successful implementation. Tracing the javascript was the most challenging aspect for Richard.

Joel Joseph (code) added a search functionality to the API. This feature allows an API query to search and return results for particular keyword. Joel’s first project was a refactoring suggested by one of the developers. This was another example of a project that needed to be extended once the initial task was complete.

Ranjoat Panesar (code) added a plugin to support 2-way SMS communication between an SMS user and the system. For example, the could stop and start notices or search for incidents related to a keyword. The motivating idea was having a user search for incidents around their current area, but we didn’t get that far.

Alex Molzhan (code) Alex added a button that allowed the incidents to be shown in their incident colour when being displayed under All Categories. Richard Laan is currently continuing to work on this feature in relation to his “Select Multiple Categories” project.

Chris Proulx (code) Chris added an AJAX-based interface to the reports editting page under the administrator. The features chris avoided reloading all the reports when one was deleted. His changes made the reports editing noticeably snappier.

Wilson Liang (code) Wilson created a standalone Java app for the desktop. His application would follow a particular deployment. It may be useful in a situation when connecting to a particular deployment may have intermittent connectivity.

Ruben Estevez de Freitas (document) Ruben worked on getting OSM installed locally and working with Ushahidi. Most instructions for OSM are for Ubuntu, so Ruben learned about the mess that is Linux package management and the difficulty in translating Ubuntu package names to Fedora package names. Ruben’s submission is not a github repository, but simply a document describing all the steps to get OSM working with Ushahidi on a Fedora virtual machine.

Andrew Gergely (code) worked on creating an SQLite-based database for Ushahidi. Andrew ran into two major issues. The first was that the configuration scripts presumed MySQL and were difficult to debug. The second issue was that MySQL and SQLite SQL queries are not completely compatible with each other. The lessonhere was that “standards” such as SQL are sometimes not that standard.

The course ended with project demos some of which the students put up for recording. The students have all made their code available and some are continuing to work on their projects.

I think I can say that the students all enjoyed working on a real software project and found it valuable. There were certainly challenges that the students mentioned. The most difficult was the lack of an up-to-date, detailed technical description of how everything works. The lesson here is that such a document rarely exists, especially on open-source projects. For one, the document would be too massive to read or to keep updated. Updating is especially difficult due to the incremental nature of open-source development where developers’ time is already stretched thin. Know-how comes from mostly from doing and playing with the code, not from documents. Although, as always, more documentation would certainly be helpful both in the code itself and external to it. In particular I think a “How to get started with Ushahidi” document would be helpful for new developers. Second, I think a curated “To do” list for various levels of experience (new, novice, advanced) perhaps on the new wiki, would help with new developers looking for a way to get involved (or for a university professors looking for projects ).

In the end the course went extremely well. I learned a lot about Ushahidi, got to interact with some great people and, of course, some great students. A big thank you to Greg Wilson, Heather Leson, Dale Zak, David Kobia, and Aaron Huslage for all their help and interaction over the last several months.

********
Contact Cam Macdonnell via email

To Cam, all the students and Grant McEwan University:
Thank you being the first class of students to focus an entire semester on Ushahidi open source software development. Your hard work has taught us much about how to integrate Ushahidi software development into classrooms. We are close to launching more changes to make it easier for people to contribute, including more Git love aka a “To Do” list. And, a special thanks to Greg Wilson for advocating open source in Canada’s universities.

To the Ushahidi Community Developer Skype Chat folks:
Thank you for supporting this initiative and answering Cam’s and his student’s questions. We hope to do more of this in the future and hope that you will join us on that journey.

This week several members of our team attended the 3rd International Conference of Crisis Mappers (ICCM) that was held in Geneva, Switzerland and we were blown away by the turn out (Follow #ICCM on Twitter). This community has grown substantially over the last 3 years – when we attended the first conference held in Cleveland, Ohio back in 2009 there were about 100 attendees. Now there are more than 400 gathered here discussing crisis mapping and the challenges they face. There are really 3 main things that we keep hearing as it relates to GIS and mapping:

• How to collect and organize data from the crowd around the globe as it relates to crisis
• How to enable action from this data
• How to build, collect, and maintain reference data for crisis

Collecting and Organizing Data from the Crowd

As for the first topic, collecting and organizing data from the crowd, there is a good tool developed by our partner Ushahidi. Ushahidi is a platform that takes crowd sourced information like SMS messages, categorizes them, and displays them on the map as a point or cluster of points showing relevant location. The result of this effort is a point map that begins to illustrate where individuals are vocalizing need or disseminating information.

Enabling Action

While points are a good start, we have been working with Ushahidi and a focus group comprised of both GIS and Crisis Mappers to define requirements for new tools that will support analysis of this data. We have heard the need for spatial and temporal analysis tools within the Ushahidi platform as well as the need for tools to bring Ushahidi data into ArcGIS where analyses can be run.

We are very excited to announce that we have made the first tool available to support these requirements-the ArcGIS add-in for Ushahidi which can be downloaded and quickly added to ArcMap. This add-in allows you to connect to a Ushahidi instance with the API enabled, convert text between languages, and download the Ushahidi data into a geodatabase. This opens up the feed of data being captured in Ushahidi to the rich spatial and temporal analysis tools within ArcGIS allowing users to empower action and inform decision makers using a sound scientific approach. Curious how this might work? At the bottom of this blog is a good write-up of using this tool to analyze information coming in from the current Thailand flooding.

Reference Data

Having this information and resulting analysis is great, but without good reference/basemap data as a backdrop, it is hard to understand the context of any situation. A common theme discussed here in Geneva is the isolated and rural nature of many locations and the lack of base data. While there may be global vector and raster datasets available, they are often either severely dated or at a scale that does not support local action.

One data set that supports crowdsourcing of basemap data is OpenStreetMap (OSM). OSM is constructed and edited for all types of use by a global user community, and yes you can join! Crowdsourced basemap data is particularly valuable during a crisis response where current and often high resolution data needs are compounded.

In support of this open source effort, Esri offers a desktop tool for ArcGIS that allows you to join the crowd by editing and publishing to OSM from within ArcMap. This tool also allows you to download OSM data over your area of interest directly into ArcGIS for use in a disconnected and offline environment common in response. You can download the ArcGIS Editor for OSM.

Esri is committed to supporting the crisis response community thru our Esri Disaster Response Program as well as thru the continued evolution of ArcGIS to support the collection, management, analysis, and visualization of data in a collaborative environment. While these tools don’t solve all of the problems we face as crisis mappers, we hope you will find them valuable in your arsenal and as a starting point to a dialogue around enhancements to and construction of additional tools or data. We are already looking forward to ICCM 2012 in Washington, DC!

ArcGIS Add-in for Ushahidi

Getting Started

To get started, first download the Esri Add-in for Ushahidi. Once you’ve installed the Add-in you’re ready to add it to ArcMap. Go to the Customize menu | Toolbars | Customize… located at the very bottom of the list.

In the Customize dialog, click the Commands tab| type Ushahidi in the Show commands containing: text box. You will see the Ushahidi2ArcGIS Add-In listed in the Commands pane.

Drag the Ushahidi2ArcGIS command to any existing toolbar in your ArcMap window. You must drag this command onto an existing toolbar, not just onto the map. You will see a new button with a blue circle icon show up on your toolbar.

Connecting to a Ushahidi Instance

To connect to an Ushahidi instance click on the Download Ushahidi Reports to ArcGIS button and enter the parameters.

The key parameter to enter is the API Endpoint. This is the main URL to the Ushahidi instance, such as Thailand Flood Crisis Information Map or Bushfire Connect. You also have the option to translate the data (using Bing Translator) for either just the categories or all the incident data. Note that the more you have to translate and the more records you have the longer the time it will take to download and create the data.

Once the data is downloaded it is added to a layer. The tool automatically sets the data to render on Unique Values in the Category Title field and uses the default colors from the Ushahidi instance.

Additionally the HTML Popup set and the description of the layer has been populated to reflect the source, date and time the data was downloaded. This is critical temporal information for Crisis Mappers.

Perform Further Analysis

Now that the Ushahidi data is downloaded you’re ready to perform further analysis. You can look at data over time, limit your focus on specific categories, or do more in depth spatial analysis.

For example if we wanted to get a better understanding of the reports of flooding around Bangkok we can focus on those reports (i.e. just one category of the incidents).

We can then visualize the data as a “heat-map” (by using the Kernel Density tool).

To get more detailed information on the data and to further determine significance of the reports we can use spatial statistics to determine if there are non-random spatial patterns and statistically significant hot or cold spots in the data. To do this we can use the Spatial Autocorrelation and Hot-Spot Analysis tools. The basic workflow is shown here in ModelBuilder:

The results of this analysis are highlighted in blue on the map as areas (1 km^2 ) that have statistically significant clusters of flood reports (in this case 8 to 27 per km2 ). These are the high priority areas that should be focused on first. Then we focus on questions like why are there so many reports in this area? Is there a single authoritative source of SMS feeds on the ground or is there a large group of people that need help?

This is just one type of analysis that can be run in ArcGIS Desktop from Ushahidi data. We are interested in learning more from you in the type of analysis that you’ve run using this tool. Please use the comments section of the tool and let us know how the tool works and what needs to be improved.

*****

Thanks to the ESRI team for creating this valuable plug-in.

World Bank Managing Director Caroline Anstey recently announced a new partnership with Google that will apparently empower citizen cartographers in 150 countries worldwide. This has provoked some concern among open source enthusiasts. Under this new agreement, the Bank, UN agencies and developing country governments will be able to “access Google Map Maker’s global mapping platform, allowing the collection, viewing, search and free access to data of geoinformation in over 150 countries and 60 languages.”

So what’s the catch? Google’s licensing agreement for Google Map Maker stipulates the following: Users are not allowed to access Google Map Maker data via any platform other than those designated by Google. Users are not allowed to make any copies of the data, nor can they translate the data, modify it or create a derivative of the data. In addition, users cannot publicly display any Map Maker data for commercial purposes. Finally, users cannot use Map Maker data to create a service that is similar to any already provided by Google.

There’s a saying in the tech world that goes like this: “If the product is free, then you are the product.” I fear this may be the case with the Google-Bank partnership. I worry that Google will organize more crowdsourced mapping projects (like the one they did for Sudan last year), and use people with local knowledge to improve Map Maker data, which will carry all the licensing restrictions described above. Does this really empower citizen cartographers?

Or is this about using citizen cartographers (as free labor?) for commercial purposes? Will Google push Map Maker data to Google Maps & Google Earth products, i.e., expanding market share & commercial interests? Contrast this with the World Bank’s Open Data for Resilience Initiative (OpenDRI), which uses open source software and open data to empower local communities and disaster risk managers. Also, the Google-Bank partnership is specifically with UN agencies and governments, not exactly citizens or NGOs.

Caroline Anstey concludes her announcement with the following:

“In the 17th century, imperial cartographers had an advantage over local communities. They could see the big picture. In the 21st century, the tables have turned: local communities can make the biggest on the ground difference. Crowdsourced citizen cartographers can help make it happen.”

Here’s another version:

“In the 21st century, for-profit companies like Google Inc have an advantage over local communities. They can use big license restrictions. With the Google-Bank partnership, Google can use local communities to collect information for free and make the biggest profit. Crowdsourced citizen cartographers can help make it happen.”

The Google-Bank partnership points to another important issue being ignored in this debate. Let’s not pretend that technology alone determines whether participatory mapping truly empowers local communities. I recently learned of an absolutely disastrous open source “community” mapping project in Africa which should one day should be written up in a blog post entitled “Open Source Community Mapping #FAIL”.

So software developers (whether from the open source or proprietary side) who want to get involved in community mapping and have zero experience in participatory GIS, local development and capacity building should think twice: the “do no harm” principle also applies to them. This is equally true of Google Inc. The entire open source mapping community will be watching every move they make on this new World Bank partnership.

I do hope Google eventually realizes just how much of an opportunity they have to do good with this partnership. I am keeping my fingers crossed that they will draft a separate licensing agreement for the World Bank partnership. In fact, I hope they openly invite the participatory GIS and open source mapping communities to co-draft an elevated licensing agreement that will truly empower citizen cartographers. Google would still get publicity—and more importantly positive publicity—as a result. They’d still get the data and have their brand affiliated with said data. But instead of locking up the Map Maker data behind bars and financially profiting from local communities, they’d allow citizens themselves to use the data in whatever platform they so choose to improve citizen feedback in project planning, implementation and monitoring & evaluation. Now wouldn’t that be empowering?

]]> http://blog.ushahidi.com/index.php/2012/01/25/google-inc-world-bank-empowering-citizen-cartographers/feed/ 4 http://blog.ushahidi.com/index.php/2012/01/10/election-monitoring-in-the-drc/ http://blog.ushahidi.com/index.php/2012/01/10/election-monitoring-in-the-drc/#comments Tue, 10 Jan 2012 18:18:43 +0000 hleson http://blog.ushahidi.com/?p=6643 [Guest post by Galya Ruffer, J.D., Ph.D., Director, Center for Forced Migration Studies at the Buffet Center, Northwestern University, Evanston, IL. Galya lead a team deployment for the recent Democratic Republic of Congo.]

On November 28th, 2011 crowds assembled at 62,000 polling stations to elect DR Congo’s fifth president in the country’s first independently administered presidential elections since independence in 1960.

Polling Station in Bukavu, Ibanda Commune

Technology had improved considerably since 2006 with most people having cell phones and greater access to wireless. On the other hand, the remote areas most sensitive to violence and election fraud are the ones without cell service and electricity. Thus, many of the same challenges remained. Knowing all these challenges, we still decided that deployment would be useful since many organizations are looking to crisis mapping to assist in combating the ongoing insecurity in eastern Congo and massive sexual violence. We could all learn from the experience. The site went live one week before the elections, on November 18th, reporting in French and English.

Organizing Networks and Teams

Through the international partners, a U.S. based diaspora group, RDC2XTE, seeking an alternative vision for DRC through supportive actions to improve accountability and advancement, and our own contacts, we created a network of local independent observers and media sources based in Bukavu and Goma in the eastern Congo and Kinshasa to continuously report back what they were witnessing at various polling stations.

One of our main dedicated partners in the east, the Institute for War and Peace Reporting, trained and organized local women journalists to SMS or email direct reports. A second dedicated partner, Collectif D’Actions Pour La Defense Des Droits Humains (CADDHOM), a local NGO focusing on a wide range of programs concerning human rights, was an official partner of the CENI (the National Election Commission) deploying 200 monitors in South Kivu. CADDHOM sent us reports via email and SMS as they received phone calls and SMS from their official field observers. I also accompanied the executive director of CADDOM, Pasteur Joseph on election day to observe the elections.

Outside EDAP Polling Station in Bukavu with CADDHOM Coordinator, Pasteur Joseph (right)

A third dedicated partner was Catholic Agency for Overseas Development (CAFOD), who organized to station a volunteer in Kinshasa to receive reports from the 30,0000 network of Catholic Bishop monitors in the field. Although in contact with the EU monitoring team, there were no actual exchanges of information and the Carter center did not respond to emails.

We provided all partners with training material and produced post card sized printouts with SMS instructions. I only arrived on the ground on November 25th, but used my time there to meet with local partners none of whom, even though they had received all my materials before hand, had actually visited the site. Internet access is simply too complicated to spend time trying to view a site that takes hours to access. On the other hand, once I arrived and installed the local SIM cards, the Android phones with SMSSync worked perfectly. In fact, since I put the SIM cards on roaming, they work even here in Chicago.

Election Day, SMS Blocked and Lessons Learned

Even with the late start, once the elections got underway we began to receive reports via SMS and email. But then a major glitch came when the government shut down the whole SMS network on December 4th due to concerns of impending violence with the announcement of the election results scheduled for December 6th. Our independent deployment hit a major roadblock between the block on SMS and evacuation of internationals from Kinshasa. I was scheduled to fly to Kinshasa on December 5th, but could not get there since flights were cancelled. All work was suspended in Kinshasa and people ordered to stay home. As CENI continued to delay announcing election results and tension mounted, the CAFOD volunteer could not send any reports. CENI finally announced Kabila’s victory on December 9th, but with growing unrest from the opposition, SMS was not restored until December 14. As soon as it was, we immediately began receiving reports from the volunteer, but these were limited to the December 13th press release that the EU confirmed the Archbishop of Kinshasa’s declaration of irregularities in the elections and media reports.

Speaking with many organizations on the ground, it became apparent that Ushahidi was not widely known in the DRC and, although I physically sat with locals and showed them the platform there was interest, no one I met with could view the site on their computers given the slow Internet connection. A local radio station in Goma. Radio Mutaani, had also set up an SMS system and gmail chat feeding into their website, but were weary of sharing data with Ushahidi given security concerns. I visited their radio station and attended a program at the University in Goma and was impressed with the level of engagement surrounding the election. Until SMS was cut off, they had a lot of activity through their gmail chat.

Without SMS the deployment shifted to media monitoring coordinated by undergraduate Liz Casano of the NorthWestern University Student team and Bharathi Ram and Leesa Astredo of the Stand-by Task Force. The SBTF was instrumental in sorting through and reporting on more than 20,000 tweets. So far, a total of 320 online reports have been uploaded from over 70 locations, comprising 55 types of incidents. There are over 150 reports still waiting to be input into the system, most likely with more to come as the team reviews additional media sources.

One of our goals going in to the deployment was to be able to provide a broad platform to link up the work of local and international monitors and amass all the reports in “real time” for use by all. We learned that this was not in the best interest of the official monitors. Given the strategic role of the National Episcopal Conference of the Congo, the country’s Catholic bishops’ council as the largest monitoring group, it was in their best interest to kept their reports secret until ready to make an official announcement which they did on December 12th. In the end, the need of human rights and humanitarian organizations to report on and respond to crisis, did not coincide with the needs of official monitoring efforts to postpone release of information until they could better assess and negotiate the political implications.

Although more time to conduct networking on the ground would have produced more buy in from humanitarian, civil and human rights organizations, it seems that in the end we might have had the same problems given the SMS and need of the largest observers to withhold their reports until the best strategic moment.

The project team is now shifting its focus to analysis. In the next three months our goal is to issue two reports on the elections. The first will examine the question of transparency that was central to the rejection of the election results by the opposition and critiques of the official monitors. The second will layer in additional data to seek to answer questions broader questions such as did NGO civics work result in reduced problems? Were their areas that had violence in 2006 but not this time? And what kinds of responses were most successful and why?

Here’s a full report from Kate Cummings, Program Manager for Ushahidi Liberia:

John is a remarkably talented developer and teacher. He has dedicated much of his time to not only creating contextually relevant plugins and features for Liberia’s Ushahidi instances, but also has spent the last 8 months conducting intro to programming training for the local staff so they can contribute their own code to the Ushahidi platform (and beyond). Working with John is an honor; he’s a natural humanitarian, always seeking ways to combine his technical expertise with pressing needs in places like Liberia.

The Simple Groups plugin – allowing multiple organizations composed of several unique users to have private admin access to the same Ushahidi instance. Each group has a private admin page that contains their own messages, reports, and admin map. Here are features we’ve added for groups:

• Whitelisted phone numbers – trusted sources’ phone numbers can be linked to particular groups
• Tagged reports – each group’s report is tagged with the organization’s logo so viewers can quickly identify the source that has approved and determined the verification status of the report
• Admin Map plugin– many partners to keep certain reports temporarily private due to their sensitive content. We created the Admin Map on each group’s admin page that shows all unapproved reports as black.

More features of Admin Map:

• Multiple categories can be compared at once using the Boolean functions OR and AND. These logical operators give groups a new way to look for trends in their data
• All of these features have also been added to the instance’s homepage (all except groups’ unapproved reports). Click on the “Big Map” button at the top of the election homepage
• Location Highlighter - When our partners are turning messages into reports, it can sometimes be difficult to find the message’s location on the map. To expedite this process, the Location Highlighter tool outlines Liberia’s counties and districts on the map to narrow the scope of the search. Because most of our groups work with low bandwidth, the Highlighter’s clear parameters allow admin users to spend less time clicking and dragging across the map and more time searching a clearly defined area
• Forwarding Messages feature – Because several of our partners have a customized instance and are Simple Group members on a shared instance (like Liberia 2011 or LERN), the “forward messages” feature was added so messages could be shared between the admin sides of both instances. We also created a code library for interacting with the Ushahidi API; this made it easier to use the API for forwarding messages, and will make it easier for all Ushahidi developers to interact with the Ushahidi API.
• Print Map – A map that’s setup to print well on letter and A4 sized paper. This page also adds a key to the map, so when it prints the user can see what categories were selected. The print map page also lets users create a link to just their customized map and selected categories. For example, if you wanted to show someone the reports of violence (one category) and women & children (another category) send them this link generated from the Print Map page at the bottom
• SMSSync and the platform – After extensive testing led by John Etherton and Ushahidi’s Henry Addo have formed a reliable protocol for operating SMS services in Liberia. Several issues were corrected in the SMSSync plugin and additional software was used on our phones to ensure the phones don’t default to “sleep” mode (which was disabling SMSSync). We now forward SMSs to our Ushahidi instances reliably.
• iFrame Map - This is for people who want to embed Ushahidi in another website. For an example, see this demonstration. Some of our partners that use the LERN site are using this feature to highlight their maps on their own websites
• Density map plugin - Another new feature on the instance is Ushahidi’s first Density Map plugin. Located on the right side of the homepage, just above the categories, the Density Map option makes it easier to separate reports by geographic region – in this case, by county. All reports that have been associated with a particular county will show up using the Density Map. This feature was requested by UN OCHA as well as other local partners, and serves as a small step towards making the Ushahidi platform a data analysis tool.
• Internationalization – Thanks to John’s twice-a-week programming trainings with Ushahidi Liberia’s local staff, many of the plugins written for Liberia have been setup to work in other languages. This helps to ensure the work we do in Liberia can be used in other parts of the world.

Contact John.

About the Ushahidi Trusted Developer Program

We are very thankful for our growing community. Each of their contributions are valued. We started the Ushahidi Trusted Developer Program to recognize excellence in Ushahidi software development.

Previous Posts in this series:
Introducing Ushahidi Badges
Recognizing Ushahidi Deployment Partners

Thanks John for all that you do! And thank you Kate for sharing.

Being part of a global hacking community supporting open source software is very important to Ushahidi. Community members participated in various cities or virtually. They answered questions, taught each other, and happily, gave us feedback on how we can improve. We hope to support some of the project leaders as they continue to work on these initiatives.

Here are some of the weekend highlights:

Water Quality reporting

The co-winner of RHok Montreal, Watervoices, collaborated with RHoK Toronto to build an Ushahidi deployment focused on giving people voice about water quality in Northern Canada. The WaterVoices project was co-lead by Steve Sauder and Melanie Gorka. The teams in both cities included front-end and back-end software developers, international development specialists, emergency managers, graphic designers, open data advocates and researchers. The prototype is currently offline, but you can follow their twitter account (@mywatervoice) to see how they will proceed. To learn more, see a WaterVoices video featuring the RHoK Montreal team members.

Another highlight of this project was testing an easy-to-use application that lets people use Tropo to input data into Ushahidi via SMS. Thanks to the Tropo team for this! It is now available on Github for other people to use and test.

Offline to Online Communications

How to give voice when technology is unavailable is a huge quandary. There were a few hacks that worked with existing solutions testing to Ushahidi. The Reflab team with Francesco Ciriaci leading the charge built an HTML5 hack for reporting Offline/Online. This hack is something that Ushahidi would like to see continue. During RHoK, the DRC map was unable to receive SMS reports due to connection issues. We will be connecting with the various hackers and groups involved during the weekend on this to see how to move it forward, including Geeks without Bounds, Reflab, Mozilla, Tropo and more. The RHok Zurich team worked on Message Carrier (another offline/online communication tool). The code is listed on github.

Also see Francesco Ciriaci’s post on his Mobile Web App for Ushahidi.

Other Ushahidi RHoK Hacks

RHoK Montreal worked on a Security Alert App for Humanitarian Workers. Medicins San Frontieres provided invaluable use case input to the team who created this Ushahidi prototype using Tropo. To learn more, see their presentation and videos (see Part 1 and Part 2).

For two RHoK events (including Rhok Portland this month), Pascal Schuback has been hacking away on SAARRA: Situational Awareness and Rapid Assessment Application using Ushahidi. He continue to work away at this and would really like to know how to have the ruby app work with Ushahidi software. If you have knowledge and can assist, let us know.

Luis Hernando Aguilar, RHoK Bogota lead, had a team of people collaborating on the “Sistema De Control de Simulacro” using Ushahidi to test within official humanitarian simulations.

RHoK Boston participants lead by, Rufus Pollack, hacked on a Pybossa to Ushahidi Geodoing Microtasker (github link).

And, lastly, we’re really excited to see Open NASA’s multi-partnered efforts with The Catalyst Map. Various cities built prototype on how actions plus activists can be connected to big data. Stay tuned for more on that topic.

RHoK in over 30 cities can be very hectic with global collaboration and juggling hacks. If we missed any active projects that used Ushahidi at RHoK or if you want to elaborate on the detail, please add comments below.

We’re excited to see these projects come to fruition and hope to see the next steps!