‘Nature’ Editorial on Citizen Science

The journal Nature published today an editorial on citizen science, titled ‘Rise of the citizen scientist’. It is very good editorial that addresses, head-on, some of the concerns that are raised about citizen science, but it is also have a problematic ending.

On the positive side, the editorial recognises that citizen scientists can do more than just data collection. The writer also demonstrated an inclusive understanding of citizen science that encompass both online and offline forms of participation. It also include volunteered computing in the list (with the reference for SETI@Home) and not dismiss it as outside the scope of citizen science.

It then show that concerns about the ability of citizen scientists to produce high quality data are not supported by research findings and as Caren Cooper noted, there are many other examples across multiple fields. My own minor contribution to this literature is to demonstrate that this is true for OpenStreetMap mappers. It also recognises the important of one of the common data assurance methods – the reliance on instrument reading as a reason to trust the data.

Finally, it recognise the need to credit citizen scientists properly, and the need to deal with their personal details (and location) carefully. So far, so good. 

Then, the article ends with rather a poor paragraph about ‘conflicts of interest’ and citizen science:

More troubling, perhaps, is the potential for conflicts of interest. One reason that some citizen scientists volunteer is to advance their political objectives. Opponents of fracking, for example, might help to track possible pollution because they want to gather evidence of harmful effects. When Australian scientists asked people who had volunteered to monitor koala populations how the animals should be managed, they found that the citizen scientists had strong views on protection that did not reflect broader public opinion.

Checking for air qualityI have already written here about the attitude of questioning activism and citizen science in specific local issues, but it seem that motivations especially irk scientists and science writers when they look at citizen science. So here some of the reasons that I think the claim above is contradictory.

There are two reasons for this: first, that scientists themselves have a complex set of motivations and are under the same ‘conflict of interests’ and secondly, if motivations having such an impact on science in general, than this is true for every science, not just citizen science.

Let’s start with the most obvious one – the whole point in the scientific method is that it investigates facts and conditions regardless of the motivation of the specific person that is carrying out the research. I have a reminder of that every day when I go to my office, at UCL’s Pearson Building. The building is named after Karl Pearson (known to any scientist because of the Pearson correlation), who was one of the leaders of Eugenics, which was the motivation for parts of his work. While I don’t like the motivation (to say the least) it doesn’t change the factual observations and analysis of the results though it surely change the interpretation of them, which we today reject. We therefore continue to use Pearson’s methods and science since they are useful despite of the motivation. We have detached the motivations from the science.

More generally, scientists like to believe that they are following Mertonian Norms and that they are ‘disinterested’ in their research – but listen to some of the episodes of the BBC Life Scientific and you discover that what keep them motivated to apply for research grants against the odds and to carry out long stretches of boring work are very deep personal motivations. They wouldn’t do it otherwise! Therefore, according to the paragraph above we should consider them conflicted.

Citizen Scientists are, of course, motivated by specific interests – they wouldn’t volunteer their free time otherwise. Look at the OED definition of citizen science at the sources of the term, and you discover that the first modern use of the term ‘citizen scientists‘ was in a report about the Audubon effort to campaign about acid rain. The fact that it was activism did not influence the very careful data collection and analysis operation. Or take the Royal Society for the Protection of Birds (RSPB) in which ‘Campaign with us‘ is the top option of ‘what we do’, and yet they run the valuable Big Garden Bird Watch with results used in scientific papers and for policy. The source of the activism, again, does not influence the outcomes, or the quality of the science.

Is it some forms of activism that Nature have a problem with?

The value of using citizen science in cases such as fracking, air quality or noise is that the scientific method support a systematic, disinterested, and objective data collection and analysis. It therefore allows to evaluate concerns about a specific issue and check if they are justified and supported by the evidence or not. In the same way that the environmental impact assessment and report from the fracking operators are created from a point of conflicts of interest, so does the data that come from the people who oppose it. As long as the data is being collected in a rigorous way, with evidence to back that it was done this way (e.g. timestamp from the smartphone, as the article noted) the scientific approach can provide evidence if the level of pollution from the fracking site (or planned site) is acceptable or not. Arguably, the risk of falsifying the data or pressure to drop inconvenient observations is actually greater, in my view, from the more powerful side of the equation.

My conclusion is that you can’t have it both ways: either science work regardless of motivations or the motivations and conflicts of interest are central to every other piece of science that Nature report on. 

Beyond quantification: a role for citizen science and community science in a smart city

Arduino sensing in MaltaThe Data and the City workshop will run on the 31st August and 1st September 2015, in Maynooth University, Ireland. It is part of the Programmable City project, led by Prof Rob Kitchin. My contribution to the workshop is titled Beyond quantification: a role for citizen science and community science in a smart city and is extending a short article from 2013 that was published by UCL’s Urban Lab, as well as integrating concepts from philosophy of technology that I have used in a talk at the University of Leicester. The abstract of the paper is:

“When approaching the issue of data in Smart Cities, there is a need to question the underlying assumptions at the basis of Smart Cities discourse and, especially, to challenge the prevailing thought that efficiency, costs and productivity are the most important values. We need to ensure that human and environmental values are taken into account in the design and implementation of systems that will influence the way cities operate and are governed. While we can accept science as the least worst method of accumulating human knowledge about the natural world, and appreciate its power to explain and act in the world, we need to consider how it is applied within the city in a way that does leave space for cultural, environmental and religious values. This paper argues that a specific form of collaborative science – citizen science and community science – is especially suitable for making Smart Cities meaningful and democratic. The paper use concepts from Albert Borgmann’s philosophy of technology – especially those of the Device Paradigm and Focal Practices, to identify the areas were sensing the city can gain meaning for the participants.”

The paper itself can be accessed here.

Other papers from the same workshop that are already available include:

Rob Kitchin: Data-Driven, Networked Urbanism

Gavin McArdle & Rob Kitchin: Improving the Veracity of Open and Real-Time Urban Data

Michael Batty: Data About Cities: Redefining Big, Recasting Small

More details on the workshop will appear on the project website

Esri survey123 tool – rapid prototyping geographical citizen science tool

There are several applications that allow creating forms rapidly – such as Open Data Kit (ODK) or EpiCollect. Now, there is another offering from Esri, in the form of Survey123 app – which is explained in the video below.

Survey123 is integrated into ArcGIS Online, so you need an ArcGIS account to use it (you can have a short experiment if you register for a trial account, but for a longer project you’ll have to pay). The forms are configured in XForms, like ODK . The forms can be designed in Excel fairly quickly, and the desktop connection package make it easy to link to the Survey123 site, as well as testing forms.  I tried creating a form for local data collection, including recording a location and taking an image with the phone. It was fairly easy to create forms with textual, numerical, image and location information, and the software also supports the use of images to items in the form, so they can be illustrated visually. The desktop connector application also allow use to render the form, so they can be tested before they are uploaded to ArcGIS Online. Then it is possible to distribute the form to mobile devices and use them to collect the information.

The app works well offline, and it is possible to collect multiple forms and then upload them all together. While the application still showing rough edges in terms of interaction design, meaningful messages and bug clearing, it can be useful for developing prototypes and forms when the geographic aspect of the data collection is central. For example, during data collection the application supports both capturing the location from GPS and pointing on a map to the location where the data was collected. You can only use GPS when you are offline, as for now it doesn’t let you cache a map of a study area.

As might be expected, the advantage of Survey123 is coming once you’ve got the information and want to analyse it, since ArcGIS Online provide the tools for detailed GIS analysis, or you can link to it from a desktop GIS and analyse and visualise the information.

Luckily for us, Esri is a partner of the Extreme Citizen Science group and UCL also holds an institutional licence for ArcGIS Online, so we have access to these tools. However, through Esri conservation programme can also apply to have access to ArcGIS Online and use this tool.

Call for papers – special issue of the Cartographic Journal on Participatory GIS

Call for papers for a special issue of The Cartographic Journal on past, present and future of
Participatory GIS and Public Participation GIS.

DSC01463In the 1990s, participatory GIS (PGIS) and Public Participation GIS (PPGIS) emerged as an approach and tool to make geospatial technologies more relevant and accessible to marginalized groups. The goal has been to integrate the qualitative and experiential knowledge of local communities and individuals, thereby empowering local peoples and non-profit organizations to participate in political decision-making. By enabling the participation of local people from different walks of life, P/PGIS has provided a platform where these people can share their viewpoints and create maps depicting alternative views of the same problem, but from a local perspective.

Over the years, numerous applications integrating GIS and social and spatial knowledge of local groups have been developed. P/PGIS appears well articulated as a technique. With the growth of Information and Communication Technologies (ICT), from an epistemological view point the relationship of P/PGIS constructs (society, technology and institutions) and the use of components (access, power relations, diverse knowledge) in P/PGIS necessitates an exploration of what P/PGIS means in 21st century.

A related field, Citizen Science a.k.a. public participation in scientific research is a research technique that allows participation of public in the discovery of new scientific knowledge through data collection, analysis, or reporting. This approach can be viewed to be somewhat similar in its implementation to P/PGIS, which broadens the scope of data collection and enables information sharing among stakeholders in specific policies to solve a problem. The success of all three concepts, citizen science, PGIS and PPGIS, is influenced by the Geoweb – an integration of the Information and Communication Technologies (ICT) (e.g., social networking sites) and geospatial technologies (e.g., virtual globes like Google Earth, free and open source GIS like QGIS and location enabled devices like the iPhone) – that allows a platform for non-experts to participate in the creation and sharing of geospatial information without the aid of geospatial professionals.

Following a successful session in the AAG 2015 Annual Meeting, this call is for papers that will appear in a special issue of ‘The Cartographic Journal’ (http://www.maneyonline.com/loi/caj). We are calling for reflections on PPGIS/PGIS and citizen science that address some of the questions that are listed below.

  1. What social theories form the basis for the current implementation of P/PGIS? Have these theories changed? What remains persistent and intractable?
  2. What role do spatial theories, such as Tobler’s law of spatial relations or issues of spatial data accuracy, have in P/PGIS, Citizen Science or crowdsourcing?
  3. Since Schlossberg and Shuford, have we gotten better at understanding who the public is in PPGIS and what their role is in a successful deployment of PGIS?
  4. Which new knowledge should be included in data collection, mapping and decision-making and knowledge production? To what extent are rural, developing country, or marginalized communities really involved in the counter-mapping process? Are they represented when this action is undertaken by volunteers?
  5. What role do new ICTs and the emergence of crowdsourcing plays in the inclusion of indigenous and local knowledge? Do new tech and concepts hinder the participatory process or enable empowerment of local communities? Do we have new insights on what could be considered technological determinism?
  6. Do we need to revisit P/PGIS in light of any of these shifts? How often do P/PGIS projects need to be revisited to address the dynamic nature of society and political factors and to allow future growth?
  7. How effective have P/PGIS and Citizen Science been in addressing issues of environmental and social justice and resource allocation, especially, from a policy-making perspective?
  8. Are we any better at measuring the success of P/PGIS and/or Citizen Science? Should there be policies to monitor citizen scientists’ participation in Geoweb? If so, for what purpose?
  9. What should be the role of privacy in P/PGIS, for example, when it influences the accuracy of the data and subsequent usability of final products? How have our notions of needed literacy (e.g., GIS) and skills shifted with the emergence of new technologies?
  10. How has the concept of the digital divide been impacted by the emergence of the Geoweb, crowdsourcing and/or neogeography?
  11. What is the range of participatory practices in Citizen Science and what are the values and theories that they encapsulate?
  12. What are the different applications of Citizen Science from policy and scientific research perspective?
  13. To what extent do the spatial distribution of citizens influence their participation in decision making process and resolving scientific problems?
  14. How have our notions of needed literacy (e.g., GIS) and skills shifted with the emergence of new technologies?

Editors: Muki Haklay (m.haklay@ucl.ac.uk), University College London, UK; Renee Sieber (renee.sieber@mcgill.ca), McGill University; Rina Ghose (rghose@uwm.edu), University of Wisconsin – Milwaukee; Bandana Kar (bandana.kar@usm.edu), University of Southern Mississippi – Hattiesburg. Please use this link to send queries about the special issues, or contact one of the editors.

Submission Deadlines
Abstract – a 250 word abstract along with the title of the paper, name(s) of authors and their affiliations must be submitted by 15th August 2015 to Muki Haklay (use the links above). The editorial team will make a decision if the paper is suitable for the special issue by 1st September
Paper – The final paper created following the guidelines of The Cartographic Journal must be submitted by 30th October 2015.
Our aim is that the final issue will be published in early 2016

Citizen Science and Policy – possible frameworks

Back in February, my report ‘Citizen Science & Policy: a European Perspective‘ was published by the Wilson Centre in the US. As I was trying to make sense of the relevance of citizen science to policy making, I used a framework that included the level of geography, area of policy making and the type of citizen science activity. This helped in noticing that citizen science is working well at the neighbourhood, city and national scales, while not so well at regional and international level. The reasons for it are mostly jurisdiction, funding and organisational structure and scale of operation.

Later on, at a workshop that was organised by Prof Aletta Bonn on Citizen Science and Policy impact, the idea of paying attention to the role of citizen science within the policy cycle was offered as another dimension of analysis.

Last week, at a workshop that was organised by the European Environment Agency (EEA) as part of their work on coordinating the European Protection Agencies (EPA) Network, I was asked to provide an introduction to these frameworks.

The presentation below is starting with noting that citizen science in an EPA is a specific case of using crowdsourced geographic information in government and some of the common issues that we have identified in the report on how governments use crowdsourced information are relevant to citizen science, too. Of particular interest are the information flows between the public and government, and the multiple flows of environmental information that the 3rd era of environmental information brought.

After noticing the individual, organisational, business and conceptual issues that influence use in general, I turn to the potential framing that are available – geography, stage in policy formation and mode of engagement, and after covering those I’m providing few examples of case to illustrate how specific cases fit into this analysis.

It was quite appropriate to present this framework in the EEA, considering that the image that was used to illustrate the page of the report on the Wilson Center site, is of the NoiseWatch app which was developed by the EEA…

COST Energic Summer School on VGI and Citizen Science in Malta

Vyron Antoniou covering VGI foundations
Vyron Antoniou covering VGI foundations

COST Energic organised a second summer school that is dedicated to Volunteered Geographic Information (VGI) and citizen science. This time, the school was run by the Institute for Climate Change & Sustainable Development of the University of Malta. with almost 40 participants from across Europe and beyond (Brazil, New Zealand), and, of course, participants from Malta. Most of the students are in early stage of their academic career (Masters and Ph.D. students and several postdoctoral fellows) but the school was also attended by practitioners – for example in urban planning or in cultural heritage. Their backgrounds included engineering, geography, environmental studies, sociology, architecture, biology and ecology, computer science. The areas from which the participants came from demonstrate the range of disciplines and practices that are now involved in crowdsourced data collection and use. Also interesting is the opening of governmental and non-governmental bodies to the potential of crowdsourcing as evident from the practitioners group.

The teachers on the programme, Maria Attard, Claire Ellul, Rob Lemmens, Vyron Antoniou, Nuno Charneca, Cristina Capineri (and myself) are all part of the COST Energic network. Each provide a different insight and interest in VGI in their work – from transport, to spatial data infrastructure or participatory mapping. The aim of the training school was to provide a ‘hands-on’ experience with VGI and citizen science data sources, assuming that some of the students might be new to the topics, the technologies or both. Understanding how to get the data and how to use it is an important issue that can be confusing to someone who is new to this field – where the data is, how do you consume it, which software you use for it etc.

Collecting information in the University of Malta
Collecting information in the University of Malta

After covering some of the principles of VGI, and examples from different areas of data collection, the students started to learn how to use various OpenStreetMap data collection tools. This set the scene to the second day, which was dedicated to going around the university campus and collecting data that is missing from OpenStreetMap, and carrying out both the data collection and then uploading the GPS Tracks and sharing the information. Of particular importance was the reflection part, as the students were asked to consider how other people, who are also new to OpenStreetMap will find the process.

Using meteorological sensors in Gozo
Using meteorological sensors in Gozo

The next level of data collection involved using sensors, with an introduction to the potential of DIY electronics such as Arduino or Raspberry Pi as a basis for sensing devices. A field trip to Gozo in the next day provided the opportunity to explore these tools and gain more experience in participatory sensing. Following a lecture on participatory GIS application in Gozo, groups of students explored a local park in the centre of Rabat (the capital of Gozo) and gained experience in participatory sensing and citizen science.

Learning together The training school also included a public lecture by Cristina Capineri on ‘the fortune of VGI’.

The students will continue to develop their understanding of VGI and citizen science, culminating with group presentations on the last day. The most important aspects of any training school, as always, is in the development of new connections and links between the people on the programme, and in the conversations you could notice how these areas of research are still full of questions and research challenges.

Citizen Science in the Research Evaluation Framework impact studies

In the UK, every 5 years or so, there is a complex and expensive process that evaluates the work of academics in research institutions across the country, and rate them in terms of quality (see the infographics). The last round of this process was called ‘Research Evaluation Framework’ or REF for short. You don’t need to look far to find complaints about it, the measures that are used, the methodology and so on. I think that a lot of this criticism is justified, but this post is not about the process of the REF, but about the outcomes.

The REF included a requirement from universities to demonstrate their wider societal impact – beyond teaching, publishing academic papers or sharing research results. The societal impact includes lots of aspects, and while academics and evaluators are fixated on economic outcomes, impacts also include policy, influencing health and wellbeing, and engaging the public in scientific research. The writing of impact case studies was a major task for the academics that were selected to write them (about 1 in 10) and universities invested money and effort in picking up the best examples that they could find. When looking at these examples, we need to remember that they were submitted in 2013, so they cover the work done by universities until then.

According to a study that looked at these impact descriptions, out of the 6,975 cases, 447 (6.5%) are classified as ‘public engagement’ of all forms (e.g. a lecture). Within these cases, the database of impact case studies provides about 731 that use the term ‘public engagement’, 260 that use the term ‘participatory’, about 60 which include ‘public participation’ and 33 that include the ‘citizen science’ with few more that did not but are about it. While this is a tiny group (0.5%), it is still interesting to see what projects are included.

It is not surprising to find that  ecological projects such as Conker Tree Science, invasive species & the ladybird surveyThe Black Squirrel Project, or observing ants and spidersgrassland fungi, stag beetles, birds, and amphibians  were included. As expected, the Open Air Laboratories (OPAL) project is noted by the Universities of Central Lancashire, Birmingham, UCL, and the Open University (but surprisingly missing from the university that coordinated the effort – Imperial College). There are also apps such as the WildKnwledge recording app or the iSpot app. Related environmental projects include monitoring peatland erosion or community volcanology. Also Community Archaeology and involvement in archaeology excavations can be considered as outdoor activities.

Volunteer thinking in the form of Zooniverse appeared several times from the Universities of Oxford, Portsmouth, and Sussex , while volunteer computing in the form of ClimatePrediction.net  is noted by two departments of University of Oxford – physics and computing). There are other astronomy projects such as Aurora Watch, or Gravitational Waves.

Other examples include our participatory mapping activities while UCL Anthropology highlighted the indigenous mapping activities, while DIY biology and DNA testing are also mentioned, and even projects in the digital humanities – the Oxyrhynchus papyri  or The Reading Experience Database.

What can we make out of this? I’d like to suggest few points: The 30 or so projects that are described in the case studies offer a good overview of the areas where citizen science is active – ecology, volunteer thinking and volunteer computing. The traditional areas in which public participation in science never stopped – astronomy, archaeology, or nature observation are well represented. Also the major citizen science projects (OPAL, Zooniverse) also appear and as expected they are ‘claimed’ by more than one unit or university. More specialised citizen science such as participatory mapping, digital humanities or DIY biology is not missing, too.

On the downside, this is a very small number of cases, and some known projects are not listed (e.g. Imperial College not claiming OPAL). I guess that like many evaluation activities, the tendency of those evaluated is to be conservative and use terms that the evaluators will be familiar with. Maybe over the next five years citizen science will become more common, so we will see more of it in the next round.