EUDACT Readings Home

Table of contents

1. Background Readings [edit]

2. Weblinks [edit]

3. [edit]

4. Crowdsourcing [edit]

4.1. Crowdsourcing Policy and government

4.1.1. Harassmap

5. Open Data [edit]

This page complements the wiki of readings in EDR. There maybe overlaps.

As the course develops it will be reorganised.

Background Readings [edit]

Bowker Geoffrey C. and Star Susan (2001) Sorting Things Out. Publication Info: Ann Arbor, MI: MPublishing, University of Michigan Library April 2001

Buchanan E (ed) (2004) Readings in Virtual Research Ethics: Issues and Controversies. IGI (http://www.igi-global.com/book/readings-virtual-research-ethics/858)

Elliot, M, K Purdam, E Mackey (2013) Data Horizons. New Forms of Data For Social Research, University of Manchester, CCSR Report 2013-3 12/6/2013 http://www.ccsr.ac.uk/publications/Data_Horizons_Report.pdf

Neff, G. (2013). Why Big Data Won’t Cure Us. Big Data, 1(3), 117–123. doi:10.1089/big.2013.0029

Hamadeh, N, Marko Rissanen, and Mizuki Yamanaka (World Bank) (2012), Crowd-sourced price data collection through mobile phones, NTTS 2013, http://www.cros-portal.eu/sites/default/files//NTTS2013fullPaper_82-v2.pdf

Howison, J. (2011). Validity Issues in the Use of Social Network Analysis with Digital Trace Data. Journal of the Association for Information Systems, 12(12), 767–797.

Ipeirotis, P. G. (2010a). Demographics of Mechanical Turk. working paper CeDER-10-01, New York University, Stern School of Business. http://hdl.handle.net/2451/29585

Ipeirotis, P. G., & Paritosh, P. K. (2011). Managing crowdsourced human computation. In Proceedings of the 20th international conference companion on World wide web - WWW ’11 (p. 287). New York, New York, USA: ACM Press. doi:10.1145/1963192.1963314

Lazer, D., Brewer, D., Christakis, N., Fowler, J., & King, G. (2009). Life in the network: the coming age of computational social science. Science, 323(5915), 721–723. doi:10.1126/science.1167742.Life

Levallois, Clement ,Stephanie Steinmetz, Paul Wouters (2013) Sloppy Data Floods or Precise Social Science Methodologies?. In Paul Wouters, Anne Beaulieu, Andrea Scharnhorst and Sally Wyatt (2013) Virtual Knowledge. Experimenting in the Humanities and the Social Sciences, MIT Press http://www.clementlevallois.net/download/datafloods_2013.pdf

Lupton D (2013) Digital Sociology, Routledge

Marres, N. (2012). The redistribution of methods: on intervention in digital social research, broadly conceived. Live Methods: Sociological Review Monographs. Wiley-Blackwell. Retrieved from http://eprints.gold.ac.uk/7773/1/Marres_redistribution_of_methods.pdf

Miller, D . Slater D (2000) The Internet: An Ethnographic Approach. Oxford:Berg.

Miller, D . (2011) Tales from Facebook. Cambridge: Polity.

Miller, D and Horst H (eds) (2012) Digital Anthropology. Oxford: Berg.

Purdam, K. (2014). Citizen social science and citizen data? Methodological and ethical challenges for social research. Current Sociology, 62(3), 374–392. doi:10.1177/0011392114527997

Rogers, R. (2013). Digital methods. Cambridge, Massachusetts; London: The MIT Press.

Savage, M., & Burrows, R. (2007). The Coming Crisis of Empirical Sociology. Sociology, 41(5), 885–899. doi:10.1177/0038038507080443

Silvertown, J. (2009). A new dawn for citizen science. Trends in Ecology & Evolution, 24(9), 467–71. doi:10.1016/j.tree.2009.03.017

Stewart, J (2014) From Crowd to Cloud: Online work exchanges for freelancing and 'crowdsourced' labour JRC Scientific and Policy Report (Forthcoming)

Swan, M. (2013). The Quantified Self: Fundamental Disruption in Big Data Science and Biological Discovery. Big Data, 1(2), 85–99. doi:10.1089/big.2012.0002

Von Ahn, L., & Dabbish, L. (2004). Labeling images with a computer game. In Proceedings of the 2004 conference on Human factors in computing systems - CHI ’04 (pp. 319–326). New York, New York, USA: ACM Press. doi:10.1145/985692.985733

Zimmer, M. (2010). But the data is already public: On the ethics of research in Facebook. Ethics & Information Technology, 12(4), 313-325.

Report of the Working Party on Conducting Research on the Internet: Guidelines for ethical practice in psychological research online, British Psychological Society , 2007 http://www.bps.org.uk/sites/default/files/documents/conducting_research_on_the_internet-guidelines_for_ethical_practice_in_psychological_research_online.pdf

Ethical Decision-Making and Internet Research Recommendations from the AoIR Ethics Working Committee (Version 2.0)

http://aoir.org/reports/ethics2.pdf

Weblinks [edit]

Avinash Kaushik Blog on Web analytics http://www.kaushik.net/avinash/

Digital Social Research Programme (UK) http://www.digitalsocialresearch.net/wordpress/

Commercial panel organisations: https://www.qualtrics.com/panel-management/

Appleton: Can Online Qualitative Research Be Potentially Misleading? http://rwconnect.esomar.org/can-online-qualitative-research-be-potentially-misleading/

Steve August: Going Deeper with Online Qual http://rwconnect.esomar.org/going-deeper-with-online-qual/

[edit]

Crowdsourcing [edit]

Aitamurto, T. (2012). Crowdsourcing for Democracy: A New Era in Policy-Making. Publication of the Committee for the Future.

Brabham, D. C. (2012). Motivations for Participation in a Crowdsourcing Application to Improve Public Engagement in Transit Planning Motivations for Participation in a Crowdsourcing Application to Improve Public Engagement in Transit Planning. Journal of Applied Communication Research, 40(3, January 2013), 307–328.

Büscher, M., Liegl, M., & Thomas, V. (2014). Collective Intelligence in Crises. In D. Miorandi, V. Maltese, M. Rovatsos, A. Nijholt, & J. Stewart (Eds.), Social Collective Intelligence SE - 12 (pp. 243–265). Springer International Publishing. doi:10.1007/978-3-319-08681-1_12

Catlin-Groves, C. L. (2012). The citizen science landscape: From volunteers to citizen sensors and beyond. International Journal of Zoology, Volume 2012 (2012), http://dx.doi.org/10.1155/2012/349630

Chunara, R., Smolinski, M. S., & Brownstein, J. S. (2013). Why We Need Crowdsourced Data in Infectious Disease Surveillance. Current Infectious Disease Reports, 15(4), 316–319. http://doi.org/10.1007/s11908-013-0341-5

Chunara, R., Goldstein, E., Patterson-Lomba, O., & Brownstein, J. S. (2015). Estimating influenza attack rates in the United States using a participatory cohort. Scientific Reports, 5(1), 9540. http://doi.org/10.1038/srep09540

Dickinson, J. L., Zuckerberg, B., & Bonter, D. N. (2010). Citizen Science as an Ecological Research Tool: Challenges and Benefits. Annual Review of Ecology, Evolution, and Systematics, 41(1), 149–172. doi:10.1146/annurev-ecolsys-102209-144636

Dunn, S., Hedges, M., & Ball, K. (n.d.). Connected Communities Crowd-Sourcing in the Humanities.(Short version)

Dunn, S., Hedges, M Engaging the Crowd with Humanities Research - AHRC project report, Kings College, London

Eickhoff, C., Harris, C. G., De Vries, A. P., & Srinivasan, P. (2012). Quality through flow and immersion: Gamifying crowdsourced relevance assessments. In SIGIR’12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 871–880). Retrieved from http://www.scopus.com/inward/record.url?eid=2-s2.0-84866626350&partnerID=40&md5=ee7c79ff9a8de89898a7b5b429957d4f

Freifeld CC, Chunara R, Mekaru SR, Chan EH, Kass-Hout T, et al. (2010) Participatory Epidemiology: Use of Mobile Phones for Community-Based Health Reporting. PLoS Med 7(12): e1000376. doi:10.1371/journal.pmed.1000376

Lavallee, D. C., Chenok, K. E., Love, R. M., Petersen, C., Holve, E., Segal, C. D., & Franklin, P. D. (2016). Incorporating Patient-Reported Outcomes Into Health Care To Engage Patients And Enhance Care. Health Affairs, 35(4), 575–582. http://doi.org/10.1377/hlthaff.2015.1362

Haythornthwaite, C. (2009). Online Knowledge Crowds and Communities. International Conference on Knowledge Communities, (February), 1–16. Retrieved from https://www.ideals.illinois.edu/handle/2142/14198

Hester, V., Shaw, A., & Biewald, L. (2010). Scalable crisis relief: Crowdsourced SMS translation and categorization with Mission 4636. In Proceedings of the First ACM Symposium on computing for development (pp. 1–7). ACM. Retrieved from http://lse.summon.serialssolutions.com/link/0/eLvHCXMwY2BQsDAzTDVONjWyTAS2rRMNDUGqLExTTJKNzVMtTZNBw9hR4Sbu3qbOQcY-SKW5myiDlJtriLOHbmJybnwB5LSFeGATxAy0PkeMgQXYIU4FACEWFqo

Ipeirotis, P. G. (2010a). Demographics of Mechanical Turk. working paper CeDER-10-01, New York University, Stern School of Business. http://hdl.handle.net/2451/29585

Koch, G., Füller, J., & Brunswicker, S. (2011). Online Crowdsourcing in the Public Sector: How to Design Open Government Platforms. In Online Communities and Social Computing: 4th International Conference, OCSC 2011, Held as Part of HCI International 2011, Orlando, FL, USA, July 9-14, 2011. Proceedings. Springer Berlin. Retrieved from http://link.springer.com/chapter/10.1007/978-3-642-21796-8_22

Kim, M., Jung, Y., Jung, D., & Hur, C. (2014). Investigating the congruence of crowdsourced information with official government data: the case of pediatric clinics. Journal of Medical Internet Research, 16(2), e29. doi:10.2196/jmir.3078

Mansell, R. (2013). Employing digital crowdsourced information resources: Managing the emerging information commons. International Journal of the Commons, 7(2), 255–277.

Prestopnik, N. R., & Crowston, K. (2011). Gaming for (Citizen) Science: Exploring Motivation and Data Quality in the Context of Crowdsourced Science through the Design and Evaluation of a Social-Computational System. In 2011 IEEE Seventh International Conference on e-Science Workshops (pp. 28–33). IEEE. doi:10.1109/eScienceW.2011.14

Silvertown, J. (2009). A new dawn for citizen science. Trends in Ecology & Evolution, 24(9), 467–71. doi:10.1016/j.tree.2009.03.017

Smolinski, M. S., Crawley, A. W., Baltrusaitis, K., Chunara, R., Olsen, J. M., Wójcik, O., … Brownstein, J. S. (2015). Flu Near You: Crowdsourced Symptom Reporting Spanning 2 Influenza Seasons. American Journal of Public Health, 105(10), 2124–2130. http://doi.org/10.2105/AJPH.2015.302696

Sui, D., Elwood, S., & Goodchild, M. (Eds.). (2013). Crowdsourcing Geographic Knowledge. Dordrecht: Springer Netherlands. doi:10.1007/978-94-007-4587-2 for example Chapter 5 Peter A. Johnson1 and Renee E. Sieber Situating the Adoption of VGI by Government

Purdam, K. (2014). Citizen social science and citizen data? Methodological and ethical challenges for social research. Current Sociology, 62(3), 374–392. doi:10.1177/0011392114527997

Roy, H.E., Pocock, M.J.O., Preston, C.D., Roy, D.B., Savage, J., Tweddle, J.C. and Robinson, L.D.
2012, Understanding Citizen Science & Environmental Monitoring. Final Report. 176pp Download Understanding Citizen Science PDF [3.37mb]

Swan, M. (2011). DIYgenomics crowdsourced health research studies: Personal wellness and preventive medicine through collective intelligence. Medicine/Science, 27, 95–102. Retrieved from http://www.aaai.org/ocs/index.php/SSS/SSS12/paper/viewFile/4293/4681

Voss, Jon, , Gabriel Wolfenstein, Kerri Young, From crowdsourcing to knowledge communities: Creating meaningful scholarship through digital collaboration, MW2015: Museums and the Web 2015

Whitla P (2009) Crowdsourcing and its application in marketing activities, Contemporary Management Research, 2009 - cmr-journal.org

Worthington, J. P., Silvertown, J., Cook, L., Cameron, R., Dodd, M., Greenwood, R. M., … Skelton, P. (2012). Evolution MegaLab: a case study in citizen science methods. Methods in Ecology and Evolution, 3(2), 303–309. doi:10.1111/j.2041-210X.2011.00164.x

Zhao, Y., & Zhu, Q. (2012). Evaluation on crowdsourcing research: Current status and future direction. Information Systems Frontiers, 16(3), 417–434. doi:10.1007/s10796-012-9350-4

Websites

NERC Centre for Ecology & Hydrology (CEH) guides and research on Citizen Science http://www.ceh.ac.uk/products/publications/understanding-citizen-science.html

Boston Children's Hospital Computational Epidemiology Lab - fascinating range of experiments and projects about digital sources for public health - from social media monitoring to crowdsourcing (

iSpot Nature http://www.ispotnature.org/communities/uk-and-ireland

National Plant Monitoring Scheme (UK)

User's Guide for Evaluating Learning Outcomes from Citizen Science, Cornell Lab of Ornithology

RSPB Big Garden Birdwatch

Cornell Lab of Ornithology. (2004). Urban bird studies. Retrieved August 12, 2005, from http://www.birds.cornell.edu/programs/urbanbirds/.

Crowd-Sourced Price Collection, World Bank http://data.worldbank.org/data-catalog/crowd-sourced-price-collection

Crowdsourcing in Research - Cambridge university webpage

http://www.citizensciencealliance.org/

Zooniverse - Crowdsourcing Science https://www.zooniverse.org

Crowdsourcing Policy and government

Institute of Government seminar on crowdsourcing policy (video)

YouChoose is an online budget simulator - tool for local authorise to engage with public on budget issues, and analyse choices and interactions by the public (try demo)

Johnson, P. A., & Sieber, R. E. (2013). Situating the Adoption of VGI by Government. In Crowdsourcing Geographic Knowledge: Volunteered Geographic Information (VGI) in Theory and Practice (pp. 65–81). Retrieved from http://www.springerlink.com/index/10.1007/978-94-007-4587-2

Harassmap

Harass Map, Egypt. http://harassmap.org/en/what-we-do/the-map/

Rebecca Chiao - HarassMap: Social Mapping Sexual Harassment