Step 2 — Design a Project
After you have explored your problem in Step 1 — Scope Out Your Problem, and found that it’s a good match for citizen science and/or crowdsourcing approaches, you’re ready to design your project. Design doesn’t have to be an overwhelming process! The suggestions below will help you break down the design of a project into manageable steps. You’ll find helpful project databases, case studies and resources to guide you.
The following tips will help you get started:
- Did You Feel It?: Crowdsourcing Earthquake Maps
- Citizen Archivist Dashboard: Crowdsourcing Historical Records
- The North American Bird Phenology Program: Crowdsourcing Migratory Bird Data
- CoCoRaHS — Community Collaborative Rain, Hail and Snow Network: Citizen Scientists Track Precipitation
- Disk Detective: Crowdsourcing New Planets
- MapGive: Crowdsourcing Map Data for Humanitarian Response and Preparedness
- mPING: Crowdsourcing Weather Reports
- The Air Sensor Toolbox: Citizen Scientists Measure Air Quality
- The Smithsonian Transcription Center: Crowdsourcing Document Transcription
- The Aggregative Contingent Estimation Program: Predicting Global Events Through Crowdsourcing
- The SMAP/GLOBE Partnership: Citizen Scientists Measure Soil Moisture
- Measuring Broadband America’s FCC Speed Test App for Android and iOS: Crowdsourcing Mobile Broadband Performance
To design your project for success, you’ll want to clearly identify objectives and break them into distinct tasks. Advance planning will help you figure out the best workflows later; it will also help you find points where you can validate the information collected by project participants. You’ll also need to think about how you will share your outcomes to clearly show their connection to your goals.
- Add detail to your goals. You know what you want to study, what information you want to collect, or what you want participants to learn. What specific measures will you use? In what format will you ask people to share information?
- Decide whether these measures and formats will work best in an online or hands-on project. If hands-on, decide whether volunteers will be able to collect data more easily individually or in groups, independently or under supervision, with or without training requirements.
- Consider possible ways of storing your data. Who needs to be able to see it– volunteers, stakeholders, researchers? How long will you need it available?
- It is often helpful to recruit team members with competencies in public communication, community engagement, visual design, data management, and evaluation. Think about your possible funding sources and why they value these goals, and list ways of reporting your results to show success.
- Citizen Science (Scientific American)
- Citizen Science Central: Resources for Projects (Cornell Lab of Ornithology)
- Designing a Participatory Project (RefShare)
- Guide to Citizen Science (UK Environmental Observation Framework, PDF)
- SciStarter: Project Finder for Citizen Scientists
- Using Crowdsourcing In Government (IBM Center for the Business of Government, PDF)
You’ve described your goals in detail. Now you’ll need to put your team together and find out what your resources and limitations are in terms of funding, staffing, equipment, needs and scope.
- To establish your team and map its tasks, figure out the responsibilities of your paid staff, volunteer staff, partner organizations, and participants. In addition to the skills and tasks common to more research projects, you’ll want to fill roles for marketing, recruitment, and communication with participants. Also figure out how many of each you will need and for how long.
- List everything you will need to complete your project, including equipment, storage, travel and training. Compare your plans to similar projects listed on citizen science and crowdsourcing directories to determine whether you can adopt or adapt protocols from existing or former projects, that represent substantial resource savings and improve data sharing, collaboration opportunities, and technology. Consider what options are most usable by your volunteers.
- Estimate the costs of travel and materials, including the costs of sharing results with volunteers and in conferences, white papers, published articles and workshops.
- Check with your internal legal guidance, and figure what you need to do to ensure the safety of project participants and the security of your data.
- Use the details of your project design to create a realistic budget, including estimates of salaries, indirect and hidden costs, return on investment, and tools and resources you have on hand.
- Choose funding strategies suited to your needs. Consider the cost and benefit tradeoffs of crowdfunding and of public and private funds or grants.
Let your estimated budget along with the case studies and resources guide the design of your workflows for your project. Many excellent citizen science and crowdsourcing projects have shared their designs and the challenges they faced.
- Identify what tasks– including recruitment, training, data collection, quality assurance, analysis, and application of results– need to fit into your workflow. How long will each one take? Are there limits (for example, academic calendar or budget year) on when each can take place?
- Decide on the best way to create and manage your community of project participants and stakeholders.
- If your project is online, decide whether you can use an existing site or tool as your primary infrastructure. If not, determine whether to build your website with open-source content management systems and/or whether to leverage existing code. You may need to sign a terms-of-service agreement.
- Don’t forget that participants can help manage the community as well.
- Create a plan for communicating with your community, including timetables and what tools and media you will use at each stage.
- Projects that do not regularly engage with their communities often face sustainability problems, as high participant turnover can exhaust project management resources more quickly than anticipated.
- Citizen Science Central: Toolkit Conference (Cornell Lab of Ornithology)
- Mayfly Watch: U.S. Fish and Wildlife Service Phenology Network
- Model Amendment to TOS for Government
- Evaluation Instruments (Citizen Science Central, Cornell Lab of Ornithology)
- Program Development and Evaluation (Cornell Lab of Ornithology)
- Negotiated Terms of Service Agreement Templates (DigitalGov)
You’ll need to be ready to work with your project team and with your community of partners and stakeholders. Set everything up so that when the time comes, it’s easy to bring in participants and share project results.
- Establish a community of stakeholders to report progress, elicit feedback and build support.
- Make it easy to participate in your project. Figure out how you will train people to understand your goals and what they need to do. Consider training by peers, and training for trainers. Pilot test your training. Consider using spotlights, forums/discussion boards, group leaders, badging, and participation procedures with colleagues or friends who are not experts in the topic to work out the kinks before launching the project.
- Design opportunities for socialization and communication among and with participants. Consider using spotlighting, forums/discussion boards, group leaders, badging and spaces for general discussion and learning. Socialization helps support participant retention.
- Make final decisions about metrics for your goals.
- Pick internal and/or external teams who will evaluate your project and analyze the results. Decide whether the evaluation results might become part of a research publication; if so, human subjects review will be needed.
- Identify when you expect the project to conclude, or under what circumstances you might need to hand it off to another party to continue.
- Make a plan for publicizing your project results, both the data you collected and your overall outcomes. Have a timeline for writing reports and briefing materials; incorporate ongoing feedback and periodic progress reports to participants, and announcements of research publications with plain-language summaries. Discuss your results.
- Well in advance of your project’s end date or pre-determined target date for releasing results, select a well-attended conference or other suitable venue to report and discuss your results.