Program evaluation services that increase program value for grantors, grantees, and communities. x

Tag Archive for: evaluation questions

You are here: Home » evaluation questions
November 6, 2018
06 Nov 2018

Just the Facts: Data Collection

Program evaluations entail research. Research is a systematic “way of finding things out.” Evaluation research depends on the collection and analysis of data (i.e., evidence, facts) that indicate the outcomes (i.e., effects, results, etc.) of the operation of programs. Typically, evaluations want to discover evidence of whether valued outcomes have been achieved. (Other kinds of evaluations, like formative evaluations, seek to discover, through the collection and analysis of data, ways that a program may be strengthened.)

Data can be either qualitative (descriptive, entail words and observations) or quantitative (numerical). What counts as data depends upon the design and character of the evaluation research. Quantitative evaluations rely primarily on the collection of countable information like measurements and statistical data. Qualitative evaluations depend upon language-based data and other descriptive data. Usually, program evaluations combine the collection of quantitative and qualitative data.

There are a range of data sources for any evaluation. These can include: observations of programs’ operation; interviews with program participants, program staff, and program stakeholders; administrative records, files, and tracking information; questionnaires and surveys; focus groups; and visual information, such as video data and photographs.

The selection of the kinds of data to collect and the ways of collecting such data will be contingent on the evaluation design, the availability and accessibility of data, economic considerations about the cost of data collection, and both the limitations and potentials of each data source. The kinds of evaluation questions and the design of the evaluation research will, together, help to determine the optimal kinds of data that will need to be collected. (See our articles
“Questions Before Methods” and “Using Qualitative Interviews in Program Evaluations”)

Resources

What is ‘Data’?

What’s the Difference? Evaluation vs. Research

Evaluation, Carole Weiss, Prentice Hall; 2nd edition (1997)

in Data Collection, Evaluation, Research /by /#permalink

Keywords

accountability actionable knowledge ai anecdotes Applicant Tracking Systems artificial intelligence assessment ATS authority automation Average basics beneficiaries bias bias in research big data Blended learning brandeis bureaucrazy Burnout busyness causation change charity charter schools cognitive bias collaboration College Admissions Scandal community foundations connections control group cost effectiveness COVID-19 data data collection data sources desired results developmental evaluation Digital technology in the classroom disadvantaged youth education educator emotional intelligence evaluation evaluation design evaluation findings Evaluation in complex environments evaluation questions evaluation research evaluation site visit evaluation vs. research evaluator skills evidence examples experience experimental design expertise external evaluator Flexwork focus groups formative evaluation formative evaluations Foundations funding game the system gaming the system gather data goals grantees Groups Groupthink helpful resources higher education Hustle culture Impact Evaluation In-groups integrity interpersonal interpersonal skills interview protocol Interviews intuition Learning learning outcomes Learning to Learn lifelong learning logic model logic modeling manufacturing max weber Mean measure measures members Meritocracy methodology methods Metric metrics models needs assessment non-profit programs non-profits Nonprofits Normal objectivity objectivity in the Social Sciences observations OD On-line learning open-ended questions organizational culture organizational development organization development organizations Out-groups outcome evaluation outcome evaluations outcomes Pandemic Philanthrocapitalism Philanthropies philanthropy planning Politics post-test power power organization pre-test privacy problem solving process process evaluation process evaluations program program evaluation program funder programming programs progress Pros and Cons of technology in the classroom Public Education public school privatization public schools public school system purpose of education qualitative evaluation qualitative measures qualitative methods quality quantitative evaluation quantitative measure quantitative measures quantitative methods quantity quasi-experimental design questions randomized control trials rationalization RCTs reports research resources respondents robo-graders robots Roles school choice Schooling Schools site visit Social Credit System social entrepreneurs social innovation social research social robotics stakeholder analysis stakeholders standardized testing starting an evaluation Statistics strategic assessment strategic planning Summative Evaluation Surveillance survey data surveys Systems theory Systems thinking Systems thinking and evaluation teachers teams Telecommuting The cult of busyness theories Thought partner tips tools treatment group types of evaluation variables workflow Working from home work teams world without work

Email Newsletter icon, E-mail Newsletter icon, Email List icon, E-mail List icon

Sign up for our Email Newsletter

Copyright © 2020 - Brad Rose Consulting