Objectives and hints The importance of good evaluation design, and how the de

 
Objectives and hints
The importance of good evaluation design, and how the design stage can be used to prevent problems that are much harder to fix using statistical methods at the analysis stage;
Key problems with data collection that can arise when conducting an impact analysis. In particular, low survey response rate and social desirability bias;
Internal and external validity and the extent to which these are threatened by problems with data collection; AND
Statistical power: the consequences of having insufficient power, and the importance of estimating statistical power of evaluation design at the outset.
CASE
New York City’s Teen ACTION Program: an Evaluation Gone Awry
ASSIGNMENT: BASED ON WHAT YOU HAVE LEARNED OVER THE COURSE OF THE TERM,
PART 1: Provide a detailed and critical policy assessment of this evaluation gone awry, and what can be learned from this to be better analysts–Be specific about what you would do to do a better analysis. Make sure to draw on readings from previous units.
After you have completed PART 1, go to the web page for Teen Action, and …
AUDIO VIDEO ONLINE
New York City’s Teen ACTION Program: an Evaluation Gone Awry: The Teen ACTION Evaluation – Part 1
AUDIO VIDEO ONLINE
New York City’s Teen ACTION Program: an Evaluation Gone Awry: The Teen ACTION Evaluation – Part 2
PART 2
… based on the available information, write a policy memo detailing the type of analysis you would recommend to the mayor and why?   Make sure to draw on readings from previous units.
The final documents should be organized and coherent.