Systematic Evaluation

1 Introduction to Evaluation.- Objectives.- What Is Evaluation?.- Methods.- Standards.- History.- The Pre-Tylerian Period.- The Tylerian Age.- The Age of Innocence.- The Age of Realism.- The Age of Professionalism.- Roles in Evaluation Work.- Knowledge Test for Unit 1.- Application Exercise.- Questions Without Answers.- References.- 2 An Analysis of Alternative Approaches to Evaluation.- Objectives.- Alternative Conceptualizations of Evaluation.- Pseudoevaluation.- Covert Investigations.- Public-relations-Inspired Studies.- Quasievaluations.- Objectives-based Studies.- Experimentally Oriented Studies.- True Evaluations.- Decision-oriented Studies.- Client-centered Studies.- Policy Studies.- Consumer-oriented Studies.- Conclusion.- Knowledge Test for Unit 2.- Application Exercises.- Questions Without Answers.- References.- 3 Objectives-oriented Evaluation: The Tylerian Tradition.- Objectives.- The Intention of the Tylerian Approach.- Procedure for Evaluation Design.- Advantages of the Tylerian Approach.- Uses of the Tylerian Model.- Some Limitations of the Tylerian Approach.- Evaluation as a Terminal Process.- Technical Constraints.- Behaviors as the Ultimate Criterion.- Bias and Narrow Focus of Evaluation Components.- Metfessel and Michael: An Extension of the Tylerian Approach.- The Eight-Step Procedure for Evaluation.- The Appendix of Multiple Criterion Measures.- Knowledge Test for Unit 2.- Application Exercises.- Questions Without Answers.- References.- 4 Edward A. Suchman and the Scientific Approach to Evaluation.- Objectives.- Conceptual Aspects of Evaluation.- Purposes and Principles of Evaluation.- Values and the Evaluation Process.- Assumptions for Evaluation Studies.- Types of Evaluation.- Categories of Evaluation.- Methodological Aspects of Evaluation.- Evaluation versus Nonevaluation Research.- Methodological Approaches to Evaluation.- Variations in Evaluation Research Design.- Principles of Evaluation Research Design.- The Measurement of Effects.- Evaluation and Program Administration.- Evaluation and Administrative Science.- Administration of Evaluation Studies: Some Problem Areas.- Compromises to Meet Administrative Constraints.- Knowledge Test for Unit 4.- Questions Without Answers.- References.- 5 Cronbachs Designing Evaluations: A Synopsis.- Objectives.- to the Issues.- Thoughtful Planning for Flexibility.- The Profitable Evaluation.- Conflicting Approaches to Evaluation.- Consensus in Design Elements.- Balance in Evaluation Design: Summary.- Cronbachs Concepts of the Elements in an Evaluation Design: Uto.- Units, Treatments, and Observing Operations.- UTOS: The Domain of Investigation.- Definition of the Elements of uto and UTO.- *UTOS: The Domain of Application.- Identifying the Research Questions.- The Divergent Phase.- The Convergent Phase.- Planning for Communication.- The Utility of Findings.- Direct Communication.- Extrapolating from Findings.- The Promise of Evaluation.- Flexibility of Design.- Evaluations and Politics: Limitations.- Other Considerations.- Knowledge Test for Unit 5.- Application Exercises.- Questions Without Answers.- References.- 6 Stufflebeams Improvement-oriented Evaluation.- Objectives.- Some Personal History.- Development of the CIPP Model.- The PDK Study Committees Elaboration of CIPP Evaluation.- CIPP Compared to Other Recent Evaluation Proposals.- CIPP as a Strategy for Improving Systems.- An Overview of CIPP Categories.- Context Evaluation.- Input Evaluation.- Process Evaluation.- Product Evaluation.- Designing Evaluations.- Metaevaluation and Standards.- Conclusion.- Knowledge Test for Unit 6.- Application Exercises.- Questions Without Answers.- References.- 7 Stakes Client-centered Approach to Evaluation.- Objectives.- The Countenance Statement of Evaluation.- Description.- Judgment.- Format for Data Collection.- Responsive Evaluation.- Responsive versus Preordinate Evaluation.- Substantive Structure of Responsive Evaluation.- General Observations.- Knowledge Test for