CONTENTS Preface xv About the Authors xvii Abbreviations xix Introduction 1 References 4 FOUNDATIONS 5 1. Introducing Development Evaluation 7 Evaluation: What Is It? 8 The Origins and History of the Evaluation Discipline 19 The Development Evaluation Context 26 Principles and Standards for Development Evaluation 29 Examples of Development Evaluations 36 Summary 41 Chapter 1 Activity 41 Notes 42 References and Further Reading 42 Web Sites 46 2. Understanding the Issues Driving Development Evaluation 49 Overview of Evaluation in Developed and Developing Countries 50 Implications of Emerging Development Issues 71 Summary 93 References and Further Reading 94 Web Sites 101 PREPARING AND CONDUCTING EFFECTIVE DEVELOPMENT EVALUATIONS 103 Chapter 3. Building a Results-Based Monitoring and Evaluation System 105 Importance of Results-Based Monitoring and Evaluation 106 What Is Results-Based Monitoring and Evaluation?107 Traditional versus Results-Based Monitoring and Evaluation 108 Ten Steps to Building a Results-Based Monitoring and Evaluation System 112 Summary 135 Chapter 3 Activities 136 Notes 139 References and Further Reading 139 Web Sites 140 Chapter 4. Understanding the Evaluation Context and the Program Theory of Change 141 Front-End Analysis 142 Identifying the Main Client and Key Stakeholders 144 Understanding the Context 149 Tapping Existing Knowledge 150 Constructing, Using, and Assessing a Theory of Change 150 Summary 171 Chapter 4 Activities 172 References and Further Reading 174 Web Sites 177 Chapters. Considering the Evaluation Approach 181 General Approaches to Evaluation 182 Summary 206 Chapter 5 Activity 211 Notes 212 References and Further Reading 212 Web Sites 216 DESIGNING AND CONDUCTING 219 Chapter 6. Developing Evaluation Questions and Starting the Design Matrix 221 Sources of Questions 222 Types of Questions 223 Identifying and Selecting Questions 230 Developing Good Questions 232 Designing the Evaluation 234 Summary 244 6 Activities 245 References and Further Reading 246 Web Sites 246 7. Selecting Designs for Cause-and-Effect, Descriptive, and Normative Evaluation Questions 247 Connecting Questions to Design 248 Designs for Cause-and-Effect Questions 252 Designs for Descriptive Questions 272 Designs for Normative Questions 275 The Need for More Rigorous Evaluation Designs 275 Chapter 7 Activities 281 Annex 7.1 Summary of Key Terms and Attributes of Different Design Types 282 References and Further Reading 284 Web Sites 287 8. Selecting and Constructing Data Collection Instruments 289 Data Collection Strategies 290 Characteristics of Good Measures 293 Quantitative and Qualitative Data 294 Tools for Collecting Data 299 Summary 348 Chapter 8 Activities 349 References and Further Reading 350 Web Sites 354 9. Choosing the Sampling Strategy 355 Introduction to Sampling 356 Types of Samples: Random and Nonrandom 356 Determining the Sample Size 364 Summary 366 Chapter 9 Activities 368 References and Further Reading 370 Web Sites 371 10. Planning for and Conducting Data Analysis 373 Data Analysis Strategy 374 Analyzing Qualitative Data 374 Analyzing Quantitative Data 388 Linking Qualitative Data and Quantitative Data 401 Summary 403 Chapter 10 Activities 405 References and Further Reading 408 Web Sites 411 MEETING CHALLENGES 413 11. Evaluating Complex Interventions 415 Big-Picture Views of Development Evaluation 416 Joint Evaluations 417 Country Program Evaluations 421 Sector Program Evaluations 423 Thematic Evaluations 424 Evaluation of Global and Regional Partnership Programs 429 Summary 434 References and Further Reading 435 Web Sites 438 LEADING 439 12. Managing an Evaluation 441 Managing the Design Matrix 442 Contracting the Evaluation 442 Roles and Responsibilities of Different Players 446 Managing People, Tasks, and Budgets 451 Summary 460 Chapter 12 Activities 461 References and Further Reading 463 Web Sites 465 13. Presenting Results 467 Grafting a Communication Strategy 468 Writing an Evaluation Report 471 Displaying Information Visually 476 Making an Oral Presentation 488 Summary 491 Chapter 13 Activities 491 References and Further Reading 492 Web Sites 493 14. Guiding the Evaluator: Evaluation Ethics, Politics, Standards, and Guiding Principles 495 Ethical Behavior 496 Politics and Evaluation 499 Evaluation Standards and Guiding Principles506 Summary 510 Chapter 14 Activity 511 References and Further Reading 512 Web Sites 513 15. Looking to the Future 515 Past to Present 516 The Future 518 Chapter 15 Activity 527 References and Further Reading 528 Web Sites 529 Appendixes 531 Index 563