Colorful Illustration of diverse people inside speech bubbles

Additional Resources

To obtain a list of foundational references for each of the seven philosophies and approaches, please click on a link below or scroll through the page.

References for each philosophy and approach are provided in chronological, not alphabetical, order to help readers more easily see how the approaches developed. All publicly-available references are linked and shown in blue font.

An annotated bibliography that provides a brief summary of each reference listed is also available for download.

Hopson, R.K. (2003). Overview of Multicultural and Culturally Competent Program Evaluation: Issues, Challenges and Opportunities. The California Endowment. https://www.uaf.edu/ces/files/internal/reporting/programevals/MultiOverviewBook.pdf
SenGupta, S., Hopson, R., & Thompson-Robinson, M. (2004). Cultural competence in evaluation: An overview. New Directions for Evaluation, 102, 5-19.
Endo Inouye, T., Cao Yu, H., & Adefuin, J. (2005). Commissioning multicultural evaluation: A foundation resource guide. Social Policy Research Associates. https://www.spra.com/wordpress2/wp-content/uploads/2015/12/TCE-Commissining-Multicutural-Eva.pdf
Lee, K. (2007). The Importance of Culture in Evaluation: A Practical Guide for Evaluators. The Colorado Trust. https://www.coloradotrust.org/wp-content/uploads/2015/03/CrossCulturalGuide.r3.pdf
American Evaluation Association (AEA). (2011). Statement on cultural competence in evaluation. https://www.eval.org/ccstatement 
Centers for Disease Control and Prevention (CDC). (2014). Practical Strategies for Culturally Competent Evaluation: Evaluation Guide. U.S. Department of Health and Human Services. https://www.cdc.gov/asthma/program_eval/cultural_competence_guide.pdf
Thomas, V.G., Madison, A., Rockcliffe, F., DeLaine, K. & McDonald-Lowe, S. (2018). Racism, social programming, and evaluation: Where do we go from here? American Journal of Evaluation, 39(4), 514-526.
Thomas, V.G. & Campbell, P.B. (2020). Evaluation in today’s world: Respecting diversity, improving quality, and promoting usability. Thousand Oaks, CA: SAGE Publications, Inc.
Frierson, H., Hood, S., & Hughes, G. (2002). Strategies that address culturally responsive evaluation. In J. Frechtling (Ed.), The 2002 User Friendly Handbook for Project Evaluation (pp. 63-76). National Science Foundation. https://www.nsf.gov/pubs/2002/nsf02057/nsf02057.pdf
Hopson, R.K. (2009). Reclaiming knowledge at the margins: Culturally responsive evaluation in the current evaluation moment. In K. Ryan & J. B. Cousins (Eds.), The Sage International Handbook of EducationalEvaluation (pp. 431-448). SAGE Publications, Inc.
Kirkhart, K. (2013, April). Repositioning Validity [Inaugural address]. Center for Culturally Responsive Evaluation and Assessment Inaugural Conference, Chicago, IL, United States. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.723.8358&rep=rep1&type=pdf
Hood, S., Hopson, R.K., & Kirkhart, K.E. (2015). Culturally responsive evaluation: Theory, practice, and future implications. In K.E. Newcomer, H.P. Hatry, & J.S. Wholey (Eds.), Handbook of Practical Program Evaluation (4th ed., pp. 281-317). Jossey-Bass.
Public Policy Associates, Inc. (2015, June). Considerations for Conducting Evaluation Using a Culturally Responsive and Racial Equity Lens. https://publicpolicy.com/wp-content/uploads/2017/04/PPA-Culturally-Responsive-Lens.pdf
McBride, D. (2018). Culturally responsive evaluation. In B.B. Frey (Ed.), The Sage Encyclopedia of Educational Research, Measurement, and Evaluation (pp. 441-444). SAGE Publications, Inc.
Caldwell, L.D., & Bledsoe, K.L. (2019). Can social justice live in a house of structural racism? A question for the field of evaluation. American Journal of Evaluation, 40(1), 6-18.
Chouinard, J., & Cram, F. (2019). Culturally Responsive Approaches to Evaluation: Empirical Implications for Theory and Practice. SAGE Publications, Inc.
Neubauer, L.C., McBride, D., Guajardo, A.D., Casillas, W.D., & Hall, M.E. (2020). Examining issues facing communities of color today: The role of evaluation to incite change. New Directions for Evaluation, 166, 7-11.
Public Policy Associates, Inc. (2015, June). Considerations for Conducting Evaluation Using a Culturally Responsive and Racial Equity Lens. https://publicpolicy.com/wp-content/uploads/2017/04/PPA-Culturally-Responsive-Lens.pdf
Expanding the Bench® Team and Advisory Team (2019). History and Definition of Culturally Responsive and Equitable Evaluation. Change Matrix. https://expandingthebench.org/cree-definition
Anderson, M., Andrews, K., Elam, P., Hilliard, T., & Johnson, L. (2020, March). Utilization of a culturally responsive and racial equity lens to help guide strategic engagement and evaluation [workshop]. International Conference of the Center for Culturally Responsive Evaluation and Assessment, Chicago, IL, United States. https://www.pathlms.com/aea/courses/25161 
Mendez, K., & Taniuchi, A. (2020, April 12). Expanding the Bench week: Culturally responsive and equitable evaluation: What is it and why is it important? American Evaluation Association. https://aea365.org/blog/expanding-the-bench-week-culturally-responsive-and-equitable-evaluation-what-is-it-and-why-is-it-important-by-karla-mendez-alina-taniuchi/
Ghanbarpour, S., Noguez Mercado, A.P., & Palotai, A. (2020). A language justice framework for culturally responsive and equitable evaluation. New Directions for Evaluation, 166, 37-47.
Lemos, D., & Garcia, D. (2020). Promoting culturally responsive and equitable evaluation with Latinx immigrants. New Directions in Evaluation,166, 80-100.
Expanding the Bench. (2021). CREE Learning Series. Change Matrix. https://expandingthebench.org/cree-learning-series
Chouinard, J., & Cousins, J.B. (2007). Culturally competent evaluation for Aboriginal communities: A review of the empirical literature. Journal of Multi-Disciplinary Evaluation, 4, 40-57.
LaFrance, J., & Nichols, R. (2008). Reframing evaluation: Defining an Indigenous evaluation framework. The Canadian Journal of Program Evaluation, 23, 13-31.
Bowman, N.R., Dodge Francis, C., & Tyndall, M. (2015). Culturally Responsive Indigenous Evaluation: A Practical Approach for Evaluating Indigenous Projects in Tribal Reservation Contexts. Continuing the Journey to Reposition Culture and Cultural Content in Evaluation Theory (pp. 335-360). Information Age.
Cram, F., Kennedy, V., Paipa, K., Pipi, K., & Wehipeihaha, N. (2015). Being Culturally Responsive Through Kaupapa Maori Evaluation. Continuing the Journey to Reposition Culture and Cultural Content in Evaluation Theory (pp. 289-313). Charlotte, NC: Information Age.
Waapalaneexkweew (Nicole R. Bowman-Farrell, Mohican/Lunaape) (2018). Looking backward but moving forward: Honoring the sacred and asserting the sovereign in Indigenous evaluation. American Journal of Evaluation, 39, 543-568.
Waapalaneexkweew (Bowman, N. Mohican/Lunaape), & Dodge-Francis, C (2018). Culturally responsive  Indigenous evaluation and tribal governments:

Understanding the relationship. New Directions for Evaluation, 159, 17-31. https://cncfr.jbsinternational.com/sites/default/files/downloads/Culturally%20Responsive%20Indigenous%20Evaluation%20and%20Tribal%20Governments%20Understanding%20the%20Relationship%20BowmanDodge-Francis-2018.pdf

University of Toronto Press. (2020). Evaluation in Indigenous contexts. Canadian Journal of Program Evaluation, (34)3. https://journalhosting.ucalgary.ca/index.php/cjpe/issue/view/5191 
Zimmerman, M.A., Israel, B.A., Schulz, A., & Checkoway, B. (1992). Further explorations in empowerment theory: An empirical analysis of psychological empowerment. American Journal of Community Psychology, 20(6), 707-727.
Fetterman, D. M. (1994). Empowerment evaluation. Evaluation Practice, 15(1), 1-15. doi:10.1016/0886-1633(94)90055-8
Andrews, A.B. (1996). Realizing empowerment in the evaluation of nonprofit women’s services organizations: Notes from the front line.  Empowerment Evaluation: Knowledge and Tools for Self-Assessment and Accountability. SAGE Publications, Inc.
Fetterman, D.M., & Wandersman, A. (Eds.). (2004). Empowerment Evaluation Principles in Practice. Guilford.
Fetterman, D.M. (2012). Empowerment Evaluation in the Digital Villages: Hewlett-Packard’s $15 Million Race Toward Social Justice. Stanford University Press.
Fetterman, D.M., Kaftarian, S. & Wandersman, A. (Eds.). (2015). Empowerment Evaluation: Knowledge and Tools for Self-assessment, Evaluation Capacity Building, and Accountability (2nd ed.). Thousand Oaks, CA: SAGE Publications, Inc.
Fetterman, D.M., Rodriguez-Campos, L., & Zukoski, A. (Eds.). (2018). Collaborative, Participatory, and Empowerment Evaluation: Stakeholder Involvement Approaches. New York: Guilford Publications.
Thomas, V.G. & Campbell, P.B. (2020). Evaluation in Today’s World: Respecting Diversity, Improving Quality, and Promoting Usability. Thousand Oaks, CA: SAGE Publications, Inc.
Bamberger, M., & Segone, M. (2011). How to Design and Manage Equity-Focused Evaluations. UNICEF. https://www.evalpartners.org/sites/default/files/library/selected/EWP5_Equity_focused_evaluations.pdf
Dean-Coffey, J., Casey, J., & Caldwell, L.D. (2014). Raising the bar—Integrating cultural competence and equity: Equitable evaluation. The Foundation Review, 6(2), 81-94.
Center for Evaluation Innovation, Institute for Foundation and Donor Learning, Dorothy A Johnson Center for Philanthropy, & Luminare Group. (2017, July). Equitable evaluation framing paper. Equitable Evaluation Initiative. www.equitableeval.org
Dean-Coffey, J. (2018). What’s race got to do with it? Equity and philanthropic evaluation practice. American Journal of Evaluation, 39(4), 527-542.
Organisation for Economic Co-operation and Development (OECD), Development Assistance Committee (DAC) Network on Development Evaluation. (2019). Better criteria for better evaluation: Revised and updated evaluation criteria. https://www.oecd.org/dac/evaluation/evaluation-criteria-flyer-2020.pdf. 
Stern, A. Guckenburg, S., Persson, H., & Petrosino, A. (2019). Reflections on Applying Principles of Equitable Evaluation. WestEd Justice & Prevention Research Center. https://www.aecf.org/resources/reflections-on-applying-principles-of-equitable-evaluation
Equitable Evaluation Initiative (2020). Equitable Evaluation Framework™. https://www.equitableeval.org/framework
Equitable Evaluation Initiative (EEI) in partnership with Grantmakers for Effective Organizations (GEO). (2021). Shifting the Evaluation Paradigm: The Equitable Evaluation Framework™. https://www.geofunders.org/resources/shifting-the-evaluation-paradigm-the-equitable-evaluation-framework-1332
Van den Berg, R.D., Magro, C., & Adrien, M.H. (Eds). (2021). Transformational Evaluation for the Global Crises of Our Time. Exeter, UK: International Development Evaluation Association (IDEAS).
Mertens, D.M. (1999). Inclusive evaluation: Implications of transformative theory for evaluation. American Journal of Evaluation, 20(1), 1-14. 
Mertens, D.M. (2007). Transformative paradigm: Mixed methods and social justice. Journal of Mixed Methods Research, 1, 212-225.
Mertens, D.M. (2009). Transformative research and evaluation. Guilford Press.
Mertens, D.M. (2010). Transformative mixed methods research. Qualitative Inquiry, 16(6), 469-474.
Mertens, D.M., & Wilson, A. (2012). The transformative paradigm and the social justice branch. In Program evaluation theory and practice (pp. 161-217). Guilford Press.
Mertens, D.M. (2016). Assumptions at the philosophical and programmatic levels in evaluation. Evaluation and Program Planning, 59, 102-108.
Mertens, D.M. (2018). Mixed methods design in evaluation. Thousand Oaks, CA: SAGE Publications, Inc.
Mertens, D.M., & Wilson, A. (2019). Program evaluation theory and practice: A comprehensive guide (2nd ed). Guilford Press.
Mertens, D.M. (2020). Research and evaluation in education & psychology: Integrating diversity with quantitative, qualitative, & mixed methods. (5th ed.) Thousand Oaks, CA: SAGE Publication, Inc.

© 2022 SLP4i and The Colorado Trust, authored by Katrina Bledsoe, Felisa Gonzales, and Blanca Guillen-Woods. This work is protected by copyright laws. No permission is required for its non-commercial use, provided that the authors are credited and cited.

For full citation use: Bledsoe, K., Gonzales, F., & Guillen-Woods, B*. (2022). The Eval Matrix©. Strategy Learning Partners for Innovation https://slp4i.com/the-eval-matrix.
*These authors contributed equally to this work with support from the Annie E. Casey Foundation and The Colorado Trust.

The Eval Matrix site designed by KarBel Multimedia