Evaluation

Evaluation of all Center programs, member experiences, and long-term outcomes is essential to developing responsive and effective programs. EBICS' Evaluation Team is led by Dr. Lizanne DeStefano, Associate Dean in the College of Sciences; Executive Director of the Center for Education Integrating Science, Mathematics, and Computing (CEISMC); and Professor at the School of Psychology at Georgia Institute of Technology. She and her team administer surveys and other assessments, conduct personal interviews and focus groups, and collect data and track outcomes related to all aspects of the Center.

EBICS employs a robust evaluation method designed to provide formative information to guide program improvement, as well as a summative assessment of program effectiveness and impact. The ultimate goal of the evaluation program is to validate and document the effectiveness of EBICS' integrative research, education, and outreach programs. The evaluation utilizes an educative, value-engaged approach (EVEN). The EVEN approach, developed with NSF-EHR support, defines high-quality STEM educational programming as that which effectively incorporates cutting-edge scientific content, strong instructional pedagogy, and sensitivity to diversity and equity issues. This evaluation involves:

  • Implementation: Are EBICS programs being implemented on schedule and as planned?
  • Effectiveness: Are key components of EBICS (e.g., leadership and management, integrative research, education, diversity, ethics, knowledge transfer, etc.) operating effectively? How might they be improved?
  • Impact: What student and faculty outcomes are associated with participation in EBICS? How do these compare with baseline measures of joint publications, collaborative research projects, grant submissions and awards, career attainment, and other targeted outcomes? What is the added value of participation in EBICS?
  • Institutionalization: How and to what extent are elements of EBICS becoming institutionalized at other participating institutions? What opportunities and barriers exist to broad institutionalization?

As part of our Knowledge Transfer program, EBICS provides high-quality, easy-to-implement evaluation resources to non-profit organizations. We believe the sharing of these resources with STCs and other science/engineering education organizations meets a major need within these communities.

We have developed evaluation processes and criteria for Management, Education, Diversity, Knowledge Transfer, and Research activities, as well as those for new activities and projects in the Center.  We have also defined a Faculty Evaluation process and evaluation criteria to assess faculty contributions to the Center annually.

EBICS Evaluation Director: Dr. Lizanne DeStefano (Georgia Institute of Technology)

  • Greene, J. C., DeStefano, L., Burgon, H., & Hall, J. (2006). An educative, values-engaged approach to evaluating STEM educational programs. In D. Huffman & F. Lawrenz (Eds.), Critical issues in STEM evaluation (special issue). New Directions for Evaluation, 109, 53-71.