top of page

Evaluation

Analysis of Indiana University IST Ph.D. Program

In this three-phase project, I independently created an evaluation plan, data collection instruments, analyzed provided data, and produced a detailed final report for the evaluation of the IU IST Ph.D. program. Below are highlighted aspects from the project.

Context

Time frame of project:                       

May-June 2017

Team members: 

This project was completed individually but with peer review during specific phases.

Scope of project:   

Phase one:   Response to Request for Proposal (RFP)

Phase two:   Development of data collection instruments (surveys) for three stakeholder groups.

Phase three: Analyze given data and create a final report.

Project Overview

This project simulated an evaluation project for a client (Indiana University - School of Education) involving three phases. The client sought an evaluation of the IST Ph.D. program performance for the past five years with recommendations for changes and an overall formative evaluation of the program. Our professor provided the RFP and raw data for the project.

In response to the Request for Proposal, I created an evaluation plan including an introduction, pre-evaluation questions, a project task schedule and tentative timeline as well as a budget proposal. When creating the evaluation plan, thought was given to choosing evaluation methods within the given budget that were the most comprehensive, as well as incorporating the triangulation of data from various view points.

In phase two, I developed three surveys to collect data from the stakeholder groups: current students, alumni, and faculty members. Surveys utilized Likert scale formatted questions as well as open-ended, free-response questions.

Phase three of the project was the most comprehensive with analysis of raw data from the three surveys in addition to archival documents. While finding alignments and deviations across the data sources through quantitative and qualitative analysis, I was able to draw conclusions and provide recommendations in a final evaluation report. The evaluation report included summaries of both the quantitative and qualitative data and addressed the specific questions posed by the client: How is the program doing overall? What aspects of the program require change? and What aspects of the program should remain the same.

Project Samples
Skills Gained
  • Knowledge of Kirkpatrick's levels of evaluation

  • Writing and constructing surveys and tests

  • Triangulation of data

  • Creating evaluation proposals

  • Use of qualitative and quantitative data collection techniques

  • Analyze and interpret evaluation data

  • Formalized reporting of evaluation project results

Downloads
Evaluation Plan
Data Collection Instruments
Final Evaluation Report
bottom of page