Teaching and Learning Forum 2000 [ Proceedings Contents ] The right-mix approach to teaching project evaluation Paul Worthington School of Information Systems Curtin University of Technology This paper discusses the use of various approaches to teaching project evaluation units. As projects involving industry collaboration are highly contextual, it is becoming more appropriate to use non-traditional teaching methods. It is also relevant to set up student groups as though they were consultants, thereby employing the use of role-playing, real-life simulation, and case study scenarios. The author uses his best-practice consulting experiences to develop a course structure where the students are first guided through project evaluation roles, policies and practices, but where their acquired business acumen, recently learned, is challenged. The paper defines the processes involved in setting up a learning environment where students are expected to become members of an effective project evaluation team. Group dynamics, communication skills, skills with using appropriate risk analysis methods, leadership, supervision skills, people skills and technical skills are all taught and learned, but reflective skills and evaluation are also considered to be significant ingredients when teaching project units effectively. The course has been designed to ensure that students' expectations are directly related to their actual performance contributed through participation and involvement in the unit. This paper investigates a "right-mix" approach to teaching and learning within project-based undergraduate units. The "right-mix approach also ensures that student expectations are related to performance. The dynamic nature of project evaluation has made it a requirement that current project evaluation methodology and practices are followed. Students are encouraged to facilitate the process by collecting artifacts from online resources for inclusion within the content of the course itself. In order to aid the course, teaching and learning materials have been delivered by the use of WebCT (a tool that facilitates the creation of integrated World Wide Web-based educational environments).

Introduction

In this paper I present findings from ongoing evaluation of my "right-mix" approach. I outline the theoretical perspective that directed my planning, disclose the general structure of the project evaluation unit, and the assessment approach adopted employed. I conclude with the feedback obtained from the students about the "right-mix" approach used.

Theoretical perspective

Implementation of the "right-mix" approach

The seven principles were encompassed in the unit components and are stated below:

1. Good Practice Encourages Student - Faculty Contact
2. Good Practice Encourages Cooperation Among Students
3. Good Practice Encourages Active Learning
4. Good Practice Gives Prompt Feedback
5. Good Practice Emphasises Time on task
6. Good Practice Communicates High Expectations
7. Good Practice Respects Diverse Talents and Ways of Learning

2 hour tutorial / laboratory session	The sessions were facilitated by a tutor. Students working in groups of 3-6 completed cases with specific tasks. The students had the opportunity to ask and obtain assistance from their tutor when completing the assigned work. Working in groups students shared their experiences and gained an understanding of the tasks that were required of them.
WebCT discussion bulletin board	Prompt feedback was given to students through the use of this online medium.
A 1 hour lecture	A formal lecture format was used to cover the unit content including theories and practical project evaluation examples.
Weekly student presentations	Students were asked to research via the Internet and online databases information regarding the weekly lecture topic. A short presentation by students was required each week. Feedback on the topic was encouraged.

Assessment approach adopted

• Mastery and application of knowledge;
• Communication skills;
• Evaluation and thinking skills;
• Creativity, problem solving and decision making skills;
• Ability to work independently or in teams as required.

A student portfolio	Students were asked to develop a directed student portfolio to demonstrate their learning and achievements. The portfolio included their case study work, annotated lecture notes, tutorial question and a 3 weekly self-reflection on personal learning achievements during the semester.
A group/ team assignment	Students were required to work in a cooperative group on an extended case study simulating a real world challenge. This form of assessment offered the opportunity to assess creativity, planning skills, ability to integrate knowledge and to work with others. The assignment also aimed to demonstrate the students' ability in investigative research by incorporating the task to navigation of on-line resources.
A group presentation	Students were required to do a presentation in groups of 3-6. The group presentation allowed the students to develop their presentation skills which are often required by consultants in industry.

Formal examination consisting of multiple choice questions and a case study (4 compulsory questions covering the breadth of the project evaluation unit) was intended to examine the lecture material component of the unit.

Validation of the "right-mix" approach

Student reflections

'The Weekly lecture notes provide a good understanding of the topics covered in the unit, The laboratory tutor encourages everyone to participate and motivate every student to talk and give his or her opinion, the portfolio is considered high quality work because students need to organize their work every week'

'So far in this unit I have found the content and course material to be very interesting, the lectures are very informative and well prepared. Working in groups has been very beneficial as it allows the group members to exchange their ideas on the relevant material to be researched ... and concludes upon concluding this unit I can now look back and reflect on the unit and the outcomes that I have learned from the unit as a whole. I found the major assignment to be very beneficial to understanding the concepts in the lectures leading up to the assignment. Working on the assignment as a group made it easy to understand how a project team would operate in the real world ...'

Student Evaluation of Educational Quality (SEEQ) Instrument

A summary of the students surveyed revealed that students found the class intellectually challenging and stimulating and that their interest in the subject had increased as a consequence of this class. The survey also revealed that the methods of evaluating student work were fair and appropriate, and that the proposed objectives agreed with those actually taught, indicating that students knew where the class was going.

Student evaluation survey

Responses showed that 75% of students either strongly agreed or agreed that doing the portfolio was a good way to assess their learning in the unit. 20% of students were neutral, while 5% of the students either disagreed or strongly disagreed.

Responses showed that 89% of students either strongly agreed or agreed that the use of a portfolio was a good way to gather unit materials. 8% of students were neutral, while 4 % either disagreed or strongly disagreed.

Responses showed that 52% of students either strongly agreed or agreed that the feedback about their portfolio usage was appropriate. 29% of students were neutral, while 17 % either disagreed or strongly disagreed.

Conclusion

References

Funderstanding (1998). About Learning/Theories, How do people learn? Constructivism. http://www.funderstanding.com/learning_theory_how1.html [17 December 1999]

Lewis, B. (1999). IS Survival Guide. http://www.idg.net/crd_project_70702.html [17 December 1999]

Marsh, H. and Roche, L .(1999). Improving Academic Teaching Project - SEEQ Factor 1, http://lsn.curtin.edu.au/seeq/fact1.html [17 December 1999]

Miami Museum of Science (1999). http://www.miamisci.org/ph/lpdefine.html#AA [17 December 1999]

Pearson, M., Barlowe, C. and Price, A. (1999). Project based learning: Not just another constructivist environment. Proceedings HERDSA Annual International Conference, Melbourne, 12-15 July. http://herdsa.org.au/vic/cornerstones/pdf/PearsonM.PDF [43 kB, 17 Dec 1999]

Reid Moomaugh & Associates (1995). Re-engineering why it so often fails. http://www.improve.org/reengfl.html [17 December 1999]

Sweeny, B. (1993). Forced-Choice, Performance and Authentic Assessments. http://www.teachermentors.com/RSOD%20Site/PerfAssmt/DefineFCAuthPA.html [17 December 1999]