![]() Category: Research |
| Teaching and Learning Forum 2011 [ Refereed papers ] |
Madeleine Bussemaker, Shannan Maisey and Duncan Wild
The University of Western Australia
bussem01@student.uwa.edu.au, maises03@student.uwa.edu.au, duncan.wild@uwa.edu.au
Undergraduate laboratory classes are being reviewed and in some cases scaled back because they are expensive to run compared to the learning outcomes for students. We believe that practical experience is essential and should remain an important part of undergraduate chemistry courses. However significant adaptations should be made to broaden the skills that students can take from these classes. We proposed to make changes which increased the value of laboratories as a tool for educating new scientists without increasing the workload for staff or students. The assessment tasks were altered to focus on learning outcomes and resources were improved and made available online and in hardcopy for students and teachers. Worksheets were introduced for each laboratory experiment and the number of full laboratory report assessments halved. The provision of worksheets placed an emphasis on the key chemical concepts and aided students in their understanding of scientific writing conventions. Students were provided with an explicit guide to writing laboratory reports and given feedback on their writing technique. The submission system was moved to the online student platform WebCT to increase flexibility and improve the quality and speed of feedback. These changes were met favorably by students, and the subsequent improvement in quality of student work was noted by the assessors. The study highlighted the importance of demonstrators as teaching staff and the need to provide them with adequate training and resources. While we acknowledge that further development is required we believe that by broadening the focus of assessment beyond chemical theory the needs of cross discipline students were met while still providing chemistry majors with a solid laboratory background.
Beyond first year, laboratory assessments are traditionally in a report format of 3-4 pages. Tuition in correct scientific writing before assessment is often overlooked because there is an in-class emphasis on the practical experiment, and as a result reports are often of low quality (Walczak and Jackson, 2007). Feedback from students at our institution has highlighted that the time taken to write laboratory reports is of high concern to students and should be taken into consideration when examining the efficacy of assessment of these courses. We propose that for the above criteria to be met, course assessment must be reviewed to more clearly meet student needs by:
Teaching resources
Postgraduate student demonstrators perform the majority of teaching in chemistry laboratories, generally with no formal training beyond a two-day introductory course. It is a requirement of second year teaching that demonstrators have a minimum one year of experience, with two to three years being typical. Weekly demonstrator meetings were implemented to train demonstrators before labs were conducted. This enabled experienced demonstrators to discuss issues that commonly appeared in previous years, and to explain laboratory equipment to new demonstrators. A demonstrator's manual was introduced with the intention of creating a resource that provides guidance for student feedback and marking. The manual contained solutions for each lab, a writing template and a guide to providing online feedback. The solutions provided literature values pertinent to the laboratory and methods of calculations. For theoretical questions, model answers including main discussion points were provided, with a breakdown in marks if required. The writing template gave a reference standard which demonstrators could use to assess and provide feedback. The manual did not, however, contain an explicit guide to giving feedback; rather, demonstrators were allowed autonomy with the medium in which feedback was provided.
Usefulness of worksheets
The worksheets were highly rated among students in aiding their understanding of the key aspects of the laboratory (89% useful or very useful rating). Eighty six percent of students found the worksheets useful for writing full reports (Figure 1). Common reasons cited were that the worksheets showed students what was expected of their work and provided guidance with questions and layout. Other reasons cited for the usefulness of the worksheets were that they helped the students with formatting, and that they were convenient and time-saving to use.
Figure 1: Evaluation of the usefulness of worksheets in helping students to
understand key aspects of the laboratory and writing a full laboratory report
Confidence in writing a full report
At the completion of the laboratory course, 78% of students felt that their scientific report writing was adequate for higher level units. The main rationale cited for proficiency in report writing was the amount of practice; other reasons cited included that the skills required had been taught in detail this year, and that the student was comfortable with the task. Students who felt their skills were inadequate were not confident with specific aspects of the reports such as aims and conclusions, error evaluation, and literature searching. Other reasons for not feeling confident were due to shortcomings in demonstrator feedback such as a lack of or inconsistency in feedback.
Feedback
There was a positive response to feedback (Figure 1) and students were most appreciative of feedback regarding where marks were lost and where improvements could be made. Students also responded positively to demonstrators who returned their reports within a short period of time. However, 70% of respondents did not receive feedback within the desired seven days, leading to complaints that feedback was sparse or lacking. The online system did not significantly affect the students' perceived access to feedback.
Online submission
After the completion of the laboratory course, more students preferred the online submission system to the previous hardcopy system (Table 1). It should be noted that the format of the post-laboratory survey questions was slightly different to the perceptions survey, with five options in the prior survey and a yes/no question in the post evaluation survey which specified that the reports must be word processed. Student responses indicated that the online submission system was convenient, saved on printing and paper, and allowed more comprehensive and legible feedback.
| Before (47 responses) | After (35 responses) | |
| Positive response | 45% | 57% |
| Negative response | 34% | 26% |
| Neutral | 21% | 17% |
Teacher perceptions
A comparison between full laboratory reports from the first and the last week of the experimental component of the course, and in relation to reports from previous years courses' demonstrated an apparent improvement in writing technique. Over the six week laboratory course, the students' ability to separate results from discussion, provide a clear aim and to draw meaningful and technically correct conclusions were developed. Final week reports from previous years did not demonstrate the same level of writing skills.
The following observations were made by demonstrators.
The instruction manual was well received by demonstrators, with verbal feedback confirming that most used it on a regular basis. A valuable suggestion for improvement was the need for sectionalised advice for pre-laboratory class discussion, in class trouble shooting, and more explicit answer guides such as a sample of previous work. A suggestion to include common calculation errors and mistakes was raised as a means of reducing marking times. Reactions to the pre-laboratory meetings were positive and were regarded by demonstrators as useful tools for enhancing their demonstrating abilities.
The purpose of this study was to improve the learning experience of a second year laboratory course through refinement of resources and assessments which included the introduction of worksheets. The use of worksheets in this context was novel and well-met by students, and overall their implementation considered successful. The worksheets were initially expected to be time saving to complete and grade however from the perspective of the students and some demonstrators they provided no time saving benefit. Nevertheless, students adopted the worksheets as a useful tool for completing the assessment tasks, and demonstrators noted that student scientific writing skills improved. Feedback from the post-evaluation surveys indicated that the worksheets aided students' ability to independently present scientific data. The worksheets successfully highlighted the key chemical theories for each experiment, and ensured that pertinent questions were considered and answered. Consequently, students were assessed on their understanding of higher level concepts, as well as learning what techniques are necessary for a critical analysis of data.
The benefits of increased accessibility and flexibility of an online submission system was well received by students and demonstrators. The benefits of the online system as a feedback tool should be emphasised when compared to previously used systems. More detailed, legible feedback can be made available to the students with a higher efficiency for the marker. If made available online in a timely manner, feedback is readily accessible to the student in a significant improvement on the time taken for the collection and redistribution of hardcopy reports. Timeliness of the feedback has been an issue in previous courses, and the new online format has allowed the unit coordinator to monitor the turnaround time of assessments.
This study highlighted the importance of demonstrators as teaching staff. Laboratory classes typically represent more than half of the student contact hours, making demonstrators an important learning resource for students. If the outlined learning objectives are to be met, demonstrators must be adequately trained and provided with the appropriate tools to provide good tuition and valuable feedback. The creation of the laboratory demonstrator manual was a positive step, and presents a valuable medium to encourage the transfer of knowledge across semesters, especially given that the turnover of teaching staff and demonstrators can be high. Its continued evolution has tremendous potential to strengthen the learning value of the course.
The delivery of feedback however was not consistent across the teaching staff and this is because there was no formal technique or guide provided. There was no policy on marking turnaround time, which was detrimental to the feedback loop and subsequently student development. This is clearly an area that requires further development to improve the course. In a relation to this; the timeliness of feedback was hindered by the intense timetabling of the laboratory course, and could be improved by conducting the same course over a longer time period. Tailoring the laboratory assessment to build on learned skills is dependent on an effective feedback loop. We believe that a greater emphasis must be placed on high quality and timely feedback for the restructure to be truly effective.
Reid, N. and Shah, I. (2007). The role of laboratory work in university chemistry, Chemical Education Research and Practice, 8(2), 172-185
Walczak, M. M.; Jackson, P. T. (2007). Incorporating Information Literacy Skills into Analytical Chemistry: An Evolutionary Step. Journal of Chemical Education, 84(8), 1385-null
Worksheets
Worksheets have been created to help you complete your lab classes and to reduce the time taken writing up reports.
You should:
Title
The title of your laboratory experiment.
Aims
In this section you need to summarise the aims of the experiment. Be sure to include the following aspects;
|
Methodology
|
Unless you have deviated, or have been asked to deviate, from the method stated in the lab manual it is sufficient to make reference to the lab manual for this section.
For the group journal assignment and the AAS Zinc experiment you are devising your own method thus must write a full explanation. It is essential that someone reading a method section can replicate your experiment exactly this means that you need to include details of the analytical reagents used (company, strength etc) as well as the specific techniques used (did you crush your tablet? How many times did you rinse your soil?). A really good way to learn what to include in a method section and the correct 'tone' of writing is to look at a Journal article. The Journal of Analytical Chemistry is a perfect guide for these experiments and available through the library website. |
Results
|
This section is where you include what your tests yielded. It is not a place to make excuse for an experiment that went wrong (i.e. I didn't get a calibration curve because my solutions were not made properly is not a result you want to be reporting!)
It's here that you include any tables of data, any plotted data, and any calculations employed. If you have undertaken repetitive calculations, it is sufficient to show the workings of one calculation. It is not advisable to simply show the results of the calculations without workings, as by doing this the marker has no idea what you have done, and hence is not in a position to determine partial marks. Please understand the difference between results and discussion. Results are just that, your data without any interpretation or inference. It is a skill to differentiate between the two and something you should take note of! A good method for separating the two is to looks for words like; because, therefore, as a result of, hence, however etc as these generally indicate some sort of analysis of the result and should be included in your discussion.
|
Discussion
|
This section is where you discuss your results, in the context of literature values and/or expectations as set out in the Aims section.You would also discuss here deviations from the literature values, and reasons for this (i.e. systematic errors.). It is an evaluation of the experiment...given your results what can you deduce? Does it agree with past experiments (i.e. from literature!)
If you are comparing multiple data sets, then do so here. For example, in experiment one where the t- and f-tests are used for statistical analysis, you should perform the analysis in this section. The raw data used in the analysis should however be presented in the Results section. You should draw upon the research question outlined in your aim and ensure that your discussion covers this. |
Conclusion
|
This is the final section of the report and you must summarise the main results of the experiment, reiterating the comparisons with literature values. This needs to be stand alone so if one were to skim read your report and just read the aim and conclusion they will know exactly what was done, why, what was found and what did this mean.
While it's difficult in these experiments to come to really meaningful conclusions we encourage you to put some effort into this section. Read a number of conclusions from Journal articles and see if you think you can determine what makes a good and what makes a bad conclusion. |
Please be sure to include answers to all questions on the worksheets in your full lab write-ups, these will generally fit well into the presentation of your results and highlight key discussion points!
As a final comment, we often see work submitted that appears to have been written, and then not re-read. Please realise that producing a document requires that you write it, and re-read a number of times (i.e. proof reading). Bad prose sticks out like a sore thumb, and leaves a sour taste in the mouth of the report marker...
************************************
Pre-lab
According to the instructions below devise an experimental plan on how to quantitatively determine the zinc in your cold remedy product. Think about how to construct and appropriate calibration curve, the laboratory techniques you will have to use and the equipment required. Be sure to include calculations for your calibration curve construction.
Experimental description
The manufacturer of a certain cold remedy product claims each tablet contains 22 mg of zinc glutonate. You will use Atomic Absorption Spectrophotometry (AAS) to determine the quantity of zinc in a tablet and test the manufacturer's claim.
The formula of zinc glutonate is Zn(C6O7H11)2 and the structural formula is shown below:
The ideal concentration for AAS analysis for zinc is about 5 ppm. Make up a solution of the tablet dissolved in water which will be about 5 ppm Zn if the manufacturer's claim is correct. Prepare four zinc standard solutions to bracket the expected value. Perform the AAS analysis in triplicate. Report the actual amount of zinc as zinc glutonate in the tablet and discuss the experimental uncertainties associated with your determination.
As you will be developing the method for this experiment please give full details in your report. It will be beneficial to read a few journal articles from a publication like the Journal of Analytical Chemistry to get an idea of what information you need to include and how.
Marking key provided to students
| Total (10) | Criteria 1 | Criteria 2 | Criteria 3 |
| Aim (1) | Clear description of what is going to be measured. (0.5) | Clear description of the experimental techniques to be employed (0.5) | |
| Methods (3) | Clear description of methods (1) | The methods are suitable for the aims (1) | The methods are suitable for a precise analytical study (1) |
| Results (3) | Relevant results are reported (1) | Presented in a logical manner (1) | Correct error analysis (1) |
| Discussion (2) | Adequate discussion of relevant results (1) | Discussion of experimental factors (1) | |
| Conclusion (1) | Clear summation of results (1) |
Notes for demonstrators
Pre-lab board notes
Aims - to perform an accurate analytical study, and to do a quality control experiment on the cold lozenges provided.
Aim (1)
Method (3)
Notes from previous years:
You can let them make their own mistakes as it is not a time consuming exercise, although watch out they don't get too off track. Here are some hints for the demonstrator;
1. Using the precise concentrations supplied with the standard solutions calculate the exact concentrations of Fe3+, SCN- and H+. Note: the numbers provided are the target concentrations you need to calculate what was actually used in your experiment!
(3 marks = 2 marks calc, 1 mark errors)
Some students have a lot of problems with this question. They get confused about the target vs. actual concentration. You usually need to check their calculations in the lab (that they've used the actual concentration on bottle) and talk through with them which ion is the limiting reagent. Get them to check if they are using the right size volumetric flasks for their calculations because there's often a mix of 25 ml and 20 ml volumetric flasks. Also, often there is confusion about using the graduated pipette...a pre-lab explanation of correct technique will help.
| Solution | 1 | 2 | 3 | 4 | 5 |
| (a) [Fe3+]/mol L-1 | 6 x 10-4 .......... | 1 x 10-3 ......... | 2 x 10-3 ........ | 4 x 10-3 ......... | 8 x 10-3 .......... |
| (b) [SCN-]/mol L-1 V'/ml... | 2 x 10-4 ......... | 2 x 10-4 ......... | 2 x 10-4 ......... | 2 x 10-4 ......... | 2 x 10-4 ......... |
| (c) [H+]/mol L-1 V''/ml... | 0.4 .......... | 0.4 .......... | 0.4 .......... | 0.4 .......... | 0.4 .......... |
| (d) I (ionic strength) | ........ | ........ | ........ | ........ | ........ |
What are the associated errors for each concentration of [Fe3+]
| Solution | 1 | 2 | 3 | 4 | 5 |
| (a) [Fe3+]/mol L-1 V/ml |
Error of measurement: pipetting and volumetric glassware errors are converted to a percentage, and the percentage is added together. Translated to absolute error, should be small.
2. Record the absorbance of solution 5 against a reference cell containing 0.4 mol L-1 perchloric acid at 10 nm intervals over the range 400-600 nm, plot the spectrum and determine the wavelength at which maximum absorption occurs. Once this wave length is known the rest of the measurements need only be taken for the specific wavelength. Record the temperature of the solution.
(3 marks = 1 mark data, 1 mark plot, 1 mark temp and max nm)
Make sure you highlight why we do this in the pre-lab: The idea is to optimise the absorbance thus we scan the wavelength until we find a maximum. Students should get an arch shaped plot (see Q9). It's a good idea to walk around while they're doing this and ask them to explain why it's necessary to do this now but not for every concentration of Fe3+.
Temperature of solution _____________ Maximum wavelength ____________
3. Measure the absorbance at the selected wavelength and record the temperature. (2 marks)
While students are doing this part talk to them about what they think the error is. Most will be able to tell you that there is a reading error from the dial, (1/2 smallest increment) some might mention that the machine will have its own error. This is correct and is 0.3% of the observed absorbance thus total error is the combination of the two.
Now is also a good time to talk to them about why they are using 5 solutions to make a calibration curve, what happens if one point is an outlier? How can they tell if their calibration curve is robust? Ask them if they can tell an outlier by eyeballing the data etc.
| Solution | Absorbance | Temperature |
| 1 | 0.085 ± 0.0052 | 21 °C |
| 2 | 0.120 ± 0.0054 | 21 °C |
| 3 | 0.210 ± 0.0056 | 22 °C |
| 4 | 0.335 ± 0.0060 | 21 °C |
| 5 | 0.470 ± 0.0064 | 20.5 °C |
4. Calculate the value of A, A/cfcs and (cf + cs)A/cfcs for each of the five solutions, include errors. (5 marks = 3 marks calc, 2 mark errors)
The table below shows student data and is a guide for the order of magnitude to expect.
| Solution | A | cf | cs | cfcs | A/cfcs | (cf + cs)A/cfcs |
| 1 | 0.085 ± 0.0052 | m(Q1) | Q1 | 7.15 x 105 ± 6.6 104 | 571 ± 63.1 | |
| 2 | 0.120 ± 0.0054 | 6.06 105 ± 4.2 104 | 726 ± 60.3 | |||
| 3 | 0.210 ± 0.0056 | 5.30 x 105 ± 2.71 x 104 | 1170 ± 75.8 | |||
| 4 | 0.335 ± 0.0060 | 4.23 x 105 ± 2.4 x 104 | 1780 ± 153 | |||
| 5 | 0.470 ± 0.0064 | 2.97 x 105 ± 1.2 x 104 | 2430 ± 39 |
5. Determine K1 from a plot of A/cfcs versus (cf + cs) A/cfcs and also determine eta for the Fe(SCN)2+ at the wavelength of maximum absorbance. Include errors for both values. How does your value of K compare to the literature value?
(9 marks = 2 marks for plot, 2 marks for K, 2 marks for eta, 2 marks errors, 1 mark lit value)
|
6. Explain why it is important that the ionic concentration of the solution remain constant in order to experimentally determine the stability constant and what effect it might have if changed. (2 marks)
| Students should briefly explain that K is reliant on the activity of the products and reactants. Therefore considering activity is directly related to the ionic strength of solution a change its value between solutions will interfere with results. It would be a source of error in the calculations if the ionic strength were to change between solutions (If the ionic strength were to change, the different solutions could not be used to find the stability constant as it would be different for each.) |
7. Why must a value for temperature accompany a reported value for K? (2 marks)
| Equilibrium constants (and thus stability constants) must be provided in the context of the temperature for which they are taken. This is because enthalpy, although not always written, is a product of each reaction.
The Van't Hoff equation shows that all equilibrium constants change with temperature.
Thus to produce a result using multiple absorbance values and concentrations, the temperature must be constant. |
8. What is meant by the term 'stability constant' how is it related to the equilibrium constant? (2 marks)
| The stability constant, Kstab, is the equilibrium constant for the equilibrium that exists between a transition metal ion surrounded by water molecule ligands and the same transition metal ion surrounded by ligands of another kind in a ligand displacement reaction. The individual ligands are displaced stepwise, and an equilibrium expression could be written for each step, but it is more common to write an overall expression for the overall ligand displacement reaction. Like all equilibrium constants, stability constants vary with temperature (http://www.avogadro.co.uk/definitions/kstab.htm |
9. Why do you need to find the wavelength with maximum absorption to take your readings? How would your calibration curve be affected if you didn't? (2 marks)
| Maybe hint at this in class and try to get students to consider the shape of the curve they derive from question 2. If they consider the derivative for the rate of change is zero at the maximum then error is minimised. If they used a non-optimized wavelength slight variation either side would drastically affect the absorption value and thus the validity of their calibration curve. The maximum also gives the best signal to noise ratio. Students may also comment on the effect that potential non-linearity of absorption could have on results (although not a huge issue here because the range of concentrations is not large). |
| Please cite as: Bussemaker, M., Maisey, S. & Wild, D. (2011). Using worksheets and the Internet to improve student learning outcomes. In Developing student skills for the next decade. Proceedings of the 20th Annual Teaching Learning Forum, 1-2 February 2011. Perth: Edith Cowan University. http://otl.curtin.edu.au/tlf/tlf2011/refereed/bussemaker.html |
Copyright 2011 Madeleine Bussemaker, Shannan Maisey and Duncan Wild. The authors assign to the TL Forum and not for profit educational institutions a non-exclusive licence to reproduce this article for personal use or for institutional teaching and learning purposes, in any format, provided that the article is used and cited in accordance with the usual academic conventions.