1. Lauren Nourse
Benicia
710 Spring 2010
Outline for Literature Review #3
1. A Comparison of Traditional Homework to Computer-Supported Homework
Michael Mendicino, Leena Razzaq and Neil T. Heffernan
2. Study of the Effectiveness of a Web-based Interactive Homework Jie Liang
Type of design or methodology was used.
Both articles used the Group comparison design with pre and post test assessments.
Educational issue being researched.
1. The first article (Mendicino, Razzaq and Heffernan, 2009) asks can 5th grade
students learn more by doing their math homework with a Web-based intelligent
tutoring system than when doing traditional paper-and-pencil homework.
2. The second article is a case study on the effectiveness of a web-based tutorial
alternative at the college level in a level one Physics class. The evaluation focused
not only on the student performance but also on the student attitude towards the
process.
Research hypothesis, question or area of inquiry.
1. Researchers hypothesized that web-based homework assistance will help students
learn more than traditional paper-and-pencil homework
2. Previous studies have shown that there is improved student learning when
meaningful homework assignments are completed and returned with constructive
comments. Since this is nearly impossible with large classes the hypothesis was
can web-based interactive intelligent design homework programs provide the
same benefits as traditional homework.
Dependent variable(s) (if applicable.).
Both studies involved using pre and post tests to assess performance
improvement.
Independent variable(s). (if applicable).
1. The 5th grade study involved the use of the web-based ASSIST-ment system for
homework.
2. The college level project used computer based homework with simulations of labs
that incorporated immediate feedback and tutorials.
Where does the research take place and who were the participants?
2. 1. Four 5th grade classrooms and students’ home computers. The school was in a
small town in a rural county.
2. Four sections of Physics 1 at Mississippi State University. The study was
conducted in the Spring of 2001.
How were data collected? Who collected it?
1. In the 5th grade project the data was collected over a 4 day period culminating in
the post test. The classroom teacher collected and administered the post test and
the evaluation was done by the researchers.
2. The Physics homework assignments and post test questions were reviewed by the
professor to insure that they addressed the topics of the study and that they were
not biased. Collection was done by the author and teacher assistants.
How was the data analyzed?
1. The data was analyzed using paired sample correlations. T-tests were run on the
web-based homework and the gain scored from pretest to posttest. The paper and
pencil gain scores were also scored on comparison from pretest to posttest.
2. Researchers compared the data by using a t-test for independent measurement and
the analysis of covariance method.
What were the results of the study?
1. The study showed that by using a system such as the ASSISTment system,
students can learn more than they would by doing their homework with paper and
pencil. In addition, teachers can take advantage of the convenience of having
homework automatically graded and recorded. Students also may take their
homework more seriously when they know it will be graded.
Teachers can also pinpoint exactly where students are having difficulties and
are able to get reports on which skills need to be addressed either for the class as a
whole or broken down by individual student need.
2. No significant differences were found in the performance of students in the study.
However, students did report more interest in having the opportunity to complete the
homework on-line.
Critique of the design and methodology of the study. Evaluation of the
methodology section.
Were the clients adequately described? Please explain.
1. The clients were adequately defined. Age and population of the test subjects was
carefully examined for access to the materials necessary to complete the study.
2. The student population was adequately defined.
Was the setting adequately described? Please explain.
1. The elementary school setting was well described.
2. The physics project adequately detailed the variety of situations studied.
Was the research design appropriate? Please explain.
3. 1. The research design appeared appropriate for the age group being studied and for
the subject matter. The evaluation took into account many of the hidden variables
such as student access to computers and how they solved their lack of access and
how the researchers handled these potential disparities. For example they
discounted students who completed the work in the morning as a group in the
school computer lab instead of at home since this no longer fit their research
definition of homework.
2. Again, the research design was carefully described and appropriate for the college
level students and subject being researched.
Were the dependent variable (s) and independent variables (s)
adequately described? Please explain.
These variables were covered adequately in both studies