Quantitative Critical Review

Improved Essays
Critical Review of Quantitative Research

Introduction
This paper is a critical review of the empirical research study (Weigle, 2010), Validation of automated scores of TOEFL iBT tasks against not-test indicators of writing ability. TOEFL iBT is the acronym for the Test of English as a Foreign Language internet-based test. The topic of Weigle’s study is the validity of automated scores produced using the computer program e-rater.

Conceptualisation
Purpose
Weigle (2010) builds up a convincing rationale in her introduction and literature review. Creswell (2014, pp.78, 84, 85) describes, in a five-part template, how to write a ‘statement of the problem’ section, these five aspects being:
(1) the topic; (2) the research program; (3) a justification
…show more content…
Weigle’s (2010) literature review, which is organised thematically, is sufficiently comprehensive, spanning two pages with a total of 27 research studies being cited in it, 24 being primary citations and 3 secondary citations. The Literature review commences with a citation to research that illustrates the early history of automated scoring (Page, 1966), and then, with information more specifically related to Weigle’s research, the history of e-rater being used on the Graduate Management Admissions Test (GMAT) and in ETS’ web-based essay evaluation service, Criterion is cited (Burstein et al., 2003, as cited in Weigle, 2010, p.336).

The second paragraph, the longest in the literature review, goes into more details about e-rater and summarises some key features of the version of e-rater that was current at the time of Weigle’s writing. These features, as listed by Weigle (2010, p.336) are:
Ø Errors in grammar, usage, mechanics, style;
Ø Organization and development;
Ø Lexical complexity; and
Ø Prompt-specific vocabulary
…show more content…
Weigle (2010, p.338) writes that: validation of automated scoring systems is still an area where research needs to be done; the current study aims to contribute to the growing body of knowledge in this area.

Research Question
There is one research question in the study, which is stated in a section of its own, immediately following the literature review. The question is expressed in a clear sentence, 38 words in length. Although the sentence is slightly long the variables and actions described by the sentence had already been developed through the earlier parts of the article, the introduction and the literature review, and the research question has encapsulated those variables well. As mentioned in the preceding section, Weigle (2010) has soundly and competently demonstrated how the research question emerged through her literature review. It matches the first four out of five of the guidelines given by Creswell.

Appropriateness of Research Design and

Related Documents

  • Great Essays

    Critical Appraisal of Quantitative Research Introduction Abstract. The abstract consisted of one paragraph, total of ten sentences, which includes the purpose, design, sampling, and results. Researchers expanded on results but did not include conclusion.…

    • 1451 Words
    • 6 Pages
    Great Essays
  • Improved Essays

    ASSIGNMENT QUESTIONS: 1. What is the regulation or law that you would propose? Be very specific in the wording. (This will be your own idea and written in your own words). (20 points) Answer:…

    • 672 Words
    • 3 Pages
    Improved Essays
  • Improved Essays

    Nt1310 Unit 4

    • 634 Words
    • 3 Pages

    1. How do the various types of scores differ regarding the information they provide? Scores provide feedback to teachers and students and reflect how a student is learning, meeting objectives, and achievement level. Raw scores are actual scores calculated by the sum of total correct answers or percentage and provide criterion-referenced information about a student’s performance.…

    • 634 Words
    • 3 Pages
    Improved Essays
  • Improved Essays

    Interaction My initial response to the concept of forgiveness therapy for abuse survivors was that it seemed counter-intuitive, as it can be perceived to excuse the abusive behavior and invalidate the suffering of the victim. However, this impression fails to acknowledge the therapeutic definition of forgiveness as used in therapy, a release of resentment (Reed & Enright, 2006). Upon review of this definition of forgiveness therapy, I concluded that it was in line with other therapeutic ideals that encourage release of negative thought patterns and encourage the construction of positive thought patterns and behaviors.…

    • 651 Words
    • 3 Pages
    Improved Essays
  • Improved Essays

    HUD VASH Program

    • 973 Words
    • 4 Pages

    On May 20, 2010, A Special Joint Hearing before the Subcommittee on Transportation and Housing and Urban Development, and related agencies, was called, and the various governmental entities and agencies were given the opportunity to present their various points, evidence, and stance on the issue of zero funding in 2011 for the HUD-VASH program. Statistics were provided, various Senators spoke…and in the end, the zero funding of the HUD-VASH program was overturned. In 2011, the HUD-VASH program received $50 million, equating to 7,500 vouchers. Every year since 2011, the funding has been resumed at $75 million and the program has been able to issue 10,000 new vouchers each year ("Housing our heroes: an examination of the progress in ending…

    • 973 Words
    • 4 Pages
    Improved Essays
  • Improved Essays

    Guns have been a hot topic in the United States for decades for many reasons. Most of the controversy revolves around The Second Amendment which states, “A well regulated Militia, being necessary to the security of a free State, the right of the people to keep and bear Arms, shall not be infringed” (U.S. Const. amend. II). On one side, we have people who take The Second Amendment very seriously.…

    • 1687 Words
    • 7 Pages
    Improved Essays
  • Improved Essays

    Cutler Bay Case Study

    • 469 Words
    • 2 Pages

    In early 2011 I received an approval for my research to explore a possibility of establishing new High school in Cutler Bay. My efforts resulted in a report that had comprehensive information and the recommendations to the key stakeholder in writing an application letter for a go-ahead to build a charter high school. I met with the Edvision application consultants, Cutler Bay Council, and the Charter school advisory committee. Throughout the entire month, I visited Florida department of education together with individuals from Edvision consultants in order to see the approval of the project go through.…

    • 469 Words
    • 2 Pages
    Improved Essays
  • Decent Essays

    D1a. Extensive research is available on this topic both primary and secondary. Research chosen was specific to this topic so the relevance was clear and major portion of the articles…

    • 341 Words
    • 2 Pages
    Decent Essays
  • Decent Essays

    Standardized assessments have become increasingly popular for helping businesses understand the interests of their employees as well as individuals considering career changes. However, these assessments are relatively new, and many people may not familiar or knowledgeable about this type of assessment. Luckily, having a couple of questions answered will help you to better understand whether this assessment can help you meet your particular goals. How Can Undergoing A Strong Interest Inventory Assessment Help You?…

    • 420 Words
    • 2 Pages
    Decent Essays
  • Improved Essays

    Question 1 – Describe the theory the researchers explore. What are the key constructs in the theory? How are they related? Identify which ones are cause, effect, mediating, or moderating constructs. How are the constructs operationalized?…

    • 1069 Words
    • 4 Pages
    Improved Essays
  • Improved Essays

    Draft 2 Revision Plan

    • 832 Words
    • 4 Pages

    Draft 2 Revision Plan My professor and my writing tutor commented that my conclusion is essentially a restatement of what I have already said in my literature review. It is important for a conclusion to contribute to the literature review in some way, so for my next draft, I plan to review the articles and extend my conclusion to include some other observation or where the field could be going. One observation I might include is that although the articles focus on time periods separated by almost five centuries, they describe the struggle of women for gender equality in the same way. Why is the current situation not significantly different from that of Elizabethan England? Another comment I received from my professor was that my proposition is too narrow.…

    • 832 Words
    • 4 Pages
    Improved Essays
  • Improved Essays

    Responses to Written Assignment Unit 7 Response 1 Aspect 1: Grade: 15 points Comment: The essay noted the conflict, which was trying to provide an internal service, and then being pulled into providing service to external sources. The effect of this conflict was that the system developed could not handle volume. However, it is not known who the “other systems” are.…

    • 664 Words
    • 3 Pages
    Improved Essays
  • Improved Essays

    Ekg Report Sample

    • 747 Words
    • 3 Pages

    Summary The study tested if EKG and core temperature would increase when you placed ice (down your back and in your hand) further from your body’s core. The outcome of the study was that your bodies EKG and core temperature decreased when placed further away from your body’s core. The significance of the study is that it shows people that if you place colder objects further from the core of your body, your vital signs are more likely to decrease, furthermore, the study presents an interesting question of whether if eating cold foods or drinking cold beverages would decrease your vital signs, since the foods and beverages are likely to travel downwards towards the body’s core, this can only be answered through further study of the topic.…

    • 747 Words
    • 3 Pages
    Improved Essays
  • Improved Essays

    Basic Reading Skills Ee107

    • 1550 Words
    • 7 Pages

    EE107 scored in the low range on Sentence Writing Fluency, which measures EE107’s her ability to formulate and write sentences quickly. However, Written Expression is a strength for EE107. Particularly, Writing Samples, which measures her ability to write sentences given a verbal and picture cue, was a strength for EE107. The discrepancy between Writing Samples (average) and Sentence Writing Fluency (low) may indicate that EE107 would benefit from extra time on writing tasks. EE107’s…

    • 1550 Words
    • 7 Pages
    Improved Essays
  • Improved Essays

    Imagine a school where every child gets instant, personalized writing help for a fraction of the cost of hiring a human teacher — and where a computer, not a person, grades a student's essays. This is the article "Computers Grade Fast... But Not Always Well," Molly Bloom, NPR that I am summarizing. The article takes feedback from professionals in the field. The first is Les Perelman, director of the student writing program at MIT has tried the computer essay grader.…

    • 280 Words
    • 2 Pages
    Improved Essays

Related Topics