Question

In this second portion of the Final Exam, you will critically evaluate a quantitative research study...

In this second portion of the Final Exam, you will critically evaluate a quantitative research study on a social science topic. Your instructor will post an announcement with the reference for the article assigned for the exam. The study will be from a peer-reviewed journal and published within the last 10 years.

In the body of your critique, describe the statistical approaches used, the variables included, the hypothesis(es) proposed, and the interpretation of the results. In your conclusion, suggest other statistical approaches that could have been used and, if appropriate, suggest alternative interpretations of the results. This process will allow you to apply the concepts learned throughout the course in the interpretation of actual scientific research.

Your critique must include the following sections and information:

Introduction:

  • This section will introduce the assigned peer-reviewed quantitative study.
  • Identify clearly the research questions and/or hypothesis(es) as well as the purpose of the study.

Methods:

  • Describe the procedures and methods of data collection, measures/instruments used, the participants and how they were selected, and the statistical techniques used.

Results:

  • Summarize in this section the results presented in the study.

Discussion:

  • Evaluate the efficacy of the research study by discussing the following:
    • Address the strengths, weaknesses, and limitations of the study and suggest future research directions.
    • Include additional forms of statistical analyses as part of the suggestions for future research.

Conclusion:

  • Summarize the main points of your evaluation of the study.
  • Explain how the statistical test used in the study could be applied to your future career. Give one example.
  • Discuss how your ability to critique quantitative research could impact your future career.

*******************************************************************************************************************************************

Article:

Method

This study used a 2x2 experiment to test the effects of commenting systems and comment moderation on perceived message and messenger credibility. The two independent variables were type of commenting system (native vs. non-native) and method of moderation (pre-moderation vs. post-moderation). This resulted in four experimental conditions. Additionally, a control condition was used that included the news story but no user comments. A post-test method of measuring responses and other pertinent information was implemented, as well as a between-subjects design, where participants were exposed to only one of the five story treatments.

Within the experiment, participants were randomly assigned to an experimental group. The conditions featured an online news story—approximately 500 words, which participants believed was from a website associated with a local community newspaper, The Tuscaloosa News. Each news story featured nine reader comments following the content of the story. The researchers had the cooperation of the newspaper, who allowed the exact look and feel of their website to be replicated in the experiment. This resulted in treatments that were essentially indistinguishable from actual online news content. Use of a known messenger was used because of the inherent difficulties in measuring messenger credibility of an unknown messenger and because consistent use of the news organization created a controlling factor in the analysis.

The story embedded within the news site was reported and written by researchers, using the paper’s style to provide a topical, relevant story that would likely engender discussion in the comments section. The story was about a food stamps program under consideration in the state, written in a way so as to present a neutral voice and no opinion toward the topic. Although the topic was of interest to the region, it was not particularly controversial and therefore should not have prompted influencing reactions from participants. Each experimental condition featured the same story. The only difference between the conditions was the type of commenting system and moderation that appeared below the news story itself.

Conditions that featured native commenting systems, ones that were unique to the news site itself, had a statement telling users to “log into The Tuscaloosa News to post a comment.” Conditions that featured non-native commenting systems, which were from external sites and require an external logon, instructed users to “log into Facebook [or Disqus] to post a comment.” The native commenting conditions included photos of three out of nine commenters, and no commenter used a real name. The non-native commenting conditions featured commenters with real names and realistic photographs—not animations or drawings—associated with the comments. The difference between the two moderation conditions were statements about “all comments are reviewed by the [newspaper name] prior to being posted” (pre-moderation) or “all comments may be removed by the [newspaper name] at a later time” (post-moderation). The nine comments in the experimental conditions were taken directly or revised slightly by researchers from actual comments about a similar story from reputable news websites or were written by researchers in order to ensure a variety of opinions commenting on the news story. The comments were selected by utilizing the commentary that was most closely related to the story itself, and any comments that contained offensive language or opinions were excluded from the conditions. Most of the comments were directed at the content of the story, with one that directly criticized the reporting of the story. Each experimental condition included the same comments, with the control group including the story but no comments.

After being asked to read the content on the page, participants completed a post-test questionnaire. Participants were asked to provide limited demographic information and information about their news consumption and commenting habits. The questions on messenger credibility45 and message credibility46 were adopted from scales shown to be correlated in a previous study47 and were randomized. Both measures—messenger and message credibility—featured five questions, for a total of 10 questions about credibility.

Participants were recruited both from undergraduate classes at a large, southeastern university and from outside of the university setting in order to gain a more diverse sample of participants. The study took place entirely online through the use of the software Qualtrics, and the link to the experiment was distributed through the university participant pool and through social media. In order to receive more nuanced responses, researchers did not inform participants in advance about the true nature of the study. After completing the experiment, participants were debriefed about its nature.

Findings

A total of 388 people participated in this experiment. To control for participants who did not fully engage in the study or answer all of the questions, responses were not analyzed if the participant spent less than one minute reading the experimental stimulus (n = 24) or if the participant did not respond to the post-test questionnaire (n = 20). This resulted in an analysis of responses from 344 participants, self-identified as 232 females and 109 males. Two hundred ninety participants reported that they were white or Caucasian (84.3 percent), and 32 participants reported that they were black or African American (9.3 percent). The remaining 7.3 percent were other races. The mean age for participants was 21(SD = 8.50). Participants were relatively evenly distributed between the experimental conditions, with between 17 percent and 23 percent of the participants in each group. A Cronbach’s Alpha reliability analysis showed that scales for messenger credibility α = .81 and message credibility α = .76 were found to be reliable. The two dependent variables were tested for normality, and were both found to be normal.

Table 1

Means for Messenger and Message Credibility

Messenger Credibility

Message Credibility

                                                           Mean                    SD                 Mean                SD

Native Commenting Systems                   3.30                    .76                  3.41                 .75

                Pre-Moderation         3.19         .79           3.30         .83          Post-Moderation                3.38         .73           3.50         .66

Non-Native Commenting Systems           3.20                     .69                 3.38                 .64

                Pre-Moderation         3.19         .68           3.41         .68          Post-Moderation                3.21         .71           3.36         .59

Control                                                 3.46                     .79                 3.50                 .67

Research Question 1 asked whether the presence of comments on a news story affected messenger and/or message credibility. After combining experimental conditions to compare to the control group, an ANOVA revealed that people who were not exposed to any comments (control group) perceived significantly more messenger credibility (M = 3.46, SD = .79) than did people who were exposed to the experimental conditions (M = 3.25, SD = .79), F(1, 338) = 3.97, p < .05. However, there was no significant difference in message credibility, F(1, 339) = 1.04, p < .31. Therefore, the answer to RQ1 is that the presence of comments on a news story significantly lowered messenger credibility.

Research Question 2 asked whether the type of commenting system (native or nonnative) would affect messenger and/or message credibility. (See Table 1 for group means.) An ANOVA between commenting system type and messenger credibility indicated that the difference between means was not significant F(2, 337) = 2.55, p < .08. An ANOVA between commenting system type and message credibility revealed that the difference between means was not significant, F(2, 338) = .57, p < .57. Therefore, commenting system type had no effect on messenger or message credibility.

Research Question 3 asked whether the type of moderation (pre-moderation or post-moderation) would affect messenger and/or message credibility. (See Table 1 for means and standard deviations.) An ANOVA between moderation type and messenger credibility showed the difference between means was not significant F(2, 337) = 2.81, p < .06. An ANOVA between moderation type and message credibility revealed the difference between means was not significant F(2, 338) = 1.04, p < .35. Therefore, moderation type had no effect on either messenger or message credibility.

Research Question 4 asked whether the amount a person reads or comments on online news affects his or her perceptions of messenger and message credibility. A Pearson’s correlation analysis showed no significance between messenger credibility and amount of news read online r(338) = .02, p < .70, message credibility and amount of news read online r(339) = .05, p < 36, or the amount a person comments online and message credibility r(337) = -.10, p < .06. However, there was significance between the amount a person comments online and overall perception of messenger credibility r(336) = -.13, p < .02, with heavy commenters posting lower messenger credibility scores than did people less likely to comment.

Homework Answers

Know the answer?
Your Answer:

Post as a guest

Your Name:

What's your source?

Earn Coins

Coins can be redeemed for fabulous gifts.

Not the answer you're looking for?
Ask your own homework help question
Similar Questions
Simulation versus online learning: Effects on knowledge acquisition, knowledge retention, and perceived effectiveness. Bredenkamp, Nancy D...
Simulation versus online learning: Effects on knowledge acquisition, knowledge retention, and perceived effectiveness. Bredenkamp, Nancy D University of Northern Colorado, 2013; Ph.D. (153 p) doctoral dissertation – research The healthcare environment continues to experience rapid changes requiring nursing professionals to update knowledge and technical skills to provide safe patient care. The result is a need for healthcare facilities to find unique, evidence-based teaching methods to support learning. The purpose of this study was to identify differences in knowledge acquisition, knowledge...
Online versus Live Delivery of Education to Pharmacists in a Large Multicentre Health Region: A Non-inferiority...
Online versus Live Delivery of Education to Pharmacists in a Large Multicentre Health Region: A Non-inferiority Assessment of Learning Outcomes. Taylor, Robert; Jung, Joanne; Loewen, Peter; Spencer, Carrie; Dossa, Anar; de Lemos, Jane BSc(Biol), BSc(Pharm), ACPR, is a Clinical Pharmacist at the Richmond Hospital, Richmond, British Columbia Canadian Journal of Hospital Pharmacy (CAN J HOSP PHARM), 2013 Jul; 66 (4): 233-40. BACKGROUND: The prevalence of online modules for continuing education in the health professions has been increasing in recent years....
11) Imagine that you have conducted a study to evaluate how learning information in different environments...
11) Imagine that you have conducted a study to evaluate how learning information in different environments using different strategies impacts older adults’ ability to remember a list of words. You ask one group of older adults to learn a list of words while seated in their kitchen at home and a second set of older adults to learn a list of words while seated at a table at the public library. For the first half of the learning list in...
Enter the hypothetical data below in SPSS to use for the assignment. The SPSS commands: 'file',...
Enter the hypothetical data below in SPSS to use for the assignment. The SPSS commands: 'file', 'new', 'data' will create a spreadsheet in which to enter the data below (manually). Case      Group                   Test 1              1                              6 2              1                              7 3              1                              5              4              1                              4 5              1                              1 6              2                              3 7              2                              5 8              2                              2 9              2                              5 10           2                                1 The groups are coded as follows: 1=experimental group, 2 control group. The participants in the experimental...
Research is an integral part of all professional fields. Designing a research study can be a...
Research is an integral part of all professional fields. Designing a research study can be a complicated task that can be simplified if the appropriate techniques can be identified. This assignment will give you the opportunity to design an experiment, including finding relevant prior research, determining the appropriate sample, data analysis techniques, and discuss the results you hope to see. Working from the topic chosen earlier in the topic selection, you will be designing your own statistical study. In a...
Imagine that you have conducted a study to evaluate how learning information in different environments using...
Imagine that you have conducted a study to evaluate how learning information in different environments using different strategies impacts older adults’ ability to remember a list of words. You ask one group of older adults to learn a list of words while seated in their kitchen at home and a second set of older adults to learn a list of words while seated at a table at the public library. For the first half of the learning list in both...
As you saw from the lab PowerPoint slides last week, you will be doing a research...
As you saw from the lab PowerPoint slides last week, you will be doing a research study looking at ‘Aggression Priming” for your first paper. For this week’s discussion, I want you to discuss with your group what you think this study is about. What is the hypothesis? What theory does it come from? What do you predict will happen (do you expect something different than the hypothesis in the researcher instructions? If so, what and why?)? Do you think...
#1. Which of the following scenarios would be best described as having a true experimental research...
#1. Which of the following scenarios would be best described as having a true experimental research design? A Research Question: Do a smaller proportion of graduates attend graduation when it is held on a Sunday compared to Saturday? Design: Randomly select 40 graduates the year it is held on a Saturday and record how many attend graduation. Do the same thing on a year the ceremony is held on a Sunday. B Research Question: Is a new vaccination effective at...
1- Which study design(s) require collecting information about participants over time? (Select all that apply.) Cross-sectional...
1- Which study design(s) require collecting information about participants over time? (Select all that apply.) Cross-sectional Case-control Meta-analysis Cohort Experimental Ecological 2- For the following research question, identify the exposure, outcome and population. Does the number of parks in a neighborhood decrease crime rates within neighborhoods across the inland empire?       -       A.       B.       C.       D.    Exposure       -       A.       B.       C.   ...
Review and submit the Donatos: Finding the New Pizza case study below. Answer the following two...
Review and submit the Donatos: Finding the New Pizza case study below. Answer the following two questions: 2. Evaluate the Wassup meeting as an exploratory methodology to help define the research question. 4. What measurement scales would you have used on the survey that was part of the in-restaurant product tests? Abstract and Written Case: The pizza segment of the fast-food industry is very aggressive. As people’s tastes change and new diets become the rage, restaurant chains must decide if...
ADVERTISEMENT
Need Online Homework Help?

Get Answers For Free
Most questions answered within 1 hours.

Ask a Question
ADVERTISEMENT