Limitations of self report data

Rob Hoskin BlogsBrain and BehaviourCognitive PsychologyUncategorized A common methodology in behavioural science is to use self-report questionnaires to gather data.

Limitations of self report data

This article has been cited by other articles in PMC. Abstract Background Accurate assessment is required to assess current and changing physical activity levels, and to evaluate the effectiveness of interventions designed to increase activity levels. This study systematically reviewed the literature to determine the extent of agreement between subjectively self-report e.

Methods Eight electronic databases were searched to identify observational and experimental studies of adult populations. Searching identified 4, potential articles. Initial screening found that examined the relationship between self-reported and directly measured physical activity and met the eligibility criteria.

A risk of bias assessment was conducted Limitations of self report data all articles from which data was abstracted. Results Correlations between self-report and direct measures were generally low-to-moderate and ranged from No clear pattern emerged for the mean differences between self-report and direct measures of physical activity.

Trends differed by measure of physical activity employed, level of physical activity measured, and the gender of participants. Conclusion The findings suggest that the measurement method may have a significant impact on the observed levels of physical activity. Self-report measures of physical activity were both higher and lower than directly measured levels of physical activity, which poses a problem for both reliance on self-report measures and for attempts to correct for self-report — direct measure differences.

This review reveals the need for valid, accurate and reliable measures of physical activity in evaluating current and changing physical activity levels, physical activity interventions, and the relationships between physical activity and health outcomes.

Background Physical activity is defined as "any bodily movement produced by the skeletal muscle that results in energy expenditure EE " [ 1 ]. Inactivity is known to be associated with an increased risk for many chronic diseases including: Physical activity levels are often monitored to assess the health behaviours of the population and their association with health status including mortality and morbidity rates.

Accurate assessment of physical activity is required to identify current levels and changes within the population, and to assess the effectiveness of interventions designed to increase activity levels. These measures are frequently used due to their practicality, low cost, low participant burden, and general acceptance [ 3 ].

Although self-reports are useful for gaining insight into the physical activity levels of populations, they have the capacity to over- or underestimate true physical activity energy expenditure and rates of inactivity. The self-report methods are often wrought with issues of recall and response bias e.

As self-report methods possess several limitations in terms of their reliability and validity [ 4 ], objective or direct measures of physical activity are commonly used to increase precision and accuracy and to validate the self-report measures.

Direct measures are believed to offer more precise estimates of energy expenditure and remove many of the issues of recall and response bias. Direct measures consist of calorimetry i. Despite the advantages of using direct methods, these types of measures are often time and cost intensive and intrusive rendering them difficult to apply to large epidemiologic settings.

These measures also require specialized training and the physical proximity of the participant for data collection.

In addition, direct measures each possess their own limitations and no single "gold standard" exists for measuring physical activity or assessing validity [ 3 ]. The appropriate method for measuring physical activity at various levels depends on factors such as the number of individuals to be monitored, the time period of measurements and available finances [ 5 ].

Many previous studies have examined the reliability and validity of various self-report and direct methods for assessing physical activity. Results from these studies have been conflicting. To our knowledge no attempt has been made to synthesize the literature to determine the validity of physical activity measures in adult populations.

The primary objective of this study was to perform a systematic review to compare self-report versus direct measures for assessing physical activity in observational and experimental studies of adult populations.

The results from this systematic review provide a comprehensive summary of past research and a comparison between physical activity levels based on direct versus self-report measures in adult populations.

Methods Study criteria The review sought to identify all studies observational or experimental that presented a comparison of self-report and direct measurement results to reveal differences in physical activity levels based on measurement in adult populations 18 years and over.to the limitations of the self-report method, or compensation in the form of stronger designs, conclusions may well be open to question (e.g.

Kasl, ; Spector, ). An understanding of the systematic biases associated with self-report measures is. The development and widespread use of the self-report method of collecting data on delinquent and criminal behavior together were one of the most important innovations in criminology research in the twentieth century.

to the limitations of the self-report method, or compensation in the form of stronger designs, conclusions may well be open to question (e.g. Kasl, ; Spector, ).

Limitations of self report data

An understanding of the systematic biases associated with self-report measures is. Oct 13,  · Self-report data can be useful in order to get personal, in-depth data; however there can also be many issues surrounding it.

For example, by using self-report data, participants can lie or exaggerate the truth and the researcher wouldn’t know, causing the results to become inaccurate, therefore lacking reliability. A common methodology in behavioural science is to use self-report questionnaires to gather data.

Data from these questionnaire can be used to identify relationships between scores on the variable(s) that the questionnaire is assumed to measure and either performance on behavioural tasks, physiological measures taken during an experiment, or even scores obtained from other questionnaires.

Nov 06,  · Proxy-report data are less prevalent but is an important means for assessing physical activity in sub-populations such as those who are chronically ill, disabled, or elderly, and who are unable to self-report on their own physical activity levels.

Self-Report - Advantages and disadvantages table in A Level and IB Psychology