GRE® Psychology Measurement, Methodology and Other: Measurement and Methodology Part 1
It’s the systematic set of assumptions, rules, and procedures psychologists use to gather empirical data, analyze it, draw conclusions, and share findings.
Define:
scientific method
It is a general procedure which psychologists use for gathering and interpreting data.
Rate to track your progress ✦
Key Terms
Define:
scientific method
It is a general procedure which psychologists use for gathering and interpreting data.
Define theory as it relates to research methods.
A well-supported, organized explanation of phenomena, built from repeated testing of hypotheses and con...
Other researchers must be able to replicate the results of an experiment to validate its conclusions.
What is replication?
It is obtaining similar results to a previous study using the same methods.
What is hindsight bias?
Explaining why something happened after it has occured.
What is a controlled experiment?
It is where researchers systematically manipulate a variable and observe the response in a laboratory.
Define:
hypothesis
A prediction of how two or more factors are related.
How do researchers specifically define what variables mean?
Researchers use operational definitions to precisely describe variables in relation to their study.
...What is the difference between an independent variable and a dependent variable in an experiment?
The factor being manipulated is the independent variable.
The factor being measure...
Identify the independent and dependent variables:
If we test the hypothesis that students who Brainscape to study, rather than simple flash cards, will learn more (as measured by higher test scores), then what is the independent variable? What is the dependent variable?
independent: method of studying (Brainscape versus regular flashcards).
dependent: amount ...
Define population as it relates to research methods.
It refers to all the individuals to which the study applies.
Define sample as it relates to research methods.
A subgroup of a population that constitutes participants of a study.
What type of sample should be used in research?
Larger sample sizes are ideal because they are the most representative of the population.
Fill in the blank:
The amount of difference between the sample and population is called __________ _____.
sampling error
Define random selection as it relates to research methods.
Every individual from a population has an equal chance of being chosen for the sample.
Which individuals are in the experimental group?
Subjects who receive the treatment or manipulation of the independent variable.
Which individuals are in the control group?
Subjects who do not receive any treatment or manipulation.
Fill in the blanks:
Subjects who receive the treatment are part of the __________ group, while those who do not receive the treatment belong to the __________ group.
experimental; control
What type of experimental design uses experimental and control groups?
A between-subjects design uses an experimental group and a control group to compare the effect of the independent variable.
Which process is used to try to ensure there are no preexisting differences between the control group and the experimental group?
Random assignment is used to assign the sample participants into groups (e.g., experimental drug or pla...
Define:
confounding variable
Any difference between the experimental group and the control group, besides the effect of the independent variable.
a.k.a. ...
List four types of confounding variables.
experimenter bias
demand characteristics
placebo effect
lack of counterbalancing
Define experimenter bias as it relates to confounding variables.
This occurs when a researcher’s expectations or preferences about the results of the study influence the experiment
Define demand characteristics as they relate to confounding variables.
These are clues the participants discover about the intention of the study that alter their responses.
Define placebo effect as it relates to confounding variables.
Responding to an inactive drug with a change in behavior because the subject believes it contain...
What is the Hawthorne effect?
Individuals who are being experimented on behave differently than in their everyday life.
What type of experimental design uses each participant as his/her own control?
A within-subjects design exposes each participant to the treatment and compares their pre-test and post-test results. This design ...
What is a single-blind procedure?
Research design in which the subjects are unaware if they are in the control or experimental group.
What is a double-blind procedure?
Research design in which neither the experimenter nor the subjects are aware who is in the control or experimental group.
Fill in the blank:
Single-blind procedures aim to eliminate the effects of __________ __________.
demand characteristics
Fill in the blank:
Double-blind procedures use a third party researcher to omit the effects of __________ ____.
experimenter bias
How are quasi-experiments different from controlled experiments?
Random assignment is not possible in quasi-experiments.
What types of research are considered quasi-experiments?
Differences in behavior between:
males and females
various age groups
students in different classes
...
Define:
correlational research
establishes a relationship between two variables
does not determine cause and effect
used to make predictions...
List three methods of data collection
naturalistic observation
surveys
tests
Which two conditions must be met for an experiment to be considered a true experiment?
The researcher manipulates the independent variable.
All participants are randomly assigned to the experimental and control ...
Define naturalistic observation as it relates to correlational research.
It consists of field observation of naturally occuring behavior, such as the way students behave in the classroom...
What are surveys and why are they not always accurate?
It is a type of correlational research.
Questionnaires and interviews given to a large group of people about their thoughts ...
Define tests as they relate to correlational research.
Research method that measures individual traits at a specific time and place.
Fill in the blank:
___ _____ ______ studies start by looking at an effect and then attempt to determine the cause.
Ex post facto
What is the difference between the reliability and validity of a test?
Reliable – consistent. When administered properly, does a test give similar results when used on different occasions?
<...
What is a case study?
Detailed examination of one person or a small group.
Beneficial for understanding rare and complex phenomena in clinical res...
What are the strengths and weaknesses of this research method?
experiments
Strengths:
determine cause and effect relationship between variables
control over confounding variables
What are the strengths and weaknesses of this research method?
correlational research
Strengths:
easy to administer surveys or tests
inexpensive
minimal time needed
substanti...
Define:
statistics
Analysis of numerical data regarding representative samples.
Fill in the blank:
__________ data include measurements, such as scores on the Wisconsin Card Sorting Task (behavioral example) or scores on the Magical Ideation Scale (self report example), that can be readily expressed using numbers.
Quantitative
Fill in the blank:
__________ data, such as clinical interviews, can be very descriptive and rich, but are challenging and ambiguous to interpret.
Qualitative
What are the four scales of measurement?
nominal
ordinal
interval
ratio
Define:
nominal scale
Data that are categorical: Numbers have no meaning except for convenience as labels.
Examples:
Hair Color (possibly coded...
Define:
ordinal scale
Numbers are used as ranks.
Examples:
The runner who wins the race is scored as 1, the runner who comes in second is scored as 2, the third...
Define:
interval scale
Numbers that have a meaningful difference between them.
Example:
Temperature: The difference between 10°F and 20°F is the same as between ...
Define:
ratio scale
Numbers that have a meaningful ratio between them on a scale with a real zero point.
Example:
Weight and height: If you weight zero pounds...
Would temperature of Celcius and Farenheit be measured on an interval scale or a ratio scale?
interval scale
If the temperature is 0°F, there is not "no temperature." There is not a meaningful ratio between values. 100°F is not twice a...
What are descriptive statistics?
Numbers that summarize a set of research data from a sample.
Define:
frequency distribution
An orderly arrangement of scores indicating the frequency of each score.
What is the difference between a histogram and a frequency polygon?
A histogram is a bar graph.
A frequency polygon is a line graph or a bell curve.
<...
Define and list the three types of:
central tendency
Measures of central tendency describe the most typical scores for a set of research data.
mode
median
m...
Define in terms of central tendency:
mode
Most frequently occurring score in the data set.
Define in terms of central tendency:
median
The middle score when the data is ordered by size.
Define in terms of central tendency:
mean
Arithmetic average of the scores in the data set.
Fill in the blank:
If two scores appear most frequently, the distribution is __________.
bimodal
Fill in the blank:
If there are three or more appearing most frequently, it is __________.
multimodal
Which measure of central tendency is the most representative? The least representative?
Mean is usually most representative, unless there are extreme outliers that pull the mean in a particular direction.
Define:
normal distribution
A bell-shaped, symmetrical curve that represents data about many characteristics, including the distribution of many human characteristics<...
Fill in the blank:
When most of the scores are compacted on one side of the bell curve, the distribution is said to be __________.
skewed
Positively skewed distributions include a lot of small values and negatively skewed distributions include a lot of large values.
Define and list the three types of:
measures of variablity
They describe the dispersion of scores for a set of research data.
range
variance
standard deviation
Define in terms of variability:
range
Difference between the largest score and the smallest score.
What do variance and standard deviation measure?
Average difference between each score and the mean of the data set.
Taller, narrow curves have less variance than short, wider curves.
What is a z score?
| (a.k.a. standard score)
allows for comparison between different scales
subtract mean from each score and divide by standard deviation
Define:
percentile score
Percentage of scores at or below a particular score between 1 and 99.
Example:
If you are in the 70th percentile, 70% of the scores are th...
Define:
Pearson correlation coefficient
statistical linear measure of the relationship between two sets of data
varies from -1 to +1
helps to make pr...
Name the correlation coefficient for each and describe the relationship:
perfect positive correlation
no relationship
perfect negative correlation
r = +1
direct relationship: as one variable increases or decreases, the other does the samer = 0
What type of graph plots single points to show the strength and direction of correlations?
scatterplot
What is the term for the line on a scatterplot that follows the trend of the points?
line of best fit or regression line
What is the difference between a null and an alternative hypothesis?
Null hypotheses state that a treatment had no effect.
Alternative hypothe...
What is the difference between a Type I and Type II error?
Type I errors, or false positives, occur if the researcher rejects a true null hypothesis.
What is a p value?
it lets you know if the finding is statistically significant, i.e., the likelihood of the findings being the result of chance. The lower the p<...
When is a finding statistically significant?
In psychology, a finding is considered statistically significant if the probability (alpha) that the finding is due to chance is less than 1 in 20 ...
What method statistically combines the results of several research studies to reach a conclusion?
meta-analysis
Why did the American Psychological Association (APA) implement ethical guidelines?
Guidelines were set in place in the late 20th century to stress responsibility and morality in research and clinical practice.
- ...
What are the purposes of an Institutional Review Board?
| (IRB)
Approve research being conducted at their particular institution.
Require participants give informed consent after hearing t...
Fill in the blank:
__________ psychology is practical and designed for real world application.
Applied
Fill in the blank:
__________ psychology is focused on research of fundamental principles and theories.
Basic
Who founded the first psychology research lab?
Wilhelm Wundt
Fill in the blank:
_____________ was one of the first psychologists to demonstrate that one could study psychological processes using experimental psychology.
Hermann Ebbinghaus
Describe the work of Oswald Kulpe.
Kulpe was one of the earliest experimental psychologists who performed numerous experiments to prove his "imageless thought" to tr...
Who was the first psychologist to introduce mental testing to the United States?
James McKeen Cattell
Who created the first intelligence test and what was its initial purpose?
Created by Simon and Binet in 1905 for the purposes of ranking the intelligence of French children to select for mentally retarded children.
Fill in the blank:
__________ __________ was a term developed by William Stern, which describes the ratio between someone's chronological and his/her mental age.
Intelligence quotient
| (IQ)
Who authored the Stanford-Binet Intelligence test?
Lewis Terman
If I were to test a population of people taking care to sample a proportionate amount to the actual composition of the group, which kind of sampling would I be using?
stratified random sampling
What is it called when participants are paired based on similar levels of a potential confounding factor to eliminate its effect?
matched-subjects design
Define:
counterbalancing
This is an experimental technique in which we make sure both the experimental and control group will experience both levels of the...
Mary designed an experiment in which the groups were not randomly assigned and so the control and experimental groups were not the same, what kind of group design is this?
nonequivalent group design
Fill in the blank:
If the results of my experiment are applicable to the entire population, my experiment is said to have __________ __________.
external validity
Fill in the blank:
If I make inferences from a data set that go beyond the actual data points, this would be _________ __________.
inferential statistics
Fill in the blank:
An _______ is an extremely large or extremely small number that affects the measure of central tendency such that it is no longer accurately representative of the sample.
outlier
What are the properties of a normal distribution?
A normal distribution is represented by a normal curve. The scores will exist such that 68% of the scores are within 1 standard de...
Define:
T-score
Similar to a Z-score, a T-score sets up a curve such that the mean is always 50 and each standard deviation is 10. You simply conv...
What is the difference between a positive correlation and a negative correlation?
A positive correlation is one in which if one value increases, the other value will increase.
What does a scatterplot look like?
Related Flashcard Decks
| Term | Definition |
|---|---|
Define: scientific method | It is a general procedure which psychologists use for gathering and interpreting data. |
Define theory as it relates to research methods. | A well-supported, organized explanation of phenomena, built from repeated testing of hypotheses and consistent observations. Unlike a hypothesis, which is a specific testable prediction, a theory integrates evidence into a broader explanatory framework. |
Other researchers must be able to replicate the results of an experiment to validate its conclusions. What is replication? | It is obtaining similar results to a previous study using the same methods. |
What is hindsight bias? | Explaining why something happened after it has occured. |
What is a controlled experiment? | It is where researchers systematically manipulate a variable and observe the response in a laboratory. |
Define: hypothesis | A prediction of how two or more factors are related. |
How do researchers specifically define what variables mean? | Researchers use operational definitions to precisely describe variables in relation to their study. For example, “effectiveness of studying” can be operationally defined with a test score. |
What is the difference between an independent variable and a dependent variable in an experiment? |
|
Identify the independent and dependent variables: If we test the hypothesis that students who Brainscape to study, rather than simple flash cards, will learn more (as measured by higher test scores), then what is the independent variable? What is the dependent variable? |
|
Define population as it relates to research methods. | It refers to all the individuals to which the study applies. |
Define sample as it relates to research methods. | A subgroup of a population that constitutes participants of a study. |
What type of sample should be used in research? | Larger sample sizes are ideal because they are the most representative of the population. |
Fill in the blank: The amount of difference between the sample and population is called __________ _____. | sampling error |
Define random selection as it relates to research methods. | Every individual from a population has an equal chance of being chosen for the sample. |
Which individuals are in the experimental group? | Subjects who receive the treatment or manipulation of the independent variable. |
Which individuals are in the control group? | Subjects who do not receive any treatment or manipulation. |
Fill in the blanks: Subjects who receive the treatment are part of the __________ group, while those who do not receive the treatment belong to the __________ group. | experimental; control |
What type of experimental design uses experimental and control groups? | A between-subjects design uses an experimental group and a control group to compare the effect of the independent variable. |
Which process is used to try to ensure there are no preexisting differences between the control group and the experimental group? | Random assignment is used to assign the sample participants into groups (e.g., experimental drug or placebo). Random assignment means neither the experimentor nor the participants decide in which group the participants will be, and each participant has an equal chance of being assigned to a given study groups (e.g., treatment vs. placebo). |
Define: confounding variable |
|
List four types of confounding variables. |
|
Define experimenter bias as it relates to confounding variables. | This occurs when a researcher’s expectations or preferences about the results of the study influence the experiment. |
Define demand characteristics as they relate to confounding variables. | These are clues the participants discover about the intention of the study that alter their responses. |
Define placebo effect as it relates to confounding variables. | Responding to an inactive drug with a change in behavior because the subject believes it contains the active ingredient. |
What is the Hawthorne effect? | Individuals who are being experimented on behave differently than in their everyday life. |
What type of experimental design uses each participant as his/her own control? | A within-subjects design exposes each participant to the treatment and compares their pre-test and post-test results. This design can also compare the results of two different treatments administered. |
What is a single-blind procedure? | Research design in which the subjects are unaware if they are in the control or experimental group. |
What is a double-blind procedure? | Research design in which neither the experimenter nor the subjects are aware who is in the control or experimental group. |
Fill in the blank: Single-blind procedures aim to eliminate the effects of __________ __________. | demand characteristics |
Fill in the blank: Double-blind procedures use a third party researcher to omit the effects of __________ ____. | experimenter bias |
How are quasi-experiments different from controlled experiments? | Random assignment is not possible in quasi-experiments. |
What types of research are considered quasi-experiments? | Differences in behavior between:
|
Define: correlational research |
|
List three methods of data collection |
|
Which two conditions must be met for an experiment to be considered a true experiment? |
So, for instance, a study that compares how men versus women do on a given task would not be a true experiment because it is not possible to assign people to group (gender). (This example would be a quasiexperiment.) |
Define naturalistic observation as it relates to correlational research. | It consists of field observation of naturally occuring behavior, such as the way students behave in the classroom. There is no manipulation of variables. |
What are surveys and why are they not always accurate? |
|
Define tests as they relate to correlational research. | Research method that measures individual traits at a specific time and place. |
Fill in the blank: ___ _____ ______ studies start by looking at an effect and then attempt to determine the cause. | Ex post facto |
What is the difference between the reliability and validity of a test? |
In order to be valid, a measure must be reliable. However, a measure can be reliable without being valid. For instance, imagine a scale that always reads 212 pounds, no matter what the weight is of the person who stands on it. That scale would be a reliable measure, but not a valid measure. |
What is a case study? |
|
What are the strengths and weaknesses of this research method? experiments | Strengths:
Weaknesses:
|
What are the strengths and weaknesses of this research method? correlational research | Strengths:
Weaknesses:
|
Define: statistics | Analysis of numerical data regarding representative samples. |
Fill in the blank: __________ data include measurements, such as scores on the Wisconsin Card Sorting Task (behavioral example) or scores on the Magical Ideation Scale (self report example), that can be readily expressed using numbers. | Quantitative |
Fill in the blank: __________ data, such as clinical interviews, can be very descriptive and rich, but are challenging and ambiguous to interpret. | Qualitative |
What are the four scales of measurement? |
|
Define: nominal scale | Data that are categorical: Numbers have no meaning except for convenience as labels. Examples: |
Define: ordinal scale | Numbers are used as ranks. Examples: |
Define: interval scale | Numbers that have a meaningful difference between them. Example: |
Define: ratio scale | Numbers that have a meaningful ratio between them on a scale with a real zero point. Example: |
Would temperature of Celcius and Farenheit be measured on an interval scale or a ratio scale? | interval scale If the temperature is 0°F, there is not "no temperature." There is not a meaningful ratio between values. 100°F is not twice as hot as 50°F. |
What are descriptive statistics? | Numbers that summarize a set of research data from a sample. |
Define: frequency distribution | An orderly arrangement of scores indicating the frequency of each score. |
What is the difference between a histogram and a frequency polygon? |
|
Define and list the three types of: central tendency | Measures of central tendency describe the most typical scores for a set of research data.
|
Define in terms of central tendency: mode | Most frequently occurring score in the data set. |
Define in terms of central tendency: median | The middle score when the data is ordered by size. |
Define in terms of central tendency: mean | Arithmetic average of the scores in the data set. |
Fill in the blank: If two scores appear most frequently, the distribution is __________. | bimodal |
Fill in the blank: If there are three or more appearing most frequently, it is __________. | multimodal |
Which measure of central tendency is the most representative? The least representative? |
|
Define: normal distribution | A bell-shaped, symmetrical curve that represents data about many characteristics, including the distribution of many human characteristics. In a normal distribution, approximately two thirds of the population will be within plus or minus one standard deviation of the norm (mean). Approximately 95% of the population will be within plus or minus two standard deviations of the mean. Over 99% of the population will fall within plus or minus three standard deviations of the mean. |
Fill in the blank: When most of the scores are compacted on one side of the bell curve, the distribution is said to be __________. | skewed Positively skewed distributions include a lot of small values and negatively skewed distributions include a lot of large values. |
Define and list the three types of: measures of variablity | They describe the dispersion of scores for a set of research data.
|
Define in terms of variability: range | Difference between the largest score and the smallest score. |
What do variance and standard deviation measure? | Average difference between each score and the mean of the data set. Taller, narrow curves have less variance than short, wider curves. |
What is a z score? | (a.k.a. standard score) |
|
Define: percentile score | Percentage of scores at or below a particular score between 1 and 99. Example: |
Define: Pearson correlation coefficient |
|
Name the correlation coefficient for each and describe the relationship:
|
|
What type of graph plots single points to show the strength and direction of correlations? | scatterplot |
What is the term for the line on a scatterplot that follows the trend of the points? | line of best fit or regression line |
What is the difference between a null and an alternative hypothesis? |
|
What is the difference between a Type I and Type II error? |
|
What is a p value? | it lets you know if the finding is statistically significant, i.e., the likelihood of the findings being the result of chance. The lower the p score, the less likely it is that the findings are due to chance. In order for a finding to be considered statistically significant, the p score must be less than or equal to .05; in other words, a %5 or less likelihood that the finding is due to chance. |
When is a finding statistically significant? | In psychology, a finding is considered statistically significant if the probability (alpha) that the finding is due to chance is less than 1 in 20 (p is less than or equal to 0.05). |
What method statistically combines the results of several research studies to reach a conclusion? | meta-analysis |
Why did the American Psychological Association (APA) implement ethical guidelines? |
|
What are the purposes of an Institutional Review Board? | (IRB) |
|
Fill in the blank: __________ psychology is practical and designed for real world application. | Applied |
Fill in the blank: __________ psychology is focused on research of fundamental principles and theories. | Basic |
Who founded the first psychology research lab? | Wilhelm Wundt |
Fill in the blank: _____________ was one of the first psychologists to demonstrate that one could study psychological processes using experimental psychology. | Hermann Ebbinghaus |
Describe the work of Oswald Kulpe. | Kulpe was one of the earliest experimental psychologists who performed numerous experiments to prove his "imageless thought" to try and combat Titchener's work and prove that there were some thoughts that did not have images to be analyzed. |
Who was the first psychologist to introduce mental testing to the United States? | James McKeen Cattell |
Who created the first intelligence test and what was its initial purpose? | Created by Simon and Binet in 1905 for the purposes of ranking the intelligence of French children to select for mentally retarded children. |
Fill in the blank: __________ __________ was a term developed by William Stern, which describes the ratio between someone's chronological and his/her mental age. | Intelligence quotient | (IQ) |
Who authored the Stanford-Binet Intelligence test? | Lewis Terman |
If I were to test a population of people taking care to sample a proportionate amount to the actual composition of the group, which kind of sampling would I be using? | stratified random sampling |
What is it called when participants are paired based on similar levels of a potential confounding factor to eliminate its effect? | matched-subjects design |
Define: counterbalancing | This is an experimental technique in which we make sure both the experimental and control group will experience both levels of the independent variable, just at different times. |
Mary designed an experiment in which the groups were not randomly assigned and so the control and experimental groups were not the same, what kind of group design is this? | nonequivalent group design |
Fill in the blank: If the results of my experiment are applicable to the entire population, my experiment is said to have __________ __________. | external validity |
Fill in the blank: If I make inferences from a data set that go beyond the actual data points, this would be _________ __________. | inferential statistics |
Fill in the blank: An _______ is an extremely large or extremely small number that affects the measure of central tendency such that it is no longer accurately representative of the sample. | outlier |
What are the properties of a normal distribution? | A normal distribution is represented by a normal curve. The scores will exist such that 68% of the scores are within 1 standard deviation of the mean and 96% of the scores will fall within 2 standard deviations of the mean. |
Define: T-score | Similar to a Z-score, a T-score sets up a curve such that the mean is always 50 and each standard deviation is 10. You simply convert each number to the T-score value for easy comparison and analysis. |
What is the difference between a positive correlation and a negative correlation? |
|
What does a scatterplot look like? |