Rasch models are probabilistic measurement models which currently find their application primarily in psychological and attainment assessment, and are being increasingly used in other areas, including the health profession and market research. Rasch models provide a foundation for the measurement of quantitative attributes and traits on a continuum, based on categorical data derived from interactions between persons and items. In principle, Rasch models can be applied in any experimental context in which persons interact with assessment questions or items in a manner that provides for comparisons between persons with respect to the magnitude of some attribute or trait. Various meters Measurement is the estimation or determination of extent, dimension or capacity, usually in relation to some standard or unit of measurement. ... // Definition of assessment Assessment is the process of documenting, usually in measurable terms, knowledge,skills, attitudes and beliefs. ... This article or section may contain external links added only to promote a website, product, or service – otherwise known as spam. ... A scale for measuring mass A quantitative property is one that exists in a range of magnitudes, and can therefore be measured. ... Look up continuum in Wiktionary, the free dictionary. ... Generally, an interaction is a kind of action which occurs as two or more objects have an effect upon one another. ...

Overview

The Rasch model for measurement

In the Rasch model, the probability of a specified response (e.g. right/wrong answer) is modelled as a function of person and item parameters. Specifically, in the simple Rasch model, the probability of a correct response is modelled as a logistic function of the difference between the person and item parameter. The mathematical form of the model is provided later in this article. In most contexts, the parameters of the model pertain to the level of a quantitative trait possessed by a person or item. For example, in educational tests, item parameters pertain to the difficulty of items while person parameters pertain to the ability or attainment level of people who are assessed. The higher a person's ability relative to the difficulty of an item, the higher the probability of a correct response on that item. When a person's location on the latent trait is equal to the difficulty of the item, there is by definition a 0.5 probability of a correct response in the Rasch model.

The purpose of applying the model is to obtain measurements from categorical response data. Estimation methods are used to obtain estimates from matrices of response data based on the model.

The Rasch model is a model in the sense that it represents the structure which data should exhibit in order to obtain measurements from the data. That is, it is a model in the sense of an ideal or standard. The perspective or paradigm underpinning the Rasch model is distinctly different from the perspective underpinning statistical modelling. Models are most often used with the intention of describing a set of data. Parameters are modified and accepted or rejected based on how well they fit the data. In contrast, when the Rasch model is employed, the objective is to obtain data which fit the model (Andrich, 2004). The rationale for this perspective is that the Rasch model embodies requirements which must be met in order to obtain measurement, in the sense that measurement is generally understood in the physical sciences.

A useful analogy for understanding this rationale is to consider objects measured on a weighing scale. Suppose the weight of an object A is measured as being substantially greater than the weight of an object B on one occasion, then immediately afterward the weight of object B is measured as being substantially greater than the weight of object A. A property we require of measurements is that the resulting comparison between objects should be the same, or invariant, irrespective of other factors. This key requirement is embodied within the formal structure of the Rasch model. Consequently, the Rasch model is not altered to suit data. Instead, the method of assessment should be changed so that this requirement is met, in the same way that a weighing scale should be rectified if it gives different comparisons between objects upon separate measurements of the objects.

Data analysed using the model are usually responses to conventional items on tests, such as educational tests with right/wrong answers. However, the model is a general one, and can be applied wherever discrete data are obtained with the intention of measuring a quantitative attribute or trait.

Scaling

Figure 1: Test characteristic curve showing the relationship between total score on a test and person location estimate

When all test-takers have an opportunity to attempt all items on a single test, each total score on the test maps to a unique estimate of ability and the greater the total, the greater the ability estimate. Total scores do not have a linear relationship with ability estimates. Rather, the relationship is non-linear as shown in Figure 1. The total score is shown on the vertical axis, while the corresponding person location estimate is shown on the horizontal axis. For the particular test on which the test characteristic curve (TCC) shown in Figure 1 is based, the relationship is approximately linear throughout the range of total scores from about 10 to 33. The shape of the TCC is generally somewhat ogival as in this example. However, the precise relationship between total scores and person location estimates depends on the distribution of items on the test. The TCC is steeper in ranges on the continuum in which there are a number of items, such as in the range on either side of 0 in Figures 1 and 2. Image File history File links TCC.PNG‎ Test Characteristic Curve produced in RUMM2020 software, RUMMlab, Perth. ... Image File history File links TCC.PNG‎ Test Characteristic Curve produced in RUMM2020 software, RUMMlab, Perth. ...

In applying the Rasch model, item locations are often scaled first, based on methods such as those described below. This part of the process of scaling is often referred to as item calibration. In educational tests, the smaller the proportion of correct responses, the higher the difficulty of an item and hence the higher the item's scale location. Once item locations are scaled, the person locations are measured on the scale. As a result, person and item locations are estimated on a single scale as shown in Figure 2.

Interpreting scale locations

Figure 2: Graph showing histogram of person distribution (top) and item distribution (bottom) on a scale

For dichotomous data such as right/wrong answers, by definition, the location of an item on a scale corresponds with the person location at which there is a 0.5 probability of success. In general, the probability of a person responding correctly to a question with difficulty lower than that person's location is greater than 0.5, while the probability of responding correctly to a question with difficulty greater than the person's location is less than 0.5. When responses of a person are listed according to item difficulty, from lowest to highest, the most likely pattern is a Guttman pattern or vector: {1,1,...,1,0,0,0,...,0}. However, while this pattern is the most probable given the structure of the Rasch model, the model requires only probabilistic Guttman response patterns; that is, patterns which tend toward the Guttman pattern. It is unusual for responses to conform strictly to the pattern because there are many possible patterns. It is unnecessary for responses to conform strictly to the pattern in order for data to fit the Rasch model. Image File history File links PersItm. ... Image File history File links PersItm. ... This article is in need of attention from an expert on the subject. ... Look up vector in Wiktionary, the free dictionary. ...

Each ability estimate has an associated standard error of measurement, which quantifies the degree of uncertainty associated with the ability estimate. Item estimates also have standard errors. Generally, the standard errors of item estimates are considerably smaller than the standard errors of person estimates because there are usually more response data for an item than for a person. That is, the number of people attempting a given item is usually greater than the number of items attempted by a given person. Standard errors of person estimates are smaller where the slope of the TCC is steeper, which is generally through the middle range of scores on a test. Thus, there is greater precision in this range since the steeper the slope, the greater the distinction between any two point on the line.

Statistical and graphical tests are used to evaluate the correspondence of data with the model. Certain tests are global, while others focus on specific items or people. Certain tests of fit provide information which can be used to increase the reliability of a test by omitting or correcting problems with poor items. In modern test theory, the person separation index is used instead of reliability indices. However, the person separation index is analogous to a reliabiltiy index. The separation index is a summary of the genuine separation as a ratio to separation including measurement error. As mentioned earlier, the level of measurement error is not uniform across the range of a test, but is generally larger for more extreme scores (low and high). Reliability concerns quality or consistency. ...

Features of the Rasch model

Figure 3: As a balance scale provides an experimental context in which to compare the masses of objects, so assessments provide a context in which to compare persons with respect to quantitative attributes and traits. The Rasch model provides a basis for deriving measurements from such 'raw' comparisons.

The class of models is named after Georg Rasch, a Danish mathematician and statistician who advanced the epistemological case for the models based on their congruence with a core requirement of measurement in physics; namely the requirement of invariant comparison. This is the defining feature of the class of models, as is elaborated upon in the following section. The Rasch model for dichotomous data has a close conceptual relationship to the law of comparative judgment (LCJ), a model formulated and used extensively by L. L. Thurstone (cf Andrich, 1978b), and therefore also to the Thurstone scale. This ray-traced image of a balance shows two plates upon which known and unknown masses can be placed. ... This ray-traced image of a balance shows two plates upon which known and unknown masses can be placed. ... Georg Rasch (1901 - 1980) was a Danish mathematician, statistician, and psychometrician, most famous for the development of a class of measurement models known as Rasch models. ... This article does not cite its references or sources. ... Physics (Greek: (phúsis), nature and (phusiké), knowledge of nature) is the science concerned with the discovery and understanding of the fundamental laws which govern matter, energy, space, and time and explaining them using mathematics. ... Conceived by L. L. Thurstone, the law of comparative judgment (LCJ) is a general mathematical representation of a discriminal process, which is any process in which a comparison is made between pairs of a collection of entities with respect to magnitudes of an attribute, trait, attitude, and so on. ... Louis Leon Thurstone (29 May 1887–29 September 1955) was a psychometrician most notable for his contributions to factor analysis with regard to psychological tests. ... In psychology, the Thurstone scale was the first formal technique for measuring an attitude. ...

Prior to introducing the measurement model he is best known for, Rasch had applied the Poisson distribution to reading data as a measurement model, hypothesizing that in the relevant empirical context, the number of errors made by a given individual was governed by the ratio of the text difficulty to the person's reading ability. Rasch referred to this model as the multiplicative Poisson model. Rasch's model for dichotomous data - i.e. where responses are classifiable into two categories - is his most widely known and used model, and is the main focus here. This model has the form of a simple logistic function. In probability theory and statistics, the Poisson distribution is a discrete probability distribution. ... Logistic curve, specifically the sigmoid function A logistic function or logistic curve models the S-curve of growth of some set P. The initial stage of growth is approximately exponential; then, as competition arises, the growth slows, and at maturity, growth stops. ...

The brief outline above highlights certain distinctive and interrelated features of Rasch's perspective on social measurement, which are as follows:

1. He was concerned principally with the measurement of individuals, rather than with distributions among populations.
2. He was concerned with establishing a basis for meeting a priori requirements for measurement deduced from physics and, consequently, did not invoke any assumptions about the distribution of levels of a trait in a population.
3. Rasch's approach explicitly recognizes that it is a scientific hypothesis that a given trait is both quantitative and measurable, as operationalized in a particular experimental context.

Thus, congruent with the perspective articulated by Thomas Kuhn in his 1961 paper The function of measurement in modern physical science, measurement was regarded both as being founded in theory, and as being instrumental to detecting quantitative anomalies incongruent with hypotheses related to a broader theoretical framework. This perspective is in contrast to that generally prevailing in the social sciences, in which data such as test scores are directly treated as measurements without requiring a theoretical foundation for measurement. Although this contrast exists, Rasch's perspective is actually complementary to the use of statistical analysis or modelling that requires interval-level measurements, because the purpose of applying the Rasch model is to obtain such measurements. Applications of the Rasch model are described in Sivakumar, Durtis & Hungi (2005). Thomas Samuel Kuhn (July 18, 1922 – June 17, 1996) was an American intellectual who wrote extensively on the history of science and developed several important notions in the philosophy of science. ... The word theory has a number of distinct meanings in different fields of knowledge, depending on their methodologies and the context of discussion. ...

Invariant comparison and sufficiency

The Rasch model for dichotomous data is often regarded as an item response theory (IRT) model with one item parameter. However, rather than being a particular IRT model, proponents of the model regard it as a model that possesses a property which distinguishes it from IRT models. Specifically, the defining property of Rasch models is their formal or mathematical embodiment of the principle of invariant comparison. Rasch summarised the principle of invariant comparison as follows: Item response theory (IRT) is a body of related psychometric theory that provides a foundation for scaling persons and items based on responses to assessment items. ... A comparison is an evaluation of similarities and differences - described by Gregory Bateson in his book Mind and Nature as the two quanta of experience. ...

The comparison between two stimuli should be independent of which particular individuals were instrumental for the comparison; and it should also be independent of which other stimuli within the considered class were or might also have been compared.

Symmetrically, a comparison between two individuals should be independent of which particular stimuli within the class considered were instrumental for the comparison; and it should also be independent of which other individuals were also compared, on the same or some other occasion (Rasch, 1961, p. 332).

Rasch models embody this principle due to the fact that their formal structure permits algebraic separation of the person and item parameters, in the sense that the person parameter can be eliminated during the process of statistical estimation of item parameters. This result is achieved through the use of conditional maximum likelihood estimation, in which the response space is partitioned according to person total scores. The consequence is that the raw score for an item or person is the sufficient statistic for the item or person parameter. That is to say, the person total score contains all information available within the specified context about the individual, and the item total score contains all information with respect to item, with regard to the relevant latent trait. The Rasch model requires a specific structure in the response data, namely a probabilistic Guttman structure. There are many different ways of discussing statistical estimation. ... Maximum likelihood estimation (MLE) is a popular statistical method used to make inferences about parameters of the underlying probability distribution from a given data set. ... In statistics, one often considers a family of probability distributions for a random variable X (and X is often a vector whose components are scalar-valued random variables, frequently independent) parameterized by a scalar- or vector-valued parameter, which let us call θ. A quantity T(X) that depends on... The factual accuracy of this article is disputed. ... This article is in need of attention from an expert on the subject. ...

In somewhat more familiar terms, Rasch models provide a basis and justification for obtaining person locations on a continuum from total scores on assessments. Although it is not uncommon to treat total scores directly as measurements, they are actually counts of discrete observations rather than measurements. Each observation represents the observable outcome of a comparison between a person and item. Such outcomes are directly analogous to the observation of the rotation of a balance scale in one direction or another. This observation would indicate that one or other object has a greater mass, but counts of such observations cannot be treated directly as measurements. Observation basically means watching something and taking note of anything it does. ... A comparison is an evaluation of similarities and differences - described by Gregory Bateson in his book Mind and Nature as the two quanta of experience. ...

Rasch pointed out that the principle of invariant comparison is characteristic of measurement in physics using, by way of example, a two-way experimental frame of reference in which each instrument exerts a mechanical force upon solid bodies to produce acceleration. Rasch (1960/1980, pp. 112-3) stated of this context: "Generally: If for any two objects we find a certain ratio of their accelerations produced by one instrument, then the same ratio will be found for any other of the instruments". It is readily shown that Newton's second law entails that such ratios are directly proportional to the ratios of the masses of the bodies. Mechanics (Greek ) is the branch of physics concerned with the behaviour of physical bodies when subjected to forces or displacements, and the subsequent effect of the bodies on their environment. ... In physics, force is an influence that may cause a body to accelerate. ... Acceleration is the time rate of change of velocity, and at any point on a velocity-time graph, it is given by the slope of the tangent to that point In physics or physical science, acceleration (symbol: a) is defined as the rate of change (or derivative with respect to... Newtons laws of motion are the three scientific laws which Isaac Newton discovered concerning the behaviour of moving bodies. ... Masses may refer to: Mass (music) Mass Mass (liturgy) This is a disambiguation page — a navigational aid which lists other pages that might otherwise share the same title. ...

The mathematical form of the Rasch model for dichotomous data

Let be a dichotomous random variable where, for example, x = 1 denotes a correct response and x = 0 an incorrect response to a given assessment item. In the Rasch model for dichotomous data, the probability of the outcome X_ni = 1 is given by:

where β_n is the ability of person n and δ_i is the difficulty of item i. Thus, in the case of a dichotomous attainment item, is the probability of success upon interaction between the relevant person and assessment item. It is readily shown that the log odds, or logit, of correct response by a person to an item, based on the model, is equal to β_n − δ_i. It can be shown that the log odds of a correct response by a person to one item, conditional on a correct response to one of two items, is equal to the difference between the item locations. For example, In mathematics, especially as applied in statistics, the logit (pronounced with a long o and a soft g, IPA ) of a number p between 0 and 1 is This function is used in logistic regression. ...

where r_n is the total score of person n over the two items, which implies a correct response to one or other of the items. Hence, the conditional log odds does not involve the person parameter β_n, which can therefore be eliminated by conditioning on the total score r_n = 1. That is, by partitioning the responses according to raw scores and calculating the log odds of a correct response, an estimate δ₂ − δ₁ is obtained without involvement of β_n. More generally, a number of item parameters can be estimated iteratively through application of a process such as Conditional Maximum Likelihood estimation (see Rasch model estimation). While more involved, the same fundamental principle applies in such estimations. Various techniques are employed in order to estimate parameters of the Rasch model from matrices of response data. ...

Figure 3: ICC for the Rasch model showing the comparison between observed and expected proportions correct for five Class Intervals of persons

The form of the Rasch model for dichotomous data can be seen in Figure 3. The grey line maps person location on the latent continuum to the probability of the discrete outcome X_ni = 1 for an item with a location of approximately 0.2 on the latent continuum. The location of an item is, by definition, that location at which the probability that X_ni = 1 is equal to 0.5. The black circles represent the actual or observed proportions of persons within Class Intervals for which the outcome was observed. For example, in the case of an assessment item used in the context of educational psychology, these could represent the proportions of persons who answered the item correctly. Persons are ordered by the estimates of their locations on the latent continuum and classified into Class Intervals on this basis in order to graphically inspect the accordance of observations with the model. In Figure 1, there is a close conformity of the data with the model. In addition to graphical inspection of data, a range of statistical tests of fit are used to evaluate whether departures of observations from the model can be attributed to random effects alone, as required, or whether there are systematic departures from the model. Image File history File links Item Characteristic Curve (ICC) for the dichotomous Rasch model showing a comparison between observed and expected proportions for five Class Intervals of persons. ... Image File history File links Item Characteristic Curve (ICC) for the dichotomous Rasch model showing a comparison between observed and expected proportions for five Class Intervals of persons. ... Educational psychology is the study of how humans learn in educational settings, the effectiveness of educational interventions, the psychology of teaching, and the social psychology of schools as organizations. ... For Wikipedia statistics, see m:Statistics Statistics is the science and practice of developing human knowledge through the use of empirical data expressed in quantitative form. ... Random redirects here. ...

The polytomous form of the Rasch model

Main article: Polytomous Rasch model

The polytomous Rasch model, which is a generalisation of the dichotomous model, can be applied in contexts in which successive integer scores represent categories of increasing level or magnitude of a latent trait, such as increasing ability, motor function, endorsement of a statement, and so forth. The Polytomous response model is, for example, applicable to the use of Likert scales, grading in educational assessment, and scoring of performances by judges. The polytomous Rasch model is a measurement model that has potential application in any context in which the objective is to measure a trait or ability through a process in which responses to items are scored with successive integers. ... In science, a magnitude is the numerical size of something: see orders of magnitude. ...

Other considerations

A criticism of the Rasch model is that it is overly restrictive or prescriptive because it does not permit each item to have a different discrimination and because there is no provision in the model for guessing (that is, the left asymptote always approaches a zero probability). These variations are available in models such as the two and three parameter logistic models (Birnbaum, 1968). However, the specification of uniform discrimination and zero left asymptote are necessary properties of the model in order to sustain sufficiency of the simple, unweighted raw score.

The sufficient statistic in the two-parameter logistic model of item response theory (2PL-IRT; Lord & Novick, 1968) is a weighted raw score, where the weights are given by model parameters, often referred to as discrimination parameters. If the weights are predetermined and fixed, a model with a parameter free sufficient statistic that still allows conditional inferences, the OPLM (Verhelst, Glas & Verstralen, 1995; Verhelst & Glas, 1995) results. Item response theory (IRT) is a body of related psychometric theory that provides a foundation for scaling persons and items based on responses to assessment items. ...

The Rasch model for dichotomous data inherently entails a single discrimination parameter common to all items which, as noted by Rasch (1960/1980, p. 121), constitutes an arbitrary choice of the unit in terms of which magnitudes of the latent trait are expressed or estimated. However, the Rasch model requires that the discrimination is uniform across interactions between persons and items within a specified frame of reference (i.e. experimental context). The former Weights and Measures office in Middlesex, England. ... Generally, an interaction is a kind of action which occurs as two or more objects have an effect upon one another. ...

References

• Andersen, E.B. (1977). Sufficient statistics and latent trait models, Psychometrika, 42, 69-81.

• Andrich, D. (1978a). A rating formulation for ordered response categories. Psychometrika, 43, 357-74.

• Andrich, D. (1978b). Relationships between the Thurstone and Rasch approaches to item scaling. Applied Psychological Measurement, 2, 449-460.

• Andrich, D. (1988). Rasch models for measurement. Beverly Hills: Sage Publications.

• Andrich, D. (2004). Controversy and the Rasch model: a characteristic of incompatible paradigms? Medical Care, 42, 1-16.

• Baker, F. The Basics of Item Response Theory. ERIC Clearinghouse on Assessment and Evaluation, University of Maryland, College Park, MD. (2001) avaialble free with software inluded form IRT at Edres.org

• Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In Lord, F.M. & Novick, M.R. (Eds.), Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

• Bond, T.G. & Fox, C.M. (2001). Applying the Rasch Model: Fundamental measurement in the human sciences. Lawrence Erlbaum.

• Fischer, G.H. & Molenaar, I.W. (1995). Rasch models: foundations, recent developments and applications. New York: Springer-Verlag.

• Hambleton RK, Jones RW. Comparison of classical test theory and item response Educational Measurement: Issues and Practice. 1993; 12(3):38-47. avaialble in the ITEMS Series from the National Council on Measurement in Education

• Harris D. Comparison of 1-, 2-, and 3-parameter IRT models. Educational Measurement: Issues and Practice;. 1989; 8: 35-41 avaialble in the ITEMS Series from the National Council on Measurement in Education

• Kuhn, T.S. (1961). The function of measurement in modern physical science. ISIS, 52, 161-193. JSTOR

• Rasch, G. (1960/1980). Probabilistic models for some intelligence and attainment tests. (Copenhagen, Danish Institute for Educational Research), expanded edition (1980) with foreword and afterword by B.D. Wright. Chicago: The University of Chicago Press.

• Rasch, G. (1961). On general laws and the meaning of measurement in psychology, pp. 321-334 in Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, IV. Berkeley: University of Chicago Press, 1980.

• Sivakumar Alagumalai, David D Durtis, & Njora Hungi (2005). Applied Rasch Measurement: A book of exemplars. Springer-Kluwer.

• Verhelst, N.D. and Glas, C.A.W. (1995). The one parameter logistic model. In G.H. Fischer and

I.W. Molenaar (Eds.), Rasch Models: Foundations, recent developments, and applications (pp. 215-238). New York: Springer Verlag.

• Verhelst, N.D., Glas, C.A.W. and Verstralen, H.H.F.M. (1995). One parameter logistic model

(OPLM). Arnhem: CITO.

• von Davier, M., & Carstensen, C. H. (2007). Multivariate and Mixture Distribution Rasch Models: Extensions and Applications. New York: Springer.

• Wright, B.D., & Stone, M.H. (1979). Best Test Design. Chicago, IL: MESA Press.

External links

• Institute for Objective Measurement
• The Standards for Educational and Psychological Testing
• Item Response Theory form EdRes.org
• IRT Modeling Lab at U. Illinois Urbana Champ.
• National Council on Measurement in Education (NCME)
• Berkeley Evaluation & Assessment Research Center