rcrtan

rcrtan provides functions for criterion-referenced test analyses as described in Brown & Hudson (2002). Currently it supports the following item and test analyses:

• Item discrimination
  • Item facility (including IF for passing test takers and failing test takers)
  • B-index
  • Agreement index
  • Item Phi
• Test dependability
  • Subkoviak’s (1988) single administration kappa coefficient
  • Subkoviak’s (1988) single administration agreement coefficient
  • Brennan’s (1980) short-cut estimate of the generalizability coefficient for absolute decisions

Installation & Documentation

Get the development version from github:

install.packages('devtools')
devtools::install_github('gtlaflair/rcrtan')

Item analysis functions

This package contains six unique functions for calculating item statistics and one omnibus function for estimating all of the six unique functions. The formulas have been adapted from Brown and Hudson (2002).

• crt_iteman: omnibus function that estimates item facility, item facility for masters, item facility for non-masters, the B-index, the agreement statistic, and item phi.

• if_total: estimates the item facility values for the entire group of test takers.

• if_pass: estimates the item facility values for the test takers who scored above the cut-score (masters).

• if_fail: estimates the item facility values for the test takers who scored below the cut-score (non-masters).

• b_index: estimates the B-index values for each item. This is the difference in item facility for masters and non-masters.

• agree_stat: estimates the agreement statistic.

• item_phi: estimates item phi.

item_stats <- crt_iteman(data = brown_depend, items = 2:31, raw_cut_score = 21, scale = 'raw')

Test dependability functions

This package contains two functions for estimating test dependability. The formulas have been adapted from Brown and Hudson (2002).

• subkoviak: This function uses Subkoviak’s (1988) methods for estimating kappa and rho from a single test administration.

sub_estimate <- subkoviak(data = brown_depend, items = 2:31, raw_cut_score = 21, look_up = FALSE)

• short_phi: This function uses Brennan’s (1980) formula for a short-cut estimate of generalizability coefficients for absolute decisions.

phi_estimate <- short_phi(data = brown_depend, items  = 2:31)