Abstract: Item replenishment is essential for item bank development and maintenance, where new items’ parameter calibration plays a significant role. Two core techniques of item replenishment under the circumstances of computerized adaptive testing (CAT) are: 1) online calibration design; 2) online calibration method. The former investigates the administration way of new items, while the later explores parameter estimation methods. This paper aims to clarify the development ideas and contexts of online calibration design and online calibration method. Additionally, their characteristics, relations and performance were illustrated and evaluated in details. At the end, several future research directions were pointed out. It is important to further study online calibration design based on different information indicators and online calibration methods based on joint estimations and error corrections. Moreover, future study could explore the online calibration technique in cognitive diagnostic CAT (CD-CAT) and multidimensional CAT (MCAT), as well as the empirical applications of item replenishment.

Key words: computerized adaptive testing, cognitive diagnostic theory, item replenishment, online calibration design, online calibration method