Portfolio assessment of teaching practice has been used in many states as one indicator to inform licensure decisions, yet the human scoring process is costly for all stakeholders. This paper documents a series of investigations of alternative scoring procedures for a state pre-service teacher performance assessment. The proposed partial double scoring procedure identifies a critical score range for double human scoring, where a second scoring may affect test outcomes and also improve score reliability. The approach is straightforward and easy to communicate with stakeholders, yet technically sound and financially sustainable.