Abstract: The subjective evaluation of vehicle dynamics performance is widely applied in different stages of vehicle development. However, the rating result has frequently been challenged because it is easily affected by various subjective and objective factors. Currently, there is no suitable index for determining evaluator’s consistency when performing a subjective evaluation of vehicle dynamics. This evaluation is quite unique, with limited samples, multiple indices, and poor repeatability, in addition to being stratified and two dimensional. The cross-grouped factor analysis (CFA) method is proposed to identify the scale for a subjective evaluation and to quantify its consistency. An application case study revealed that the proposed method is effective.