The development of rural tourism will promote the rural economy and affect the whole national economy. It will help breaking the two structure in urban and rural areas, make adjustment of rural industrial structure and optimizate tourism culture resources. The concept of this study is to analyze the tourist decision-making behavior based on the tourist's departure.In this paper, we conclude four indicators which affect the consumer decision making in rural tourism as price factor, market factors, safety factors and personal factors, and then we make empirical analysis by using factor analysis model.The result shows that food prices, accommodation prices, others recommend and local security level is the most important factor that will affect rural tourist decision-making.