Abstract: Focusing on the system design problem of Mars probe which is far away from the Earth and has the complex flight environment，the optimization function with comprehensive objective combined by coverage rate and ground sample distance was set up. Considering the orbit discipline，the payload discipline and the power discipline，the system-level and discipline-level optimization model of the Mars probe were established based on the cooperative optimization method，thus decomposing the complicated optimization problem into parallel cooperative optimization problems with multiple sub-disciplines. The adaptive dynamic penalty function is used to accelerate the convergence. The numeric results indicate that the collaborative optimization can be successfully applied in the system optimal design of Mars probe.