Oil pump is a critical part of engine lubrication system. The performance and efficiency of oil pump are greatly affected by vibration and noise, which would lead to the pump service life decreasing and pump body easily wearing. Hence the vibration and noise of oil pump is of great importance to study. In this paper, a FEA model of the variable displacement oil pump(VDOP) was established to carry on the modal and noise analysis, while the geometric structure was optimized with test verification. The modal analysis of VDOP was carried out by ABAQUS software, the 3-D unsteady flow field in VDOP was simulated by Pumplinx software, and the sound field was analyzed by ACTRAN acoustic module. Using a special oil pump test bench combined with B&K PULSE vibration and noise test equipment, the NVH and comprehensive performance experiment of the VDOP were carried out here. The final results show that, the major vibration deformation zone occurred at the inlet area closed to the gear meshing position. The large vibration mode can be eliminated by adding stiffener there. The vibration and noise level were improved by the geometric structure optimization. The vibration at starting point is heavier than that under normal conditions, while the vibration acceleration is larger in the high frequency range.