Vision-based Advanced Driver Assistance Systems has achieved rapid growth in recent years. Since vehicle field testing under various driving scenarios can be costly, tedious, unrepeatable, and often dangerous, simulation has thus become an effective means that reduces or partially replaces the conventional field testing in the early development stage. However, most of the commercial tools are lack of elaborate lens/sensor models for the vehicle mounted cameras. This paper presents the system-based camera modeling method integrated virtual environment for vision-based ADAS design, development and testing. We present how to simulate two types of cameras with virtual 3D models and graphic render: Pinhole camera and Fisheye camera. We also give out an application named Envelope based on pinhole camera model which refers to the coverage of Field-of-Views (FOVs) of one or more cameras projected to a specific plane. Some preliminary simulation results demonstrate the correctness and effectiveness of the system-based camera modeling method. In the future, other camera's effects could be simulated based on this modeling framework.