In present paper, the process of joining aluminum alloy 6111T4 and steel HSLA340 sheets by self-piercing riveting (SPR) is studied. The rivet material properties were obtained by inverse modeling approach. Element erosion technique was adopted in the LS-DYNA/explicit analysis for the separation of upper sheet before the rivet penetrates into lower sheet. Maximum shear strain criterion was implemented for material failure after comparing several classic fracture criteria. LS-DYNA/implicit was used for springback analysis following the explicit riveting simulation. Large compressive residual stress was observed near frequent fatigue crack initiation sites, both around vicinity of middle inner wall of rivet shank and upper 6111T4 sheet.