Objectives: The role of leisure-time physical activity in reducing all-cause and cardiovascular mortality is well explored. The knowledge on occupational and commuting physical activity continues to be ambiguous and misleading. The aim of the study is to assess the influence of different kinds of physical activity on cardiovascular mortality risk in men. Material and Methods: Data analysis on physical activity level and other selected cardiovascular risk factors acquired from 3577 men in the age between 50–80 years who participated in the National Multicenter Health Survey WOBASZ (Wieloośrodkowe Ogólnopolskie Badanie Stanu Zdrowia), Poland (2003–2005) was linked with male mortality in 2004–2009. Data about causes of deaths were obtained from the Central Statistical Office and the Population Electronic Register. Results: Among males aged 50–59 years, the strongest risk factor was living in large settlements and provincial capitals as a place of residence and the most protective factor was occupational physical activity. In the age group 60–69 years and 70–80 years, the strongest protective effect was observed for leisure-time physical activity. In men aged between 70–80 years (unlike in the 50–59 years age group), the protective effect of large settlements and provincial capitals as a place of residence was noted. Conclusions: Occupational physical activity significantly reduced cardiovascular mortality in men aged 50–69 years, while for leisure-time activity the positive effect was observed in age group 60–69 years and 70–80 years. On the other hand, for the inhabitants of large settlements and provincial capitals, significantly higher risk of cardiovascular mortality in the age group 50–69 years and lower risk in the age group ≥ 70 years was noted, both in comparison with smaller places of residence.