Yes! If it's matte on the outside and fleecy on the inside it's a sweatshirt, whereas if it's knitted it's a jumper. I think you can have a sweatshirt material cardigan - I have one in a novelty comic strip print that I bought in the mid oughts - but I wouldn't argue with someone saying that it was in fact a light jacket and a cardigan had to be knitted.

I used to have a style advice book that referred to any kind of jacket / cardigan / shrug as a 'topper' which I found rather off-putting.