You’re not bad at layering, you’re just stopping too soon.
If you think layering is only about the upper body, try this:
Layer socks and gloves too - A base layer followed by a thermal layer and see the game changing!
Save this for your winter outfits and layer better.