Albatross

A burden that is psychological and sometimes might feel as if you are cursed because of that burden.