Decadence- why does this have a negative definiton?

when sometimes it has a positive connotation- as in luxurious surroundings, or delicious, creative food for parties, or ultra beautifully, glamourous jewelery? i'm confused- is it both?