Is fragile a negative connotation

I'd say it's a negative. It can break easily, it's too delicate, and you'd have to be extra careful with it.