Take your leave; survey shows nearly half are scared to