The invention relates to a high voltage device for providing electrical insulation of a conductor extending through the device. The device includes a hollow insulator; a conductor extending through the hollow insulator; a field gradient decreasing arrangement including a condenser core and a voltage grading shield. The condenser core and the voltage grading shield are arranged around the conductor inside the hollow insulator in a manner so that the voltage grading shield is arranged around at least part of the condenser core.