An optical lens assembly and an optical system is provided. The optical lens assembly includes a first optical element including a partial reflector and a quarter-wave plate and a second optical element including a reflective polarizer. The first optical element and the second optical element form a cavity. The pancake lens assembly further includes a varifocal lens having an adjustable optical power, and the varifocal lens is disposed inside or outside the cavity.