A house 2 is isolated from the foundation 1 by a rolling bearing 3. A vibration control device 6 with a releasable rigid connector 5 is added in parallel to the rolling bearing 3. Further, a release controller 8 of the rigid connector 5 is connected to the output end of an earthquake detector 7 on the house 2, so as to release the rigid connector 5 in response to output signal from the earthquake detector 7. Thus, the building 2 normally stands without vibration against wind by rigid connection to the foundation 1 through the rigid connector 5. On the other hand, when earthquake occurs, the rigid connector 5 is released by the release controller 8 by the output from the earthquake detector 7, so as to control the vibration of the building 2 by a combination of the rolling bearing 3 and the vibration control device 6.