A system and method are disclosed for controlling presentations and videoconference using hand motions. A camera captures video of an area relative to content displayed on a display device from a content source. A control unit is communicatively coupled to the content source, the display device, and the camera. The control unit receives captured video from the camera. The control unit detects a hand motion by a presenter that occurs within the captured video and determines the location within the captured video of at least one control for controlling the presentation or videoconference. The control unit determines if the detected hand motion occurs within the determined location of the at least one control, and the control unit controls the content source based on the determined control.