A gesture and location recognition system and method are provided. The system (100) includes a sensor device (110-n) that captures a data signal of a user (160) and detects a gesture input from the user (160) from the data signal, wherein a user location can be calculated based on a sensor location of the sensor device (110-n) in a building and the collected data signal of the user (160), a signalprocessing device (151) that generates a control signal based on the gesture input and the user location, and in-building equipment (152.1, 152.2) that receives the control signal from the signal processing device (151) and controls the in-building equipment based on the control signal.