A mobile device includes a position sensing unit, a remote control information obtainment unit, and a storage unit. Position information obtained by the position sensing unit is stored in the storage unit in association with remote control information. The mobile device further includes a directional space obtainment unit and an apparatus specification unit. The mobile device recognizes a direction pointed by a user using the mobile device, and enables operation of a terminal apparatus existing in the pointing direction.