The invention provides a method for implementing on off test by data acquisition, which comprises the following steps of: controlling on off operation of equipment to be tested; acquiring a display image and an equipment log of the equipment to be tested; analyzing and processing the display image and the equipment log, and judging whether the equipment to be tested has a fault; and if the fault happens, sending fault notification to a test person, and keeping a fault field. In addition, the invention also provides a device for implementing on off test by data acquisition, which comprises a data acquisition module, a control module, a data analysis and processing module and an automatic notification module. The method and the device can acquire the running data of the equipment to be tested in real time, analyze and judge the data, notify the test person in the first time if the on off fault happens, and can automatically keep the fault field when the fault happens so as to provide convenience for the test person to analyze the fault reason and save a large amount of test time and manpower resources in system test and problem debugging.