Audiovisual Detection of Expectation Violations in Disparate Home Automation Systems

    公开(公告)号:US20240069516A1

    公开(公告)日:2024-02-29

    申请号:US18240731

    申请日:2023-08-31

    IPC分类号: G05B19/042

    CPC分类号: G05B19/0428 G05B2219/2642

    摘要: The invention pertains to methods for monitoring the operational status of a home automation system through extrinsic visual and audible means. Initial training periods involve capturing image and audio data representative of nominal operation, which is then processed to identify operational indicators. Unsupervised machine learning models are trained with these indicators to construct a model of normalcy and identify expectation violations in the system's operational pattern. After meeting specific stopping criteria, real-time monitoring is initiated. When an expectation violation is detected, contrastive collages or sequences are generated comprising nominal and anomalous data. These are then transmitted to an end user, effectively conveying the context of the detected anomalies. Further features include providing deep links to smartphone applications for home automation configuration and the use of auditory scene analysis techniques. The invention provides a multi-modal approach to home automation monitoring, leveraging machine learning for robust anomaly detection.

    Audiovisual Detection of Expectation Violations in Disparate Home Automation Systems

    公开(公告)号:US20240071055A1

    公开(公告)日:2024-02-29

    申请号:US18461746

    申请日:2023-09-06

    IPC分类号: G05B19/042

    CPC分类号: G05B19/0428 G05B2219/2642

    摘要: The invention pertains to methods for monitoring the operational status of a home automation system through extrinsic visual and audible means. Initial training periods involve capturing image and audio data representative of nominal operation, which is then processed to identify operational indicators. Unsupervised machine learning models are trained with these indicators to construct a model of normalcy and identify expectation violations in the system's operational pattern. After meeting specific stopping criteria, real-time monitoring is initiated. When an expectation violation is detected, contrastive collages or sequences are generated comprising nominal and anomalous data. These are then transmitted to an end user, effectively conveying the context of the detected anomalies. Further features include providing deep links to smartphone applications for home automation configuration and the use of auditory scene analysis techniques. The invention provides a multi-modal approach to home automation monitoring, leveraging machine learning for robust anomaly detection.