公开(公告)号：US20220156486A1

公开(公告)日：2022-05-19

申请号：US17098285

申请日：2020-11-13

Applicant: Microsoft Technology Licensing, LLC

Inventor： Tianyi CHEN ,  Gowtham GANESAN ,  Biyi FANG ,  Sheng YI

IPC: G06K9/00 ,  G06K9/72 ,  G06T7/10 ,  G06K9/62 ,  G06K9/46 ,  G06N3/04 ,  G06N3/08

Abstract: A data processing system for performing a semantic analysis of digital ink stroke data implements obtaining the digital ink stroke data representing handwritten text, drawings, or both; analyzing the digital ink stroke data to extract path signature feature information from the digital ink stroke data; analyzing the path signature feature information using a convolutional neural network (CNN) trained to perform a pixel-level sematic analysis of the digital ink stroke data and to output a pixel segmentation map with semantic prediction information for each pixel of digital ink stroke data; analyzing the pixel segmentation map to generate stroke-level semantic information using a pixel-to-stroke conversion model; and processing the digital ink stroke data based on the stroke-level semantic information.