-
公开(公告)号:US11003841B2
公开(公告)日:2021-05-11
申请号:US16830077
申请日:2020-03-25
Applicant: DROPBOX, INC.
Inventor: Nils Peter Welinder , Peter N. Belhumeur , Ying Xiong , Jongmin Baek , Simon Kozlov , Thomas Berg , David J. Kriegman
IPC: G06F40/166 , G06T7/194 , G06T11/00 , G06K9/00 , G06F16/93 , G06T5/00 , G06F40/106 , G06F40/123 , G06F40/197 , G06K9/46 , G06K9/78 , G06F3/0484 , G06K9/40 , G06K9/32 , G06T11/60 , G06F3/12 , G06F40/103 , G06F40/169 , G06F17/00
Abstract: The present disclosure is directed toward systems and methods that efficiently and effectively generate an enhanced document image of a displayed document in an image frame captured from a live image feed. For example, systems and methods described herein apply a document enhancement process to a displayed document in an image frame that result in an enhanced document image that is cropped, rectified, un-shadowed, and with dark text against a mostly white background. Additionally, systems and method described herein determine whether a stored digital content item includes a displayed document. In response to determining that a stored digital content item does include a displayed document, systems and methods described herein generate an enhanced document image of a displayed document included in the stored digital content item.
-
公开(公告)号:US20200226319A1
公开(公告)日:2020-07-16
申请号:US16830077
申请日:2020-03-25
Applicant: DROPBOX, INC.
Inventor: Nils Peter Welinder , Peter N. Belhumeur , Ying Xiong , Jongmin Baek , Simon Kozlov , Thomas Berg , David J. Kriegman
IPC: G06F40/166 , G06T7/194 , G06T11/00 , G06K9/00 , G06F16/93 , G06T5/00 , G06F40/106 , G06F40/123 , G06F40/197 , G06K9/46 , G06K9/78
Abstract: The present disclosure is directed toward systems and methods that efficiently and effectively generate an enhanced document image of a displayed document in an image frame captured from a live image feed. For example, systems and methods described herein apply a document enhancement process to a displayed document in an image frame that result in an enhanced document image that is cropped, rectified, un-shadowed, and with dark text against a mostly white background. Additionally, systems and method described herein determine whether a stored digital content item includes a displayed document. In response to determining that a stored digital content item does include a displayed document, systems and methods described herein generate an enhanced document image of a displayed document included in the stored digital content item.
-
公开(公告)号:US10290086B2
公开(公告)日:2019-05-14
申请号:US15722806
申请日:2017-10-02
Applicant: DROPBOX, INC.
Inventor: Jongmin Baek
Abstract: One or more embodiments of an image enhancement system enable a computing device to generate an enhanced digital image. In particular, a computing device can enhance a digital image including, for example, a photograph of a whiteboard, document, chalkboard, or other object having a uniform background. The computing device can determine modifications to apply to the digital image by minimizing an energy heuristic that both causes pixels of the digital image to change to a uniform color (e.g., white) and preserves gradients from the digital image. The computing device can further generate an enhanced digital image by applying the determined modifications to the digital image.
-
公开(公告)号:US20180025251A1
公开(公告)日:2018-01-25
申请号:US15658291
申请日:2017-07-24
Applicant: DROPBOX, INC.
Inventor: Nils Peter Welinder , Peter N. Belhumeur , Ying Xiong , Jongmin Baek , Simon Kozlov , Thomas Berg , David J. Kriegman
CPC classification number: G06F17/24 , G06F3/04842 , G06F16/93 , G06F17/212 , G06F17/2205 , G06F17/2288 , G06K9/00442 , G06K9/00456 , G06K9/00463 , G06K9/00744 , G06K9/3208 , G06K9/40 , G06K9/4604 , G06K9/78 , G06T5/002 , G06T5/007 , G06T7/194 , G06T11/001 , G06T2207/20056 , G06T2207/20081 , G06T2207/20084 , G06T2207/30176 , G06T2210/22
Abstract: The present disclosure is directed toward systems and methods to quickly and accurately identify boundaries of a displayed document in a live camera image feed, and provide a document boundary indicator within the live camera image feed. For example, systems and methods described herein utilize different display document detection processes in parallel to generate and provide a document boundary indicator that accurately corresponds with a displayed document within a live camera image feed. Thus, a user of the mobile computing device can easily see whether the document identification system has correctly identified the displayed document within the camera viewfinder feed.
-
公开(公告)号:US12099566B2
公开(公告)日:2024-09-24
申请号:US16675671
申请日:2019-11-06
Applicant: Dropbox, Inc.
Inventor: Jongmin Baek , Jiarui Ding , Neeraj Kumar
IPC: G06N20/10 , G06F16/957 , G06F18/2413 , G06N3/047 , G06N3/08 , G06N7/01 , G06V10/764 , G06V10/82 , G06F16/178 , G06F16/2457
CPC classification number: G06F16/9577 , G06F18/24137 , G06N3/047 , G06N3/08 , G06N7/01 , G06N20/10 , G06V10/764 , G06V10/82 , G06F16/178 , G06F16/24573
Abstract: Techniques for learning and using content type embeddings. The content type embeddings have the useful property that a distance in an embedding space between two content type embeddings corresponds to a semantic similarity between the two content types represented by the two content type embeddings. The closer the distance in the space, the more the two content types are semantically similar. The farther the distance in the space, the less the two content types are semantically similar. The learned content type embeddings can be used in a content suggestion system as machine learning features to improve content suggestions to end-users.
-
公开(公告)号:US20240296388A1
公开(公告)日:2024-09-05
申请号:US18659482
申请日:2024-05-09
Applicant: Dropbox, Inc.
Inventor: Jongmin Baek
Abstract: Computer-implemented techniques encompass using distinct machine learning sub-models to score respective types of candidate content for the purpose of providing personalized content suggestions to end-users of a content management system. The relevancy scores generated by the distinct sub-models are mapped to expected end-user interaction scores of the candidate content scored. Content suggestions are provided at end-users' computing devices where the suggested content is selected from the candidate content based on the expected end-user interaction scores of the candidate content. For each distinct sub-model, a normalizing mapping function is solved using an optimizer that maps the relevancy scores generated by the sub-model for the candidate content to expected end-user interaction scores for the candidate content. The expected end-user interaction scores are comparable across the distinct sub-models and can be used to rank content suggestions across the distinct sub-models.
-
公开(公告)号:US11620438B2
公开(公告)日:2023-04-04
申请号:US17315027
申请日:2021-05-07
Applicant: DROPBOX, INC.
Inventor: Nils Peter Welinder , Peter N. Belhumeur , Ying Xiong , Jongmin Baek , Simon Kozlov , Thomas Berg , David J. Kriegman
IPC: G06F40/166 , G06T7/194 , G06T11/00 , G06F16/93 , G06T5/00 , G06F40/106 , G06F40/123 , G06F40/197 , G06V10/10 , G06V10/44 , G06V20/40 , G06V30/40 , G06V30/413 , G06V30/414 , G06F3/04842 , G06T11/60 , G06F3/12 , G06F40/103 , G06F40/169 , G06V10/30 , G06V10/24 , G06V30/418
Abstract: The present disclosure is directed toward systems and methods to quickly and accurately identify boundaries of a displayed document in a live camera image feed, and provide a document boundary indicator within the live camera image feed. For example, systems and methods described herein utilize different display document detection processes in parallel to generate and provide a document boundary indicator that accurately corresponds with a displayed document within a live camera image feed. Thus, a user of the mobile computing device can easily see whether the document identification system has correctly identified the displayed document within the camera viewfinder feed.
-
公开(公告)号:US11017159B2
公开(公告)日:2021-05-25
申请号:US16830047
申请日:2020-03-25
Applicant: DROPBOX, INC.
Inventor: Nils Peter Welinder , Peter N. Belhumeur , Ying Xiong , Jongmin Baek , Simon Kozlov , Thomas Berg , David J. Kriegman
IPC: G06F40/166 , G06T7/194 , G06T11/00 , G06K9/00 , G06F16/93 , G06T5/00 , G06F40/106 , G06F40/123 , G06F40/197 , G06K9/46 , G06K9/78 , G06F3/0484 , G06K9/40 , G06K9/32 , G06T11/60 , G06F3/12 , G06F40/103 , G06F40/169 , G06F17/00
Abstract: The present disclosure is directed toward systems and methods that efficiently and effectively generate an enhanced document image of a displayed document in an image frame captured from a live image feed. For example, systems and methods described herein apply a document enhancement process to a displayed document in an image frame that result in an enhanced document image that is cropped, rectified, un-shadowed, and with dark text against a mostly white background. Additionally, systems and method described herein determine whether a stored digital content item includes a displayed document. In response to determining that a stored digital content item does include a displayed document, systems and methods described herein generate an enhanced document image of a displayed document included in the stored digital content item.
-
公开(公告)号:US20210089963A1
公开(公告)日:2021-03-25
申请号:US16681599
申请日:2019-11-12
Applicant: Dropbox, Inc.
Inventor: Jongmin Baek
Abstract: Computer-implemented techniques encompass using distinct machine learning sub-models to score respective types of candidate content for the purpose of providing personalized content suggestions to end-users of a content management system. The relevancy scores generated by the distinct sub-models are mapped to expected end-user interaction scores of the candidate content scored. Content suggestions are provided at end-users' computing devices where the suggested content is selected from the candidate content based on the expected end-user interaction scores of the candidate content. For each distinct sub-model, a normalizing mapping function is solved using an optimizer that maps the relevancy scores generated by the sub-model for the candidate content to expected end-user interaction scores for the candidate content. The expected end-user interaction scores are comparable across the distinct sub-models and can be used to rank content suggestions across the distinct sub-models.
-
公开(公告)号:US20180122054A1
公开(公告)日:2018-05-03
申请号:US15722806
申请日:2017-10-02
Applicant: DROPBOX, INC.
Inventor: Jongmin Baek
CPC classification number: G06T5/005 , G06T1/0007 , G06T5/008 , G06T5/20 , G06T7/11 , G06T7/12 , G06T7/136 , G06T7/168 , G06T2207/10004 , G06T2207/10024 , G06T2207/20012 , G06T2207/20028 , G06T2207/20112
Abstract: One or more embodiments of an image enhancement system enable a computing device to generate an enhanced digital image. In particular, a computing device can enhance a digital image including, for example, a photograph of a whiteboard, document, chalkboard, or other object having a uniform background. The computing device can determine modifications to apply to the digital image by minimizing an energy heuristic that both causes pixels of the digital image to change to a uniform color (e.g., white) and preserves gradients from the digital image. The computing device can further generate an enhanced digital image by applying the determined modifications to the digital image.
-
-
-
-
-
-
-
-
-