公开(公告)号：US20240004625A1

公开(公告)日：2024-01-04

申请号：US17852926

申请日：2022-06-29

申请人： Microsoft Technology Licensing, LLC

发明人： Prerana Dharmesh GAMBHIR ,  Sharena Meena PARI-MONASCH ,  Yongchang DONG ,  Thanh Trung NGUYEN ,  Shmuel NAVON ,  Qiong ZHOU ,  Yiming SHI ,  Linh Phuong NGUYEN ,  Xiao LIANG ,  Christopher Robert HAYWORTH ,  Daniel Ming-Wei CHEUNG

IPC分类号： G06F8/60 ,  G06F8/71 ,  G06F11/34 ,  G06F8/77

CPC分类号： G06F8/60 ,  G06F8/71 ,  G06F11/3409 ,  G06F8/77 ,  G06F2201/865

摘要： Various embodiments of the present technology include an improved system for measuring the impacts of feature rollouts on machine utilization and service performance. More specifically, embodiments of the present technology include an exposure control system based on randomized machine assignments and a corresponding score card for comparing machine utilization metrics. In an embodiment, a computing apparatus identifies a new feature in a codebase, wherein the codebase has been updated with the new feature across multiple resources, enables the new feature for a target group of the multiple resources while keeping the new feature dormant for a control group of the multiple resources, collects performance information for the target group and the control group for a time period, and generates a visualization of one or more differences between the performance information for the target group and the performance information for the control group for the time period.