公开(公告)号：US09772923B2

公开(公告)日：2017-09-26

申请号：US13830946

申请日：2013-03-14

申请人： SOASTA, Inc.

发明人： Philip Santosh Tellis ,  Vernon Archie Brewer, III

IPC分类号： G06F15/16 ,  G06F11/34 ,  H04L12/24 ,  G06F11/30 ,  G06F11/32

CPC分类号： G06F11/3419 ,  G06F11/3082 ,  G06F11/32 ,  G06F11/3438 ,  G06F11/3452 ,  G06F11/3495 ,  G06F2201/875 ,  G06F2201/88 ,  H04L41/5009 ,  H04L41/5083

摘要： A method for real-time capture and analysis of website performance metrics includes receiving, in each of a plurality of result servers, data values transmitted from a plurality of client devices, each data value representing a measurement of a performance metric associated with an experience of a user on a web page or using a web application, the measurement being made and the data value produced being transmitted in real-time while the user is on the web page or using the web application. For each data value received, a count in one of a set of N data buckets defined in a memory is incremented. All of the counts in each of the corresponding data buckets is aggregated to produce a histogram of the performance metric is rendered on an analytic dashboard.

公开(公告)号：US09720569B2

公开(公告)日：2017-08-01

申请号：US14534346

申请日：2014-11-06

申请人： SOASTA, Inc.

发明人： Kenneth C. Gardner ,  Tal Broda ,  Tana C. Jackson ,  Matthew Solnit ,  Mukul Sharma ,  Ben Bubenheim ,  Kendall Cosby

IPC分类号： G06F3/048 ,  G06F3/0482 ,  H04W4/00 ,  G06F3/0488

CPC分类号： G06F3/0482 ,  G06F3/0488 ,  G06Q30/0201 ,  H04W4/50 ,  H04W4/60

摘要： A method for real-time capture of analytics from real users of a native mobile application (app) includes storing a custom metric/timer definition for a native mobile application (app) in a configuration file on a server. The custom metric/timer definition includes one or more identifiers of an element or object of the native mobile app selected by touch gesture input via a user interface on a mobile device running the native mobile app in a special mode. The configuration file is downloaded from the server to real users running the native mobile app on associated mobile devices. Immediately thereafter, one or more collector servers receive data beaconed in real-time from the associated mobile devices of the real users. The beaconed data includes custom metric/timer data obtained from the custom metric/timer definition.

公开(公告)号：US20160147632A1

公开(公告)日：2016-05-26

申请号：US15012839

申请日：2016-02-01

申请人： Charles A. Vazac ,  Tal Broda ,  Michael Hemmert ,  Mukul Sharma

发明人： Charles A. Vazac ,  Tal Broda ,  Michael Hemmert ,  Mukul Sharma

IPC分类号： G06F11/34 ,  H04L29/08 ,  G06F17/18

CPC分类号： G06F11/3495 ,  G06F11/3409 ,  G06F11/3414 ,  G06F11/3419 ,  G06F11/3466 ,  G06F17/18 ,  G06F2201/875 ,  H04L67/02

摘要： A method for real-time analysis of results from a load test performed on a target website includes calculating first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are calculated from data points received by each of the load server instances from the target website. The first-level aggregated test results include a sum of the data points, a count of the number of the data points, a sum of squares of the data points, and an average of the data points. A standard deviation result (STDEV) is calculated and chart is generated on a display via a graphical user interface. The chart provides a visual representation of a performance metric for the load test based on the standard deviation result.

摘要翻译： 用于对在目标网站上执行的负载测试的结果进行实时分析的方法包括计算在目标网站上产生负载的多个负载服务器实例中的每一个中的第一级聚合测试结果。 第一级聚合测试结果是从目标网站的每个加载服务器实例接收的数据点计算出来的。 第一级聚合测试结果包括数据点的总和，数据点的数量的计数，数据点的平方和和数据点的平均值。 计算标准偏差结果（STDEV），并通过图形用户界面在显示器上生成图表。 该图表提供了基于标准偏差结果的负载测试的性能指标的可视化表示。

公开(公告)号：US09229842B2

公开(公告)日：2016-01-05

申请号：US13492249

申请日：2012-06-08

申请人： Tal Broda ,  Darrell Esau ,  Michael Hemmert

发明人： Tal Broda ,  Darrell Esau ,  Michael Hemmert

IPC分类号： G06F17/00 ,  G06F11/34

CPC分类号： H04L43/045 ,  G06F3/0481 ,  G06F3/0484 ,  G06F11/3414 ,  G06F11/3428 ,  G06F11/3495 ,  G06F2201/875 ,  G06T11/206 ,  H04L41/22 ,  H04L61/1511 ,  H04L69/16

摘要： A processor-implemented method includes providing an analytic dashboard with a graphical user interface (GUI) that outputs aggregated results streaming in real-time of a load test performed on a target website. The load test consists of a plurality of virtual users simulated by one or more load servers that execute a test composition on one or more webpages of the website. A waterfall chart is produced on the analytic dashboard that includes a plurality of timeline bars. Each of the timeline bars represents an aggregated result for a resource of the one or more webpages across all of the virtual users. The timeline bars change in real-time as the load test progresses.

摘要翻译： 处理器实现的方法包括向分析仪表板提供图形用户界面（GUI），其在目标网站上执行的负载测试的实时输出聚合结果流。 负载测试由在一个或多个网站上执行测试组合的一个或多个负载服务器模拟的多个虚拟用户组成。 在包括多个时间轴条的分析仪表板上产生瀑布图。 每个时间轴条表示跨所有虚拟用户的一个或多个网页的资源的聚合结果。 负载测试进行时，时间线条会实时更改。

公开(公告)号：US20150222494A1

公开(公告)日：2015-08-06

申请号：US14172045

申请日：2014-02-04

申请人： SOASTA, Inc.

发明人： Tal Broda ,  Ed Salazar ,  Craig R. Powers ,  Kenneth C. Gardner ,  Daniel J. Bartow ,  Kendall Cosby ,  Ben Bubenheim

IPC分类号： H04L12/24 ,  G06F3/0484

CPC分类号： H04L41/22 ,  H04L43/50

摘要： A method includes providing a graphical user interface (GUI) that allows a user to dynamically change virtual user (VU) distributions of a load test performed on a target website or web application during test run-time. The GUI allowing the user to make a change to a current ramp profile of one or more VU distributions responsive to application of first user input. The first input including dragging an icon to a position in a first graph, the position denoting a future number of VUs at a future time. Following application of the first input, the change to the current ramp profile is visually displayed on a second graph in real-time as the load test progresses.

摘要翻译： 一种方法包括提供图形用户界面（GUI），其允许用户在测试运行时期间动态地改变在目标网站或web应用上执行的负载测试的虚拟用户（VU）分布。 GUI允许用户响应于应用第一用户输入而改变一个或多个VU分发的当前斜坡分布。 第一个输入包括将图标拖动到第一个图形中的位置，该位置表示将来的未来数量的VU。 在施加第一输入之后，当负载测试进行时，当前斜坡曲线的变化被实时地视觉显示在第二图上。

公开(公告)号：US08306195B2

公开(公告)日：2012-11-06

申请号：US12927426

申请日：2010-11-15

申请人： Kenneth C. Gardner ,  Craig R. Powers ,  Robert Charles Holcomb ,  Kendall J. Cosby ,  Tana Christine Jackson ,  Charles A. Vazac ,  Matthew Solnit ,  Michael Hemmert

发明人： Kenneth C. Gardner ,  Craig R. Powers ,  Robert Charles Holcomb ,  Kendall J. Cosby ,  Tana Christine Jackson ,  Charles A. Vazac ,  Matthew Solnit ,  Michael Hemmert

IPC分类号： H04M1/64 ,  G06F3/01 ,  G06Q30/00

CPC分类号： H04L41/0253 ,  G06F8/34 ,  G06F11/3414 ,  G06F11/3495 ,  G06F11/3664 ,  G06F11/3684 ,  G06F11/3688 ,  H04L41/22 ,  H04L43/50

摘要： In one embodiment, a graphical user interface (“GUI”) enables the efficient composition and execution of a test of a message-based application, Web application, or SOA systems' capacity to receive, process and respond to message traffic. The GUI may be used to generate a test composition by dragging and dropping message clips onto one or more tracks. Each clip includes one or more message, with each track being organized into one or more bands. Each track and each band may run contemporaneously to send messages to a target device or application. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure.

摘要翻译： 在一个实施例中，图形用户界面（GUI）能够有效地组合和执行基于消息的应用程序，Web应用程序或SOA系统接收，处理和响应消息流量的能力的测试。 GUI可以用于通过将消息剪辑拖放到一个或多个轨道上来生成测试组合。 每个剪辑包括一个或多个消息，每个轨道被组织成一个或多个频带。 每个轨道和每个频段可以同时运行，以将消息发送到目标设备或应用程序。 要强调的是，该摘要被提供以符合要求抽象的规则，允许搜索者或其他读者快速确定技术公开的主题。

公开(公告)号：US09450834B2

公开(公告)日：2016-09-20

申请号：US14043791

申请日：2013-10-01

申请人： SOASTA, Inc.

发明人： Kenneth C. Gardner ,  Cliff Crocker ,  Daniel J. Bartow ,  Darrell Esau ,  Tal Broda ,  Michael Hemmert ,  Wilson Stockman ,  Kendall Cosby

IPC分类号： G06F17/22 ,  H04L12/24 ,  G06F11/34 ,  G06F3/0481 ,  G06F11/32 ,  H04L12/26

CPC分类号： H04L41/22 ,  G06F3/04815 ,  G06F3/04845 ,  G06F11/323 ,  G06F11/3409 ,  G06F11/3495 ,  G06F2201/875 ,  G06T13/20 ,  H04L41/5038 ,  H04L43/045 ,  H04L43/06 ,  H04L43/12 ,  H04L43/50 ,  H04L67/02 ,  H04L67/22

摘要： A method includes providing a graphical user interface (GUI) that displays a view of the globe as from outer space. The view including a geographic distribution of beacons having one or more visual attributes. Each beacon corresponds to one or more real users who are accessing a website, web application or mobile app from a geographic location. The visual attributes include an indicator of a performance metric representative of an experience of the one or more real users of the website, web application, or mobile app. Each beacon is generated in real-time from aggregated data obtained in real-time from one or more corresponding real user sessions on the website, web application or mobile app. The beacons are periodically refreshed with the visual attributes changing in response to measured changes in the geographic distribution, a total number of real users at the location, or the performance indicator at the location.

摘要翻译： 一种方法包括提供从外部空间显示地球视图的图形用户界面（GUI）。 视图包括具有一个或多个视觉属性的信标的地理分布。 每个信标对应于正在从地理位置访问网站，网络应用或移动应用的一个或多个真实用户。 视觉属性包括代表网站，网络应用或移动应用的一个或多个真实用户的体验的性能指标的指标。 每个信标是从网站，网络应用程序或移动应用程序上的一个或多个相应的真实用户会话实时获得的聚合数据实时生成的。 随着视觉属性响应于地理分布中的测量变化，位置处的真实用户总数或位置处的性能指标而变化，信标被周期性刷新。

公开(公告)号：US09436579B2

公开(公告)日：2016-09-06

申请号：US12804338

申请日：2010-07-19

申请人： Tal Broda ,  Michael Hemmert ,  Matthew Solnit

发明人： Tal Broda ,  Michael Hemmert ,  Matthew Solnit

IPC分类号： G06F11/34

CPC分类号： G06F11/3495 ,  G06F11/3409 ,  G06F11/3414 ,  G06F11/3419 ,  G06F2201/875

摘要： A method for real-time analysis of results from a load test performed on a target website includes periodically computing first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are computed from data received by each of the load server instances from the target website every first time interval. The first-level aggregated test results are then periodically sent from each of the load server instances to an associated one of a plurality of analytic server instances every second time interval. The first-level aggregated test results are aggregated by each of the analytic server instances to produce second-level aggregated test results, which test results may then further aggregated to produce third-level aggregated test results at a data storage instance in real-time.

摘要翻译： 用于对在目标网站上执行的负载测试的结果进行实时分析的方法包括在多个负载服务器实例中的每一个周期性地计算在目标网站上产生负载的一级聚合测试结果。 第一级聚合测试结果是根据每个加载服务器实例从目标网站每第一个时间间隔接收的数据计算的。 然后，每隔一段时间间隔，将一级聚合测试结果从每个负载服务器实例周期性地发送到多个分析服务器实例中相关的一个。 第一级聚合测试结果由每个分析服务器实例聚合以产生二级聚合测试结果，然后可以进一步聚合测试结果，以便在数据存储实例上实时生成第三级聚合测试结果。

公开(公告)号：US20140280880A1

公开(公告)日：2014-09-18

申请号：US13830946

申请日：2013-03-14

申请人： SOASTA, INC

发明人： Philip Santosh Tellis ,  Vernon Archie Brewer, III

IPC分类号： H04L12/26

CPC分类号： G06F11/3419 ,  G06F11/3082 ,  G06F11/32 ,  G06F11/3438 ,  G06F11/3452 ,  G06F11/3495 ,  G06F2201/875 ,  G06F2201/88 ,  H04L41/5009 ,  H04L41/5083

摘要： A method for real-time capture and analysis of website performance metrics includes receiving, in each of a plurality of result servers, data values transmitted from a plurality of client devices, each data value representing a measurement of a performance metric associated with an experience of a user on a web page or using a web application, the measurement being made and the data value produced being transmitted in real-time while the user is on the web page or using the web application. For each data value received, a count in one of a set of N data buckets defined in a memory is incremented. All of the counts in each of the corresponding data buckets is aggregated to produce a histogram of the performance metric is rendered on an analytic dashboard.

摘要翻译： 用于实时捕获和分析网站性能度量的方法包括：在多个结果服务器的每一个中，从多个客户端设备发送的数据值接收每个数据值，表示与经验相关联的性能度量的度量 网页上的用户或使用Web应用程序的用户，进行测量，并且在用户处于网页或使用网络应用程序时实时发送所产生的数据值。 对于接收到的每个数据值，在存储器中定义的一组N个数据桶中的一个中的计数增加。 对每个相应数据存储区中的所有计数进行聚合，以生成在分析仪表板上呈现性能指标的直方图。

公开(公告)号：US20130097307A1

公开(公告)日：2013-04-18

申请号：US13317440

申请日：2011-10-18

申请人： Charles A. Vazac ,  Tana Christine Jackson ,  Tal Broda ,  Kendall Cosby

发明人： Charles A. Vazac ,  Tana Christine Jackson ,  Tal Broda ,  Kendall Cosby

IPC分类号： G06F15/173

CPC分类号： G06F11/3433 ,  G06F11/3414 ,  G06F11/3476 ,  G06F2201/875 ,  H04L43/14 ,  H04L43/50

摘要： A computer-implemented method includes scanning a clip of messages that includes message requests and message responses arranged in a sequence. The scanning is performed based on one or more search parameters and produces a list of one or more name/value pairs. The clip is utilized to perform a load test on a target website. Each name/value pair has a corresponding value. For each name/value pair in the list a message request in the clip is identified where the corresponding value is first used. Then, looking backwards in the sequence from the message request where the corresponding value is first used, prior message responses are located where the corresponding value is found. An extraction point is specified in the clip for the corresponding value as a latest message response in the sequence where the corresponding value was returned from the target website. The corresponding value is then stored as a property.

摘要翻译： 计算机实现的方法包括扫描包括以序列排列的消息请求和消息响应的消息的剪辑。 基于一个或多个搜索参数执行扫描并产生一个或多个名称/值对的列表。 该剪辑用于在目标网站上执行负载测试。 每个名称/值对具有相应的值。 对于列表中的每个名称/值对，将标识剪辑中的消息请求，其中首先使用相应的值。 然后，从首先使用对应值的消息请求的顺序中向后看，先前的消息响应位于找到相应值的位置。 在相应值的剪辑中指定提取点作为从目标网站返回相应值的序列中的最新消息响应。 然后将相应的值作为属性存储。