公开(公告)号：US08306195B2

公开(公告)日：2012-11-06

申请号：US12927426

申请日：2010-11-15

申请人： Kenneth C. Gardner ,  Craig R. Powers ,  Robert Charles Holcomb ,  Kendall J. Cosby ,  Tana Christine Jackson ,  Charles A. Vazac ,  Matthew Solnit ,  Michael Hemmert

发明人： Kenneth C. Gardner ,  Craig R. Powers ,  Robert Charles Holcomb ,  Kendall J. Cosby ,  Tana Christine Jackson ,  Charles A. Vazac ,  Matthew Solnit ,  Michael Hemmert

IPC分类号： H04M1/64 ,  G06F3/01 ,  G06Q30/00

CPC分类号： H04L41/0253 ,  G06F8/34 ,  G06F11/3414 ,  G06F11/3495 ,  G06F11/3664 ,  G06F11/3684 ,  G06F11/3688 ,  H04L41/22 ,  H04L43/50

摘要： In one embodiment, a graphical user interface (“GUI”) enables the efficient composition and execution of a test of a message-based application, Web application, or SOA systems' capacity to receive, process and respond to message traffic. The GUI may be used to generate a test composition by dragging and dropping message clips onto one or more tracks. Each clip includes one or more message, with each track being organized into one or more bands. Each track and each band may run contemporaneously to send messages to a target device or application. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure.

摘要翻译： 在一个实施例中，图形用户界面（GUI）能够有效地组合和执行基于消息的应用程序，Web应用程序或SOA系统接收，处理和响应消息流量的能力的测试。 GUI可以用于通过将消息剪辑拖放到一个或多个轨道上来生成测试组合。 每个剪辑包括一个或多个消息，每个轨道被组织成一个或多个频带。 每个轨道和每个频段可以同时运行，以将消息发送到目标设备或应用程序。 要强调的是，该摘要被提供以符合要求抽象的规则，允许搜索者或其他读者快速确定技术公开的主题。

公开(公告)号：US20110066892A1

公开(公告)日：2011-03-17

申请号：US12927426

申请日：2010-11-15

申请人： Kenneth C. Gardner ,  Craig R. Powers ,  Robert Charles Holcomb ,  Kendall J. Cosby ,  Tana Christine Jackson ,  Charles A. Vazac ,  Matthew Solnit ,  Michael Hemmert

发明人： Kenneth C. Gardner ,  Craig R. Powers ,  Robert Charles Holcomb ,  Kendall J. Cosby ,  Tana Christine Jackson ,  Charles A. Vazac ,  Matthew Solnit ,  Michael Hemmert

IPC分类号： G06F3/01 ,  G06F11/07

CPC分类号： H04L41/0253 ,  G06F8/34 ,  G06F11/3414 ,  G06F11/3495 ,  G06F11/3664 ,  G06F11/3684 ,  G06F11/3688 ,  H04L41/22 ,  H04L43/50

摘要： In one embodiment, a graphical user interface (“GUI”) enables the efficient composition and execution of a test of a message-based application, Web application, or SOA systems' capacity to receive, process and respond to message traffic. The GUI may be used to generate a test composition by dragging and dropping message clips onto one or more tracks. Each clip includes one or more message, with each track being organized into one or more bands. Each track and each band may run contemporaneously to send messages to a target device or application. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure.

摘要翻译： 在一个实施例中，图形用户界面（“GUI”）使得能够高效地组合和执行基于消息的应用程序，Web应用程序或SOA系统接收，处理和响应消息流量的能力。 GUI可以用于通过将消息剪辑拖放到一个或多个轨道上来生成测试组合。 每个剪辑包括一个或多个消息，每个轨道被组织成一个或多个频带。 每个轨道和每个频段可以同时运行，以将消息发送到目标设备或应用程序。 要强调的是，该摘要被提供以符合要求抽象的规则，允许搜索者或其他读者快速确定技术公开的主题。

公开(公告)号：US07844036B2

公开(公告)日：2010-11-30

申请号：US11503580

申请日：2006-08-14

申请人： Kenneth C. Gardner ,  Craig R. Powers ,  Robert Charles Holcomb ,  Kendall J. Cosby ,  Tana Christine Jackson ,  Charles A. Vazac ,  Matthew Solnit ,  Michael Hemmert

发明人： Kenneth C. Gardner ,  Craig R. Powers ,  Robert Charles Holcomb ,  Kendall J. Cosby ,  Tana Christine Jackson ,  Charles A. Vazac ,  Matthew Solnit ,  Michael Hemmert

IPC分类号： H04M1/64

CPC分类号： H04L41/0253 ,  G06F8/34 ,  G06F11/3414 ,  G06F11/3495 ,  G06F11/3664 ,  G06F11/3684 ,  G06F11/3688 ,  H04L41/22 ,  H04L43/50

摘要： In one embodiment, a graphical user interface (“GUI”) enables the efficient composition and execution of a test of a message-based application, Web application, or SOA systems' capacity to receive, process and respond to message traffic. The GUI may be used to generate a test composition by dragging and dropping message clips onto one or more tracks. Each clip includes one or more message, with each track being organized into one or more bands. Each track and each band may run contemporaneously to send messages to a target device or application. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure.

摘要翻译： 在一个实施例中，图形用户界面（“GUI”）使得能够高效地组合和执行基于消息的应用程序，Web应用程序或SOA系统接收，处理和响应消息流量的能力。 GUI可以用于通过将消息剪辑拖放到一个或多个轨道上来生成测试组合。 每个剪辑包括一个或多个消息，每个轨道被组织成一个或多个频带。 每个轨道和每个频段可以同时运行，以将消息发送到目标设备或应用程序。 要强调的是，该摘要被提供以符合要求抽象的规则，允许搜索者或其他读者快速确定技术公开内容的主题。

公开(公告)号：US20080066009A1

公开(公告)日：2008-03-13

申请号：US11503580

申请日：2006-08-14

申请人： Kenneth C. Gardner ,  Craig R. Powers ,  Robert Charles Holcomb ,  Kendall J. Cosby ,  Tana Christine Jackson ,  Charles A. Vazac ,  Matthew Solnit ,  Michael Hemmert

发明人： Kenneth C. Gardner ,  Craig R. Powers ,  Robert Charles Holcomb ,  Kendall J. Cosby ,  Tana Christine Jackson ,  Charles A. Vazac ,  Matthew Solnit ,  Michael Hemmert

IPC分类号： G06F3/048

CPC分类号： H04L41/0253 ,  G06F8/34 ,  G06F11/3414 ,  G06F11/3495 ,  G06F11/3664 ,  G06F11/3684 ,  G06F11/3688 ,  H04L41/22 ,  H04L43/50

摘要： In one embodiment, a graphical user interface (“GUI”) enables the efficient composition and execution of a test of a message-based application, Web application, or SOA systems' capacity to receive, process and respond to message traffic. The GUI may be used to generate a test composition by dragging and dropping message clips onto one or more tracks. Each clip includes one or more message, with each track being organized into one or more bands. Each track and each band may run contemporaneously to send messages to a target device or application. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure.

摘要翻译： 在一个实施例中，图形用户界面（“GUI”）使得能够高效地组合和执行基于消息的应用程序，Web应用程序或SOA系统接收，处理和响应消息流量的能力。 GUI可以用于通过将消息剪辑拖放到一个或多个轨道上来生成测试组合。 每个剪辑包括一个或多个消息，每个轨道被组织成一个或多个频带。 每个轨道和每个频段可以同时运行，以将消息发送到目标设备或应用程序。 要强调的是，该摘要被提供以符合要求抽象的规则，允许搜索者或其他读者快速确定技术公开内容的主题。

公开(公告)号：US20120017112A1

公开(公告)日：2012-01-19

申请号：US12804317

申请日：2010-07-19

申请人： Tal Broda ,  Matthew Solnit ,  Kenneth C. Gardner ,  Craig R. Powers ,  Michael Hemmert ,  Charles A. Vazac ,  Kendall Cosby

发明人： Tal Broda ,  Matthew Solnit ,  Kenneth C. Gardner ,  Craig R. Powers ,  Michael Hemmert ,  Charles A. Vazac ,  Kendall Cosby

IPC分类号： G06F11/20 ,  G06F15/177

CPC分类号： H04L67/32 ,  G06F9/5083 ,  G06F11/0793 ,  G06F11/3428 ,  G06F2201/875

摘要： An automated method for provisioning a grid used to run a load test on a target website includes sending one or more requests in a multi-threaded manner to at least one cloud provider, the one or more requests for an allocation of N load server instances and M result server instances which comprise the grid. Requests received back from the cloud provider are also handled in a multi-threaded manner; any errors occurring during the allocation being corrected automatically. The N load server instances and the M result server instances are then verified to be operational and correctly running software deployed to provide defined test services. Errors identified during the verification are automatically corrected either by attempting to restart a failed instance or allocating a different instance.

公开(公告)号：US20160147632A1

公开(公告)日：2016-05-26

申请号：US15012839

申请日：2016-02-01

申请人： Charles A. Vazac ,  Tal Broda ,  Michael Hemmert ,  Mukul Sharma

发明人： Charles A. Vazac ,  Tal Broda ,  Michael Hemmert ,  Mukul Sharma

IPC分类号： G06F11/34 ,  H04L29/08 ,  G06F17/18

CPC分类号： G06F11/3495 ,  G06F11/3409 ,  G06F11/3414 ,  G06F11/3419 ,  G06F11/3466 ,  G06F17/18 ,  G06F2201/875 ,  H04L67/02

摘要： A method for real-time analysis of results from a load test performed on a target website includes calculating first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are calculated from data points received by each of the load server instances from the target website. The first-level aggregated test results include a sum of the data points, a count of the number of the data points, a sum of squares of the data points, and an average of the data points. A standard deviation result (STDEV) is calculated and chart is generated on a display via a graphical user interface. The chart provides a visual representation of a performance metric for the load test based on the standard deviation result.

摘要翻译： 用于对在目标网站上执行的负载测试的结果进行实时分析的方法包括计算在目标网站上产生负载的多个负载服务器实例中的每一个中的第一级聚合测试结果。 第一级聚合测试结果是从目标网站的每个加载服务器实例接收的数据点计算出来的。 第一级聚合测试结果包括数据点的总和，数据点的数量的计数，数据点的平方和和数据点的平均值。 计算标准偏差结果（STDEV），并通过图形用户界面在显示器上生成图表。 该图表提供了基于标准偏差结果的负载测试的性能指标的可视化表示。

公开(公告)号：US09251035B1

公开(公告)日：2016-02-02

申请号：US13369899

申请日：2012-02-09

申请人： Charles A. Vazac ,  Tal Broda ,  Michael Hemmert ,  Mukul Sharma

发明人： Charles A. Vazac ,  Tal Broda ,  Michael Hemmert ,  Mukul Sharma

IPC分类号： G06F11/34

CPC分类号： G06F11/3495 ,  G06F11/3409 ,  G06F11/3414 ,  G06F11/3419 ,  G06F11/3466 ,  G06F17/18 ,  G06F2201/875 ,  H04L67/02

摘要： A method for real-time analysis of results from a load test performed on a target website includes calculating first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are calculated from data points received by each of the load server instances from the target website. The first-level aggregated test results include a sum of the data points, a count of the number of the data points, a sum of squares of the data points, and an average of the data points. A standard deviation result (STDEV) is calculated and chart is generated on a display via a graphical user interface. The chart provides a visual representation of a performance metric for the load test based on the standard deviation result.

摘要翻译： 用于对在目标网站上执行的负载测试的结果进行实时分析的方法包括计算在目标网站上产生负载的多个负载服务器实例中的每一个中的第一级聚合测试结果。 第一级聚合测试结果是从目标网站的每个加载服务器实例接收的数据点计算出来的。 第一级聚合测试结果包括数据点的总和，数据点的数量的计数，数据点的平方和和数据点的平均值。 计算标准偏差结果（STDEV），并通过图形用户界面在显示器上生成图表。 该图表提供了基于标准偏差结果的负载测试的性能指标的可视化表示。

公开(公告)号：US09436579B2

公开(公告)日：2016-09-06

申请号：US12804338

申请日：2010-07-19

申请人： Tal Broda ,  Michael Hemmert ,  Matthew Solnit

发明人： Tal Broda ,  Michael Hemmert ,  Matthew Solnit

IPC分类号： G06F11/34

CPC分类号： G06F11/3495 ,  G06F11/3409 ,  G06F11/3414 ,  G06F11/3419 ,  G06F2201/875

摘要： A method for real-time analysis of results from a load test performed on a target website includes periodically computing first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are computed from data received by each of the load server instances from the target website every first time interval. The first-level aggregated test results are then periodically sent from each of the load server instances to an associated one of a plurality of analytic server instances every second time interval. The first-level aggregated test results are aggregated by each of the analytic server instances to produce second-level aggregated test results, which test results may then further aggregated to produce third-level aggregated test results at a data storage instance in real-time.

摘要翻译： 用于对在目标网站上执行的负载测试的结果进行实时分析的方法包括在多个负载服务器实例中的每一个周期性地计算在目标网站上产生负载的一级聚合测试结果。 第一级聚合测试结果是根据每个加载服务器实例从目标网站每第一个时间间隔接收的数据计算的。 然后，每隔一段时间间隔，将一级聚合测试结果从每个负载服务器实例周期性地发送到多个分析服务器实例中相关的一个。 第一级聚合测试结果由每个分析服务器实例聚合以产生二级聚合测试结果，然后可以进一步聚合测试结果，以便在数据存储实例上实时生成第三级聚合测试结果。

公开(公告)号：US20120017156A1

公开(公告)日：2012-01-19

申请号：US12804338

申请日：2010-07-19

申请人： Tal Broda ,  Michael Hemmert ,  Matthew Solnit

发明人： Tal Broda ,  Michael Hemmert ,  Matthew Solnit

IPC分类号： G06F15/173 ,  G06F3/048

CPC分类号： G06F11/3495 ,  G06F11/3409 ,  G06F11/3414 ,  G06F11/3419 ,  G06F2201/875

摘要： A method for real-time analysis of results from a load test performed on a target website includes periodically computing first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are computed from data received by each of the load server instances from the target website every first time interval. The first-level aggregated test results are then periodically sent from each of the load server instances to an associated one of a plurality of analytic server instances every second time interval. The first-level aggregated test results are aggregated by each of the analytic server instances to produce second-level aggregated test results, which test results may then further aggregated to produce third-level aggregated test results at a data storage instance in real-time.

摘要翻译： 用于对在目标网站上执行的负载测试的结果进行实时分析的方法包括在多个负载服务器实例中的每一个周期性地计算在目标网站上产生负载的一级聚合测试结果。 第一级聚合测试结果是根据每个加载服务器实例从目标网站每第一个时间间隔接收的数据计算的。 然后，每隔一段时间间隔，将一级聚合测试结果从每个负载服务器实例周期性地发送到多个分析服务器实例中相关的一个。 第一级聚合测试结果由每个分析服务器实例聚合以产生二级聚合测试结果，然后可以进一步聚合测试结果，以便在数据存储实例上实时生成第三级聚合测试结果。

公开(公告)号：US10067850B2

公开(公告)日：2018-09-04

申请号：US15012839

申请日：2016-02-01

申请人： Charles A. Vazac ,  Tal Broda ,  Michael Hemmert ,  Mukul Sharma

发明人： Charles A. Vazac ,  Tal Broda ,  Michael Hemmert ,  Mukul Sharma

IPC分类号： G06F11/34 ,  G06F17/18 ,  H04L29/08

摘要： A method for real-time analysis of results from a load test performed on a target website includes calculating first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are calculated from data points received by each of the load server instances from the target website. The first-level aggregated test results include a sum of the data points, a count of the number of the data points, a sum of squares of the data points, and an average of the data points. A standard deviation result (STDEV) is calculated and chart is generated on a display via a graphical user interface. The chart provides a visual representation of a performance metric for the load test based on the standard deviation result.