Annotations-based generic load generator engine
    1.
    发明授权
    Annotations-based generic load generator engine 有权
    基于注释的通用负载发生器引擎

    公开(公告)号:US09558465B1

    公开(公告)日:2017-01-31

    申请号:US14133554

    申请日:2013-12-18

    摘要: A generic transaction generator framework for testing a network-based production service may work in conjunction with a product-specific transaction creator module that executes transactions on the service. The transaction creator module may include runtime-discoverable information to communicate product specific details to the framework. Runtime-discoverable information may identify initialization methods, terminate methods, transaction types, transaction methods, transaction dependencies as well as testing parameters, such as transaction rate, testing period and a desired distribution of transaction types. The framework may generate and execute various test transactions and collect performance metrics regarding how well the service performed the test transactions.

    摘要翻译: 用于测试基于网络的生产服务的通用事务生成器框架可以与在服务上执行事务的特定于产品的事务创建器模块一起工作。 交易创建者模块可以包括运行时可发现的信息以将产品特定细节传达到框架。 运行时可发现的信息可以识别初始化方法,终止方法,事务类型,事务方法,事务依赖性以及测试参数,例如事务速率,测试周期和事务类型的期望分配。 框架可以生成和执行各种测试事务,并收集关于服务执行测试事务的良好性能指标。

    Scalable testing in a production system with autoscaling

    公开(公告)号:US09507681B2

    公开(公告)日:2016-11-29

    申请号:US14656989

    申请日:2015-03-13

    摘要: A network-based production service is configured to process client requests for the production service via a network, capture production request data defining the requests and store the production request data in a data store. A test system comprising one or more controllers creates test jobs according to a test plan for testing the production service. The test plan creates a test profile for using specified production request data to simulate a load on the production service. Each job created by the test plan specifies a portion of production request data. A job queue receives and queues test jobs from one or more controllers configured to add test jobs to the job queue according to the test plan. Workers access jobs from the job queue and the production request data from the data store as specified in each job and replay the production request data to the production service.

    Proxy server testing
    4.
    发明授权
    Proxy server testing 有权
    代理服务器测试

    公开(公告)号:US09203931B1

    公开(公告)日:2015-12-01

    申请号:US13854786

    申请日:2013-04-01

    IPC分类号: G06F15/16 H04L29/06

    CPC分类号: H04L67/28 H04L67/02

    摘要: Systems and associated processes for testing a reverse proxy server are disclosed. A backend proxy server test system can receive a request from a reverse proxy server under test. The request may be generated in response to a request from a test client to access a backend service. In responding to the received request, the backend proxy server test system can include a copy of the received request. Upon the test client receiving the response from the proxy server to the test client's request, the test client can extract the embedded copy of the received request that the reverse proxy server generated to determine whether it matches the request that a functioning reverse proxy server generates. Based, at least in part on the result of this comparison, the test client can determine whether the reverse proxy server is malfunctioning.

    摘要翻译: 公开了用于测试反向代理服务器的系统和相关联的过程。 后端代理服务器测试系统可以从被测试的逆向代理服务器接收请求。 可以响应于来自测试客户端访问后端服务的请求而生成该请求。 在响应所接收的请求时,后端代理服务器测试系统可以包括接收到的请求的副本。 当测试客户端从代理服务器接收到测试客户端请求的响应时,测试客户端可以提取所接收的请求的嵌入式副本,该代理服务器生成以确定其是否与正在运行的逆向代理服务器生成的请求相匹配。 至少部分地基于该比较的结果,测试客户端可以确定逆向代理服务器是否发生故障。

    Scalable production test service
    5.
    发明授权

    公开(公告)号:US11310165B1

    公开(公告)日:2022-04-19

    申请号:US14133559

    申请日:2013-12-18

    IPC分类号: H04L12/911 H04L47/70

    摘要: A network-based scalable production load test service may be implemented on a provider network including a plurality of computing devices in order to provide load testing for network-based production systems. In some embodiments, the plurality of computing devices is configured to receive a request to capture to a load test data repository items of transaction data for a network-based production service. In some embodiments, the plurality of computing devices is configured to capture to the load test data repository the items of transaction data. The transaction data include input to the network-based production service over a network. In some embodiments, in response to a load test specification received by the scalable production load test service, the plurality of computing devices is configured to dynamically allocate one or more resources to perform a load test of the network-based production service according to the load test specification.

    Scalable load testing using a queue
    6.
    发明授权
    Scalable load testing using a queue 有权
    可扩展负载测试使用队列

    公开(公告)号:US09396039B1

    公开(公告)日:2016-07-19

    申请号:US14032324

    申请日:2013-09-20

    IPC分类号: G06F9/50 G06F9/455

    摘要: Methods and systems for load generation for scalable load testing are disclosed. A plurality of job descriptions are generated based on a load step description. The load step description specifies a total transaction frequency or a total number of concurrent connections for a load test of a service over a period of time. The job descriptions specify subdivisions of the total transaction frequency or the total number of concurrent connections and subdivisions of the period of time. The job descriptions are placed in a job queue. A plurality of worker hosts remove the job descriptions from the job queue and concurrently execute local jobs based on the job descriptions.

    摘要翻译: 公开了用于可扩展负载测试的负载产生的方法和系统。 基于加载步骤描述生成多个作业描述。 加载步骤描述指定在一段时间内服务的负载测试的总交易频率或并发连接的总数。 作业描述指定总交易频率的细分,或时间段的并发连接和细分的总数。 作业描述被放置在作业队列中。 多个工作主机从作业队列中删除作业描述,并根据作业描述并行执行本地作业。

    Testing using production data in scalable pre-production environments
    8.
    发明授权
    Testing using production data in scalable pre-production environments 有权
    在可扩展的预生产环境中使用生产数据进行测试

    公开(公告)号:US09229845B1

    公开(公告)日:2016-01-05

    申请号:US13666832

    申请日:2012-11-01

    IPC分类号: G06F11/36

    摘要: Proposed updates to systems are evaluated in a manner that is automated and horizontally scalable. Input to a first system is provided to a second system. The first system and second system process the input and each generates output. The output from the first system and second system is analyzed and differences in the output data between the two systems are identified. Analyzing the output may be performed by a fleet of data processing units and the work of analyzing the output may be performed such that differences in the output data are traceable to subsystems of the second system that caused the differences.

    摘要翻译: 系统的建议更新以自动化和水平扩展的方式进行评估。 向第二系统提供对第一系统的输入。 第一个系统和第二个系统处理输入,每个生成输出。 分析第一系统和第二系统的输出,并识别两个系统之间输出数据的差异。 分析输出可以由一组数据处理单元执行,并且可以执行分析输出的工作,使得输出数据的差异可追溯到导致差异的第二系统的子系统。