File system for caching web proxies

    公开(公告)号:US07058763B2

    公开(公告)日:2006-06-06

    申请号:US09848826

    申请日:2001-05-04

    IPC分类号: G06F12/00

    CPC分类号: G06F17/30902 G06F17/30067

    摘要: A special-purpose file system is provided which includes a combination of services and features which improve the performance of applications employing caches, such as caching web proxies. This file system also provides a file system cache which can be used as a general high-performance file system cache for file systems which need a cache. The services and features include collocating files together on a disk; keeping file meta-data in memory; compressing file names to hash values for reference; using a flat naming scheme for files; providing background daemons that pack files into clusters and clean disk and main memory space; and implementing a user-level library. The file system reduces access to related disk files, eliminates disk operations that are needed to maintain directory and meta-data information, and avoids multiple buffering of file data, and saves and efficiently manages disk and main memory space.

    Redundant data storage and data recovery system
    2.
    发明授权
    Redundant data storage and data recovery system 有权
    冗余数据存储和数据恢复系统

    公开(公告)号:US06763436B2

    公开(公告)日:2004-07-13

    申请号:US10059482

    申请日:2002-01-29

    IPC分类号: G06F1216

    摘要: A data replication system is disclosed in which replication functionalities between a host computer, an interconnecting computer network, and a plurality of storage devices are separated into host elements and a plurality of storage elements. The host computer is connected to one or more host elements. The host element is responsible for replicating data between the storage devices, which are each connected to an associated storage element, and for maintaining data consistency. Further, the host element instructs a storage element whose associated storage device does not contain up-to-date data to recover from another one of the plurality of storage elements and its associated storage device. The storage elements and their associated storage devices may be located in any combination of diverse or same geographical sites in a manner to ensure sufficient replication in the event of a site or equipment failure. The storage elements are responsible for executing read and write requests received from the host computer and for maintaining data consistency. When a storage element and its associated storage device is determined not to contain up-to-date data, recovery is effected by data transfer from one of the other storage elements and its associated storage device, that is indicated by the host element. Such recovery is done directly between the respective storage elements and associated storage devices, without transiting the data through the host element.

    摘要翻译: 公开了一种数据复制系统,其中主计算机,互连计算机网络和多个存储设备之间的复制功能被分离成主机元件和多个存储元件。 主机连接到一个或多个主机元件。 主机元件负责在存储设备之间复制数据,每个存储设备都连接到关联的存储元件,并保持数据的一致性。 此外,主机元件指示其相关联的存储设备不包含最新数据的存储元件从多个存储元件中的另一个存储元件及其相关联的存储设备恢复。 存储元件及其相关联的存储设备可以以确保在站点或设备故障的情况下的充分复制的方式位于多个或相同地理站点的任何组合中。 存储元件负责执行从主计算机接收的读取和写入请求,并保持数据的一致性。 当确定存储元件及其相关联的存储设备不包含最新数据时,通过由主机元件指示的其他存储元件及其相关联的存储设备之一的数据传输来实现恢复。 这种恢复直接在相应的存储元件和相关联的存储设备之间完成,而不通过主机元件转移数据。

    Method and system for providing computer storage access with quality of service guarantees
    4.
    发明授权
    Method and system for providing computer storage access with quality of service guarantees 有权
    提供计算机存储访问与服务质量保证的方法和系统

    公开(公告)号:US06434631B1

    公开(公告)日:2002-08-13

    申请号:US09418795

    申请日:1999-10-15

    IPC分类号: G06F1314

    摘要: A method and system for servicing disk I/O requests from domains which have been guaranteed minimum quality of disk service maintains I/O requests for each domain are in separate queues. The queues are serviced by a disk scheduler which selects requests from the queues in accordance with a fair queuing scheduling algorithm that considers the estimated time required to service the request at the head of a queue with regard for the size of the input or output associated with the request, the proportion of disk bandwidth assigned to the particular domain, and the state of the other queues.

    摘要翻译: 用于保护磁盘I / O请求的方法和系统,这些请求已经被保证,磁盘服务的最低质量维护每个域的I / O请求都在不同的队列中。 队列由磁盘调度器提供服务,磁盘调度器根据公平的排队调度算法来选择来自队列的请求,该算法考虑到与队列中相关联的输入或输出的大小相关联的队列头部处的服务请求所需的估计时间 请求,分配给特定域的磁盘带宽的比例以及其他队列的状态。

    Methods and apparatus for ensuring quality of service in an operating system
    5.
    发明授权
    Methods and apparatus for ensuring quality of service in an operating system 有权
    确保操作系统服务质量的方法和设备

    公开(公告)号:US06725456B1

    公开(公告)日:2004-04-20

    申请号:US09450035

    申请日:1999-11-29

    IPC分类号: G06F900

    CPC分类号: G06F9/5011 G06F2209/5014

    摘要: A uniform application programming interface (API) provides efficient generation and control of resource reservations so as to ensure a desired quality of service (QoS) for applications running on an operating system of a computer system. The uniform API is based on a hierarchical file system which associates resource reservations with references to shared objects, rather than with the objects themselves. The uniform API permits the use of a variety of different proportional share schedulers for controlling access to physical resources, e.g., CPU, memory, disk, network interfaces, etc. of the computer system. The hierarchical file system includes a separate directory for each independently-scheduled physical resource of the computer system. A parent of the resource reservation in the hierarchical file system is either a root node of the file system or another reservation for the same resource. The resource reservation represents either an internal reservation, corresponding to a directory in the file system which is permitted to have child nodes associated therewith in the file system, or a queue, corresponding to a directory which is not permitted to have child nodes associated therewith. A given request for a resource reservation is processed by a proportional share scheduler associated with the resource, and identifies a queue having a predetermined portion of the resource allocated thereto. The invention also provides mechanisms for request tagging by the operating system, parental limitation of resources used by a child process, and “garbage collection” of resource reservations that are no longer needed.

    摘要翻译: 统一的应用编程接口(API)提供资源预留的有效生成和控制,以便确保在计算机系统的操作系统上运行的应用的期望的服务质量(QoS)。 统一API基于分层文件系统,其将资源预留与对共享对象的引用相关联,而不是与对象本身相关联。 统一API允许使用各种不同的比例共享调度器来控制对物理资源的访问,例如计算机系统的CPU,存储器,盘,网络接口等。 分层文件系统包括用于计算机系统的每个独立调度的物理资源的单独的目录。 分层文件系统中的资源预留的父节点是文件系统的根节点或相同资源的另一个预留。 资源预留表示与文件系统中允许具有与文件系统相关联的子节点的目录相对应的内部预留,或对应于不允许具有与其相关联的子节点的目录的队列。 资源预留的给定请求由与资源相关联的比例共享调度器处理,并且识别具有分配给其的资源的预定部分的队列。 本发明还提供了由操作系统请求标记的机制,子进程使用的资源的父母限制以及不再需要的资源预留的“垃圾收集”。

    Signaled receiver processing methods and apparatus for improved protocol processing
    6.
    发明授权
    Signaled receiver processing methods and apparatus for improved protocol processing 失效
    用于改进协议处理的信号接收机处理方法和装置

    公开(公告)号:US06625149B1

    公开(公告)日:2003-09-23

    申请号:US09450034

    申请日:1999-11-29

    IPC分类号: H04L1256

    摘要: Received packets are processed utilizing protocol processing stages in an operating system, in accordance with a technique referred to as signaled receiver processing (SRP). A given protocol processing stage uses a next stage submit (NSS) function to pass a packet to a subsequent protocol processing stage. Each protocol processing stage is associated with one or more sockets. Each socket is associated with the input function of a protocol processing stage, an unprocessed input queue (UIQ) that contains packets destined to the socket but not yet processed by the socket's input function, and a list of owner processes, which expect input from the socket. NSS uses a multi-stage early demultiplexing (MED) function, which determines a packet's next destination socket, based on the stage currently processing the packet and on information contained in the packet. If the amount of buffering used by a packet plus the amount of input buffering already used by the packet's destination socket exceeds a designated limit associated with that socket, NSS drops the packet. Otherwise, NSS enqueues the packet in that socket's UIQ and signals that socket's owner processes. The signal triggers a default action corresponding to performance of the required protocol processing by one of the destination socket's owner processes, but those processes may override the default action by, e.g., deferring the required protocol processing until execution of a subsequent receive call.

    摘要翻译: 根据称为信令接收机处理(SRP)的技术,在操作系统中利用协议处理级来处理接收的分组。 给定的协议处理阶段使用下一阶段提交(NSS)功能将数据包传递到后续的协议处理阶段。 每个协议处理阶段与一个或多个套接字相关联。 每个套接字与协议处理阶段的输入功能相关联,一个未处理的输入队列(UIQ),其包含目的地为套接字但尚未由套接字输入函数处理的数据包,以及所有者进程列表, 插座。 NSS使用多阶段早期解复用(MED)功能,其基于当前处理分组的阶段和包中包含的信息来确定分组的下一个目的地套接字。 如果数据包使用的缓冲量加上数据包目的套接口已经使用的输入缓冲量超过与该套接字相关联的指定限制,NSS将丢弃数据包。 否则,NSS将该套接字的UIQ中的数据包排入队列,并指示套接字的所有者进程。 信号触发与目标套接字所有者进程之一所需的协议处理性能相对应的默认动作,但是这些进程可以通过例如延迟所需的协议处理来覆盖默认动作,直到执行后续的接收呼叫。

    Efficient document clustering
    7.
    发明授权
    Efficient document clustering 有权
    高效的文档聚类

    公开(公告)号:US08200670B1

    公开(公告)日:2012-06-12

    申请号:US12262846

    申请日:2008-10-31

    IPC分类号: G06F7/00

    CPC分类号: G06F17/3071

    摘要: Methods, systems, and apparatus, including computer program products, for clustering documents. A plurality of documents are identified from a set of documents, where the identified documents have the same top N terms by term frequency score for an integer N. A pattern string that is satisfied by at least a subset of the identified documents is identified. A document cluster is formed from at least the subset of the identified documents.

    摘要翻译: 用于聚类文档的方法,系统和设备,包括计算机程序产品。 从一组文档中识别多个文档,其中所标识的文档具有与整数N的术语频率分数相同的前N个项。由至少识别的文档的子集满足的模式字符串被识别。 至少从所识别的文档的子集形成文档簇。

    Methods and apparatus for providing quality of service for legacy applications
    8.
    发明授权
    Methods and apparatus for providing quality of service for legacy applications 有权
    为传统应用提供服务质量的方法和设备

    公开(公告)号:US06675229B1

    公开(公告)日:2004-01-06

    申请号:US09450036

    申请日:1999-11-29

    IPC分类号: G06F954

    CPC分类号: G06F9/5055 G06F2209/5014

    摘要: A computer operating system that allows legacy applications to be run automatically with quality of service (QoS) guarantees matching required QoS performance levels. In accordance with the invention, files have QoS requirement attributes that can be set-by users. Additionally, users may interpose a requirement broker between a given legacy application and the operating system. The requirement broker may be in the form of a modified version of a library that is dynamically linked with applications at load time. The requirement broker intercepts certain system calls and automatically requests from the system QoS guarantees in accordance with the QoS requirement attributes of the accessed files, whether local or remote.

    摘要翻译: 允许遗留应用程序以服务质量(QoS)自动运行的计算机操作系统保证匹配所需的QoS性能级别。 根据本发明,文件具有可由用户设置的QoS要求属性。 此外,用户可以在给定的遗留应用和操作系统之间插入需求代理。 需求代理可以是在加载时与应用程序动态链接的库的修改版本的形式。 需求代理根据所访问的文件的QoS要求属性(无论是本地还是远程)拦截某些系统调用并根据系统的QoS保证自动请求。

    Method and apparatus for detecting the movement of a device that receives a signal broadcast from a relative fixed position
    9.
    发明授权
    Method and apparatus for detecting the movement of a device that receives a signal broadcast from a relative fixed position 有权
    用于检测接收从相对固定位置广播的信号的设备的移动的方法和装置

    公开(公告)号:US06191739B1

    公开(公告)日:2001-02-20

    申请号:US09170015

    申请日:1998-10-13

    IPC分类号: G08B1314

    摘要: A system for detecting the movement of a device that receives a signal broadcast from a relative fixed position, such as a set-top terminal in a Direct Broadcast Satellite (DBS) system, is disclosed, using the phase shift of the broadcast signal, as received by the device. A set-top terminal or similar mechanism restricts access to the transmitted multimedia information using stored decryption keys. If a set-top terminal is moved, the distance between the set-top terminal and the satellite will change, thereby causing a measurable phase shift in the signal received by the set-top terminal. The set-top terminal periodically or intermittently records a sequence of bits received from the satellite and provides the recorded bits to the service provider server for analysis. If the set-top terminal has been moved, the recorded bits will shift. The sequence of bits may be recorded at random intervals, triggered by an external event, shown, for example, by an accurate internal clock, a request sent by a terrestrial paging network, or a request sent by a low-earth-orbit (LEO) satellite messaging system. The service provider detects relative movements of the set-top terminals by instructing a group of set-top terminals in geographical proximity to start recording at the same time, and comparing the sequence of bits recorded by each set-top terminal.

    摘要翻译: 公开了一种用于检测从直接广播卫星(DBS)系统中的机顶终端接收从相对固定位置广播的信号的设备的移动的系统,使用广播信号的相移作为 由设备接收。 机顶终端或类似机构使用存储的解密密钥限制对所发送的多媒体信息的访问。 如果机顶终端被移动,则机顶终端和卫星之间的距离将改变,从而导致由机顶终端接收的信号中的可测量的相移。 机顶终端定期或间歇地记录从卫星接收的比特序列,并将记录的比特提供给服务提供商服务器进行分析。 如果机顶终端已被移动,则记录的位将移位。 位序列可以以外部事件触发的随机间隔记录,例如通过精确的内部时钟,由地面寻呼网络发送的请求或由低地球轨道发送的请求(LEO )卫星信息系统。 服务提供商通过指示地理接近的一组机顶终端同时开始记录来检测机顶终端的相对移动,并比较每个机顶终端记录的比特序列。

    Method for maintaining consistency and performing recovery in a replicated data storage system
    10.
    发明授权
    Method for maintaining consistency and performing recovery in a replicated data storage system 有权
    在复制数据存储系统中维护一致性和执行恢复的方法

    公开(公告)号:US07103884B2

    公开(公告)日:2006-09-05

    申请号:US10107829

    申请日:2002-03-27

    摘要: A recovery process allows a recovering replica in a replicated data storage system to recover from a current replica the changes to the data that it has missed during a failure while, at the same time, the system is processing new requests issued by the source. Sequence numbers, assigned by the source to write requests and stored by each replica in association with the data item that the write request modifies, are used by the recovery process to determine when a replica has missed one or more write requests and requires recovery. During recovery, the recovering replica ignores all requests directly received from the source, and replaces the contents of a data item with the data received from the current replica only if the newly received data item has a higher sequence number than the corresponding sequence number of the data item already stored in the recovering replica. It also updates data items in response to new write requests that are forwarded to it by the current replica. At the same time, the current replica continues to receive requests from the source, performs those requests, and forwards those write requests to the recovering replica. It also scans its data items and sends to the recovering replica those data items and associated sequence numbers that have a sequence number higher than the sequence number of the last consecutive write request sent by the source that the recovering replica received before missing a write request.

    摘要翻译: 恢复过程允许复制数据存储系统中的恢复副本从当前副本中恢复其在故障期间丢失的数据的更改,同时系统正在处理源发出的新请求。 由源写入请求并由与写入请求修改的数据项相关联的每个副本存储的序列号由恢复过程用于确定副本何时错过了一个或多个写入请求并需要恢复。 在恢复期间,恢复副本忽略从源直接接收到的所有请求,并且只有当新接收到的数据项具有比相应的序列号更高的序列号时,才能用从当前副本接收到的数据替换数据项的内容 已经存储在恢复副本中的数据项。 它还会更新数据项,以响应当前副本转发给它的新写入请求。 同时,当前副本继续接收来自源的请求,执行这些请求,并将这些写请求转发到恢复副本。 它还扫描其数据项,并向恢复的副本发送具有序列号高于由缺少写入请求之前接收的恢复副本的源发送的最后连续写入请求的序列号的数据项和相关序列号。