公开(公告)号：US11593309B2

公开(公告)日：2023-02-28

申请号：US17089851

申请日：2020-11-05

Applicant: International Business Machines Corporation

Inventor： John T. Olson ,  Deepavali M. Bhagwat ,  Frank Schmuck ,  Shekhar Amlekar ,  Luis Teran ,  Jacob Morris Tick ,  April Brown

IPC: G06F16/00 ,  G06F16/17 ,  G06F16/182 ,  G06F9/54 ,  G06F16/2455 ,  G06F16/23 ,  G06F12/0866 ,  G06F12/0815

Abstract: Embodiments include a method for fault tolerance in the delivery of event information within a file system cluster. One or more processors to determine event information associated with file system activity performed by a node of the cluster. The one or more processors add the event information to an event log buffer in memory. The one or more processors receive a first log sequence number (LSN) associated with flushing of recovery information from a recovery log buffer. The one or more processors determine the event information in the event log buffer having a log sequence number less than or equal to the first log sequence number, and determining the event information includes log sequence numbers less than or equal to the first log sequence number, the one or more processors flush the corresponding event information from the event log buffer to disk storage.

公开(公告)号：US11281629B2

公开(公告)日：2022-03-22

申请号：US16355418

申请日：2019-03-15

Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION

Inventor： Subashini Balachandran ,  John T. Olson

IPC: G06F16/17 ,  G06F16/11 ,  G06F11/14 ,  G06N3/08 ,  G06N20/00

Abstract: Provided are a computer program product, system, and method for using and training a machine learning module to determine actions to be taken in response to file system events in a file system. A file system event is detected. An action to be performed corresponding to the file system event is selected from an action list. A determination is made as to whether an outcome in the computing system resulting from the performed action satisfies an outcome threshold. A machine learning module is trained to increase a likelihood of selecting the performed action corresponding to the file system event when the outcome satisfies the outcome threshold. The machine learning module is trained to decrease a likelihood of selecting the performed action corresponding to the file system event when the outcome does not satisfy the outcome threshold.

公开(公告)号：US11076020B2

公开(公告)日：2021-07-27

申请号：US16800505

申请日：2020-02-25

Applicant: International Business Machines Corporation

Inventor： Duane M. Baldwin ,  Sasikanth Eda ,  John T. Olson ,  Sandeep R. Patil

IPC: H04L29/08 ,  G06F9/50 ,  G06F9/455 ,  H04L29/06

Abstract: A system and method dynamically transitions the file system role of compute nodes in a distributed clustered file system for an object that includes an embedded compute engine (a storlet). Embodiments of the invention overcome prior art problems of a storlet in a distributed storage system with a storlet engine having a dynamic role module which dynamically assigns or changes a file system role served by the node to a role which is more optimally suited for a computation operation in the storlet. The role assignment is made based on a classification of the computation operation and the appropriate filesystem role that matches computation operation. For example, a role could be assigned which helps reduce storage needs, communication resources, etc.

公开(公告)号：US10929347B2

公开(公告)日：2021-02-23

申请号：US16121616

申请日：2018-09-04

Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION

Inventor： Duane M. Baldwin ,  John T. Olson ,  Sandeep R. Patil ,  Riyazahamad M. Shiraguppi

IPC: G06F16/17

Abstract: Provided are a computer program product, system, and method for defragmenting files having file blocks in multiple point-in-time copies. Multiple point-in-time copies for a file having file blocks ap. Maintained. Each point-in-time copy to the file has at least one different block in the storage for at least one of the file blocks in the file. For each of a plurality of the point-in-time copies for the file, moving the blocks for the file blocks in the point-in-time copy to contiguous locations on the storage.

公开(公告)号：US10681180B2

公开(公告)日：2020-06-09

申请号：US16355720

申请日：2019-03-16

Applicant: International Business Machines Corporation

Inventor： Duane M. Baldwin ,  Sasikanth Eda ,  John T. Olson ,  Sandeep R. Patil

IPC: G06F15/16 ,  H04L29/08 ,  G06F9/50 ,  G06F9/455 ,  H04L29/06

Abstract: A system and method dynamically transitions the file system role of compute nodes in a distributed clustered file system for an object that includes an embedded compute engine (a storlet). Embodiments of the invention overcome prior art problems of a storlet in a distributed storage system with a storlet engine having a dynamic role module which dynamically assigns or changes a file system role served by the node to a role which is more optimally suited for a computation operation in the storlet. The role assignment is made based on a classification of the computation operation and the appropriate filesystem role that matches computation operation. For example, a role could be assigned which helps reduce storage needs, communication resources, etc.

公开(公告)号：US10565018B2

公开(公告)日：2020-02-18

申请号：US15833193

申请日：2017-12-06

Applicant: International Business Machines Corporation

Inventor： Duane M. Baldwin ,  Sasikanth Eda ,  John T. Olson ,  Sandeep R. Patil

IPC: G06F9/50

Abstract: A present invention embodiment manages resources of a distributed system to perform computational tasks within a specified time interval. A received object is classified into a type of computational processing, and a quantity of objects is maintained for each type. An execution time for processing a single object is estimated based on a corresponding computation resource template. A total execution time for the quantity of objects of a type of computational processing is determined based on the estimated execution time. In response to the total execution time exceeding a user-specified time interval, an amount of resources of the distributed system is determined to process the quantity of objects of the type within the user-specified time interval. Nodes of the distributed system with objects classified in the type use the determined amount of resources to process the quantity of objects for the type within the user-specified time interval.

公开(公告)号：US10210191B2

公开(公告)日：2019-02-19

申请号：US14220921

申请日：2014-03-20

Applicant: International Business Machines Corporation

Inventor： Duane M. Baldwin ,  John T. Olson ,  Sachin C. Punadikar ,  Sandeep R. Patil

IPC: G06F17/30

Abstract: In one embodiment, a method for creating an object includes creating an object in an object store making use of a file system, obtaining an index node (inode) identifier (ID) for an inode associated with the object, creating an object ID for the object, wherein the object ID is unique from any other object IDs in the object store, merging the object ID with the inode ID, and modifying the inode to include at least the object ID. In another embodiment, a system includes a processor and logic integrated with and/or executable by the processor, the logic being configured to: create an object in an object store making use of a file system, obtain an inode ID for an inode associated with the object, create an object ID for the object, the object ID including the inode and modify the inode to include at least the object ID.

公开(公告)号：US20180285452A1

公开(公告)日：2018-10-04

申请号：US15992571

申请日：2018-05-30

Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION

Inventor： John T. Olson ,  Erik Rueger ,  Christof Schmitt ,  Michael L. Taylor

IPC: G06F17/30 ,  H04L29/06

CPC classification number: G06F17/30702 ,  G06F17/30 ,  H04L41/0893 ,  H04L63/083 ,  H04L63/0846 ,  H04L63/101 ,  H04L63/102 ,  H04L67/306 ,  H04W12/08

Abstract: An embodiment of the invention may include a method, computer program product, and system for data management. The embodiment may include receiving a login token and instruction from a user device. The login token is associated with a user of the user device. The instruction may be reading or writing profile data belonging to the user. The embodiment may include determining whether a user profile container exists for the user based on the received login token. The embodiment may include creating the user profile container for the user based on determining that the user profile container does not exist. Creating the user profile container for the user may include identifying profile data belonging to the user located in a plurality of locations within a file system and storing identified profile data belonging to the user within a single binary large object. The embodiment may include executing the received instruction.

公开(公告)号：US20180081719A1

公开(公告)日：2018-03-22

申请号：US15270391

申请日：2016-09-20

Applicant: International Business Machines Corporation

Inventor： Duane M. Baldwin ,  Sasikanth Eda ,  John T. Olson ,  Sandeep R. Patil

IPC: G06F9/48 ,  G06F9/50

Abstract: A present invention embodiment manages resources of a distributed system to perform computational tasks within a specified time interval. A received object is classified into a type of computational processing, and a quantity of objects is maintained for each type. An execution time for processing a single object is estimated based on a corresponding computation resource template. A total execution time for the quantity of objects of a type of computational processing is determined based on the estimated execution time. In response to the total execution time exceeding a user-specified time interval, an amount of resources of the distributed system is determined to process the quantity of objects of the type within the user-specified time interval. Nodes of the distributed system with objects classified in the type use the determined amount of resources to process the quantity of objects for the type within the user-specified time interval.

公开(公告)号：US20170161286A1

公开(公告)日：2017-06-08

申请号：US14962011

申请日：2015-12-08

Applicant: International Business Machines Corporation

Inventor： Sasikanth Eda ,  Shah M. R. Islam ,  John T. Olson ,  Sandeep R. Patil

IPC: G06F17/30 ,  G06F3/06

CPC classification number: G06F17/30088 ,  G06F3/0619 ,  G06F3/0643 ,  G06F3/0647 ,  G06F3/065 ,  G06F3/067

Abstract: A method, computer program product and/or system saves an original logical block in a file system and generates a first heatmap reflecting access operations on the original logical block. After taking of a file system snapshot, and receiving information that the original logical block is going to be revised, a second heatmap is generated, reflecting predicted access operations on the revised logical block. The second heatmap is based, at least in part, on the first heatmap. Selecting a physical storage location for the revised logical block is based on the second heatmap.