-
公开(公告)号:US20220222219A1
公开(公告)日:2022-07-14
申请号:US17671068
申请日:2022-02-14
Applicant: Google LLC
Inventor: Jeffrey Adgate Dean , Sanjay Ghemawat , Andrew Fikes , Yasushi Saito
IPC: G06F16/182 , G06F16/22 , G06F9/50 , G06F16/13 , H04L67/1001
Abstract: A method of accessing data includes storing a table that includes a plurality of tablets corresponding to distinct non-overlapping table portions. Respective pluralities of tablet access objects and application objects are stored in a plurality of servers. A distinct application object and distinct tablet are associated with each tablet access object. Each application object corresponds to a distinct instantiation of an application associated with the table. The tablet access objects and associated application objects are redistributed among the servers in accordance with a first load-balancing criterion. A first request directed to a respective tablet is received from a client. In response, the tablet access object associated with the respective tablet is used to perform a data access operation on the respective tablet, and the application object associated with the respective tablet is used to perform an additional computational operation to produce a result to be returned to the client.
-
公开(公告)号:US20200341950A1
公开(公告)日:2020-10-29
申请号:US16927264
申请日:2020-07-13
Applicant: Google LLC
Inventor: Jeffrey Dean , Sanjay Ghemawat , Andrew Fikes , Yasushi Saito
IPC: G06F16/182 , G06F16/22 , G06F9/50 , G06F16/13 , H04L29/08
Abstract: A method of accessing data includes storing a table that includes a plurality of tablets corresponding to distinct non-overlapping table portions. Respective pluralities of tablet access objects and application objects are stored in a plurality of servers. A distinct application object and distinct tablet are associated with each tablet access object. Each application object corresponds to a distinct instantiation of an application associated with the table. The tablet access objects and associated application objects are redistributed among the servers in accordance with a first load-balancing criterion. A first request directed to a respective tablet is received from a client. In response, the tablet access object associated with the respective tablet is used to perform a data access operation on the respective tablet, and the application object associated with the respective tablet is used to perform an additional computational operation to produce a result to be returned to the client.
-
公开(公告)号:US10686686B2
公开(公告)日:2020-06-16
申请号:US15348181
申请日:2016-11-10
Applicant: Google LLC
Inventor: Vadim Borisov , Andrew Fikes , Brian F. Cooper
Abstract: Methods and systems for monitoring performance in a distributed storage system described. One example method includes identifying requests sent by clients to the distributed storage system, each request including request parameter values for request parameters; generating probe requests based on the identified requests, the probe requests including probe request parameter values for probe request parameter values, representing a statistical sample of the request parameters included in the identified requests; sending the generated probe requests to the distributed storage system over a network, wherein the distributed storage system is configured to perform preparations for servicing each probe request in response to receiving the probe request; receiving responses to the probe requests from the distributed storage system; and outputting at least one performance metric value measuring a current performance state of the distributed storage system based on the received responses.
-
公开(公告)号:US11822521B2
公开(公告)日:2023-11-21
申请号:US17671068
申请日:2022-02-14
Applicant: Google LLC
Inventor: Jeffrey Adgate Dean , Sanjay Ghemawat , Andrew Fikes , Yasushi Saito
IPC: G06F16/182 , G06F16/22 , G06F9/50 , G06F16/13 , H04L67/1001 , H04L67/1004 , H04L67/1029
CPC classification number: G06F16/182 , G06F9/5083 , G06F16/13 , G06F16/184 , G06F16/22 , H04L67/1001 , H04L67/1004 , H04L67/1029
Abstract: A method of accessing data includes storing a table that includes a plurality of tablets corresponding to distinct non-overlapping table portions. Respective pluralities of tablet access objects and application objects are stored in a plurality of servers. A distinct application object and distinct tablet are associated with each tablet access object. Each application object corresponds to a distinct instantiation of an application associated with the table. The tablet access objects and associated application objects are redistributed among the servers in accordance with a first load-balancing criterion. A first request directed to a respective tablet is received from a client. In response, the tablet access object associated with the respective tablet is used to perform a data access operation on the respective tablet, and the application object associated with the respective tablet is used to perform an additional computational operation to produce a result to be returned to the client.
-
公开(公告)号:US11582130B2
公开(公告)日:2023-02-14
申请号:US16902228
申请日:2020-06-15
Applicant: Google LLC
Inventor: Vadim Borisov , Andrew Fikes , Brian F. Cooper
IPC: H04L43/12 , G06F11/34 , G06F11/30 , G06F9/50 , H04L41/5009 , H04L43/0852 , H04L67/1097
Abstract: Methods and systems for monitoring performance in a distributed storage system described. One example method includes identifying requests sent by clients to the distributed storage system, each request including request parameter values for request parameters; generating probe requests based on the identified requests, the probe requests including probe request parameter values for probe request parameter values, representing a statistical sample of the request parameters included in the identified requests; sending the generated probe requests to the distributed storage system over a network, wherein the distributed storage system is configured to perform preparations for servicing each probe request in response to receiving the probe request; receiving responses to the probe requests from the distributed storage system, and outputting at least one performance metric value measuring a current performance state of the distributed storage system based on the received responses.
-
公开(公告)号:US20230188452A1
公开(公告)日:2023-06-15
申请号:US18165578
申请日:2023-02-07
Applicant: Google LLC
Inventor: Vadim Borisov , Andrew Fikes , Brian F. Cooper
IPC: H04L43/12 , G06F11/34 , G06F11/30 , G06F9/50 , H04L41/5009 , H04L43/0852 , H04L67/1097
CPC classification number: H04L43/12 , G06F11/3414 , G06F11/3096 , G06F11/3093 , G06F9/5011 , G06F11/3034 , H04L41/5009 , H04L43/0852 , H04L67/1097 , G06F11/3452
Abstract: Methods and systems for monitoring performance in a distributed storage system described. One example method includes identifying requests sent by clients to the distributed storage system, each request including request parameter values for request parameters; generating probe requests based on the identified requests, the probe requests including probe request parameter values for probe request parameter values, representing a statistical sample of the request parameters included in the identified requests; sending the generated probe requests to the distributed storage system over a network, wherein the distributed storage system is configured to perform preparations for servicing each probe request in response to receiving the probe request; receiving responses to the probe requests from the distributed storage system; and outputting at least one performance metric value measuring a current performance state of the distributed storage system based on the received responses.
-
公开(公告)号:US11556375B2
公开(公告)日:2023-01-17
申请号:US16895132
申请日:2020-06-08
Applicant: Google LLC
Inventor: Brian Frank Cooper , Alexander Lloyd , Sebastian Kanthak , Andrew Fikes , Christopher Taylor
Abstract: In a distributed system where a client's call to commit a transaction occurs outside the transaction's lock-hold interval, computation of timestamp information for the transaction is moved to a client library, while ensuring that no conflicting reads or writes are performed between a time of the computation and acquiring all locks for the transaction. The transaction is committed in phases, with each phase being initiated by the client library. Timestamp information is added to the locks to ensure that timestamps are generated during lock-hold intervals. An increased number of network messages is thereby overlapped with a commit wait period in which a write in a distributed database is delayed in time to ensure concurrency in the database.
-
8.
公开(公告)号:US20200301729A1
公开(公告)日:2020-09-24
申请号:US16895132
申请日:2020-06-08
Applicant: Google LLC
Inventor: Brian Frank Cooper , Alexander Lloyd , Sebastian Kanthak , Andrew Fikes , Christopher Taylor
Abstract: In a distributed system where a client's call to commit a transaction occurs outside the transaction's lock-hold interval, computation of timestamp information for the transaction is moved to a client library, while ensuring that no conflicting reads or writes are performed between a time of the computation and acquiring all locks for the transaction. The transaction is committed in phases, with each phase being initiated by the client library. Timestamp information is added to the locks to ensure that timestamps are generated during lock-hold intervals. An increased number of network messages is thereby overlapped with a commit wait period in which a write in a distributed database is delayed in time to ensure concurrency in the database.
-
公开(公告)号:US11281631B2
公开(公告)日:2022-03-22
申请号:US16927264
申请日:2020-07-13
Applicant: Google LLC
Inventor: Jeffrey Dean , Sanjay Ghemawat , Andrew Fikes , Yasushi Saito
IPC: G06F16/182 , G06F16/22 , G06F9/50 , G06F16/13 , H04L67/1001 , H04L67/1004 , H04L67/1029
Abstract: A method of accessing data includes storing a table that includes a plurality of tablets corresponding to distinct non-overlapping table portions. Respective pluralities of tablet access objects and application objects are stored in a plurality of servers. A distinct application object and distinct tablet are associated with each tablet access object. Each application object corresponds to a distinct instantiation of an application associated with the table. The tablet access objects and associated application objects are redistributed among the servers in accordance with a first load-balancing criterion. A first request directed to a respective tablet is received from a client. In response, the tablet access object associated with the respective tablet is used to perform a data access operation on the respective tablet, and the application object associated with the respective tablet is used to perform an additional computational operation to produce a result to be returned to the client.
-
公开(公告)号:US20200382403A1
公开(公告)日:2020-12-03
申请号:US16902228
申请日:2020-06-15
Applicant: Google LLC
Inventor: Vadim Borisov , Andrew Fikes , Brian F. Cooper
Abstract: Methods and systems for monitoring performance in a distributed storage system described. One example method includes identifying requests sent by clients to the distributed storage system, each request including request parameter values for request parameters; generating probe requests based on the identified requests, the probe requests including probe request parameter values for probe request parameter values, representing a statistical sample of the request parameters included in the identified requests; sending the generated probe requests to the distributed storage system over a network, wherein the distributed storage system is configured to perform preparations for servicing each probe request in response to receiving the probe request; receiving responses to the probe requests from the distributed storage system, and outputting at least one performance metric value measuring a current performance state of the distributed storage system based on the received responses.
-
-
-
-
-
-
-
-
-