公开(公告)号：US20250156469A1

公开(公告)日：2025-05-15

申请号：US18934470

申请日：2024-11-01

Applicant: Beijing Volcano Engine Technology Co., Ltd.

Inventor： Mengjun LI ,  Jun GUO ,  Ke SUN ,  Qing XU

IPC: G06F16/383 ,  G06F16/23

Abstract: The present disclosure discloses a lakehouse metadata change determination method, an electronic device, and a computer-readable medium. The method includes: for a metadata storage system, after receiving a metadata processing request sent by a data engine and used for requesting to perform update processing on a target object, executing object update processing logic corresponding to the metadata processing request, and after it is determined that the object update processing logic is completed, generating an update description message corresponding to the target object according to a comparison result between the target object before updating and the target object after updating, so that the update description message indicates that the update processing on the target object has been performed, and the update description message can be subsequently sent to a message receiving object.

公开(公告)号：US20250156445A1

公开(公告)日：2025-05-15

申请号：US18942247

申请日：2024-11-08

Applicant: Beijing Volcano Engine Technology Co., Ltd.

Inventor： Mengjun LI ,  Jun GUO ,  Ke SUN ,  Qing XU

IPC: G06F16/28 ,  G06F16/2455

Abstract: A lakehouse metadata tag creation method, a lakehouse metadata tag query method and an electronic device are provided. The method includes: after a metadata service gateway determines a metadata tag creation request based on a metadata tag creation parameter provided by a data engine, sending, by the metadata service gateway, the metadata tag creation request to a metadata tag service system, so that the metadata tag service system executes a tag creation logic based on the metadata tag creation parameter carried in the metadata tag creation request, to implement a requirement of tagging one or more pieces of metadata.

公开(公告)号：US20250165501A1

公开(公告)日：2025-05-22

申请号：US18841279

申请日：2023-05-18

Applicant: Beijing Volcano Engine Technology Co., Ltd.

Inventor： Jun GUO ,  Jiajun XIE ,  Ke SUN ,  Xuan LUO

IPC: G06F16/28 ,  G06F16/2458

Abstract: The present application discloses a virtual column construction method based on data lake and a data query method. The present disclosure includes: first, automatically performing expression statistical analysis on a large quantity of statements to be analyzed in a data lake, so as to obtain an expression to be used; next, automatically constructing a virtual column construction request corresponding to the expression to be used, according to virtual column construction description information corresponding to the expression to be used, so that the virtual column construction request is used to request construction of a virtual column that can represent the expression to be used; then, according to the virtual column construction request, constructing a virtual column corresponding to the expression to be used, to enable the virtual column to represent the expression to be used.

公开(公告)号：US20250068757A1

公开(公告)日：2025-02-27

申请号：US18812238

申请日：2024-08-22

Applicant: Beijing Volcano Engine Technology Co., Ltd.

Inventor： Mengjun LI ,  Qing XU ,  Ke SUN ,  Jun GUO ,  Xuan LUO

IPC: G06F21/62

Abstract: The present application discloses an access limiting method for a metadata server, an apparatus and a device, wherein the method is applied to a data lake metadata server, receives a metadata access request sent by a client, wherein the request is used for obtaining metadata stored by a storage server for describing target data, and the target data is data in a target table. The metadata service interface used by the data lake metadata server is determined according to the metadata access request. When the metadata service interface satisfies the preset condition, determining the number of applied tokens corresponding to the metadata access request according to the number of table partitions and the number of partition levels of the obtained target table.

公开(公告)号：US20250156436A1

公开(公告)日：2025-05-15

申请号：US18941424

申请日：2024-11-08

Applicant: Beijing Volcano Engine Technology Co., Ltd.

Inventor： Mengjun LI ,  Jun GUO ,  Ke SUN ,  Qing XU

IPC: G06F16/25

Abstract: A method of generating a lakehouse metadata service log, a method of querying a lakehouse metadata service log, an electrode device and a storage medium are provided. The method of generating a lakehouse metadata service log includes: after a metadata server receives a data processing request sent by a data engine, determining, by the metadata server, first request identification information based on the data processing request, such that the first request identification information is used for identifying the data processing request; and then executing, by the metadata server, the request processing logic corresponding to the data processing request, and generating a log corresponding to the request processing logic based on the first request identification information, such that the log carries the first request identification information.

公开(公告)号：US20240054163A1

公开(公告)日：2024-02-15

申请号：US18278149

申请日：2022-09-06

Applicant: BEIJING VOLCANO ENGINE TECHNOLOGY CO., LTD.

Inventor： Xiaoyu GENG ,  Shimin YANG ,  Jun GUO

IPC: G06F16/908

CPC classification number: G06F16/908

Abstract: The present disclosure relates to a data management method and apparatus, a storage medium, and an electronic device. The method comprises: obtaining a data access request sent by an engine side, the data access request being used for requesting to perform an access operation on first target data in a data lake; determining, according to the data access request, target metadata corresponding to the first target data from a metadata storage module, the metadata storage module storing metadata of the data lake in different storage modes, respectively, and the metadata stored in the different storage modes having at least one type of the same information; and sending the first target data corresponding to the target metadata in the data lake to the engine side. By constructing a data lake metadata unified service view that meets various engine requirements, metadata intercommunication between different engines is realized.