Method, electronic device and computer readable medium for information processing for accelerating neural network training

    公开(公告)号:US11640528B2

    公开(公告)日:2023-05-02

    申请号:US16660259

    申请日:2019-10-22

    申请人: Baidu USA LLC

    IPC分类号: G06N3/08 G06N20/00 G06N3/048

    摘要: A method for information processing for accelerating neural network training. The method includes: acquiring a neural network corresponding to a deep learning task; and performing iterations of iterative training on the neural network based on a training data set. The training data set includes task data corresponding to the deep learning task. The iterative training includes: processing the task data in the training data set using a current neural network, and determining, based on a processing result of the neural network on the task data in a current iterative training, prediction loss of the current iterative training; determining a learning rate and a momentum in the current iterative training; and updating weight parameters of the current neural network by gradient descent based on a preset weight decay, and the learning rate, the momentum, and the prediction loss in the current iterative training. This method achieves efficient and low-cost deep learning-based neural network training.

    Systems and methods for defense against adversarial attacks using feature scattering-based adversarial training

    公开(公告)号:US11636332B2

    公开(公告)日:2023-04-25

    申请号:US16506519

    申请日:2019-07-09

    申请人: Baidu USA, LLC

    IPC分类号: G06N3/08 G06F21/57 G06K9/62

    摘要: Described herein are embodiments for a feature-scattering-based adversarial training approach for improving model robustness against adversarial attacks. Conventional adversarial training approaches leverage a supervised scheme, either targeted or non-targeted in generating attacks for training, which typically suffer from issues such as label leaking as noted in recent works. Embodiments of the disclosed approach generate adversarial images for training through feature scattering in the latent space, which is unsupervised in nature and avoids label leaking. More importantly, the presented approaches generate perturbed images in a collaborative fashion, taking the inter-sample relationships into consideration. Extensive experiments on different datasets compared with state-of-the-art approaches demonstrate the effectiveness of the presented embodiments.

    ENCLOSURE FOR ELECTRONIC DEVICE WITH LIQUID COOLING

    公开(公告)号:US20230115186A1

    公开(公告)日:2023-04-13

    申请号:US17484800

    申请日:2021-09-24

    申请人: BAIDU USA LLC

    发明人: Tianyi GAO

    IPC分类号: H05K7/20

    摘要: In one embodiment, an electronic device cooling package includes an enclosure to house an electronics package, the enclosure including at least one panel with an integrated conducting plate exposed to both an inner surface of the at least one panel and an outer surface of the at least one panel. The electronic device cooling package further includes a mounting mechanism attached to the enclosure to detachably couple a cooling device to the outer surface of the at least one panel of the enclosure. Different electronics packaged within the cooling package includes different co-design of the cooling package and cooling devices.

    SYSTEM AND PROCESS FOR REPAINTING OF PLANAR OBJECTS IN VIDEO

    公开(公告)号:US20230100305A1

    公开(公告)日:2023-03-30

    申请号:US17485952

    申请日:2021-09-27

    申请人: Baidu USA LLC

    IPC分类号: G06T5/00 G06T7/73

    摘要: According to one embodiment, a method is provided for video repainting performed by at least one processor of a computer device. The method includes receiving a video sequence having one or more image frames; detecting presences of a target object within the one or more image frames and determining pose condition and style shift of the detected objects; generating content representing a replacement object for the one or more image frames by applying the corresponding pose condition and style shift to the replacement object; and repainting the detected target object in the one or more image frames with the generated content.

    SYMMETRICAL DUAL FLUID DISTRIBUTION UNIT FOR SERVER RACK

    公开(公告)号:US20230089909A1

    公开(公告)日:2023-03-23

    申请号:US17483704

    申请日:2021-09-23

    申请人: Baidu USA LLC

    发明人: Tianyi Gao

    IPC分类号: H05K7/20

    摘要: A fluid distribution apparatus for servers mounted onto a rack. The apparatus includes one or more pairs of distribution units that are rotationally symmetric and are attached to each other to form the pair. Each of the distribution units includes a main supply port and main return port that are connected to the rack's fluid manifolds. Each of the distribution units also includes plurality of supply and return connectors that connect to the servers. A pump in each of the distribution units delivers fluid from the rack's fluid manifolds to the servers for cooling. Each server is connected to fluid ports on both distribution units, so as to provide full redundancy. A controller receives signals form the servers and sends operation signals to the pumps to control the fluid delivery for cooling the servers.

    Two phase containment system having controlled air flow

    公开(公告)号:US11612081B2

    公开(公告)日:2023-03-21

    申请号:US17409657

    申请日:2021-08-23

    申请人: Baidu USA LLC

    发明人: Tianyi Gao

    IPC分类号: H05K7/20

    摘要: A two-phase immersion cooling system for cooling electronics. The electronics are immersed in immersion tank filled with phase change liquid. As liquid evaporates due to heat generated by the electronics, it enters a vapor passageway that leads the vapor to a condenser situated remotely from the immersion tank. Upon condensing at the condenser, the condensed liquid is directed to a resupply tank, wherein the condensed liquid cools. When the level of the two phase liquid in the immersion tank drops below a set threshold, a pump is activated to deliver the condensed liquid from the resupply tank to the immersion tank. The immersion tank, vapor passageway and condenser are position inside a containment passageway. The containment passageway captures any vapor not entering the vapor passageway and direct such vapor to the condenser. An air mover generates pressure differential within the containment passageway to direct the vapor towards the condenser.

    Latency compensation in inertial navigation system

    公开(公告)号:US11609342B2

    公开(公告)日:2023-03-21

    申请号:US16649559

    申请日:2020-03-05

    IPC分类号: G01S19/40 G01S19/49 G01C21/16

    摘要: In one embodiment, a method for calculating a location of an autonomous driving vehicle includes receiving new global navigation satellite system (GNSS) data. The method further includes identifying a first previously estimated location from a plurality of previously estimated locations with a timestamp that is closest to the timestamp of the new GNSS data and identifying a second previously estimated location from the plurality of previously estimated locations with a most recent timestamp. The method further includes calculating a difference between the first previously estimated location and the second previously estimated location, adjusting the new GNSS data based on the difference; and calculating a current estimated location of the ADV based on the adjusted GNSS data.

    AUTOMATIC CHANNEL PRUNING VIA GRAPH NEURAL NETWORK BASED HYPERNETWORK

    公开(公告)号:US20230084203A1

    公开(公告)日:2023-03-16

    申请号:US17846555

    申请日:2022-06-22

    申请人: Baidu USA, LLC

    IPC分类号: G06N3/08 G06N3/04

    摘要: Model pruning is used to trim large neural networks, like convolutional neural networks (CNNs), to reduce computation overheads. Existing model pruning methods mainly rely on heuristics rules or local relationships of CNN layers. A novel hypernetwork based on graph neural network is disclosed for generating and evaluating pruned networks. A graph is first constructed according to information flow of channels and layers in a CNN network, with channels and layers represented as nodes and information flows represented as edges. A graph neural network is applied to aggregate both local and global dependencies across all channels and layers of the CNN network, resulting in informative node embeddings. With such embeddings, pruned CNN networks including their architectures and weights may be effectively generated and evaluated.