公开(公告)号：US20220390961A1

公开(公告)日：2022-12-08

申请号：US17341832

申请日：2021-06-08

Applicant: X Development LLC

Inventor： Sarah Ann Laszlo ,  Jeffrey Bush ,  Doris Tang

IPC: G05D1/10 ,  G06N3/04 ,  G06N3/08 ,  G08G5/00 ,  G05D1/00

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving, at each of multiple time steps, sensor data captured by an onboard sensor of a drone at the time step, providing an input including the sensor data to a drone control neural network having a brain emulation sub-network with an architecture that is specified by synaptic connectivity between neurons in a brain of a biological organism, including instantiating a respective artificial neuron in the brain emulation sub-network corresponding to each of multiple biological neurons in the brain of the biological organism, and instantiating a respective connection between each pair of artificial neurons, processing the input using the drone control neural network to generate an action selection output, and selecting an action to be performed to control the drone at the time step based on the action selection output.

公开(公告)号：US20220387109A1

公开(公告)日：2022-12-08

申请号：US17337020

申请日：2021-06-02

Applicant: X Development LLC

Inventor： Sarah Ann Laszlo ,  Benoit Schillings

IPC: A61B34/10 ,  G05B19/4099 ,  B33Y50/00

Abstract: In one aspect, there is provided a method performed by one or more data processing apparatus, the method including obtaining a baseline image of a baseline biological organism brain, obtaining a follow-up image of a target biological organism brain, wherein the follow-up image shows at least a damaged region of the target biological organism brain, processing the baseline image and the follow-up image to generate data defining a predicted anatomical microstructure of the damaged region of the target biological organism brain before the target biological organism brain was damaged, and generating a design for a neural prosthesis for replacing the damaged region of the target biological organism brain based on the predicted anatomical microstructure of the damaged region of the target biological organism brain before the target biological organism brain was damaged.

公开(公告)号：US20220383606A1

公开(公告)日：2022-12-01

申请号：US17834269

申请日：2022-06-07

Applicant: X Development LLC

Inventor： Jie Jacquot ,  Hongxu Ma ,  Allen Richard Zhao ,  Vadim Tschernezki ,  Ronald Votel

IPC: G06V10/143 ,  G06K9/62 ,  G06N3/04 ,  G06N3/08 ,  G06T3/40 ,  G06V10/40

Abstract: Methods, systems, apparatus, and computer-readable media for data band selection using machine learning. In some implementations, image data comprising information for each of multiple wavelength bands is obtained. A multi-layer neural network is trained using the image data to perform one or more classification or regression tasks. A proper subset of the wavelength bands is selected based on parameters of a layer of the trained multi-layer neural network, where the parameters were determined through training of the multi-layer neural network using the image data. Output is provided indicating that the selected wavelength bands are selected for the one or more classification or regression tasks.

公开(公告)号：US20220365532A1

公开(公告)日：2022-11-17

申请号：US17814738

申请日：2022-07-25

Applicant: X Development LLC

Inventor： David Millard ,  Mikael Persson

IPC: G05D1/00 ,  G05D1/02 ,  B25J9/00 ,  B25J9/16 ,  G01C21/20 ,  G06V20/10

Abstract: Systems, methods, devices, and techniques for planning travel of an autonomous robot. A system identifies one or more obstacles that are located in proximity of at least a portion of a planned route for the autonomous robot. For each obstacle, the system: (i) determines a semantic class of the obstacle, including selecting the semantic class from a library that defines a set of multiple possible semantic classes for obstacles, and (ii) selects a planning policy for the obstacle that corresponds to the semantic class of the obstacle. The system can generate a trajectory along the at least the portion of the planned route using the selected planning policies. The robot can then initiate travel according to the trajectory.

公开(公告)号：US20220358265A1

公开(公告)日：2022-11-10

申请号：US17307849

申请日：2021-05-04

Applicant: X Development LLC

Inventor： Kangkang Wang ,  Bodi Yuan ,  Zhiqiang Yuan ,  Hong Wu ,  Daniel Ribeiro Silva ,  Zihao Li

IPC: G06F30/27 ,  G06T17/00 ,  G06N3/04

Abstract: Implementations are described herein for realistic plant growth modeling and various applications thereof. In various implementations, a plurality of two-dimensional (2D) digital images that capture, over time, one or more of a particular type of plant based on one or more machine learning models to generate output, may be processed. The output may be analyzed to extract temporal features that capture change over time to one or more structural features of the particular type of plant. Based on the captured temporal features, a first parameter subspace of whole plant parameters may be learned, wherein the whole plant parameters are usable to generate a three-dimensional (3D) growth model that realistically simulates growth of the particular type of plant over time. Based on the first parameter subspace, one or more 3D growth models that simulate growth of the particular type of plant may be non-deterministically generated and used for various purposes.

公开(公告)号：US20220357753A1

公开(公告)日：2022-11-10

申请号：US17825295

申请日：2022-05-26

Applicant: X Development LLC

Inventor： Martin Friedrich Schubert ,  Michael Jason Grundmann ,  Clifford Biffle ,  Philip Edwin Watson

IPC: G05D1/10 ,  G05D1/00 ,  G06N7/00 ,  B64C39/02 ,  G01C21/00 ,  G05D1/06 ,  G08G5/00 ,  G08G5/02 ,  G01C21/20

Abstract: An example method may include receiving, from a client computing device, an indication of a target drop-off spot for an object within a first virtual model of a first region of a delivery destination. A second virtual model of a second region of the delivery destination may be determined based on sensor data received from one or more sensors on a delivery vehicle. A mapping may be determined between physical features represented in the first virtual model and physical features represented in the second virtual model to determine an overlapping region between the first and second virtual models. A position of the target drop-off spot within the second virtual model may be determined based on the overlapping region. Based on the position of the target drop-off spot within the second virtual model, the delivery vehicle may be navigated to the target drop-off spot to drop off the object.

公开(公告)号：US20220357383A1

公开(公告)日：2022-11-10

申请号：US17729627

申请日：2022-04-26

Applicant: X Development LLC

Inventor： Phillip Ellsworth Stahlfeld ,  Ananya Gupta

IPC: G01R29/18 ,  G06V10/44 ,  G06T7/70

Abstract: Methods, systems, and apparatus, including computer programs encoded on a storage device, for identifying phases of electrical grid wires are disclosed. A method includes identifying, within an image of a utility pole, a cross-arm supporting multiple wires; identifying a cardinal orientation of the cross-arm based on characteristics of the image; and determining, based on the cardinal orientation of the cross-arm, an electrical phase for each of the wires supported by the cross-arm. Identifying the cardinal orientation of the cross-arm includes: determining an orientation of the cross-arm relative to an axis of a field of view of the image; determining a cardinal orientation of the axis of the field of view; and estimating the cardinal orientation of the cross-arm based on an angular difference between the orientation of the cross-arm relative to the axis of a field of view and the cardinal orientation of the axis of the field of view.

公开(公告)号：US11495333B2

公开(公告)日：2022-11-08

申请号：US16902422

申请日：2020-06-16

Applicant: X Development LLC

Inventor： Sarah Ann Laszlo ,  Nina Thigpen ,  Katherine Elise Link ,  Vladimir Miskovic

IPC: G06F16/20 ,  G16H10/20 ,  G06F16/28 ,  G16H50/70 ,  G16H10/60 ,  G06F40/30 ,  G16H50/20 ,  G06Q10/10

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a plurality of answers to a first set of questions. The actions include generating an adjacency matrix based on the question-answer pairs. The actions include determining a network graph that includes question nodes and edges. The actions include identifying one or more clusters of question nodes by applying a community detection algorithm on the network graph. The actions include determining, for each cluster, i) a cluster centrality and ii) a cluster magnitude. The actions include ranking the clusters based on the cluster centralities and the cluster magnitudes of the one or more clusters. The actions include selecting a second set of questions for the user. And, the actions include causing the questions from the second set of questions to be presented to the user.

公开(公告)号：US20220343910A1

公开(公告)日：2022-10-27

申请号：US17811425

申请日：2022-07-08

Applicant: X Development LLC

Inventor： Daniel Alex Lam

IPC: G10L15/22 ,  G06N7/00 ,  B25J13/00 ,  G10L15/26

Abstract: Systems and methods are described include a robot and/or an associated computing system that can use various cues about an environment of the robot to apply a bias to increase the accuracy of speech transcription. In some implementations, audio data corresponding to a spoken instruction to a robot is received. Candidate transcriptions of the audio data are obtained. A respective action of the robot corresponding to each of the candidate transcriptions of the audio data is determined. One or more scores indicating characteristics of a potential outcome of performing the respective action corresponding to the candidate transcription of the audio data are determined for each of the candidate transcriptions of the audio data. A particular candidate transcription is selected from among the candidate transcriptions based at least on the one or more scores. The action determined for the particular candidate transcription is performed.

公开(公告)号：US20220339803A1

公开(公告)日：2022-10-27

申请号：US17857443

申请日：2022-07-05

Applicant: X Development LLC

Inventor： Jeffrey Bingham ,  Taylor Alexander ,  Bianca Homberg ,  Joseph DelPreto ,  Alex Shafer

IPC: B25J19/02 ,  B25J9/10 ,  B25J15/00 ,  B25J13/08 ,  B25J15/02 ,  B25J15/12

Abstract: A robotic gripping device is provided. The robotic gripping device includes a palm and a plurality of digits coupled to the palm. The robotic gripping device also includes a time-of-flight sensor arranged on the palm such that the time-of-flight sensor is configured to generate time-of-flight distance data in a direction between the plurality of digits. The robotic gripping device additionally includes an infrared camera, including an infrared illumination source, where the infrared camera is arranged on the palm such that the infrared camera is configured to generate grayscale image data in the direction between the plurality of digits.