SERVER-SIDE FRAME RENDER TIMING DELAY TO REDUCE CLIENT-SIDE FRAME PRESENT DELAY

    公开(公告)号:US20240196033A1

    公开(公告)日:2024-06-13

    申请号:US18078603

    申请日:2022-12-09

    发明人: Yuping Shen Min Zhang

    摘要: In a cloud gaming system or other remote video streaming system, a client device and a server coordinate to introduce an adjustable delay in the frame start timing in the frame rendering pipeline at the server to reducing vertical synchronization (VSYNC) presentation latency, and thus reduce overall frame latency. In implementations, the coordination between the client device and the server includes the client device observing the current VSYNC presentation latencies in recently processed video frames reporting this observed VSYNC presentation latency to the server. The server uses this feedback to determine a frame start delay that is then used to introduce a frame start shift for an upcoming frame and subsequent frames, thereby shifting the server rendering and encoding pipeline back so that the resulting video frames are made available to present at the client device closer to their respective VSYNC signal assertions.

    Transmission apparatus, transmission method, and program

    公开(公告)号:US11949887B2

    公开(公告)日:2024-04-02

    申请号:US17638407

    申请日:2020-08-28

    发明人: Katsushi Otsuka

    摘要: A transmission apparatus, a transmission method, and a program that can reduce the number of times that useless transmission of image data is performed due to a failure in reception of image data indicating a reference destination. A transmission failure likelihood data management section checks the likelihood of a failure in transmission of first image data. Second image is an image rendered in a frame buffer for the first time after a timing when a predetermined time has elapsed since the transmission of the first image data. An encoding processing section controls whether or not to generate second image data requiring no reference destination, depending on the likelihood of the failure in the transmission of the first image data at a timing of encoding the second image.

    METHOD TO OPTIMIZE THE QUALITY OF VIDEO DELIVERED OVER A NETWORK

    公开(公告)号:US20240040136A1

    公开(公告)日:2024-02-01

    申请号:US18379595

    申请日:2023-10-12

    摘要: A system and method for transcoding data. The system includes an adaptive transcoder that transcodes data to produce transcoded data having a first data rate, and transmits the transcoded data to a client device. The adaptive transcoder receives a quality signal. The adaptive transcoder transcodes the data at a second data rate in response to the adaptive transcoder determining that the quality signal indicates that the first data rate is deficient based on at least one of processing capabilities of the client device and network connection capabilities between the adaptive transcoder and the client device.

    Data transmission system and data transmission method

    公开(公告)号:US11825233B2

    公开(公告)日:2023-11-21

    申请号:US17518577

    申请日:2021-11-03

    发明人: Jie Li Jie Zhang

    摘要: Disclosed is a data transmission system having a transmitter and a receiver. The transmitter encodes external input signals to acquire coded transmission data transmitted in multiple paths with different frequency band, and then transmits them to respective receiver; and the receiver performs data fusion on the received transmission signals to acquire coded received data, and decodes it to acquire and output the decoded data. In conclusion, since the received signals are split into a plurality of transmission signals of different frequency bands by the transmitter and the signals are fused in the receiver, the signals are not susceptible to the same frequency interference during transmission, improving the anti-interference of the data transmission system, realizing high-reliability transmission at low cost or in a complex wireless environment, also expanding the applications of the data transmission system.

    METHOD AND DEVICE FOR CONTROLLING TRANSMISSION OR RECEPTION OF DATA IN WIRELESS COMMUNICATION SYSTEM

    公开(公告)号:US20230345030A1

    公开(公告)日:2023-10-26

    申请号:US18013756

    申请日:2021-06-25

    摘要: The present disclosure relates to a method and device for controlling transmission or reception of data in a wireless communication system, an operating method of a transmission user equipment (UE) in a wireless communication system including: obtaining a point cloud by photographing an object; transmitting, to a reception UE, a message including a parameter for transmission and reception of the point cloud, wherein the parameter for transmission and reception of the point cloud includes at least one of a parameter associated with a direction of the object or a space parameter associated with the object; receiving, from the reception UE, a response message including an application parameter of the reception UE, wherein the application parameter of the reception UE is determined based on the parameter for transmission and reception of the point cloud and a channel state of the reception UE; compressing the point cloud, based on the application parameter of the reception UE, and transmitting, to the reception UE, the compressed point cloud.

    A Method, An Apparatus and a Computer Program Product for Video Encoding and Video Decoding

    公开(公告)号:US20230146498A1

    公开(公告)日:2023-05-11

    申请号:US17914852

    申请日:2021-03-24

    摘要: Some embodiments relate to a method including obtaining information of available quality features of a sender device for providing omnidirectional visual media content; selecting one or more of the available quality features; and providing an indication of the selected one or more of the available quality features. There is also provided a method including obtaining information of available quality features of a receiver device for processing omnidirectional visual media content; providing an indication of the available quality features; receiving from a sender device indication of available quality features of the sender device among the available quality features of the receiver device; selecting one of the quality features, which are available both in the sender device and in the receiver device; and providing an indication of the selected quality feature.

    METHOD AND APPARATUS FOR ARTIFICIAL INTELLIGENCE DOWNSCALING AND UPSCALING DURING VIDEO CONFERENCE

    公开(公告)号:US20230085530A1

    公开(公告)日:2023-03-16

    申请号:US17895561

    申请日:2022-08-25

    摘要: Provided is an electronic device configured to participate in video conference by using artificial intelligence (AI), the electronic device including a display and a processor configured to execute one or more instructions. The processor configured to obtain, from a server, image data generated by first encoding first image related to another electronic device participating in video conference, and AI data related to AI downscaling from original image to first image, obtain second image corresponding to first image by performing first decoding on image data, determine whether to perform AI upscaling on second image, based on importance of the other electronic device, based on determining to perform AI upscaling, obtain third image by performing AI upscaling on second image through an upscaling deep neural network and provide third image to display, and based on determining not to perform AI upscaling, provide second image to display.

    ENTROPY-BASED PRE-FILTERING USING NEURAL NETWORKS FOR STREAMING APPLICATIONS

    公开(公告)号:US20230085156A1

    公开(公告)日:2023-03-16

    申请号:US17466176

    申请日:2021-09-03

    IPC分类号: H04N19/117 H04N19/164

    摘要: In various examples, a deep neural network (DNN) based pre-filter for content streaming applications is used to dynamically adapt scene entropy (e.g., complexity) in response to changing network or system conditions of an end-user device. For example, where network and/or system performance issues or degradation are identified, the DNN may be implemented as a frame pre-filter to reduce the complexity or entropy of the frame prior to streaming—thereby allowing the frame to be streamed at a reduced bit rate without requiring a change in resolution. The DNN-based pre-filter may be tuned to maintain image detail along object, boundary, and/or surface edges such that scene navigation—such as by a user participating in an instance of an application—may be easier and more natural to the user.