公开(公告)号：US20230370600A1

公开(公告)日：2023-11-16

申请号：US18029397

申请日：2021-09-27

Applicant: KONINKLIJKE PHILIPS N.V.

Inventor： Christiaan Varekamp

IPC: H04N19/126 ,  H04N19/184 ,  H04N19/172 ,  H04N19/167 ,  H04N19/119

CPC classification number: H04N19/126 ,  H04N19/184 ,  H04N19/172 ,  H04N19/167 ,  H04N19/119

Abstract: Methods are provided for encoding and decoding image or video data comprising two or more views (10) of a scene. The encoding method comprises obtaining (11), for each of the two or more views, a respective block segmentation mask (12) of the view and block image data (13) of the view. The method further comprises generating (14) at least one packed frame (40) containing the two or more block segmentation masks and the block image data of the two or more views; and encoding (15) the at least one packed frame into at least one bitstream (16). Each view is divided into blocks of pixels (30), and the block segmentation mask indicates which blocks of pixels belong to an area of interest (31) in the view. The block image data comprises the blocks of pixels that belong to the area of interest. Also provided are a corresponding encoder, decoder, and bitstream.

公开(公告)号：US11656839B2

公开(公告)日：2023-05-23

申请号：US17258822

申请日：2019-07-02

Applicant: KONINKLIJKE PHILIPS N.V.

Inventor： Christiaan Varekamp ,  Jeroen Gerardus Henricus Koppens ,  Bart Kroon ,  Nathan Souviraa-Labastie ,  Arnoldus Werner Johannes Oomen

IPC: G06F3/16 ,  H04L12/18 ,  H04S7/00

CPC classification number: G06F3/165 ,  H04L12/1827 ,  H04S7/304 ,  H04S2400/11 ,  H04S2400/15 ,  H04S2420/01

Abstract: A distribution system comprises an audio server (101) for receiving incoming audio from remote clients (103) and for transmitting audio derived from the incoming audio to the remote clients (103). An audio apparatus comprises an audio a receiver (401) which receives data comprising: audio data for a plurality of audio components representing audio from a remote client of the plurality of remote clients; and proximity data for at least one of the audio components. The proximity data is indicative of proximity between remote clients. A generator (403) of the apparatus generates an audio mix from the audio components in response to the proximity data. For example, an audio component indicated to be proximal to a remote client may be excluded from an audio mix for that remote client.

公开(公告)号：US20220383476A1

公开(公告)日：2022-12-01

申请号：US17641831

申请日：2020-09-08

Applicant: KONINKLIJKE PHILIPS N.V.

Inventor： Christiaan Varekamp

IPC: G06T7/00 ,  G06T15/10 ,  G06T7/55 ,  G06T7/90 ,  G06T9/00

Abstract: An apparatus for evaluating a quality for image capture comprises a stored (101) for storing a model of a scene and a capture circuit (105) for generating virtual captured images for a camera configuration by rendering from the model. A depth generation circuit (107) generates model depth data from the model and a depth estimation circuit (111) generates estimated depth data from the virtual captured images. A first synthesis circuit (109) and a second synthesis circuit (113) generates first and second view images for test poses by processing the virtual captured images based on the model depth data or estimated depth data respectively. A reference circuit (103) generates reference images for the f test poses by rendering based on the model. A quality circuit (115) generates a quality metric based on a comparison of the first view images, the second view images, and the reference images.

公开(公告)号：US11228704B2

公开(公告)日：2022-01-18

申请号：US16768944

申请日：2018-11-30

Applicant: KONINKLIJKE PHILIPS N.V.

Inventor： Christiaan Varekamp ,  Bartholomeus Wilhelmus Sonneveldt

IPC: H04N5/232 ,  G06T7/70

Abstract: An image capturing apparatus comprises a capture unit (101) for capturing images of a scene. A tracker (103) dynamically determines poses of the capture unit and a pose processor (105) determines a current pose of the capture unit (101) relative to a set of desired capture poses. The pose may include a position and orientation of the capture unit (101). A display controller (107) is coupled to the pose processor (105) and is arranged to control a display to present a current capture pose indication, the current capture pose indication comprising an indication of a position of the current pose of the capture unit (101) relative to the set of desired capture poses in a direction outside an image plane of capture unit (101). In some embodiments, the set of desired capture poses may be adaptively updated in response to data captured for the scene.

公开(公告)号：US11189079B2

公开(公告)日：2021-11-30

申请号：US16622996

申请日：2018-06-19

Applicant: KONINKLIJKE PHILIPS N.V.

Inventor： Christiaan Varekamp ,  Bart Kroon ,  Patrick Luc Els Vandewalle

IPC: G06T15/00 ,  G06T15/20 ,  G06T15/04 ,  G06T17/20

Abstract: An apparatus comprises a receiver (201) for receiving an image signal comprising a number of three dimensional images representing a scene from different viewpoints, each three dimensional image comprising a mesh and a texture map, the signal further comprising a plurality of residual data texture maps for a first viewpoint being different from the different viewpoints of the number of three dimensional images, a first residual data texture map of the plurality of residual texture maps providing residual data for a texture map for the first viewpoint relative to a texture map resulting from a viewpoint shift of a first reference texture map being a texture map of a first three dimensional image of the number of three dimensional images and a second residual data texture map of the plurality of residual texture maps providing residual data for a texture map for the first viewpoint relative to a texture map resulting from a viewpoint shift of a second reference texture map being a texture map of a second three dimensional image of the number of three dimensional images. A mesh processor (203) generates a first mesh for the first viewpoint and a second mesh for the first viewpoint from an additional reference mesh being a mesh of the second three dimensional image of the plurality of three dimensional images. A first texture processor (205) generates a first intermediate texture map in response to a viewpoint transformation of the first reference texture map from a viewpoint of the first three dimensional image to the first viewpoint and an second intermediate texture map in response to a viewpoint transformation of the second reference texture map from a viewpoint of the second three dimensional image to the first viewpoint. A second texture processor (207) generates a first texture map in response to a combination of the first intermediate texture map and the first residual data texture map, and a second texture map in response to a combination of the second intermediate texture map and the second additional residual data texture map. An image generator (209) generates an image for a second viewpoint from the first texture map, the first mesh, the second texture map, and the second mesh.

公开(公告)号：US11172183B2

公开(公告)日：2021-11-09

申请号：US16607394

申请日：2018-04-26

Applicant: KONINKLIJKE PHILIPS N.V.

Inventor： Christiaan Varekamp ,  Wilhelmus Hendrikus Alfonsus Bruls

IPC: G06K9/00 ,  H04N13/128 ,  H04N13/271 ,  H04N13/261 ,  H04N13/00

Abstract: An apparatus for processing a depth map comprises a receiver (203) receiving an input depth map. A first processor (205) generates a first processed depth map by processing pixels of the input depth map in a bottom to top direction. The processing of a first pixel comprises determining a depth value for the first pixel for the first processed depth map as the furthest backwards depth value of: a depth value for the first pixel in the input depth map, and a depth value determined in response to depth values in the first processed depth map for a first set of pixels being below the first pixel. The approach may improve the consistency of depth maps, and in particular for depth maps generated by combining different depth cues.

公开(公告)号：US11122295B2

公开(公告)日：2021-09-14

申请号：US16959208

申请日：2019-01-04

Applicant: KONINKLIJKE PHILIPS N.V.

Inventor： Bart Kroon ,  Christiaan Varekamp ,  Patrick Luc Els Vandewalle

IPC: H04N19/597 ,  H04N19/166 ,  H04N13/161 ,  H04N13/00

Abstract: An apparatus comprises a store (201) storing a set of image parts and associated depth data for images representing a scene from different view poses (position and orientation). A predictability processor (203) generates predictability measures for image parts of the set of images for view poses of the scene. A predictability measure for a first image part for a first view pose is indicative of an estimate of the prediction quality for a prediction of at least part of an image for a viewport of the first view pose from a subset of image parts of the set of image parts not including the first image part. A selector (205) selects a subset of image parts of the set of image parts in response to the predictability measures, and a bitstream generator (207) for generating the image bitstream comprising image data and depth data from the subset of image parts.

公开(公告)号：US10607351B2

公开(公告)日：2020-03-31

申请号：US15741403

申请日：2016-07-12

Applicant: KONINKLIJKE PHILIPS N.V.

Inventor： Christiaan Varekamp ,  Patrick Luc Els Vandewalle

IPC: G06T7/521 ,  G01S17/89 ,  G01S17/02 ,  G01B11/25 ,  G06T7/55 ,  G06T7/586 ,  G01S17/46 ,  G01S17/08

Abstract: An apparatus for determining a depth map for an image of a scene comprises an active depth sensor (103) and a passive depth sensor (105) for determining a depth map for the image. The apparatus further comprises a light determiner (109) which determines a light indication indicative of a light characteristic for the scene. The light indication may specifically reflect a level of visible and/or infrared light for the scene. A depth map processor (107) determines an output depth map for the image by combining the first depth map and the second depth map. Specifically, a depth value for the output depth map is determined as a combination of depth values of the first and the second depth map where the combining is dependent on the light indication. The light determiner (109) estimates the first infrared light indication from a visible light indication indicative of a light level in a frequency band of the visible light spectrum.

公开(公告)号：US10212407B2

公开(公告)日：2019-02-19

申请号：US15515160

申请日：2015-09-24

Applicant: KONINKLIJKE PHILIPS N.V.

Inventor： Christiaan Varekamp ,  Patrick Luc Els Vandewalle

IPC: H04N13/122 ,  H04N13/128 ,  H04N13/00

Abstract: An apparatus for reducing the visibility of disparity estimation errors at edges, and in particular at overlays. The apparatus comprises a receiver (401) for receiving a three dimensional image represented by at least image values (brightness/contrast values) and a disparity value. A subset selector (403) evaluates an image property criterion for the image value for a group of pixels and determines a subset of pixels of the group of pixels for which the image property criterion is met. The criterion may for example reflect whether the pixel belongs to an image object edge. A distribution evaluator (405) generates a frequency distribution for disparity values of the subset of pixels and an analyzer (407) determines a shape property for the frequency distribution (the presence of a peak). An adaptor (409) determining a disparity remapping in response to the shape property and a remapper (411) modifies disparity values of the three dimensional image by applying the disparity remapping. The approach may e.g. reduce image depth when overlay graphics is likely to be present.

公开(公告)号：US09648308B2

公开(公告)日：2017-05-09

申请号：US14388045

申请日：2013-03-19

Applicant: KONINKLIJKE PHILIPS N.V.

Inventor： Karel Johannes Gerhardus Hinnen ,  Erno Hermanus Antonius Langendijk ,  Christiaan Varekamp

IPC: H04N13/00 ,  H04N13/04

CPC classification number: H04N13/305 ,  H04N13/183 ,  H04N13/31 ,  H04N13/32 ,  H04N13/351 ,  H04N13/354 ,  H04N13/359 ,  H04N13/368 ,  H04N13/373 ,  H04N13/376 ,  H04N13/398

Abstract: A display device (120) has a 3D display (160) for emitting at least two views of 3D image data to enable autostereoscopic viewing of 3D image data at multiple viewing positions (182, 184). A processor (140) processes the 3D image data (122) for generating the views for display on the 3D display, and a viewer detector (130) detects a viewer position of a viewer in front of the 3D display. The processor has a viewer conflict detector (141) for detecting and resolving viewer position conflicts. The detector obtains at least a first viewer position of a first viewer via the viewer detector, and detects a viewer position conflict at the first viewer position where said first view and second view do not provide the 3D effect for the first viewer. If so, the detector controls generating the views in dependence of the detected viewer position conflict. At least one of said at least two views as received by the first viewer is dynamically modified to signal or resolve the conflict.