公开(公告)号：US09918068B2

公开(公告)日：2018-03-13

申请号：US14115099

申请日：2012-06-15

申请人： Yu-Lin Chang ,  Shih-Ta Hsiang ,  Chi-Ling Wu ,  Chih-Ming Fu ,  Chia-Ping Chen ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Yu-Lin Chang ,  Shih-Ta Hsiang ,  Chi-Ling Wu ,  Chih-Ming Fu ,  Chia-Ping Chen ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N13/00 ,  H04N19/597 ,  H04N19/119 ,  G06T9/00 ,  H04N19/503

CPC分类号： H04N13/161 ,  G06T9/00 ,  H04N19/119 ,  H04N19/503 ,  H04N19/597

摘要： A method and apparatus for texture image compression in a 3D video coding system are disclosed. Embodiments according to the present invention derive depth information related to a depth map associated with a texture image and then process the texture image based on the depth information derived. The invention can be applied to the encoder side as well as the decoder side. The encoding order or decoding order for the depth maps and the texture images can be based on block-wise interleaving or picture-wise interleaving. One aspect of the present invent is related to partitioning of the texture image based on depth information of the depth map. Another aspect of the present invention is related to motion vector or motion vector predictor processing based on the depth information.

公开(公告)号：US08755437B2

公开(公告)日：2014-06-17

申请号：US13177808

申请日：2011-07-07

申请人： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/28

CPC分类号： H04N19/513 ,  H04N19/52

摘要： An apparatus and method for deriving a motion vector predictor are disclosed. In video coding systems, the spatial and temporal redundancy is exploited using spatial and temporal prediction to reduce the information to be transmitted or stored. Motion vector prediction has been used to further conserve the bitrate associated with motion vector coding. In a conventional coding system, a motion vector predictor (MVP) is selected from the spatial MVPs and temporal MVP. The spatial MVP according to a conventional approach is based on motion vectors (MVs) of neighboring blocking pointing to a target reference picture in a given reference list. Embodiments according to the present invention perform the MVP search among an extended search set including MVs pointing to other reference pictures in the given reference list or the other reference list and MVs pointing to the target reference picture in the given reference list or the other reference list. Other aspects of the present invention address the search order of the search set and configuration of neighboring blocks.

摘要翻译： 公开了一种用于导出运动矢量预测器的装置和方法。 在视频编码系统中，使用空间和时间预测来利用空间和时间冗余来减少要发送或存储的信息。 运动矢量预测已被用于进一步节省与运动矢量编码相关的比特率。 在常规编码系统中，从空间MVP和时间MVP中选择运动矢量预测器（MVP）。 根据常规方法的空间MVP基于指向给定参考列表中的目标参考图片的相邻块的运动矢量（MV）。 根据本发明的实施例在包括指定给定参考列表中的其他参考图片的MV的扩展搜索集或另一参考列表中的MVP搜索和指向给定参考列表或另一参考列表中的目标参考图片的MV 。 本发明的其它方面解决了搜索集的搜索顺序和相邻块的配置。

公开(公告)号：US20130303247A1

公开(公告)日：2013-11-14

申请号：US13466960

申请日：2012-05-08

申请人： Chi-Ling WU ,  Yu-Pao TSAI ,  Yu-Lin CHANG

发明人： Chi-Ling WU ,  Yu-Pao TSAI ,  Yu-Lin CHANG

IPC分类号： A63F13/04 ,  G09G5/00

CPC分类号： G06F3/011 ,  A63F13/005 ,  A63F2300/1087 ,  A63F2300/8076 ,  A63F2300/8082 ,  G06F3/005 ,  G06F3/017 ,  G06F3/0304

摘要： An interaction display system applied in a mobile device is provided. The system has a first camera, facing a first side of the mobile device configured to capture first images of a user; a second camera, facing a second side opposite to the first side of the mobile device, configured to capture second images of a scene; and a processing unit coupled to the first camera and the second camera directly, configured to perform interactions between the user and the scene utilizing the first images and the second images simultaneously captured by the first camera and the second camera.

摘要翻译： 提供了一种应用在移动设备中的交互式显示系统。 该系统具有第一相机，面向被配置为捕获用户的第一图像的移动设备的第一侧; 面向与移动设备的第一侧相对的第二侧的第二相机，被配置为捕获场景的第二图像; 以及处理单元，其直接耦合到所述第一相机和所述第二相机，被配置为使用由所述第一相机和所述第二相机同时捕获的所述第一图像和所述第二图像来执行所述用户与所述场景之间的交互。

公开(公告)号：US20120128060A1

公开(公告)日：2012-05-24

申请号：US13047600

申请日：2011-03-14

申请人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26 ,  H04N7/32

CPC分类号： H04N19/00696 ,  H04N19/573 ,  H04N19/577

摘要： An apparatus and method for deriving a motion vector predictor or a motion vector predictor candidate or a motion vector or a motion vector candidate for a current block are disclosed. In video coding systems, the spatial and temporal redundancy is exploited using spatial and temporal prediction to reduce the information to be transmitted or stored. Motion Vector Prediction (MVP) has been used to further conserve the bitrate associated with motion vector coding. The MVP technique being developed for the current HEVC only considers the motion vector having the same reference list and the same reference picture index as the current block to be an available spatial motion vector predictor candidate. It is desirable to develop a MVP scheme that can improve the availability of the motion vector predictor candidate based on motion vectors from the spatially neighboring block. Accordingly, an apparatus and method for determining a motion vector predictor or motion vector predictor candidate or motion vector or motion vector candidate for a current block based on motion vectors associated with reference pictures in list 0 and list 1 of a neighboring block are disclosed. The improved MVP scheme may reduce motion vector residues and consequently the coding efficiency can be improved. Furthermore, the MVP scheme is based on a priority order so that the predictor can be derived at the decoder using decoded information without side information.

摘要翻译： 公开了一种用于导出运动矢量预测器或运动矢量预测器候选或用于当前块的运动矢量或运动矢量候选的装置和方法。 在视频编码系统中，使用空间和时间预测来利用空间和时间冗余来减少要发送或存储的信息。 运动矢量预测（MVP）已被用于进一步节省与运动矢量编码相关的比特率。 针对当前HEVC开发的MVP技术仅考虑具有与当前块相同的参考列表和相同参考图像索引的运动矢量作为可用的空间运动矢量预测器候选。 期望开发可以基于来自空间相邻块的运动矢量来提高运动矢量预测器候选的可用性的MVP方案。 因此，公开了一种用于基于与相邻块的列表0和列表1中的参考图片相关联的运动矢量来确定当前块的运动矢量预测器或运动矢量预测器候选或运动矢量或运动矢量候选的装置和方法。 改进的MVP方案可以减少运动矢量残差，从而可以提高编码效率。 此外，MVP方案基于优先级顺序，使得可以在解码器处使用没有副信息的解码信息来导出预测器。

公开(公告)号：US20120063514A1

公开(公告)日：2012-03-15

申请号：US13048893

申请日：2011-03-16

申请人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Shaw-Min Lei

IPC分类号： H04N7/32

CPC分类号： H04N19/00715 ,  H04N19/54 ,  H04N19/547 ,  H04N19/56 ,  H04N19/573 ,  H04N19/58 ,  H04N19/70

摘要： A method for performing hybrid multihypothesis prediction during video coding of a coding unit includes: processing a plurality of sub-coding units in the coding unit; and performing motion vector derivation of a portion of the sub-coding units. More particularly, the step of performing motion vector derivation of the portion of the sub-coding units further includes: deriving a plurality of motion vectors for multihypothesis motion-compensated prediction of a specific sub-coding unit of the portion of the sub-coding units from at least one other sub-coding/coding unit or by performing motion estimation. The method further includes performing multihypothesis motion-compensated prediction on the specific sub-coding unit according to the plurality of motion vectors, and more particularly, includes utilizing a linear combination of a plurality of pixel values derived from the plurality of motion vectors as a predicted pixel value of the specific sub-coding unit. An associated apparatus is also provided.

摘要翻译： 一种用于在编码单元的视频编码期间执行混合多重假设预测的方法包括：在编码单元中处理多个子编码单元; 以及执行子编码单元的一部分的运动矢量导出。 更具体地，执行子编码单元的部分的运动矢量导出的步骤还包括：导出用于子编码单元的一部分的特定子编码单元的多假设运动补偿预测的多个运动矢量 从至少一个其他子编码/编码单元或通过执行运动估计。 该方法还包括根据多个运动矢量对特定子编码单元执行多重假设运动补偿预测，更具体地，包括利用从多个运动矢量导出的多个像素值的线性组合作为预测 特定子编码单元的像素值。 还提供了一种相关联的装置。

公开(公告)号：US20110255600A1

公开(公告)日：2011-10-20

申请号：US13080668

申请日：2011-04-06

申请人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Shaw-Min Lei

IPC分类号： H04N7/12

CPC分类号： H04N19/139 ,  H04N19/513 ,  H04N19/52 ,  H04N19/56

摘要： A method for performing localized multihypothesis prediction during video coding of a coding unit includes: dividing the coding unit into a plurality of sub-coding units; and performing motion vector prediction of each of the sub-coding units. More particularly, the step of performing motion vector prediction of each of the sub-coding units further includes: obtaining a plurality of motion vectors for multihypothesis motion compensation of a specific sub-coding unit of the sub-coding units from a plurality of other sub-coding/coding units. The method further includes performing multihypothesis motion compensation on the specific sub-coding unit according to the plurality of motion vectors, and more particularly, includes utilizing a linear combination of a plurality of pixel values of the plurality of other sub-coding/coding units as a predicted pixel value of the specific sub-coding unit. An associated apparatus is also provided.

摘要翻译： 一种用于在编码单元的视频编码期间执行局部多重假设预测的方法包括：将编码单元划分为多个子编码单元; 以及对每个子编码单元进行运动矢量预测。 更具体地，执行每个子编码单元的运动矢量预测的步骤还包括：从多个其他子级获得多个子编码单元的特定子编码单元的多假设运动补偿的运动矢量 编码/编码单元。 该方法还包括根据多个运动矢量对特定子编码单元执行多重假设运动补偿，更具体地，包括利用多个其他子编码/编码单元的多个像素值的线性组合作为 特定子编码单元的预测像素值。 还提供了一种相关联的装置。

公开(公告)号：US09300963B2

公开(公告)日：2016-03-29

申请号：US13879903

申请日：2012-01-19

申请人： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Chih-Ming Fu ,  Chi-Ling Wu ,  Yu-Pao Tsai ,  Ching-Yeh Chen ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Chih-Ming Fu ,  Chi-Ling Wu ,  Yu-Pao Tsai ,  Ching-Yeh Chen ,  Shaw-Min Lei

IPC分类号： H04N11/02 ,  H04N19/65 ,  H04N19/52

CPC分类号： H04N19/109 ,  H04N19/119 ,  H04N19/139 ,  H04N19/147 ,  H04N19/174 ,  H04N19/177 ,  H04N19/184 ,  H04N19/52 ,  H04N19/567 ,  H04N19/593 ,  H04N19/615 ,  H04N19/65 ,  H04N19/70 ,  H04N19/895

摘要： A method and apparatus for deriving a motion vector predictor (MVP) are disclosed. The MVP is selected from spatial MVP and temporal MVP candidates. The method uses a flag to indicate whether temporal MVP candidates are disabled. If the flag indicates that the temporal MVP candidates are disabled, the MVP is derived from the spatial MVP candidates only. Otherwise, the MVP is derived from the spatial and temporal MVP candidates. The method may further skip spatial redundant MVP removal by comparing MV values. Furthermore, the parsing error robustness scheme determines a forced temporal MVP when a temporal MVP is not available and the temporal MVP candidates are allowed as indicated by the flag. The flag may be incorporated in sequence, picture, slice level, or a combination of these levels.

摘要翻译： 公开了一种用于导出运动矢量预测器（MVP）的方法和装置。 MVP从空间MVP和时间MVP候选中选择。 该方法使用标志来指示是否禁用时间MVP候选。 如果标志指示时间MVP候选被禁用，则MVP仅从空间MVP候选导出。 否则，MVP是从空间和时间MVP候选导出的。 该方法可以通过比较MV值来进一步跳过空间冗余MVP去除。 此外，解析误差鲁棒性方案在时间MVP不可用时确定强制时间MVP，并且如标志所指示的那样允许时间MVP候选。 标志可以按序列，图片，切片级别或这些级别的组合来合并。

公开(公告)号：US09137544B2

公开(公告)日：2015-09-15

申请号：US13206891

申请日：2011-08-10

申请人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N19/52

CPC分类号： H04N19/52

摘要： A method and apparatus for deriving a temporal motion vector predictor (MVP) are disclosed. The MVP is derived for a current block of a current picture in Inter, or Merge, or Skip mode based on co-located reference blocks of a co-located block. The co-located reference blocks comprise an above-left reference block of the bottom-right neighboring block of the co-located block. The reference motion vectors associated with the co-located reference blocks are received and used to derive the temporal MVP. Various configurations of co-located reference blocks can be used to practice the present invention. If the MVP cannot be found based on the above-left reference block, search for the MVP can be continued based on other co-located reference blocks. When an MVP is found, the MVP is checked against the previously found MVP. If the MVP is the same as the previously found MVP, the search for MVP continues.

摘要翻译： 公开了用于导出时间运动矢量预测器（MVP）的方法和装置。 基于同位置块的同位置参考块，针对Inter或当前图像的当前块导出MVP，或合并或跳跃模式。 共同定位的参考块包括同位置块的右下相邻块的左上参考块。 与同位置参考块相关联的参考运动矢量被接收并用于导出时间MVP。 可以使用共同定位的参考块的各种配置来实施本发明。 如果基于上述左参考块不能找到MVP，则可以基于其他同位置参考块继续搜索MVP。 当找到MVP时，将针对先前发现的MVP检查MVP。 如果MVP与以前发现的MVP相同，则继续搜索MVP。

公开(公告)号：US08837816B2

公开(公告)日：2014-09-16

申请号：US13527583

申请日：2012-06-19

申请人： Yu-Lin Chang ,  Yu-Pao Tsai

发明人： Yu-Lin Chang ,  Yu-Pao Tsai

IPC分类号： G06K9/00 ,  G06K9/32 ,  G06T7/00

CPC分类号： G06T7/0075 ,  G06T7/593 ,  G06T2207/10012 ,  G06T2207/20016

摘要： A method for generating a final depth information related map includes the following steps: receiving a coarse depth information related map, wherein a resolution of the coarse depth information related map is smaller than a resolution of the final depth information related map; and outputting the final depth information related map reconstructed from the coarse depth information related map by receiving an input data and performing a guided interpolation operation upon the coarse depth information related map according to the input data.

摘要翻译： 一种用于生成最终深度信息相关地图的方法包括以下步骤：接收与粗深度信息相关的地图的分辨率小于最终深度信息相关地图的分辨率的粗略深度信息相关地图; 并通过接收输入数据输出从粗略深度信息相关图重建的最终深度信息相关图，并根据输入数据对粗深度信息相关图进行引导插值运算。

公开(公告)号：US08837592B2

公开(公告)日：2014-09-16

申请号：US12987170

申请日：2011-01-10

申请人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Shaw-Min Lei

IPC分类号： H04N7/26 ,  H04N19/51 ,  H04N19/56

CPC分类号： H04N19/139 ,  H04N19/513 ,  H04N19/52 ,  H04N19/56

摘要： A method for performing local motion vector derivation during video coding of a coding unit includes: processing a plurality of sub-coding units in the coding unit; and performing motion vector prediction of each of the sub-coding units. More particularly, the step of performing motion vector prediction of each of the sub-coding units further includes: deriving a motion vector of a specific sub-coding unit of the sub-coding units by utilizing at least one motion vector of at least one other sub-coding/coding unit. Thus, the method performs motion compensation on the specific sub-coding unit according to the motion vector of the specific sub-coding unit. An associated apparatus is also provided.

摘要翻译： 一种用于在编码单元的视频编码期间执行局部运动矢量导出的方法包括：处理编码单元中的多个子编码单元; 以及对每个子编码单元进行运动矢量预测。 更具体地，执行每个子编码单元的运动矢量预测的步骤还包括：通过利用至少一个其他的至少一个运动矢量来导出子编码单元的特定子编码单元的运动矢量 子编码/编码单元。 因此，该方法根据特定子编码单元的运动矢量对特定子编码单元执行运动补偿。 还提供了一种相关联的装置。