A method and apparatus of encoding frames with a frame type structure adaptively according to a current encoding status after receiving a request for an IDR frame or receiving an indication of picture data loss are disclosed. If the check result of the current encoding status is true, the second frame type structure is the same as the first frame type structure; and if the check result of the current encoding status is false, the second frame type structure is different from the first frame type structure. Another method and apparatus of encoding frames with a reference frame structure and a frame type structure adaptively according to one or more current encoding statuses after receiving an indication of picture data loss are disclosed. The system may use two different check results to adaptively select the reference frame structure and the frame type structure.