The invention provides a package structure of optical connector, comprising: an input circuit board, an output circuit board, a flexible circuit board, an optical transceiver module, and an enclosure for packing the above components. The input/output circuit board comprises a connecting terminal and an input/output terminal comprising a plurality of input/output ports, wherein the input circuit board and the output circuit board are fixed by the two opposite sides of the enclosure to create a specific space between the input circuit board and the output circuit board. The flexible circuit board is electrically connected to the connecting terminal of the input circuit board and/or the connecting terminal of the output circuit board. The optical transceiver module is electrically connected to the input circuit board and the output circuit board. The enclosure comprises an electrical connecting opening and an optical connecting opening corresponding to the electrical connecting opening.