-
公开(公告)号:US12200084B2
公开(公告)日:2025-01-14
申请号:US18513681
申请日:2023-11-20
Applicant: BRIGHT DATA LTD.
Inventor: Derry Shribman , Ofer Vilenski
IPC: H04L67/60 , H04L9/40 , H04L43/0864 , H04L65/612 , H04L67/02 , H04L67/06 , H04L67/141 , H04L67/567 , H04L67/59 , H04L67/52 , H04N21/462 , H04W4/029
Abstract: A method for fetching a content from a web server to a client device is disclosed, using tunnel devices serving as intermediate devices. The client device accesses an acceleration server to receive a list of available tunnel devices. The requested content is partitioned into slices, and the client device sends a request for the slices to the available tunnel devices. The tunnel devices in turn fetch the slices from the data server, and send the slices to the client device, where the content is reconstructed from the received slices. A client device may also serve as a tunnel device, serving as an intermediate device to other client devices. Similarly, a tunnel device may also serve as a client device for fetching content from a data server. The selection of tunnel devices to be used by a client device may be in the acceleration server, in the client device, or in both. The partition into slices may be overlapping or non-overlapping, and the same slice (or the whole content) may be fetched via multiple tunnel devices.
-
公开(公告)号:US12147490B2
公开(公告)日:2024-11-19
申请号:US17943294
申请日:2022-09-13
Applicant: BRIGHT DATA LTD.
Inventor: Derry Shribman , Ofer Vilenski
IPC: H04L29/08 , G06F9/54 , G06F16/909 , G06F16/955 , H04L1/00 , H04L67/01 , H04L67/02 , H04L67/146 , H04L67/568 , H04L69/40 , H04L61/59 , H04L67/56
Abstract: A method for overcoming intermittent, temporary, or other fetching failures by using multiple attempts for retrieving a content from a web server to a client device is disclosed. The URL fetching may use direct or non-direct fetching schemes, or a combination thereof. The non-direct fetching method may use intermediate devices, such as proxy server, Data-Center proxy server, tunnel devices, or any combination thereof. Upon sensing a failure of a fetching action, the action is repeated using the same or different parameters or attributes, such as by using different intermediate devices, selected based on different parameters or attributes, such as different countries. The repetitions are limited to a pre-defined maximum number or attempts. The fetching attempts may be performed by the client device, by an intermediate device in a non-direct fetching scheme, or a combination thereof. Various fetching schemes may be used sequentially until the content is retrieved.
-
公开(公告)号:US20240370519A1
公开(公告)日:2024-11-07
申请号:US18775204
申请日:2024-07-17
Applicant: BRIGHT DATA LTD.
Inventor: Derry Shribman , Ofer Vilenski
IPC: G06F16/955 , G06F9/54 , G06F16/909 , H04L1/00 , H04L61/59 , H04L67/01 , H04L67/02 , H04L67/146 , H04L67/56 , H04L67/568 , H04L69/40
Abstract: A method for overcoming intermittent, temporary, or other fetching failures by using multiple attempts for retrieving a content from a web server to a client device is disclosed. The URL fetching may use direct or non-direct fetching schemes, or a combination thereof. The non-direct fetching method may use intermediate devices, such as proxy server, Data-Center proxy server, tunnel devices, or any combination thereof. Upon sensing a failure of a fetching action, the action is repeated using the same or different parameters or attributes, such as by using different intermediate devices, selected based on different parameters or attributes, such as different countries. The repetitions are limited to a pre-defined maximum number or attempts. The fetching attempts may be performed by the client device, by an intermediate device in a non-direct fetching scheme, or a combination thereof. Various fetching schemes may be used sequentially until the content is retrieved.
-
公开(公告)号:US20240331053A1
公开(公告)日:2024-10-03
申请号:US18738081
申请日:2024-06-10
Applicant: BRIGHT DATA LTD.
Inventor: Derry Shribman , Ofer Vilenski
IPC: G06Q40/08 , E03B7/07 , G05B15/02 , G06Q10/10 , G06Q30/02 , G06Q50/16 , G06Q50/163 , G08B21/04 , G08B21/20 , G16Y10/50 , G16Y40/10 , H04L12/28
CPC classification number: G06Q40/08 , E03B7/071 , G05B15/02 , G06Q10/10 , G06Q30/0278 , G06Q50/16 , G06Q50/163 , G08B21/20 , G16Y10/50 , H04L12/2823 , H04L12/2827 , G05B2219/163 , G05B2219/2642 , G08B21/043 , G16Y40/10 , H04L12/2803
Abstract: A method for fetching a content from a web server to a client device is disclosed, using tunnel devices serving as intermediate devices. The client device accesses an acceleration server to receive a list of available tunnel devices. The requested content is partitioned into slices, and the client device sends a request for the slices to the available tunnel devices. The tunnel devices in turn fetch the slices from the data server, and send the slices to the client device, where the content is reconstructed from the received slices. A client device may also serve as a tunnel device, serving as an intermediate device to other client devices. Similarly, a tunnel device may also serve as a client device for fetching content from a data server. The selection of tunnel devices to be used by a client device may be in the acceleration server, in the client device, or in both. The partition into slices may be overlapping or non-overlapping, and the same slice (or the whole content) may be fetched via multiple tunnel devices.
-
公开(公告)号:US12101372B2
公开(公告)日:2024-09-24
申请号:US18513677
申请日:2023-11-20
Applicant: BRIGHT DATA LTD.
Inventor: Derry Shribman , Ofer Vilenski
IPC: H04L67/01 , H04L41/046 , H04L67/02 , H04L67/1001 , H04L67/1023 , H04L67/1061 , H04L67/1074 , H04L67/142 , H04L67/50 , H04L67/563 , H04L67/564
CPC classification number: H04L67/01 , H04L41/046 , H04L67/1001 , H04L67/1023 , H04L67/1063 , H04L67/108 , H04L67/142 , H04L67/535 , H04L67/563 , H04L67/564 , H04L67/02
Abstract: A system designed for increasing network communication speed for users, while lowering network congestion for content owners and ISPs. The system employs network elements including an acceleration server, clients, agents, and peers, where communication requests generated by applications are intercepted by the client on the same machine. The IP address of the server in the communication request is transmitted to the acceleration server, which provides a list of agents to use for this IP address. The communication request is sent to the agents. One or more of the agents respond with a list of peers that have previously seen some or all of the content which is the response to this request (after checking whether this data is still valid). The client then downloads the data from these peers in parts and in parallel, thereby speeding up the Web transfer, releasing congestion from the Web by fetching the information from multiple sources, and relieving traffic from Web servers by offloading the data transfers from them to nearby peers.
-
公开(公告)号:US20240314191A1
公开(公告)日:2024-09-19
申请号:US18675522
申请日:2024-05-28
Applicant: BRIGHT DATA LTD.
Inventor: Derry Shribman , Ofer Vilenski
IPC: H04L67/01 , H04L41/046 , H04L67/02 , H04L67/1001 , H04L67/1023 , H04L67/1061 , H04L67/1074 , H04L67/142 , H04L67/50 , H04L67/563 , H04L67/564
CPC classification number: H04L67/01 , H04L41/046 , H04L67/1001 , H04L67/1023 , H04L67/1063 , H04L67/108 , H04L67/142 , H04L67/535 , H04L67/563 , H04L67/564 , H04L67/02
Abstract: A system designed for increasing network communication speed for users, while lowering network congestion for content owners and ISPs. The system employs network elements including an acceleration server, clients, agents, and peers, where communication requests generated by applications are intercepted by the client on the same machine. The IP address of the server in the communication request is transmitted to the acceleration server, which provides a list of agents to use for this IP address. The communication request is sent to the agents. One or more of the agents respond with a list of peers that have previously seen some or all of the content which is the response to this request (after checking whether this data is still valid). The client then downloads the data from these peers in parts and in parallel, thereby speeding up the Web transfer, releasing congestion from the Web by fetching the information from multiple sources, and relieving traffic from Web servers by offloading the data transfers from them to nearby peers.
-
公开(公告)号:US12095841B2
公开(公告)日:2024-09-17
申请号:US18241874
申请日:2023-09-03
Applicant: BRIGHT DATA LTD.
Inventor: Derry Shribman , Ofer Vilenski
IPC: H04L67/01 , H04L41/046 , H04L67/02 , H04L67/1001 , H04L67/1023 , H04L67/1061 , H04L67/1074 , H04L67/142 , H04L67/50 , H04L67/563 , H04L67/564
CPC classification number: H04L67/01 , H04L41/046 , H04L67/1001 , H04L67/1023 , H04L67/1063 , H04L67/108 , H04L67/142 , H04L67/535 , H04L67/563 , H04L67/564 , H04L67/02
Abstract: A system designed for increasing network communication speed for users, while lowering network congestion for content owners and ISPs. The system employs network elements including an acceleration server, clients, agents, and peers, where communication requests generated by applications are intercepted by the client on the same machine. The IP address of the server in the communication request is transmitted to the acceleration server, which provides a list of agents to use for this IP address. The communication request is sent to the agents. One or more of the agents respond with a list of peers that have previously seen some or all of the content which is the response to this request (after checking whether this data is still valid). The client then downloads the data from these peers in parts and in parallel, thereby speeding up the Web transfer, releasing congestion from the Web by fetching the information from multiple sources, and relieving traffic from Web servers by offloading the data transfers from them to nearby peers.
-
公开(公告)号:US12081612B2
公开(公告)日:2024-09-03
申请号:US18209193
申请日:2023-06-13
Applicant: BRIGHT DATA LTD.
Inventor: Derry Shribman , Ofer Vilenski
IPC: H04L67/01 , H04L41/046 , H04L67/02 , H04L67/1001 , H04L67/1023 , H04L67/1061 , H04L67/1074 , H04L67/142 , H04L67/50 , H04L67/563 , H04L67/564
CPC classification number: H04L67/01 , H04L41/046 , H04L67/1001 , H04L67/1023 , H04L67/1063 , H04L67/108 , H04L67/142 , H04L67/535 , H04L67/563 , H04L67/564 , H04L67/02
Abstract: A system designed for increasing network communication speed for users, while lowering network congestion for content owners and ISPs. The system employs network elements including an acceleration server, clients, agents, and peers, where communication requests generated by applications are intercepted by the client on the same machine. The IP address of the server in the communication request is transmitted to the acceleration server, which provides a list of agents to use for this IP address. The communication request is sent to the agents. One or more of the agents respond with a list of peers that have previously seen some or all of the content which is the response to this request (after checking whether this data is still valid). The client then downloads the data from these peers in parts and in parallel, thereby speeding up the Web transfer, releasing congestion from the Web by fetching the information from multiple sources, and relieving traffic from Web servers by offloading the data transfers from them to nearby peers.
-
公开(公告)号:US20240275628A1
公开(公告)日:2024-08-15
申请号:US18624563
申请日:2024-04-02
Applicant: BRIGHT DATA LTD.
Inventor: Derry Shribman , Ofer Vilenski
IPC: H04L12/28 , G06F7/58 , G06F8/71 , G06F9/455 , G06F9/48 , G06F16/955 , H04L9/40 , H04L12/46 , H04L47/283 , H04L61/256 , H04L61/2575 , H04L61/2585 , H04L61/2589 , H04L61/2592 , H04L61/4511 , H04L61/5007 , H04L67/01 , H04L67/02 , H04L67/025 , H04L67/133 , H04L67/141 , H04L67/142 , H04L67/288 , H04L67/2885 , H04L67/56 , H04L67/563 , H04L67/568 , H04L67/5681 , H04L67/63 , H04L69/16 , H04L69/167 , H04L69/168 , H04L101/69 , H04W4/80 , H04W48/18 , H04W84/10 , H04W84/18
CPC classification number: H04L12/2803 , G06F7/58 , G06F7/588 , G06F8/71 , G06F9/45545 , G06F9/4555 , G06F9/4881 , G06F16/955 , H04L12/2856 , H04L12/4633 , H04L47/283 , H04L61/256 , H04L61/2575 , H04L61/2585 , H04L61/2589 , H04L61/2592 , H04L61/4511 , H04L61/5007 , H04L63/0272 , H04L63/0281 , H04L63/029 , H04L63/164 , H04L67/01 , H04L67/02 , H04L67/025 , H04L67/133 , H04L67/141 , H04L67/142 , H04L67/288 , H04L67/2885 , H04L67/56 , H04L67/563 , H04L67/568 , H04L67/5681 , H04L67/63 , H04L69/16 , H04L69/162 , H04L69/167 , H04L69/168 , H04W4/80 , H04W48/18 , H04W84/10 , H04W84/18 , G06F9/45558 , G06F2009/45591 , G06F2009/45595 , H04L2101/69
Abstract: A method for fetching a content from a web server to a client device is disclosed, using tunnel devices serving as intermediate devices. The tunnel device is selected based on an attribute, such as IP Geolocation. A tunnel bank server stores a list of available tunnels that may be used, associated with values of various attribute types. The tunnel devices initiate communication with the tunnel bank server, and stays connected to it, for allowing a communication session initiated by the tunnel bank server. Upon receiving a request from a client to a content and for specific attribute types and values, a tunnel is selected by the tunnel bank server, and is used as a tunnel for retrieving the required content from the web server, using standard protocol such as SOCKS, WebSocket or HTTP Proxy. The client only communicates with a super proxy server that manages the content fetching scheme.
-
公开(公告)号:US20240259227A1
公开(公告)日:2024-08-01
申请号:US18624527
申请日:2024-04-02
Applicant: BRIGHT DATA LTD.
Inventor: Derry Shribman , Ofer Vilenski
IPC: H04L12/28 , G06F7/58 , G06F8/71 , G06F9/455 , G06F9/48 , G06F16/955 , H04L9/40 , H04L12/46 , H04L47/283 , H04L61/256 , H04L61/2575 , H04L61/2585 , H04L61/2589 , H04L61/2592 , H04L61/4511 , H04L61/5007 , H04L67/01 , H04L67/02 , H04L67/025 , H04L67/133 , H04L67/141 , H04L67/142 , H04L67/288 , H04L67/2885 , H04L67/56 , H04L67/563 , H04L67/568 , H04L67/5681 , H04L67/63 , H04L69/16 , H04L69/167 , H04L69/168 , H04L101/69 , H04W4/80 , H04W48/18 , H04W84/10 , H04W84/18
CPC classification number: H04L12/2803 , G06F7/58 , G06F7/588 , G06F8/71 , G06F9/45545 , G06F9/4555 , G06F9/4881 , G06F16/955 , H04L12/2856 , H04L12/4633 , H04L47/283 , H04L61/256 , H04L61/2575 , H04L61/2585 , H04L61/2589 , H04L61/2592 , H04L61/4511 , H04L61/5007 , H04L63/0272 , H04L63/0281 , H04L63/029 , H04L63/164 , H04L67/01 , H04L67/02 , H04L67/025 , H04L67/133 , H04L67/141 , H04L67/142 , H04L67/288 , H04L67/2885 , H04L67/56 , H04L67/563 , H04L67/568 , H04L67/5681 , H04L67/63 , H04L69/16 , H04L69/162 , H04L69/167 , H04L69/168 , H04W4/80 , H04W48/18 , H04W84/10 , H04W84/18 , G06F9/45558 , G06F2009/45591 , G06F2009/45595 , H04L2101/69
Abstract: A method for fetching a content from a web server to a client device is disclosed, using tunnel devices serving as intermediate devices. The tunnel device is selected based on an attribute, such as IP Geolocation. A tunnel bank server stores a list of available tunnels that may be used, associated with values of various attribute types. The tunnel devices initiate communication with the tunnel bank server, and stays connected to it, for allowing a communication session initiated by the tunnel bank server. Upon receiving a request from a client to a content and for specific attribute types and values, a tunnel is selected by the tunnel bank server, and is used as a tunnel for retrieving the required content from the web server, using standard protocol such as SOCKS, WebSocket or HTTP Proxy. The client only communicates with a super proxy server that manages the content fetching scheme.
-
-
-
-
-
-
-
-
-