This post is also available in: Português
Those days I had to implement an Oracle Cloud "IAAS Classic" solution for databases and applications with DR environments, considering the primary region as Ashburn (uscom-east-1) and the standby region as Chicago (uscom-central-1). To make both regions talk securely over the internet, I had to implement a VPN connection between both regions.
Before stating everything, I had to check that the connection between both regions would be large and fast enough to ensure the redo stream data generated on the instances running on Ashburn DC could be transferred to Chicago DC, with no delays. And vice-versa.
So, to measure the bandwidth between both DCs I used iperf3 utility, increasing the number of parallel connections from 1 to 100, and calculating the average speed in 1 minute frame. Please note that this test was performed using Public IP address, bypassing the VPN layer.
Below are the result tests of Total Bandwidth x Number of Connections:
And the raw output (double click and scroll for full text):
$ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 1 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [ 4] 0.00-60.00 sec 4.44 GBytes 635 Mbits/sec 555 sender [ 4] 0.00-60.00 sec 4.43 GBytes 635 Mbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 2 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 8.90 GBytes 1.27 Gbits/sec 909 sender [SUM] 0.00-60.00 sec 8.90 GBytes 1.27 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 3 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 10.7 GBytes 1.53 Gbits/sec 1169 sender [SUM] 0.00-60.00 sec 10.7 GBytes 1.53 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 4 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 12.5 GBytes 1.79 Gbits/sec 2272 sender [SUM] 0.00-60.00 sec 12.5 GBytes 1.79 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 5 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 15.4 GBytes 2.21 Gbits/sec 2854 sender [SUM] 0.00-60.00 sec 15.4 GBytes 2.21 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 6 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 11.8 GBytes 1.69 Gbits/sec 2742 sender [SUM] 0.00-60.00 sec 11.8 GBytes 1.68 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 7 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 16.3 GBytes 2.33 Gbits/sec 4667 sender [SUM] 0.00-60.00 sec 16.3 GBytes 2.33 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 8 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 18.2 GBytes 2.61 Gbits/sec 5049 sender [SUM] 0.00-60.00 sec 18.2 GBytes 2.60 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 9 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 19.4 GBytes 2.78 Gbits/sec 4960 sender [SUM] 0.00-60.00 sec 19.4 GBytes 2.78 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 10 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 19.7 GBytes 2.82 Gbits/sec 5678 sender [SUM] 0.00-60.00 sec 19.7 GBytes 2.82 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 11 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 22.2 GBytes 3.17 Gbits/sec 5588 sender [SUM] 0.00-60.00 sec 22.1 GBytes 3.17 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 12 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 20.4 GBytes 2.93 Gbits/sec 7590 sender [SUM] 0.00-60.00 sec 20.4 GBytes 2.92 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 13 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 24.0 GBytes 3.43 Gbits/sec 5421 sender [SUM] 0.00-60.00 sec 23.9 GBytes 3.43 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 14 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 23.3 GBytes 3.34 Gbits/sec 8865 sender [SUM] 0.00-60.00 sec 23.3 GBytes 3.34 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 15 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 23.8 GBytes 3.41 Gbits/sec 7567 sender [SUM] 0.00-60.00 sec 23.8 GBytes 3.41 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 16 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 26.4 GBytes 3.78 Gbits/sec 9267 sender [SUM] 0.00-60.00 sec 26.3 GBytes 3.77 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 17 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 24.2 GBytes 3.47 Gbits/sec 10146 sender [SUM] 0.00-60.00 sec 24.2 GBytes 3.46 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 18 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 26.5 GBytes 3.80 Gbits/sec 9632 sender [SUM] 0.00-60.00 sec 26.5 GBytes 3.79 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 19 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 23.3 GBytes 3.34 Gbits/sec 13640 sender [SUM] 0.00-60.00 sec 23.3 GBytes 3.33 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 20 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 29.6 GBytes 4.24 Gbits/sec 12223 sender [SUM] 0.00-60.00 sec 29.6 GBytes 4.24 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 21 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 29.4 GBytes 4.21 Gbits/sec 13786 sender [SUM] 0.00-60.00 sec 29.3 GBytes 4.20 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 22 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 29.3 GBytes 4.20 Gbits/sec 11510 sender [SUM] 0.00-60.00 sec 29.3 GBytes 4.19 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 23 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 30.8 GBytes 4.40 Gbits/sec 11503 sender [SUM] 0.00-60.00 sec 30.7 GBytes 4.40 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 24 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 28.2 GBytes 4.03 Gbits/sec 16838 sender [SUM] 0.00-60.00 sec 28.1 GBytes 4.03 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 25 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 30.9 GBytes 4.43 Gbits/sec 12400 sender [SUM] 0.00-60.00 sec 30.9 GBytes 4.42 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 26 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 32.7 GBytes 4.68 Gbits/sec 14334 sender [SUM] 0.00-60.00 sec 32.6 GBytes 4.67 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 27 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 30.4 GBytes 4.35 Gbits/sec 13520 sender [SUM] 0.00-60.00 sec 30.3 GBytes 4.34 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 28 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 33.2 GBytes 4.76 Gbits/sec 14995 sender [SUM] 0.00-60.00 sec 33.2 GBytes 4.75 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 29 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 35.5 GBytes 5.08 Gbits/sec 13700 sender [SUM] 0.00-60.00 sec 35.4 GBytes 5.06 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 30 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 33.6 GBytes 4.81 Gbits/sec 16360 sender [SUM] 0.00-60.00 sec 33.5 GBytes 4.80 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 31 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 32.4 GBytes 4.63 Gbits/sec 17546 sender [SUM] 0.00-60.00 sec 32.3 GBytes 4.62 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 32 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 33.8 GBytes 4.84 Gbits/sec 16175 sender [SUM] 0.00-60.00 sec 33.8 GBytes 4.83 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 33 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 35.5 GBytes 5.08 Gbits/sec 15388 sender [SUM] 0.00-60.00 sec 35.4 GBytes 5.07 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 34 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 35.2 GBytes 5.04 Gbits/sec 16878 sender [SUM] 0.00-60.00 sec 35.1 GBytes 5.03 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 35 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 31.7 GBytes 4.54 Gbits/sec 20320 sender [SUM] 0.00-60.00 sec 31.6 GBytes 4.52 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 36 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 34.5 GBytes 4.94 Gbits/sec 23477 sender [SUM] 0.00-60.00 sec 34.4 GBytes 4.93 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 37 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 34.8 GBytes 4.98 Gbits/sec 25531 sender [SUM] 0.00-60.00 sec 34.7 GBytes 4.97 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 38 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 34.0 GBytes 4.87 Gbits/sec 22540 sender [SUM] 0.00-60.00 sec 33.9 GBytes 4.86 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 39 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.2 GBytes 5.18 Gbits/sec 23663 sender [SUM] 0.00-60.00 sec 36.1 GBytes 5.17 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 40 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.0 GBytes 5.15 Gbits/sec 20853 sender [SUM] 0.00-60.00 sec 35.9 GBytes 5.14 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 41 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.2 GBytes 5.47 Gbits/sec 23307 sender [SUM] 0.00-60.00 sec 38.1 GBytes 5.45 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 42 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.6 GBytes 5.38 Gbits/sec 21347 sender [SUM] 0.00-60.00 sec 37.5 GBytes 5.37 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 43 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 35.8 GBytes 5.12 Gbits/sec 23382 sender [SUM] 0.00-60.00 sec 35.7 GBytes 5.11 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 44 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.7 GBytes 5.26 Gbits/sec 24618 sender [SUM] 0.00-60.00 sec 36.6 GBytes 5.24 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 45 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.3 GBytes 5.34 Gbits/sec 25856 sender [SUM] 0.00-60.00 sec 37.2 GBytes 5.33 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 46 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.0 GBytes 5.44 Gbits/sec 21343 sender [SUM] 0.00-60.00 sec 37.9 GBytes 5.42 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 47 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.9 GBytes 5.28 Gbits/sec 24938 sender [SUM] 0.00-60.00 sec 36.7 GBytes 5.26 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 48 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.0 GBytes 5.16 Gbits/sec 31976 sender [SUM] 0.00-60.00 sec 35.9 GBytes 5.14 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 49 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.7 GBytes 5.26 Gbits/sec 22912 sender [SUM] 0.00-60.00 sec 36.6 GBytes 5.24 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 50 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.1 GBytes 5.31 Gbits/sec 26398 sender [SUM] 0.00-60.00 sec 36.9 GBytes 5.29 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 51 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.8 GBytes 5.41 Gbits/sec 30428 sender [SUM] 0.00-60.00 sec 37.6 GBytes 5.39 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 52 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 39.3 GBytes 5.63 Gbits/sec 32234 sender [SUM] 0.00-60.00 sec 39.2 GBytes 5.61 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 53 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 33.7 GBytes 4.82 Gbits/sec 40708 sender [SUM] 0.00-60.00 sec 33.6 GBytes 4.81 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 54 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.6 GBytes 5.39 Gbits/sec 26800 sender [SUM] 0.00-60.00 sec 37.5 GBytes 5.37 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 55 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.5 GBytes 5.52 Gbits/sec 28761 sender [SUM] 0.00-60.00 sec 38.4 GBytes 5.50 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 56 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.7 GBytes 5.40 Gbits/sec 27830 sender [SUM] 0.00-60.00 sec 37.6 GBytes 5.38 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 57 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 39.9 GBytes 5.71 Gbits/sec 28941 sender [SUM] 0.00-60.00 sec 39.7 GBytes 5.69 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 58 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.1 GBytes 5.31 Gbits/sec 31642 sender [SUM] 0.00-60.00 sec 37.0 GBytes 5.29 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 59 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.4 GBytes 5.36 Gbits/sec 26601 sender [SUM] 0.00-60.00 sec 37.3 GBytes 5.34 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 60 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.8 GBytes 5.27 Gbits/sec 34734 sender [SUM] 0.00-60.00 sec 36.7 GBytes 5.25 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 61 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.9 GBytes 5.29 Gbits/sec 38099 sender [SUM] 0.00-60.00 sec 36.8 GBytes 5.26 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 62 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.6 GBytes 5.53 Gbits/sec 38161 sender [SUM] 0.00-60.00 sec 38.5 GBytes 5.51 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 63 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.5 GBytes 5.37 Gbits/sec 27974 sender [SUM] 0.00-60.00 sec 37.4 GBytes 5.35 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 64 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.8 GBytes 5.26 Gbits/sec 37504 sender [SUM] 0.00-60.00 sec 36.6 GBytes 5.24 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 65 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.8 GBytes 5.56 Gbits/sec 40569 sender [SUM] 0.00-60.00 sec 38.6 GBytes 5.53 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 66 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.7 GBytes 5.26 Gbits/sec 30704 sender [SUM] 0.00-60.00 sec 36.6 GBytes 5.24 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 67 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.3 GBytes 5.35 Gbits/sec 36550 sender [SUM] 0.00-60.00 sec 37.2 GBytes 5.32 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 68 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.7 GBytes 5.40 Gbits/sec 32058 sender [SUM] 0.00-60.00 sec 37.5 GBytes 5.37 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 69 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.5 GBytes 5.51 Gbits/sec 34878 sender [SUM] 0.00-60.00 sec 38.3 GBytes 5.48 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 70 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 39.7 GBytes 5.68 Gbits/sec 32010 sender [SUM] 0.00-60.00 sec 39.5 GBytes 5.66 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 71 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 39.1 GBytes 5.60 Gbits/sec 26776 sender [SUM] 0.00-60.00 sec 38.9 GBytes 5.57 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 72 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.2 GBytes 5.18 Gbits/sec 36237 sender [SUM] 0.00-60.00 sec 36.0 GBytes 5.16 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 73 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.1 GBytes 5.45 Gbits/sec 32541 sender [SUM] 0.00-60.00 sec 37.9 GBytes 5.42 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 74 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.0 GBytes 5.44 Gbits/sec 40630 sender [SUM] 0.00-60.00 sec 37.8 GBytes 5.42 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 75 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.3 GBytes 5.49 Gbits/sec 31906 sender [SUM] 0.00-60.00 sec 38.2 GBytes 5.47 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 76 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.1 GBytes 5.45 Gbits/sec 42777 sender [SUM] 0.00-60.00 sec 37.9 GBytes 5.43 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 77 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 29.3 GBytes 4.20 Gbits/sec 72788 sender [SUM] 0.00-60.00 sec 29.2 GBytes 4.18 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 78 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 35.8 GBytes 5.12 Gbits/sec 43979 sender [SUM] 0.00-60.00 sec 35.6 GBytes 5.10 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 79 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.6 GBytes 5.23 Gbits/sec 41788 sender [SUM] 0.00-60.00 sec 36.4 GBytes 5.21 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 80 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.1 GBytes 5.30 Gbits/sec 40703 sender [SUM] 0.00-60.00 sec 36.9 GBytes 5.28 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 81 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 34.7 GBytes 4.97 Gbits/sec 64616 sender [SUM] 0.00-60.00 sec 34.5 GBytes 4.94 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 82 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 34.1 GBytes 4.88 Gbits/sec 56353 sender [SUM] 0.00-60.00 sec 33.9 GBytes 4.86 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 83 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.6 GBytes 5.24 Gbits/sec 37069 sender [SUM] 0.00-60.00 sec 36.4 GBytes 5.22 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 84 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 35.6 GBytes 5.09 Gbits/sec 51745 sender [SUM] 0.00-60.00 sec 35.4 GBytes 5.07 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 85 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 30.4 GBytes 4.36 Gbits/sec 64969 sender [SUM] 0.00-60.00 sec 30.3 GBytes 4.34 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 86 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 35.0 GBytes 5.02 Gbits/sec 54833 sender [SUM] 0.00-60.00 sec 34.8 GBytes 4.99 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 87 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 34.6 GBytes 4.95 Gbits/sec 56437 sender [SUM] 0.00-60.00 sec 34.4 GBytes 4.92 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 88 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 28.3 GBytes 4.05 Gbits/sec 47278 sender [SUM] 0.00-60.00 sec 28.1 GBytes 4.03 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 89 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 29.9 GBytes 4.28 Gbits/sec 40591 sender [SUM] 0.00-60.00 sec 29.7 GBytes 4.25 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 90 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 31.2 GBytes 4.47 Gbits/sec 32226 sender [SUM] 0.00-60.00 sec 31.0 GBytes 4.44 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 91 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 33.2 GBytes 4.76 Gbits/sec 40975 sender [SUM] 0.00-60.00 sec 33.0 GBytes 4.73 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 92 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 32.7 GBytes 4.68 Gbits/sec 29841 sender [SUM] 0.00-60.00 sec 32.5 GBytes 4.65 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 93 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 35.7 GBytes 5.11 Gbits/sec 55298 sender [SUM] 0.00-60.00 sec 35.5 GBytes 5.08 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 94 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 36.3 GBytes 5.19 Gbits/sec 47390 sender [SUM] 0.00-60.00 sec 36.1 GBytes 5.17 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 95 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 38.1 GBytes 5.46 Gbits/sec 42721 sender [SUM] 0.00-60.00 sec 37.9 GBytes 5.43 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 96 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.0 GBytes 5.29 Gbits/sec 57684 sender [SUM] 0.00-60.00 sec 36.8 GBytes 5.26 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 97 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 35.9 GBytes 5.14 Gbits/sec 46511 sender [SUM] 0.00-60.00 sec 35.7 GBytes 5.11 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 98 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.7 GBytes 5.40 Gbits/sec 46307 sender [SUM] 0.00-60.00 sec 37.5 GBytes 5.38 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 99 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 35.6 GBytes 5.10 Gbits/sec 53705 sender [SUM] 0.00-60.00 sec 35.4 GBytes 5.07 Gbits/sec receiver $ iperf3 -c 129.X.X.X -p 5201 -t 60 -i 60 -P 100 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [SUM] 0.00-60.00 sec 37.2 GBytes 5.32 Gbits/sec 54443 sender [SUM] 0.00-60.00 sec 37.0 GBytes 5.30 Gbits/sec receiver
Conclusions:
- The connection speed between 2 servers in those regions tend to stabilize at 5.15 Gbits/sec when 40 parallels or more connections are opened.
- One single connection doesn't perform faster than 0.635 Gbits/sec, so it's better to configure your database to do parallel redo shipping when your redo generation is bigger than that. Configure the number of connections based on the database redo generation and the graph above.
- Same thing applies for application DR. Whatever tool you are using, consider always parallel.
- Oracle probably has a backbone and do internal routing of connections involving Public IPs of both regions, to achieve this ~ 5 Gbits/sec bandwidth.