Best Practice - VPN Performance Testing

The following VPN performance test method provides a guideline for creating a standardized VPN performance testing environment required by Barracuda Networks Technical Support that allows you to identify potential configuration improvements. Please note that the VPN throughput results can differ from the values published on the datasheet of CloudGen Firewall F models due to varying test methods and equipment used.

Before You Begin

• To collect all relevant information for Barracuda Networks Technical Support, download the Word template form and fill in the required values as you go through the steps. Paste the output from each step into the text form and save the result. Include the completed form when contacting Barracuda Networks Support.

• Make sure that clients driving the test are powerful enough. iperf3 is especially critical in that respect because it is inherently single-threaded.
• Download VPN Performance Testing Form (Microsoft Word).

VPN Performance Test Setup

Before You Begin

To rule out devices in the local and remote networks, as well as side effects of other services on the firewall, create the following setup:

1. Testing must be performed on dedicated clients on both ends. Do not run performance tests directly on the shell of the firewall unless specifically stated otherwise.
2. Connect the test clients directly to the firewall. If that is not possible, up to one switch between the firewall and the test client is acceptable.
3. Do not use wireless network connections to connect to the firewall.

Step 1. VPN Tunnel Configuration

Configure the VPN tunnel on both firewalls with the following settings:

1. Create a TINA site-to-site VPN tunnel with a single transport with the following encryption settings:
2. In the Basics tab, configure the following settings:
   
   • Transport – Select UDP.
   • Encryption – Select AES 128. 
   • Authentication – Select NOHASH.
   • Compression – Select Disabled.
   • Use Dynamic Mesh – Clear check box.
   
3. In the SD-WAN Bandwidth Protection tab, configure the following settings:
   
   • Dynamic Bandwidth Detection – Select Disabled. 
   • Bandwidth Policy – Select None. 
   • Consolidated Shaping – Clear the check box.
   
4. In the Advanced tab, configure the following settings:
   

   • High Performance Settings (optional) – Select the check box.

     This setting can be applied only to tunnels that bind to port 691 (UDP) on both sides. Ensure also that the local tunnel IP address is listed in Service Properties > Service IPs.

     When running on VMWare with the vmxnet3 driver, the High Performance Settings have no impact. 

   • WANOpt Policy – Select NO-WANOpt. 

   

5. Configure the Local and Remote Networks.
6. Configure the Local and Remote IP addresses used by the VPN endpoint.

For more information, see How to Create a TINA VPN Tunnel between CloudGen Firewalls.

Step 2. Optimize Performance Settings for VPN

1. Go to CONFIGURATION > Configuration Tree > Box > Advanced Configuration > System Settings.
2. From the Interface CPU Assignment drop-down list, select Optimize-for-VPN.
   

Step 3. Access Rule Configuration

On both firewalls, configure access rules to allow the test traffic through the VPN tunnel.

1. Create a Pass access rule:
   • Source – Select the IP address of the local test client.
   • Service – Select Any.
   • Destination – Select the IP address of the remote test client.
   • Bi-Directional – Select the check box.
   • IPS Policy – Select No Scan.
   • Application Policy – Select No AppControl.
   • QoS Band (Fwd) – Select No-Shaping.
   • QoS Band (Reply) – Select No-Shaping.

   

Step 4. Verify the Network Interface Is Using Full Duplex

On the CONTROL > Network page of both firewalls: Verify that the network interfaces used by the test client and the VPN tunnel are using full duplex:

Step 5. (Multi-Core Firewalls Only) Verify VPN Bypass Is Enabled

VPN bypass is a performance optimization for the VPN device queues on multi-core firewalls. The VPN bypass must be enabled.

1. Log into the firewall via SSH.

2. Enter the following command to check the VPN bypass state:

   acpfctrl tune vpnbypass

   

3. If it is disabled, enable it with the following command:

   acpfctrl tune vpnbypass on

Performance Testing

Perform the following tests to gather performance data for the VPN tunnel and the ISP connection.

• ISP link speed
• VPN tunnel throughput
• Latency to the other firewall
• (virtual only) Cryptographic hardware performance test

Collect System Information

Collect the following information from both firewalls.

1. Log into the firewall via SSH.

2. Copy the performance output for the firewall kernel module:

   cat /proc/phion/acpf_prof 

   

3. Copy the output from the VPN kernel module:

   cat /proc/phion/ktina_prof

   

4. Collect the following values from the output: 

   • acpf_prof output
   • ktina_prof output
     

Check SMP

Execute setsmp and collect the output.

1. Log into the firewall via SSH.

2. Run command: setsmp

3. Collect the output.

Check ISP Link Speed

Execute the speed test on both firewalls.

1. Log into the firewall via SSH.

2. Run command: speedtest-cli

   

3. Collect the following the output from both firewalls:

   • Speedtest output
     

Ping Firewall to Firewall

1. Log into the firewall via SSH.
2. Enter ping <public IP address of the remote firewall>
   
3. Collect the following values from the output:
   
   • Ping firewall to firewall

Ping Test Client to Test Client

1. Log into the test client.
2. Enter ping <IP address remote test client>
   
3. Collect the following values from the output:
   
   • Ping test client to test client

Test VPN Tunnel TCP Traffic Throughput

1. Log into the remote test client 
2. Install iperf.

3. Start an iperf server:

   iperf -s 

4. Log into the local test client.

5. Install iperf.

6. Test the VPN throughput for TCP traffic:

   iperf -c <IP address remote test client> -P <2 x number of CPU cores> -e -m 

   

7. Repeat in the other direction.
8. Collect the following values from the output:
   • VPN TCP iperf (fw1 to fw2)
     
   • VPN TCP iperf (fw2 to fw1)

Test VPN Tunnel UDP Traffic Throughput

1. Log into the remote test client 
2. Install iperf.

3. Start an iperf server:

   iperf -s -u

4. Log into the local test client.

5. Install iperf.

6. Test the VPN throughput for UDP traffic.

   1. Specify a target bandwidth.

      -b <expected throughput / argument provided to -P

   2. Test the VPN throughput.

      iperf -c <IP address remote test client> -P <2 x number of CPU cores> -e -m -u

      

7. Repeat in the other direction.
8. Collect the following values from the output: 
   • VPN UDP iperf (fw1 to fw2)
     
   • VPN UDP iperf (fw2 to fw1) 

(Virtual and Public Cloud Only) Test Hardware Capabilities

Execute the following test to measure the hardware capabilities on virtual and public cloud firewalls.

1. Log into the firewall via SSH.
2. Enter cryptoctrl perf all
   
3. Collect the following values from the output: 
   • Cryptoctrl output

Testing with SMB / CIFS Traffic

When testing performance with SMB/CIFS traffic an be difficult to receive reproducible results. When testing the same VPN tunnel with iperf and CIFS traffic, expect the transfer rate for the file transfer to be slower than the iperf value.

• Calculate the theoretical TCP throughput to know the theoretical bandwidth of the connection: https://www.switch.ch/network/tools/tcp_throughput/.
• If file transfer performance is very low, verify that you are not affected by issues with TCP receive windows scaling on Microsoft Windows. A quick search will offer troubleshooting steps and solutions for this problem.