Howto connect multiple networks over the Internet the cheap way

October 17, 2010

I’m quit often asked by 2 types of people how to connect cheaply multiple networks securely over the Internet. The first type are owners of small companies which have more than one office and want to connect them to their central office. And the other type are people who are the de facto IT guy for their family and friends and need an easy way to get into the the other networks.

In the beginning most of them start with with remote connection software like Teamview, VNC, but at some point thats not enough anymore, when the responsibilities grow. The solution that I implement for them is based on the OpenVPN which is a well know, free and secure Open Source VPN solution, which is able to run on cheap hardware. Why do I say it needs hardware when you see on their homepage that it runs on Windows too?

You want a system with which nobody messes around and so it works for years without ever touching it again. And yes that is possible with the proposed solution. If you can’t reach the router it normally a ISP problem or power outage.
You don’t have only one Computer in each network and one VPN for each computer is not a good idea if you don’t need it.
There are also devices in the network where you can’t or won’t install a VPN software. e.g. printer, TV, receiver, acess point, ….

Anyway you can also use this setup to let road warriors into your network over the Internet. I’ll also show how to do that, but it is not the main focus of this blog post.

So about what hardware I’m talking?

An Accesspoint/DSL/Cable Router which is able to run OpenWRT, or any other system for which OpenVPN is available. I basically stick with systems that can run OpenWRT as I want similar systems to minimize my efforts. To be precise I’m almost always use a Linksys WRT54GL which you get under 40 Euros. But you’re free to use anything else. e.g. a friend of mine has a setup working with a SheevaPlug and Debian on it, an other has a setup running with DD-WRT.
If you have a local server in the network, be it Linux or Windows based, you can use that do. But don’t use clients if its not for road warriors.

The Setup

You need one OpenVPN node per network/location. In the following example we have

one central office network with a server and the router is from Internet service provider and we cannot install software on it, the server is also used as DHCP server. (I’ve specially selected that as it shows what additionally needs to be done if the OpenVPN server is not the default gateway for the devices in the network. If for your setup thats in a remote location its the same setup there.)
one remote office which is connected via cable the Internet. An OpenWRT based router is connected to the cable modem and masquerades the devices behind it.
one remote office which is connected via DSL to the Internet. An OpenWRT based router inserted after the provider router, both masquerades and to make the life interesting you cannot change anything on the provider router, e.g. add a port forwarding

In this howto we’re working with following subnets:

10.23.0.0/24 – central office
10.23.1.0/24 – remote office 1
10.23.2.0/24 – remote office 2
10.23.255.0/24 – transport network remote offices
10.23.254.0/24 – transport network road warriors (not in the figure)

network diagram

In the figure above you see that each Network has a different subnet – this is important as we need to route packets! Advise: Always use different subnets for different locations you set up. Even if you don’t connect them together at the beginning, make a list which subnets you’ve already used. There are plenty subnets in the 10.0.0.0 - 10.255.255.255 range for a single guy or a small company. Use a separate C class networks for each location (e.g. 10.42.0.0/24 for the first, 10.42.1.0/24 for the second and so on).

One subnet is needed as transit network within the VPN to connect the all remote offices to the central one. One subnet is only needed if you also want road warriors to connect to your network.

Preconditions

Common to all locations:

Get OpenVPN installed on all 3 systems. The version can differ a little between the servers which makes it easy if your OpenWRT router has an older version as you use for your main server.

Central office:

You need to forward 2 UDP ports on the ISP router from the Internet to your server. The example ports I use in this howto are 10000 for the VPN connection of the remote offices and 10001 for the road warriors.
Create an DNS entry for the external IP address of your router. If you’ve a dynamic IP address or no own DNS server/domain you can use for example the dyndns.com service; during this howto I assume centraloffice.dyndns.org as the host name.
You need to add a routing rule in your DHCP config which tells the clients that 10.23.0.0/16 is reachable behind the IP of your sever. And yes the 10.23.0.0/16 also includes the 10.23.0.0/24 of the central office, but it is important to remember that the more specific rule counts. The usage of one 10.23.0.0/16 and not a rule for ech C Class subnet allows you to add remote offices later without changing the DHCP. If your DHCP server is not able to add routing rules, a workaround is possible if your default gateway used by the clients (in this case the ISP router) is able to add the 10.23.0.0/16 rule to its routing table. In this case every traffic goes first to the default gateway and then back to the server. Thats not nice but for a small network with only a low bandwidth connection to the other networks it is ok. In a big network the security / network guy will cry…..
Make sure that routing is enable on the server. On Linux systems you can check that easily with cat /proc/sys/net/ipv4/ip_forward. If the result is 1 it is enabled otherwise not.
Make sure that if you’ve a local firewall enabled that UDP ports 10000 and 10001 are open.

Remote offices:

All requirements are meet if you’ve installed a modern version of OpenVPN and if the systems have the correct time. This maybe harder than it sounds as most DSL routers don’t have an internal clock that survives reboot. But it is important that the time of the router is bigger than the time the certificates where created, as otherwise the systems will not accept the certificate of the node in the central office. An easy way to make sure that at least this requirement is fulfilled is to set the date at boot to something fixed. I’ll show a simple way to do this later.

Firewall considerations

OpenVPN uses tun* device names for the VPN tunnels. On the central office server you’ve have tun0 for the remote offices and tun1 for the road warrios. For testing purposes you should let any traffice from and to tun0,tun1 and eth0 (LAN interface) through. After you made sure that everything works you should limit that to traffic which is really needed. On the remote offices nodes I recommend to open the traffic permanently in both directions (eth0 to tun0 and tun0 to eth0) as otherwise you need to administer the firewall rules on on multiple systems.

Import: You need also firewalls rules (on the central office server) that allow the traffic from one remote office to the other if you wish that kind of traffic. OpenVPN will be configured in a way that lets that kind of traffic through but without firewall rules that also allow the traffic it will not work.

Setting up a Certicate Authority (CA)

So what is a CA? I copied the first paragraph and linked the explanation of wikipedia as a starting point.

In cryptography, a certificate authority or certification authority (CA) is an entity that issues digital certificates. The digital certificate certifies the ownership of a public key by the named subject of the certificate. This allows others (relying parties) to rely upon signatures or assertions made by the private key that corresponds to the public key that is certified. In this model of trust relationships, a CA is a trusted third party that is trusted by both the subject (owner) of the certificate and the party relying upon the certificate. CAs are characteristic of many public key infrastructure (PKI) schemes.

In more common words each VPN nodes needs to have a one certificate (*.crt – containing the public key and the signature of the CA) and one private key. Each node needs to trust the CA and for this they have the certificate of the CA stored. For each node you need therefore at least 3 cryptography files. The certificate file also contains a flag describing a node as server or client. We’ll configure the OpenVPN clients in a way that will make sure that they connect only to nodes with the server flag.

The CA should be not on one of the VPN nodes but on separate computer. The easiest way to reach a working and secure enough solution for a small company is to put the CA onto a USB stick and only insert it on a secure PC if you’ll need it for generating new certificates.

Now lets get to the doing part, I’ll will assume that you’ve a Linux or Linux like system as your CA system but it will also work on others. In your OpenVPN package you’ll find a directory or .gz file named something like easy-rsa-2.0. On an Ubuntu/Debian system you’ll find it under /usr/share/doc/openvpn/examples/easy-rsa/2.0/ after installing the package openvpn.

Copy or extract easy-rsa to a directory of your liking.
Open the vars file in a text editor and scroll down to the end of the file. There you can change the key length to something higher than 1024 but keep in mind that you’ve not the fastest systems if you’re using OpenWRT on a DSL Router. You should also change the default country, city, … entries. The default lifetime of the certificates with 10 years should be enouch 😉
Type . vars which will load the variable in the environment of your current shell. You need to this step every time you start with an fresh shell and want todo any CA operation.
Call ./clean-all – Important: Only do that in the beginning as it will delete your complete CA and certificates if you’ll use it later.
Call ./build-ca mycompany-ca to generate the CA, you can leave most questions to the default answers. The important part the common name is already specified a command line parameter.
Call ./build-dh to get a special file for the OpenVPN node in the central office
Call ./build-key-server centralofficenode to generate the certificate for your central office node. Change the name to something meaningfull. Important: The name (= common name) needs to be unique for all nodes and I recommend to use only A-Z,a-z,0-9,-,_ as common name.
Call ./build-key remoteofficenode for each remote location you want to connect. Important: Use a system to choose the names otherwise you’ll loose overview of it if you’ll get more nodes and subnets. e.g. the name of the location/network you typically use to refer to it.

You’ll find all files in the keys subdirectory and you need to copy the .crt, .key of each node and the CA file to the node (and not the files for an other node!) For the node in the central office you need also the dh1024.pem.

road warriors:

If you also want to setup a VPN service for road warriors I recommend to use a separate CA – so make a second copy of the easy-rsa and start again. Import use other names otherwise you will loose the overview.

OpenVPN configuration

Central office:

I assume in this howto that it is a Linux server (Ubuntu/Debian based to be exact) in your central office, but the configuration on for example Windows is the basically the same – just the paths, starting methods and logging stuff are different.

Create the directory /etc/openvpn/certs/ and copy the centraloffice.crt, centraloffice.key, ca.crt and the dh1024.pem to this directory and change the permissions for the directory to 700 and for all files to 600 and the owner should be root for both.
Create a config file /etc/openvpn/0_remote_offices.conf with following content:
port 10000 proto udp dev tun ca /etc/openvpn/certs/ca.crt cert /etc/openvpn/certs/centraloffice.crt key /etc/openvpn/certs/centraloffice.key dh /etc/openvpn/certs/dh1024.pem server 10.23.255.0 255.255.255.0 client-to-client client-config-dir /etc/openvpn/remoteoffice_networks verb 3 # we can here operate with the same B class network as the more specify rules counts route 10.32.0.0 255.255.0.0 push "route 10.32.0.0 255.255.0.0" keepalive 10 120 cipher AES-128-CBC # AES comp-lzo max-clients 100 persist-key persist-tun
Create the directory /etc/openvpn/remoteoffice_networks and insert one file for each remote relocation with the name of the common name you choose for it. The files contain only one line with following content for the first remote location iroute 10.23.1.0 255.255.255.0 and iroute 10.23.2.0 255.255.255.0 for the second remote location. This tells OpenVPN which remote network is reachable behind which node.
Optional: Copy the road warrior CA stuff needed to the certs directory. Important: Make sure that you use an other name as ca.crt, as you’ve that one for the remote offices.
5. Optional: Create a configuration file /etc/openvpn/1_remote_offices.conf with following content for the road warriors:
port 10001 proto udp dev tun ca/etc/openvpn/certs/ca_roadwarrior.crt cert/etc/openvpn/certs/centraloffice_roadwarrior.crt key/etc/openvpn/certs/centraloffice_roadwarrior.key dh/etc/openvpn/certs/centraloffice_dh1024.pem server 10.23.254.0 255.255.255.0 verb 3 push "route 10.23.0.0 255.255.0.0" keepalive 10 120 # Maybe you need to comment this out, as your e.g. Windows client uses an slightly other encoding and so you can't transfer data. But if possible AES is the best. cipher AES-128-CBC # AES comp-lzo max-clients 100 persist-key persist-tun
Restart the OpenVPN server with /etc/init.d/openvpn restart and check if the configuration was at least that much correct to start up.
Run tail -f /var/log/syslog (or your distribution equivalent) to check on entries if the OpenVPN clients try to connect.

Remote Offices:

You need to do following steps for each remote office and replace the filenames with the correct ones for the specify remote location.

Create the directory /etc/openvpn/certs/ and copy the remoteoffice*.crt, remoteoffice*.key and ca.crt to this directory and change the permissions for the directory to 700 and for all files to 600 and the owner should be root for both.
Create a config file /etc/openvpn/0_to_the_central_office.conf with following content:
client dev tun proto udp remote centraloffice.dyndns.org 10000 resolv-retry infinite ns-cert-type server cipher AES-128-CBC ping 15 ping-restart 45 ping-timer-rem persist-tun persist-key comp-lzo verb 3 ca /etc/openvpn/certs/ca.crt cert /etc/openvpn/certs/remoteoffice*.crt key /etc/openvpn/certs/remoteoffice*.key
Create an init.d script /etc/init.d/openvpn with the permissions 755 and the content:
# change the date to something bigger than the time you used to generate the certificates date -s "2010-03-01 10:00:00" cd /etc/openvpn openvpn --config /etc/openvpn/0_to_the_central_office.conf --daemon
Create an symlink to start the init.d script automatically.
cd /etc/rc.d/ ln -s ../init.d/openvpn S65openvpn
For the first test you should do the steps in the init.d script by hand to check if they work and to see potential errors. For this don’t copy the --daemon parameter for the OpenVPN as this way you’ve see all errors and can easily stop OpenVPN with CRTL-C. Look also at the OpenVPN log entries on the central office node as it may also contain important error message.

Road Warriors:

The configuration file looks similar to the remote offices ones, just use the 10001 port and use the files from the road warrior CA. On Windows you should use the GUI version of OpenVPN which needs the configuration file normally in c:\programs\openvpn\conf with the extension .ovpn. Copy also the files into the same directory and use no absolute paths as it may varies on different clients and you don’t want to change it for every client.

Conclusion

I hope this howto has shown how easily you can connect various networks via the Internet with Open Source tools and cheap hardware. I’ve you’ve any questions please write them in the comments below that post, I’ll try to answer them. This setup is only the beginning, if there is interest I can show some stuff I use to extend this setup. I’ve also written a blog post some time ago which is interesting for you if you use the same CA for different VPN Server and want to make sure that only a some clients are allowed to connect to a specific server.

In HowTo, IT Security, Linux | 7 Comments

7 Comments »

RSS feed for comments on this post. TrackBack URI

Do not forget that VPN rooter are damn expensive.
The only cheap solution i know it the router from Fritz Box.

http://www.heise.de/ct/artikel/Nach-Hause-tunneln-796611.html

Comment by Oscar Angress — October 18, 2010 #
Did you really read the article? The purpose of this article is to show how you can do it cheaply – and with OpenWRT and OpenVPN you can work with routers below 40 Euros.

Comment by robert — October 18, 2010 #
Very clear, well written HowTo! The diagram is well done as well. 🙂

Comment by sgtrock — October 19, 2010 #
hi :

i just want to know how really do this into 2 offices
central —-remote
with 2 pc like server
i install ubuntu 10 04 lts but i get errors and i cant know what fail

could you tell me what exact steps have to do to put to work this …

i use pc with ubuntu 10.04 LTS with open vpn… i think that is the way no?

but how else ,,,

need to solve create vpn site to site between 2 pc over the internet … ADSL services ISP inet service provider….

Comment by racso — July 12, 2011 #
Hi, I’ve a need to link multiple offices cheaply but they need to pass multicast traffic. We can do that easily with individual workstation but the bandwidth requirement is severe for both the central office and the branch offices. Would your suggested configuration work when Openvpn is operating in bridge mode?

Comment by Terry — July 28, 2013 #
[…] the file without extension is the configuration for OpenVPN, which gets created from the GUI. The GUI config is stored in the .conf file. So if we change the OpenVPN configuration file it gets overwritten if we change the GUI config, but we won’t do that anymore ;-). Now we create a sub directory and upload our client (=NAS) certificate files. The long and hopefully good documentation on creating the certificates and how to configure OpenVPN on a standard distribution can be found here. […]

Pingback by Configure a Synology NAS as OpenVPN client with certificate authentication (and make it stable) | Robert Penz Blog — March 8, 2014 #
about linking branches

hello i want ask about linking branches i have accounting system and i want services for linking branches with Head Office you have any services for this please
Without Static ip Because i don’t have static ip

Comment by khalid — December 19, 2018 #

Howto connect multiple networks over the Internet the cheap way

7 Comments »

Leave a comment