Configure DNS

How to expose your app on the internet

By default, all environments which have applied the k8s-base module has as output either a dns name or ip address for the load balancer handling the http/grpc requests for the environment. These are called:

  • load_balancer_raw_ip in Azure and GCP
  • load_balancer_raw_dns in AWS

You can get the values simply by running opta output after the apply.

These domains/ip are always valid and can be used to serve traffic immediately, but without ssl (and as extension grpc) or “real” names. To get those features, Opta offers 2 options:

  1. You will need to execute either the dns delegation steps or the external ssl and CNAME steps outlined below (invalid option for Azure).
  2. You “import” your SSL certificate into the Opta system and point your DNS zone straight to the load balancer’s ip/dns name

Setting the domain for an Environment via Domain Delegation

With Opta, you can specify a domain for each environment which can be used by all the services running in that environment. This is done with the aws-dns/gcp-dns module with the following steps:

Step 1: Apply your Opta Environment YAML with the DNS module added

See the following for example:

As is, the dns module will create the “hosted zone” resource which manages your dns rules for the domain you listed. In order for it to receive public traffic and get ssl (to have https instead of http connections), continue with the next steps.

Step 2: Figure out your hosted zone’s nameservers

These values are needed in the next steps to tell your domain registrar (e.g. Google Domains, Godaddy) where to delegate. You can find these values out by running opta output and note down the nameservers that get printed. It’s usually a set of 4 servers.

Step 3: Update your domain registrar with the new nameservers

Assuming you own example.com and want to map staging.example.com to this environment. Then you’d add the following NS records in your domain registrar, where ns1-ns4 are the nameservers from the previous step.

staging				1h			ns1
staging				1h			ns2
staging				1h			ns3
staging				1h			ns4

Typically you do this by selecting the option of adding a new dns record, selecting the NS type, and in the values you typically can pass in a list (so you only need to create 1 new record).

Step 4: Wait ~10 minutes

Seriously, DNS propagation takes a while and there’s no way of making it faster, so just go and grab some coffee for 10 minutes. You can verify that you did this properly by running this command:

dig staging.startup.com NS

You should see your name servers under the ANSWER SECTION part.

Step 5: Set delegated to true in your DNS module and Opta apply

Please update your Opta yaml aws-dns/gcp-dns section to have a new field delegated: true. Following the past yaml examples, it should look like:

Now run opta apply one more time and Opta will now generate your ssl certificates and attach them. Congratulations, your environment will now be picking up public traffic on your domain and have https!

External SSL and CNAME Setup

For the users which can not/do not wish to undergo the dns delegation steps, we do offer the simpler method of passing in an external ssl certificate and manually adding appropriate CNAME records.

To add your ssl cert, simply include the external-ssl-cert module in the environment yaml prior to the k8s-cluster module like so:

Note the relative paths to the different certificate files:

  • private_key_file – This is the relative path to the pem private key file for your cert. The file consists of a single block.

    -----BEGIN PRIVATE KEY-----
    ...
    -----END PRIVATE KEY-----
    
  • certificate_body_file – This is the relative path to the certicate body file. This is sometimes called “cert.pem”. The file consists of a single block.

    -----BEGIN CERTIFICATE-----
    ...
    -----END CERTIFICATE-----
    

    If you only have one big pem file with many such blocks, then create a new file and add just the first block.

  • certificate_chain_file – This is the relative path to the certicate chain file. This is sometimes called “chain.pem” and is a file consisting of one or (usually) many blocks.

    -----BEGIN CERTIFICATE-----
    ...
    -----END CERTIFICATE-----
    

    If you only have one big pem file with many such blocks, then create a new file and add all the blocks except the first one.

After running opta apply, your ssl certificate will be utilized (you can check by going to the load_balancer_raw_ip or load_balancer_raw_dns in your browser).

To then make traffic go to your environment for your given domain, simply go to your domain’s hosted zone (e.g. Route53 if you bought it with AWS, Google domains if bought with google, etc…) find the list of DNS records and ask to add 2 new A records if you have a load_balancer_raw_ip, or 2 new CNAME records if you have a load_balancer_raw_dns. These records should be named YOUR_DOMAIN, and *.YOUR_DOMAIN and should point to the respective ip/dns.

Once that final step is done, your environment should be live in your domain and utilizing your imported ssl!

External SSL Certificate and DNS Zone

If you prefer/need to handle DNS and SSL certificate creation yourself, then Opta supports you as well. Opta has an external-ssl-cert module which is capable of reading ssl cert files from the local filesystem and automatically integrating it. Let us show by example:

Suppose you own a certain domain called startup.com which you purchased from a particular cloud provider or dns seller. You know wish to create an opta environment using the staging.startup.com subdomain, but do not wish to undergo the dns delegation. At this point you can purchase an ssl certificate from your domain provider or another 3rd party (NOTE: some providers like AWS do not allow you to download your provisioned ssl certificate), or use certbot (a.k.a let’s encrypt) to get a short-term (3 month lifespan) credential for free. You can do so by downloading the certbot cli and executing the following command:

certbot certonly -d startup.com -d "*.startup.com" --manual --preferred-challenges \
  dns --config-dir . --work-dir . --logs-dir .

Certbot will then prompt you for certain input, including steps where you will manually add the domain validation TXT records into your public DNS Zone. Sometimes the propagation of your TXT records may take sometime, and you can also validate that you have done the step correctly by executing dig startup.com TXT and checking for your addenda there.

Once completed you should now have valid ssl certificate files under the relative path ./live/startup.com:

# ls ./live/startup.com
README        cert.pem      chain.pem     fullchain.pem privkey.pem

Of these files, the 3 which are important are cert.pem, chain.pem, and privkey.pem (note that fullchain.pem is just the cert and chain files fused together). We can then add them to the opta environment by including an instance of the external-ssl-cert file like so:

modules:
  - type: base
  - type: external-ssl-cert
    domain: staging.startup.com
    private_key_file: "./live/privkey.pem" # NOTICE THE RELATIVE PATH
    certificate_body_file: "./live/cert.pem"
    certificate_chain_file: "./live/chain.pem"

After applying with this, you will note that your load balancer ip/dns now handles ssl and redirects http over to https. The final step is to add a CNAME/A record (former if you have a load balancer dns, latter if it’s an IP) from your DNS Zone (the same one modified for the ssl cert verification, this will be a sibling record) pointing to your load balancer. With that complete your environment will be live to the public and secured with ssl.

Exposing a service

A service can be exposed on a subdomain of the environment domain or on a path via the public_uri field.

Exposing on a subdomain

name: hello
environments:
  - name: staging
    path: "opta.yaml"
modules:
  - type: k8s-service
    name: hello
    port:
      http: 80
    image: ghcr.io/run-x/hello-opta/hello-opta:main
    healthcheck_path: "/"
    public_uri: "hello.{parent.domain}"

Following the domain examples above, this will expose the service at https://hello.staging.startup.com

Exposing on a path

name: hello
environments:
  - name: staging
    path: "opta.yaml"
modules:
  - type: k8s-service
    name: hello
    port:
      http: 80
    image: ghcr.io/run-x/hello-opta/hello-opta:main
    healthcheck_path: "/"
    public_uri: "{parent.domain}/hello"

Following the domain examples above, this will expose the service at https://staging.startup.com/hello

Combine both

name: hello
environments:
  - name: staging
    path: "opta.yaml"
modules:
  - type: k8s-service
    name: hello
    port:
      http: 80
    image: ghcr.io/run-x/hello-opta/hello-opta:main
    healthcheck_path: "/"
    public_uri: "hello.{parent.domain}/v1"

Following the domain examples above, this will expose the service at https://hello.staging.startup.com/v1

Advanced Topic: Adding Extra Annotations to Ingress Objects

While Opta will automatically add the ingress object and required annotations, you an add extra Nginx ingress annotations to control traffic via Nginx ingress for your service. For example:

name: hello
environments:
  - name: staging
    path: "opta.yaml"
modules:
  - type: k8s-service
    name: hello
    ingress_extra_annotations:
      nginx.ingress.kubernetes.io/client-body-buffer-size: 10k
      nginx.ingress.kubernetes.io/limit-rps: 10
      foo: bar
    port:
      http: 80
    image: ghcr.io/run-x/hello-opta/hello-opta:main
    healthcheck_path: "/"
    public_uri: "hello.{parent.domain}/v1"

Last modified August 5, 2022 : Cleanup install script (#197) (2175394)