Egress FQDN FAQ

Why is Egress Control Filter needed?

egress_overview

For Internet-bound egress traffic, specifying an outbound policy at the IP address level is not sufficient, as the domain names of a site can be translated to many different IP addresses.

An NAT gateway does not offer security group functions; it relies on security groups by each instance. An NAT instance’s security group does not have enough entries to support the large set of IP address lists. The egress filtering needs to happen at Layer 7.

On the other hand, workloads in AWS are mostly applications or programs where it is deterministic which outbound APIs the application program calls. For example, an application runs API queries to www.salesforce.com for data retrieving and runs API queries to www.google.com for app authentication. In these cases, making sure that only these sites are allowed for egress traffic is sufficient from a security point of view. Note that this is very different from on-prem situations where end user traffic and application traffic are mingled together; you may need a full-fledged firewall for Internet-bound traffic.

Another use case is for PCI DSS compliance. PCI DSS specifies that if you handle any payment and sensitive data, there must be firewall policy enforcement at the egress. In the cloud, the logical egress point is per VPC/VNet.

What does the Aviatrix FQDN feature do?

Aviatrix Fully Qualified Domain Name (FQDN) is a security service specifically designed for workloads or applications in the public cloud. It filters Internet-bound egress traffic initiated from workloads in a VPC/VNet. This service is centrally managed by the Controller and executed by an Aviatrix Gateway instance in the VPC/VNet in the distributed architecture..

Aviatrix FQDN filters any TCP and UDP traffic including HTTP, HTTPS, and SFTP traffic. The filtering function allows only the destination host names (whitelist) specified in the list to pass and drop all other destinations.

Each destination is specified as fully qualified domain name. For example, if you only allow Internet bound traffic to www.salesforce.com, you can list the domain name www.salesforce.com in the whitelist.

For HTTP/HTTPS (TCP port 80/443), FQDN feature also supports wild cards, such as *. In this example, you can specify *.salesforce.com to allow traffic to any domain names that end in “salesforce.com.”

How does it work?

The function is transparent to individual instances and is carried out inline without requiring any certificate or keys to decrypt the traffic.

Non-HTTP/HTTPS traffic can also be filtered based on exact domain names. Use cases are secure file transfer (SFTP) to external sites, secure login in (SSH) to external sites.

A tag is defined as a list of FQDNs and it is created and managed on the Controller console. One or more gateways may be attached to a tag; each gateway can be attached to more than one tag. Any updates to a tag on the Controller automatically triggers updates to all gateways attached to the tag.

Multiple tags can be defined for the Controller. The domains in the tag are the destinations that are allowed for traffic to pass.

For configuration details, refer to this doc.

How do I enable 2 AZ HA for FQDN gateways?

Go to the Gateway page, highlight the gateway, and click Edit.

At Gateway for High Availability Peering, select a subnet (a public subnet for AWS, GCP, and OCI) in the dropdown menu and click Create. A backup gateway with the name extension -hagw will be created. Note that this takes a few minutes of time.

For FQDN function, the primary gateway and backup gateway load balance the Internet bound traffic from different subnets based on a route table.

How do I enable 3 AZ HA for FQDN gateways?

Her are the steps to enable 3 AZ HA FQDN gateways:

  1. Launch an Aviatrix gateway in AZ1.

  2. Launch an Aviatrix gateway in AZ2.

  3. Launch an Aviatrix gateway in AZ3.

  4. Attach the same FQDN tag to each gateway launched in the steps above.

  5. Enable the FQDN tag.

Following the instructions above, Aviatrix Controller will try to load balance the route tables to point to the gateways with AZ affinity. When a gateway fails, the Controller will reprogram the VPC/VNet route table to redistribute the traffic to the remaining gateways.

How does Aviatrix Egress FQDN compare to Squid and other solutions?

Squid is a popular open-source software that can be configured to do transparent HTTP/HTTPS filtering. Squid does not process non-HTTP/HTTPS traffic. For example, if you need to filter on a SFTP site that runs on TCP port 22, Squid does not work. Below is a more comprehensive comparison between Aviatrix FQDN and Squid.

The table below also compares with other solutions such as AWS NAT Gateway, AWS Network Firewall, and Azure Firewall.

Functions

Aviatrix FQDN

AWS NAT Gateway

AWS Network Firewall

Azure Firewall

Squid

Requires instance configuration

No

No

No

No

No

HTTP and HTTPS FQDN filter

Yes (support wildcard)

No

Yes

Yes

Yes

non-HTTP/HTTPS FQDN filter

Yes

No

No

No

No

Requires dedicated subnet

No

No

Yes

Yes

No

Multi AZ High Availability

Yes (load balanced)

Yes

Yes

Yes

No

Centrally Managed

Yes

Yes

Yes

Yes

No

Egress Discovery

Yes

No

No

No

No

API support

Yes

Yes

Yes

Yes

No

Terraform support

Yes

Yes

Yes

No

No

Out-of-box log integration

Yes

No

Yes

Yes

No

Allow specified destination to bypass filter

Yes

No

No

No

No

Allow specified source CIDR to apply to rule

Yes

No

No

No

No

Allow specified source CIDR to bypass filter

Yes

No

No

No

No

Out of box visibility on sessions

Yes

No

No

No

No

Search a specified rule match history

Yes

No

No

No

No

Vendor product support

Yes

Yes

Yes

Yes

No

How do I troubleshoot FQDN problems?

If you have problems with FQDN on a specific gateway, follow the instructions below to troubleshoot:

  1. Make sure the corresponding AWS or Azure route table has the route entry 0.0.0.0/0 which points to the gateway instance.

  2. To verify that the above step is set up properly, disable the FQDN function of the problem gateway by detaching it from the associated tag, and run a ping test to www.yahoo.com from an instance in the private subnet to make sure Internet egress works.

  3. Attach the problem gateway to the tag. Make sure the tag has Enabled button on. Make sure the Whitelist or Blacklist is selected as intended.

  4. Check the tag to make sure it has the intended URL configured.

  5. Run a wget test from a private instance in the VPC/VNet to a URL configured in the tag.

  6. Use Step 4 at Egress FQDN View Log, select the problem gateway and download the log. Review the log file and analyze if the intended URL is in the log entry, why it is being accepted or denied.

  7. Note: if a tag has the White list option selected, all URLs in the tag will be accepted. On the other hand, if a tag has a Black list option selected, all URLs in the tag will be dropped.

  8. If none of the above work, try to Disable and Enable the tag again. This will restart the FQDN function on all attached gateways.

  9. If all above steps failed, get help from the Aviatrix support team and upload tracelog.

Any vendor specific comments to be noted?

Any GCE instance (excluding Controller-created gateways) that needs to participate in egress control (FQDN, SNAT and FW Egress) have to be tagged as “avx-snat-noip”. The GCE network tag “avx-snat-noip” can be associated during GCE instance creation or by editing an existing instance.

What happens if I enable FQDN and there are route tables that have an existing default route?

When enabling egress filtering on a VPC/VNet, each subnet’s route table is reviewed. If there is an existing default route (0.0.0.0/0) in the route table, the following logic is used:

Target

Aviatrix action

igw-*

Ignore this route table

anything other than igw-*

Update the Target to point to the AVX GW ENI and remember the current value of Target. (see note below)

Note

If the Gateway is detached from the VPC/VNet (via the egress configuration page), the route table will be updated with the original values.

Can FQDN gateway be deployed in a central place?

Yes. Available in Release 5.0 and later, Aviatrix FQDN gateway can be deployed centrally in the TGW environment as shown in the diagram below.

fqdn_in_firenet

One use case is if you need to limit the public IP addresses to a third-party public service. Follow the Firewall Network workflow to deploy.

How do FQDN and Stateful Firewall work together?

If FQDN service is enabled on a gateway for any TCP port 80 and 443 traffic, all forwarding traffic to destination TCP port 80 and 443 are processed by FQDN engine and the decision to drop or accept the session is reached by FQDN engine. Stateful firewall can only process traffic destined to non TCP port 80 and 443.

In what order are the FQDN rules processed?

Since you can create multiple tags with each consisting of a list of FQDN rules, the Controller must merge these rules in a specific order before sending these rules to FQDN gateway for processing.

The Controller merges all FQDN rules by this order:

  1. If the rule ACTION is Deny, it is placed in the first block for processing, that is, they are processed first.

  2. Within each block (Deny, Allow, Base Policy), the more specific rules are processed or examined first. For example, salesforce.com is more specific than *.salesforce.com therefore salesforce.com is processed first.

  3. Each rule has a verdict, Accept or Drop. When the FQDN processing engine finds a match, the verdict is reached and the packet is either dropped or accepted. The processing engine does not continue on to the next rule.

FQDN Option for Exact Match

This is a new feature where if a FQDN rule does not have * an exact match is expected. If this global option is not enabled, FQDN rules use regex to match any FQDN names that are subset of the name. For example, if salesforce.com is a rule and Exact Match option is enabled, finance.salesforce.com is not a match and will be dropped.