| Internet-Draft | Route-Leak Detection and Mitigation | August 2024 |
| Sriram & Azimov | Expires 27 February 2025 | [Page] |
Problem definition for route leaks and enumeration of types of route leaks are provided in RFC 7908. This document describes a new well-known Large Community that provides a way for route-leak prevention, detection, and mitigation. The configuration process for this Community can be automated with the methodology for setting BGP roles that is described in RFC 9234.¶
This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79.¶
Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet-Drafts is at https://datatracker.ietf.org/drafts/current/.¶
Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress."¶
This Internet-Draft will expire on 27 February 2025.¶
Copyright (c) 2024 IETF Trust and the persons identified as the document authors. All rights reserved.¶
This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Revised BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Revised BSD License.¶
RFC 7908 [RFC7908] provides a definition of the route-leak problem and enumerates several types of route leaks. For this document, the definition that is applied is that a route leak occurs when a route received from a transit provider or a lateral peer is forwarded (against commonly used policy) to another transit provider or a lateral peer. The commonly used policy is that a route received from a transit provider or a lateral peer MAY be forwarded only to customers.¶
This document describes a solution for prevention, detection and mitigation of route leaks which is based on conveying route-leak detection information in a transitive well-known BGP Large Community [RFC8092]. The configuration process for the Large Community MUST be defined according to peering relations between ISPs. This process can be automated with the methodology for setting BGP roles that is described in [RFC9234].¶
The techniques described in this document can be incrementally deployed. If a pair of ISPs and/or Internet Exchanges (IXes) deploy the proposed techniques, then they would detect and mitigate any route leaks that occur in an AS path between them even when other ASes in the path are not upgraded.¶
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here.¶
As described in [RFC9234], there are several common peering relations between eBGP neighbors:¶
Provider - sender is a transit provider of the neighbor;¶
Customer - sender is a customer of the neighbor;¶
Route Server (RS) - sender is route server at an internet exchange (IX)¶
RS-client - sender is client of an RS at an IX¶
Peer - sender and neighbor are lateral (non-transit) peers;¶
If a route is received from a provider, peer, or RS-client, it MUST follow the 'down only' rule, i.e., it MAY be advertised only to customers. If a route is sent to a customer, peer, or RS-client, it also MUST follow the 'down only' rule at each subsequent AS in the AS path.¶
A standardized transitive route-leak detection signal is needed that will prevent Autonomous Systems (ASes) from leaking and also inform a remote ISP (or AS) in the AS path that a received route violates the 'down only' policy. This signal would facilitate a way to stop the propagation of leaked prefixes.¶
To improve reliability and cover for non-participating preceding neighbor, the signal should be set on both receiver and sender sides.¶
This section presents a brief discussion of the advantages and disadvantages of communities and BGP path attributes for the purpose of route-leak detection.¶
A transitive path attribute is a native way to implement the route-leak detection signal. Based on the way BGP protocol works, the use of a transitive attribute makes it more certain that the route-leak detection signal would pass unaltered through non-participating (i.e., not upgraded) BGP routers. The main disadvantage of this approach is that the deployment of a new BGP attribute requires a software upgrade in the router OS which may delay wide adoption for years.¶
On the other hand, BGP Communities do not require a router OS update. The potential disadvantage of using a Community for the route-leak detection signal is that it is more likely to be dropped somewhere along the way in the AS path. Currently, the use of BGP Communities is somewhat overloaded. BGP Communities are already used for numerous applications: different types of route marking, route policy control, blackholing, etc. It is observed that some ASes seem to purposefully or accidentally remove BGP Communities on receipt, sometimes well-known ones. Perhaps this issue may be mitigated with strong policy guidance related to the handling of Communities.¶
Large Communities have much higher capacity, and therefore they are likely to be less overloaded. Hence, Large Community is proposed to be used for route-leak detection. This document suggests reserving <TBD1> class for the purpose of transitive well-known Large Communities that MUST NOT be stripped on ingress or egress.¶
While it is not a part of this document, the route-leak detection signal described here can also be carried in a transitive BGP Path Attribute, and similar prevention and mitigation techniques as described here would apply (see [RFC9234]).¶
Due to frequently occurring regional and global disruptions in Internet connectivity, it is critical to move forward with a solution that is viable in the near term. That solution would be route-leak detection using a well-known Large Community.¶
This section specifies the semantics of route-leak detection Community and its usage. This Community is given the specific name Down Only (DO) Community. The DO Community is carried in a BGP Large Community with a format as shown in Figure 1.¶
0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | TBD1 (class for transitive well-known Large Communities) | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | TBD2 (subclass for DO) | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | ASN | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
The authors studied different options for route-leak mitigation. The main options considered are (1) drop detected route leaks and (2) deprioritize detected route leaks. It can be demonstrated that the loose mode that uses deprioritization is not safe. Traffic Engineering (TE) techniques which limit prefix visibility are quite common. It may happen that a more specific TE prefix is sent only to downstream ASes or to IX(es)/selected peers, and a control Community is used to restrict its propagation. If such a more specific prefix is leaked, deprioritization will not stop such a route leak from propagating. In addition, propagation of leaked prefixes based on deprioritization may result in priority loops leading to BGP wedgies [RFC4264] or even persistent route oscillations.¶
So, the only truly safe way to implement route-leak mitigation is to drop detected route leaks. The ingress and egress policies corresponding to 'drop detected route leaks' is described in Section 4.1. This policy SHOULD be used as a default behavior.¶
Nevertheless, early adopters might want to deploy only the signaling and perhaps use it only for diagnostics before applying any route-leak mitigation policy. They are also encouraged to use slightly limited marking, which is described in Section 4.2.¶
This section describes the eBGP ingress and egress policies that MUST be used to perform route-leak prevention, detection and mitigation using the DO Community. It should be noted that a route may carry more than one DO Communities. Hence, in the rest of this document, "a route with DO Community" means "a route with one or more DO Communities".¶
The ingress policy MUST use the following procedure:¶
If a route with DO Community is received from a Customer or RS-client, then it is a route leak and MUST be dropped. The procedure halts.¶
If a route with DO Community is received from a Peer (non-transit) and at least one DO value is not equal to the sending neighbor's ASN, then it is a route leak and MUST be dropped. The procedure halts.¶
If a route is received from a Provider, Peer, or RS, then a DO Community MUST be added with a value equal to the sending neighbor's ASN.¶
The egress policy MUST use the following procedure:¶
A route with DO Community (i.e., DO Community was present or added at ingress) MUST NOT be sent to a Provider, Peer, or RS.¶
If a route is sent to a Customer or Peer, then a DO Community MUST be added with value equal to the ASN of the sender.¶
The above procedures comprehensively provide route-leak prevention, detection and mitigation. Policy consisting of these procedures SHOULD be used as a default behavior.¶
This section describes eBGP ingress and egress marking policies that MUST be used if an AS is not performing route-leak mitigation (i.e., not dropping detected route leaks) as described in Section 4.1, but wants to use the DO Community only for marking. The slightly limited DO marking (compared to that in Section 4.1) described below guarantees that this DO marking will not limit the leak detection opportunities for subsequent ASes in the AS path.¶
The ingress policy MUST use the following procedure:¶
If a route with DO Community is received from a Customer or RS-client, then it is a route leak. The procedure halts.¶
If a route with DO Community is received from a Peer (non-transit) and at least one DO value is not equal to the sending neighbor's ASN, then it is a route leak. The procedure halts.¶
If a route is received from a Provider, Peer, or RS, then a DO Community MUST be added with value equal to the sending neighbor's ASN.¶
The egress policy MUST use the following procedure:¶
If a route is sent to a Customer or RS-client, then a DO Community MUST be added with value equal to the ASN of the sender.¶
If a route without DO Community is sent to a Peer, then a DO Community MUST be added with value equal to the ASN of the sender. Conversely, if a route with DO Community (i.e., DO Community was present or added at ingress) is sent to a Peer, then an additional DO Community MUST NOT be added.)¶
These above procedures specify setting the DO signals in a way that can be used to evaluate the potential impact of route-leak mitigation policy before deploying strict dropping of detected route leaks.¶
It was observed that the majority of BGP implementations do not support negative match for communities like a:b:!c. Further, it is observed that a route received from a compliant Peer (non-transit) adhering to procedures from either Section 4.1 or Section 4.2 will always have a single DO Community with value equal to the peer's ASN. Hence, it is suggested to replace the second rule from the ingress policies (in Section 4.1 and Section 4.2) with the following:¶
In Section 4.1: If a route with DO Community is received from a Peer and a DO value is equal to the sending neighbor's ASN, then it is a valid route, otherwise it is a route leak and MUST be dropped. The procedure halts.¶
In Section 4.2: If a route with DO Community is received from a Peer and a DO value is equal to the sending neighbor's ASN, then it is a valid route, otherwise it is a route leak. The procedure halts.¶
This rule is based on a weaker assumption that a peer that is doing marking is also doing filtering (i.e., dropping detected leaks). That is why networks that do not follow the route-leak mitigation policy in Section 4.1 MUST carefully follow marking rules described in Section 4.2.¶
IANA is requested to reserve a Global Administrator ID <TBD1> for transitive well-known Large Community registry. IANA is also requested to register a subclass <TBD2> for DO Community in this registry.¶
In specific circumstances in a state of partial adoption, route-leak mitigation mechanism can result in Denial of Service (DoS) for the victim prefix. Such a scenario may happen only for a prefix that has a single path from the originator to a Tier-1 ISP and only when the prefix is not covered with a less specific prefix with multiple paths to the Tier-1 ISP. If, in such unreliable topology, a route leak is injected somewhere inside this single path, then it may be dropped by upper tier providers in the path, thus limiting prefix visibility. While such anomaly is unlikely to happen, such an issue should be easy to debug, since it directly affects the sequence of originator's providers.¶
With the use of BGP Community, there is often a concern that the Community propagates beyond its intended perimeter and causes harm [streibelt]. However, that concern does not apply to the DO Community because it is a transitive Community that must propagate as far as the update goes.¶
The authors wish to thank John Scudder, Susan Hares, Ruediger Volk, Jeffrey Haas, Mat Ford, Greg Skinner for their review and comments.¶
The following people made significant contributions to this document and should be considered co-authors:¶
Brian Dickson Independent Email: [email protected] Doug Montgomery USA National Institute of Standards and Technology Email: [email protected] Keyur Patel Arrcus Email: [email protected] Andrei Robachevsky Internet Society Email: [email protected] Eugene Bogomazov Qrator Labs Email: [email protected] Randy Bush Internet Initiative Japan Email: [email protected]¶