Node management
This section includes topics such as node RBAC and node discover, including bootstrapping and zero-touch provisioning (ZTP).
Node RBAC
EDA supports the use of node RBAC to secure communications between EDA and nodes. System administrators can configure node security profile, node groups and node users using TACACS.
Node groups
The NodeGroup resource defines a group on a node. It includes RBAC
settings and the selection of services to which users belonging to the group has access,
and TACACS configuration. A node group has the following attributes:
- an optional name override in
groupName, allowing the resource name and local group name on the target to be different - the set of enabled services
- an indicator if the group provides superuser permissions
- a set of rules, being target specific RBAC rules
- mapping to a privilege level in the TACACS container
A NodeGroupDeployment resource is used to deploy
NodeGroup resources to target toponodes.
Rules
Users of for node groups can define a set of rules that are specific to a specified
operating system. The Rules section of the
NodeGroup resource includes the following parameters that
define a rule:
- An action, which can be one of the following:
DenyReadWriteRead
- An
operatingSystem- which OS to apply this rule to. - A
match- an OS-specific path, for exampleinterfacefor SR Linux, orconfigure portfor SR OS.
Rules that match the operating system of the target are deployed to that target.
The default for action is set to ReadWrite, and to
simplify the majority of deployments the operatingSystem is set to
srl.
Superuser
EDA supports a superuser attribute; if enabled for a node user
group, users that belong to the node group can perform all functions on the system,
including sudo and root access, if available.
TACACS+
System administrators commonly use TACACS+ to authenticate users, and then use the local device enforce a locally-defined rule set, or role. In EDA, enforcement uses the privilege level in TACACS+. If TACACS+ is used for authentication and if a privilege level is returned, a user is granted the set of permissions from all groups that match that privilege level and lower (following TACACS+ implementation of higher privilege levels inheriting permissions of lower levels).
Configlet application.Services
- CLI
- FTP
- gNMI
- gNSI
- gRIBI
- Reflection
- JSON-RPC
- NETCONF
Default sudo group
The default sudo node group is provided during the bootstrap process
or playground deployment. This group enables critical services and provides
read/write access to all paths. This NodeGroup is referenced by the
admin NodeUser resource that is provided with playground KPT
package.
The following example shows a sudo NodeGroup
resource:
apiVersion: core.eda.nokia.com/v1
kind: NodeGroup
metadata:
name: sudo
namespace: eda
spec:
services:
- GNMI
- CLI
- NETCONF
superuser: true
Creating node groups
- Click Create.
-
Configure metadata for this resource.
Set the following fields:
- Name
- Namespace
- Labels
- Annotations
-
Configure specifications for the node group.
- Provide a group name. If the you do not provide name, the system uses the resource name.
- In the Services drop-down list, select the services that users who belong to this group can access.
- Enable the Superuser field to make members of this node user group superusers.
-
In the Rules section, click Add
to configure rules.
Set the following fields to define the operating system match rule for this group:
- Action: select an action from the drop-down list
- Operating System: select srl for SR Linux or sros for SR OS.
- Match: a string to match input against; for example, interface for SR Linux or configure port for SR OS. Rules here should be specified in the target specific format.
- If TACACS is used for authentication, in the TACACS section, select the privilege level.
- Click Add To Transaction.
Node users
The NodeUser resource defines a node user using the following
parameters:
- username and password
- node groups to which the user belongs
- SSH public keys to be deployed for the user
Creating node users
- Click Create.
-
Configure metadata for this resource.
Set the following fields:
- Name
- Namespace
- Labels
- Annotations
-
Configure the specifications for this node user.
In the Specification section, set the following fields:
- Username: provide a name for this user. If you do not provide a username, the resource name is used.
- Password: provide a password for this user
-
Configure group bindings.
In the Group Bindings section, click Add.
- Select the toponodes.
- To use a label selector to select nodes, in the Node Selector section, click Add a Label Selector .
- To identify specific nodes, in the Nodes section, click Add item to select toponodes from the drop-down list.
- In the Groups section, click Add to specify the node groups to which this user belongs.
- Select the toponodes.
- In the SSH Public Keys field, click Add item to set the SSH public key to deploy for the user.
NodeUser resource
---
apiVersion: core.eda.nokia.com/v1
kind: NodeUser
metadata:
name: node-user
spec:
username: test
password: testPassword
groups:
- admin
nodeSelector:
- eda.nokia.com/role=spine
- eda.nokia.com/role=leaf
- eda.nokia.com/role=superspine
sshPublicKeys:
- "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCsYFM9U5hwi+hcZGr5EPjbcneMB+CRmJ1zYDI5wXq8BgtJdXLCqRnsHtdTpfXn5agwGfkMntsw+/whDjJj3HBX6FxAnB9CO/tHw0AZ7wwAagfp5TFkQwGsUVroJlqUfiu1I1yHqNx+etS8DrAAyLtiUMaEvSLztpqjG/4E3TsEvR1pRgt5OkEfX7CX8PIuCtKvuFBh7aaU6W8a5kvInQaL0TrxEWHb3cnqwTryRri+ohtHFaSFvpJsTT07in3j2UwPw8ICpi75xd8PMKC8CIqijIACIHMIADK0qUIhB+VEXhFp0RPihXraX8v+l7IFRBHLHqIW8ygJ5PUXQKx6+p+TRDhCNtuhL7pd+TWFJPqD9bZigIWEYfQE3dQ2ZNabXr+5sOxyeHot1nYUj5TiFLuCtNz36i3TkXNbHfKxuMymoLEiSOZyD2EkKNlzvxiW4RJl2wZAjjg9pqZILNkbkFVNo0gE3QSkr6fzIRFy27xUBWmG8zi06T4iumEvmhL05Ri3cPDzWQa4FoI9kzt1iCgCFqhHioK882CjZoWt9vX5+JqqddKXJV7oix5jlTvKtEQBYFSKTra2Mt+Gwpbn5bG3TtaumtpX4rK9PVPKnfCLccwRnp+mpijxcGA91N7+2Ud9fSPe8JX/jdGfSXAyU1GuCNI/pHjp0ILqFy2GwQseGQ== admin"
Node security profile
The NodeSecurityProfile resource provides the parameters that define how
to secure communication between EDA and a node. The NodeSecurityProfile
resource facilitates the configuration, generation, and rotation of TLS certificates,
trust bundle management, and secure communication with specified nodes.
Node selection
In NodeSecurityProfile resource, you can select nodes using the
following methods:
- listing the nodes: in the
nodesfield, list theTopoNodesto which the profile applies - by label: in the
nodeSelectorfield, select a label that applies toTopoNodesthat meet the criteria selected. This field can contain a list of label selectors; aTopoNodemust contain at least one of the labels to inherit the profile's settings.A
nodeSelectorset to an empty string ("") means that the profile applies to all nodes.
The nodes field takes precedence over the
nodeSelector setting. If multiple profiles match a node's
labels, the profile whose name is first in alphabetic order is applied.
TLS configuration
The tls context indicates whether the connection to the node is
secure (with TLS) or insecure (without TLS). The absence of the tls
field implies an insecure connection, while its presence signals a secure
connection.
EDA-managed certificates
When EDA is responsible for managing node certificates, the tls
context must include the following entries:
-
issuerRef: a reference to a CertManager Issuer, which is responsible for issuing the certificates. -
csrParams: the Certificate Signing Request (CSR) parameters define the parameters for certificate generation and rotation.csrSuite: the key and digest set to be used for generating the CSR.commonName: the common name (CN) to include in the certificate. This value is auto-generated.country: the legally registered country of the organization.state: the state or province where the organization is located.city: the city in which the organization is based.org: the name of the organization requesting the CSR.orgUnit: the department or division within the organization requesting the certificate.certificateValidity: the duration for which the certificate remains valid post-issuance.SAN(Subject Alternative Names):dns: List of DNS names used to access the node.emails: Email addresses associated with the certificate.ips: IP addresses that the certificate should validate.uris: Specific URIs that the certificate needs to authenticate.
The following is an example of nodeSecurityProfile where EDA manages
certificates:
apiVersion: v1
items:
- apiVersion: core.eda.nokia.com/v1
kind: NodeSecurityProfile
metadata:
annotations:
config.k8s.io/owning-inventory: 8c2644abc6befe73d5ad0cfc386ec155f31bc07d-1729769165484669347
kubectl.kubernetes.io/last-applied-configuration: >
{"apiVersion":"core.eda.nokia.com/v1","kind":"NodeSecurityProfile","metadata":{"annotations":{"config.k8s.io/owning-inventory":"8c2644abc6befe73d5ad0cfc386ec155f31bc07d-1729769165484669347"},"name":"insecure","namespace":"default"},"spec":{"nodeSelector":["eda.nokia.com/security-profile=insecure"]}}
name: insecure
namespace: eda
spec:
nodeSelector:
- eda.nokia.com/security-profile=insecure
- apiVersion: core.eda.nokia.com/v1
kind: NodeSecurityProfile
metadata:
annotations:
config.k8s.io/owning-inventory: 8c2644abc6befe73d5ad0cfc386ec155f31bc07d-1729769165484669347
kubectl.kubernetes.io/last-applied-configuration: >
{"apiVersion":"core.eda.nokia.com/v1","kind":"NodeSecurityProfile","metadata":{"annotations":{"config.k8s.io/owning-inventory":"8c2644abc6befe73d5ad0cfc386ec155f31bc07d-1729769165484669347"},"name":"managed-tls","namespace":"default"},"spec":{"nodeSelector":["eda.nokia.com/security-profile=managed"],"tls":{"csrParams":{"certificateValidity":"2160h","city":"Sunnyvale","country":"US","csrSuite":"CSRSUITE_X509_KEY_TYPE_RSA_2048_SIGNATURE_ALGORITHM_SHA_2_256","org":"NI","orgUnit":"EDA","state":"California"},"issuerRef":"eda-node-issuer"}}}
name: managed-tls
namespace: eda
spec:
nodeSelector:
- eda.nokia.com/security-profile=managed
tls:
csrParams:
certificateValidity: 2160h
city: Sunnyvale
country: US
csrSuite: CSRSUITE_X509_KEY_TYPE_RSA_2048_SIGNATURE_ALGORITHM_SHA_2_256
org: NI
orgUnit: EDA
state: California
issuerRef: eda-node-issuer
- apiVersion: core.eda.nokia.com/v1
kind: NodeSecurityProfile
metadata:
annotations:
config.k8s.io/owning-inventory: 8c2644abc6befe73d5ad0cfc386ec155f31bc07d-1729769165484669347
kubectl.kubernetes.io/last-applied-configuration: >
{"apiVersion":"core.eda.nokia.com/v1","kind":"NodeSecurityProfile","metadata":{"annotations":{"config.k8s.io/owning-inventory":"8c2644abc6befe73d5ad0cfc386ec155f31bc07d-1729769165484669347"},"name":"unmanaged-tls","namespace":"default"},"spec":{"nodeSelector":["eda.nokia.com/security-profile=unmanaged"],"tls":{"trustBundle":"eda-node-trust-bundle"}}}
name: unmanaged-tls
namespace: eda
spec:
nodeSelector:
- eda.nokia.com/security-profile=unmanaged
tls:
trustBundle: eda-node-trust-bundle
kind: List
metadata:
resourceVersion: ""
External certificate management
tls section must
reference an external trust bundle. The trustBundle field in
(ConfigMap) contains a reference to a ConfigMap that holds a CA certificate. EDA
uses this CA certificate to verify the node’s certificate whenever it establishes a
connection. The trust bundle must be provided if node certificate management is
performed outside of EDA, allowing the node to validate certificates through an
external
authority.apiVersion: core.eda.nokia.com/v1
kind: NodeSecurityProfile
metadata:
name: example-node-security-profile
spec:
nodeSelector:
- "eda.nokia.com/role=leaf"
tls:
trustBundle: "node-trust-bundle"Node discovery
This section includes topics related to initial node discovery.
Bootstrapping
The Init application generates an initial configuration file for nodes
that require bootstrapping. The input to the Init application is an
Init resource, which specifies which toponodes to select and for
which toponodes to create an initial configuration.
The initial configuration file is stored in the artifact server. When toponodes connect to NPP, NPP pushes the initial configuration file to the node.
Additionally, the Init application generates the Python provisioning
script for SR Linux and bootstrap files needed for SR OS or other operating system.
Based on the same selection criteria, a bootstrap file or Python provisioning script is
generated for the selected nodes.
The bootstrap file or Python provisioning script ensures that the node boots into the version specified in the toponode. The software and any other artifacts are downloaded to the node during ZTP using HTTPS.
By default, if no toponode selectors are present in the Init resource,
an initial configuration file is generated for every toponode present in EDA.
Management interface IP address assignment
The Init resource allows you to configure the management interface
IP assignment method using DHCP or by defining static IP addresses. For details, see
Enabling DHCP clients and Setting static management IP addresses.
Saving node configuration on commit
To specify whether the node configuration is saved after each commit or not, in the
Init CR include the entry commitSave: true.
The Init script must reflect the commitSave value
in the generated initial configuration.
Preparing for bootstrapping
Ensure that you meet the following requirements:
-
The NodeSecurityProfile resource (for TLS) must be configured to ensure successful onboarding. For details, see Node security profile.
-
A node requires the relevant
EDA-CE licenseresource to be applied. Without this license, the node may not move to READY state.apiVersion: core.eda.nokia.com/v1 kind: License metadata: name: eda-license namespace: eda-system spec: enabled: true data: "ACoAgOlJq7AABoAU6V6W6XAERezbcYa+ZRZLg8M5IyqMgAABAATAEVEQS1bQkNdLTAuMC4qAAACABIATm9raWEuY29tLOVEQQAAAMAAMQCjorJ+SPKP3if9pcD3OhqlyaWK1VE89JWreOWkyOJcbIWO602C+iwp+FFp8AwAAAADAB4ARWRhIGxpY2Vuc2UgSW50ZXJuYWwgVGVzdAAAAAUAHADl0zNnAAAAAABgKWcAAAAAADohaAAAAADAACQAoKr6XCCQCZj1rWFYik1dGbiqG7TWRK2orh+0sjUKXNYBACkAMDAwMDAwMDAtMDAwMC0wMDAwLTAwMDAtMDAwMDAwMDAwMDAwAAAAAAYADAABAAQAAAAAAMAAMAC/KQqX7Di/m1d0zYz9quIyghaHatF0yDvDgK/fFr011Wa/7FN3LO/OoD3aHg8AXQFkOEh6ejQrTlFyNmVJNTNsVW9SMi9JV2xXd1NqMUF3QVh0eEd6LzhGdlp0WXphTkdOQ1RWRnNCQ3wwZ0p2b21pSDNiZHFTSFBYQ2R6d0xxVlNhM3FZZUZuL1BGMnhoSjN6OS8yS3RlVGpmUngreWFNS1NwZ0p5OE12YlBVbmw2TUFpNHRXR1g4U3R0WXFBN21uVUNhVHp5eXpLOWtXcWgwZVZtR1oyV09RTURML0thaWY1RGMva21tc0NVY042RUdNZUNiTmdvV2RKUFlXZ1o4c2hlaG03b2tsZHdsSDBxMXZWdjhHMjZ4OVUxbTd2ellBN3BDNkFXODJyZ3FsaExWTUJxYm11VDdKSzdPWWhzYVp4Q3h4a2lIbWZ5KytNY3FLVHFBUk1McWhYRzRIb290ME0xK1RaRVZTdUJKNFl5a3pkeHdVV3pGZGRZdjg5Ym5uUHBsdXc9PQAAAAA=" If the deployment uses EDA DHCP for bootstrapping,
GlobalConfigandUdpProxyCR may be needed.Following is an example ofFollowing is an example of aGlobalConfigresourceapiVersion: v1 items: - apiVersion: core.eda.nokia.com/v1 kind: GlobalConfig metadata: name: global namespace: eda-system spec: dhcp: domainName: mv1-3.dclab.nuq.ion.nokia.net httpPort: 9200 httpsPort: 9443 ipv4Address: 10.11.12.13 ipv6Address: 3001:cafe:11::2 kind: List metadata: resourceVersion: ""UdpProxyresource:apiVersion: v1 items: - apiVersion: core.eda.nokia.com/v1 kind: UdpProxy metadata: annotations: config.k8s.io/owning-inventory: aeb8a5709fd9a90c89d3d3dcc1d9c3817f2618ae-1732279916926223978 kubectl.kubernetes.io/last-applied-configuration: > {"apiVersion":"core.eda.nokia.com/v1","kind":"UdpProxy","metadata":{"annotations":{"config.k8s.io/owning-inventory":"aeb8a5709fd9a90c89d3d3dcc1d9c3817f2618ae-1732279916926223978"},"name":"eda-dhcp","namespace":"eda-system"},"spec":{"bufferSize":65535,"destHost":"eda-dhcp","destPort":67,"idleTimeout":60,"proxyPort":67}} name: eda-dhcp namespace: eda-system spec: bufferSize: 65535 destHost: eda-dhcp destPort: 67 idleTimeout: 60 proxyPort: 67 - apiVersion: core.eda.nokia.com/v1 kind: UdpProxy metadata: annotations: config.k8s.io/owning-inventory: aeb8a5709fd9a90c89d3d3dcc1d9c3817f2618ae-1732279916926223978 kubectl.kubernetes.io/last-applied-configuration: > {"apiVersion":"core.eda.nokia.com/v1","kind":"UdpProxy","metadata":{"annotations":{"config.k8s.io/owning-inventory":"aeb8a5709fd9a90c89d3d3dcc1d9c3817f2618ae-1732279916926223978"},"name":"eda-dhcp6","namespace":"eda-system"},"spec":{"bufferSize":65535,"destHost":"eda-dhcp6","destPort":547,"idleTimeout":60,"proxyPort":547}} name: eda-dhcp6 namespace: eda-system spec: bufferSize: 65535 destHost: eda-dhcp6 destPort: 547 idleTimeout: 60 proxyPort: 547 kind: List metadata: resourceVersion: ""- The init and relevant images must be downloaded to the artifacts server.
The following resource must be present:
apiVersion: v1 kind: Secret metadata: name: srl-node-cred namespace: eda type: Opaque data: username: YWRtaW4= password: Tm9raWFTcmwxIQ== --- apiVersion: v1 kind: Secret metadata: name: srl-ftp-cred namespace: eda type: Opaque data: username: ZnRwdXNlcg== password: U2ghbmluZyR0YXIxIQ== --- apiVersion: artifacts.eda.nokia.com/v1 kind: Artifact metadata: name: srlinux-24.10.1-492 namespace: eda spec: repo: images filePath: srl.bin remoteFileUrl: fileUrl: ftp://10.10.10.10/eda/srl_images/srlinux-24.10.1-492.bin secret: srl-ftp-cred --- apiVersion: artifacts.eda.nokia.com/v1 kind: Artifact metadata: name: srlinux-24.10.1-492-md5 namespace: eda spec: repo: images filePath: srl.bin.md5 remoteFileUrl: fileUrl: ftp://10.10.10.10/eda/srl_images/srlinux-24.10.1-492.bin.md5 secret: srl-ftp-cred
Enabling DHCP clients
To enable the IPv4 and IPv6 DHCP clients on the management interface, in the
Init resource, include the following entries in the mgmt
context:
ipv4DHCP: true
ipv6DHCP: true
mgmt section, by default, both ipv4DHCP and
ipv6DHCP are set to true. Optionally, you can also
set the IP MTU, as shown in the following
example:apiVersion: bootstrap.eda.nokia.com/v1alpha1
kind: Init
metadata:
name: init-config
spec:
nodeSelector:
- 'eda.nokia.com/role=leaf'
- 'eda.nokia.com/role=spine'
- 'eda.nokia.com/role=borderleaf'
- 'eda.nokia.com/role=superspine'
- 'eda.nokia.com/role=backbone'
mgmt:
ipv4DHCP: true
ipv6DHCP: true
ipMTU: 9000Setting static management IP addresses
To set the management IP address statically, the init script must
use the productionAddress setting from the Toponode
resource as the IPv4 or IPv6 address in the generated configuration.
The init script sets the address as either IPv4 or IPv6 and sets the prefix length.
The table below displays the different combinations of ipv4DHCP,
ipv6DHCP and productionAddress settings and the
corresponding resulting initial configuration.
| Init resource | TopoNode setting | Result |
|---|---|---|
ipv4DHCP: true
|
* | The management interface IPv4 client is enabled in the initial configuration. |
ipv6DHCP: true
|
* | The management interface IPv6 client is enabled in the initial configuration. |
ipv4DHCP: false
|
IPv4 productionAddress is set | The production address is set as the IPv4 address of the management interface in the initial configuration. |
ipv4DHCP: false
|
IPv6 productionAddress is set | The IPv4 address is left unset in the initial configuration and the IPv4 DHCP client is not enabled. |
ipv6DHCP: false
|
IPv4 productionAddress is set | The IPv6 address is left unset in the initial configuration and the IPv6 DHCP client is not enabled. |
ipv6DHCP: false
|
IPv6 productionAddress is set | The production address is set as the IPv6 address of the management interface in the initial configuration. |
ipv4DHCP: false
ipv6DHCP: false
|
productionAddress is not set | Results in than error: add productionAddress to TopoNode or enable a DHCP client. |
Static Routes
Init CR, specify an IP prefix and
a next hop. The Init script adds the static routes to the
management network instance. For
example:apiVersion: bootstrap.eda.nokia.com/v1alpha1
kind: Init
metadata:
name: init-config
spec:
nodeSelector:
- 'eda.nokia.com/role=leaf'
- 'eda.nokia.com/role=spine'
- 'eda.nokia.com/role=borderleaf'
- 'eda.nokia.com/role=superspine'
- 'eda.nokia.com/role=backbone'
mgmt:
ipv4DHCP: true
ipv6DHCP: true
ipMTU: 9000
staticRoutes:
- prefix: 10.10.0.0/16
nextHop: 172.16.255.29
- prefix: 2001:10:10::/64
nextHop: "200::"Zero-touch provisioning
Zero Touch Provisioning (ZTP) allows for a device to be installed in a rack, powered on, and without any additional input from an operator, boot up pull down the software version of its operating system, an initial configuration and any other boot artifacts required for it to be managed.
Most ZTP implementations rely on DHCP to provide an IP address to the DUT and use DHCP options to inform the DUT of the location of any boot artifacts it requires to complete its ZTP process. In SR Linux, the DHCP server provides the URL of a Python provisioning script which is then used by the DUT to perform actions such as software upgrade and applying an initial configuration. In SR OS, the DHCP server provides a URL to a provisioning file which is a text file containing URLs to software images and configuration files.
For devices running SR OS and SR Linux, the devices send a DHCP Discover message with option 61 (client-id) set to the chassis serial number. This setting is used on the DHCP server to associate a DHCP discover message with a specific DUT and allows for the DHCP server to allocate static DHCP leases (IPs) and potentially device-specific boot artifacts (Python script or boot file).
- Use of an internal DHCP server (hosted and managed by EDA)
- Use of an external DHCP server (hosted and managed outside of EDA)
To serve the boot artifacts (Python script, boot file, software, or any other files needed during the bootstrapping process), an artifact server must be present in EDA. An intent is used to allow for artifacts to be added to the server, which is then be retrieved by the devices during boot.
DHCP server
In deployments that use EDA to handle ZTP in its entirety, a DHCP server is required to provide IP addresses to devices.
When a device issues a DHCP discovery message, the client-id option (61) attribute
includes their chassis serial number. This serial number is used to associate real
devices with node objects in EDA. Additionally, an IP address is assigned to device
via a Target object. The DHCP server must support the following
capabilities:
- Static lease assignment using the client-id (option 61) as the binding between an IP address and a device
- Ability to receive DHCP packets from a DHCP relay (the DHCP relay between the devices and the DHCP server)
- When providing an IP address to the device, the DHCP server must be able to populate option 66 or 67 in the DHCP offer. This option provides HTTPs. The URL points to the ZTP provisioning script or boot file hosted on the artifact server.
- Ability to populate other options as required by the operator, for example:
- Router option 3
- Time Server option 4
- Name Server option 5
- Domain Server option 6
- Log server option 7
- Support both IPv4 and IPv6 IP addressing