Inventory
Ansible automates tasks on managed nodes (also named hosts) in the cluster infrastructure, using a list or group of lists known as inventory .
Important Settings
There are two key configuration settings, influencing how the cluster will be deployed.
Playbook Batch Size
Because K3s uses tokens to secure the node join process, a serial must be defined, generating the token on the first cluster type node. Next, the generated token is copied to additional nodes while running the Provisioning playbook.
Batch Size Usage
Example of serial structure with 3 server type nodes and 5 agent type nodes, used in the Provisioning playbook:
Provisioning Details
serial:
- 1
- 2
- 5The serial structure has the following pattern:
1— firstservertype node, where the K3s token is generated2— two additionalservertype nodes, where the K3s token is copied5— five additionalagenttype nodes, where the K3s token is copied
Update the serial structure in the provisioning.yaml playbook file.
Example of serial structure with 3 server type nodes and 5 agent type nodes, used in the Reset playbook:
Reset Details
serial:
- 3
- 5The serial structure has the following pattern:
3—servertype nodes are reset first5—agenttype nodes are reset
Update the serial structure in the reset.yaml playbook file.
k3s_vars.cluster.controlplane.tainted
The setting allows the end-user to control where the Kubernetes pods will be deployed. In a scenario where there is only a single agent type node or none deployed, setting the value to false will allow pods to be deployed on any cluster node type.
Update the setting in the k3s role main.yaml variables file.
Cluster Nodes
The hosts.yaml inventory file contains the list of server and agent cluster node types.
Please review the K3s Architecture for further details.
High Availability
The minimum number of server type nodes for a HA cluster is 3. Ideally, a cluster should have a starting point of 6 nodes — 3 tainted server type nodes (running control-plane and datastore components) and 3 agent type nodes (where Kubernetes pods are deployed).
Example of an HA cluster inventory with 4 nodes:
Inventory Details
Inventory, set in the hosts.yaml inventory file:
server:
hosts:
apollo:
boreas:
cerus:
agent:
hosts:
chaos:
cluster:
children:
server:
agent:Batch size, set in the provisioning.yaml playbook file:
serial:
- 1
- 2
- 1Batch size, set in the reset.yaml playbook file:
serial:
- 3
- 1Single Point of Failure
The above detailed configuration will introduce a SPOF, since Kubernetes pods are deployed to a single agent type node or none.
To address this issue, set the k3s_vars.server.controlplane.tainted option to false in the k3s role main.yaml variables file.
Non High Availability
The minimum number of server type nodes for a non-HA cluster is 1. By K3s Architecture design, a cluster can have either 1 or 3+ server type nodes.
If the targeted cluster has fewer than 3 server type nodes, the Provisioning playbook will automatically disable all related HA features.
Example of a non-HA cluster inventory with 2 nodes:
Inventory Details
Inventory, set in the hosts.yaml inventory file:
server:
hosts:
apollo:
agent:
hosts:
chaos:
cluster:
children:
server:
agent:Batch size, set in the provisioning.yaml playbook file:
serial:
- 1Batch size, set in the reset.yaml playbook file:
serial:
- 2