[release-1.26] Make klipper-lb image configurable

[brandond]

• Make klipper-lb image configurable  #7625 backport

[ShylajaDevadiga]

Validated on v1.26.5+k3s1 passing cloud-config.yaml using latest klipper-lb image

OS: SLES 15 SP4

Default install:

> sudo /usr/local/bin/crictl -r /var/run/k3s/containerd/containerd.sock images |grep klipper-lb 
docker.io/rancher/klipper-lb                 v0.4.3                 613ae033d1f9c       4.28MB

Passing cloud-config.yaml using latest klipper-lb image

ec2-user@ip-172-31-10-72:~> cat /etc/rancher/k3s/cloud-config.yaml 
{
  "lbEnabled": true,
  "lbImage": "rancher/klipper-lb:v0.4.4",
  "lbNamespace": "kube-system",
  "nodeEnabled": true,
  "rootless": false
}

ec2-user@ip-172-31-10-72:~> curl -fL https://get.k3s.io| INSTALL_K3S_VERSION=v1.26.5+k3s1 sh -s - server --kube-cloud-controller-manager-arg="cloud-config=/etc/rancher/k3s/cloud-config.yaml"

ec2-user@ip-172-31-10-72:~> kubectl get nodes
NAME              STATUS   ROLES                  AGE     VERSION
ip-172-31-10-72   Ready    control-plane,master   3m46s   v1.26.5+k3s1

ec2-user@ip-172-31-10-72:~> kubectl get pods -A
NAMESPACE     NAME                                      READY   STATUS      RESTARTS   AGE
kube-system   local-path-provisioner-76d776f6f9-4rfbf   1/1     Running     0          3m34s
kube-system   coredns-59b4f5bbd5-g5x7r                  1/1     Running     0          3m34s
kube-system   helm-install-traefik-crd-xhn6s            0/1     Completed   0          3m34s
kube-system   helm-install-traefik-svz65                0/1     Completed   1          3m34s
kube-system   svclb-traefik-7082b9fa-7vpq4              2/2     Running     0          3m20s
kube-system   traefik-57c84cf78d-qwwcc                  1/1     Running     0          3m20s
kube-system   metrics-server-7b67f64457-5bz74           1/1     Running     0          3m34s

ec2-user@ip-172-31-10-72:~> sudo /usr/local/bin/crictl -r /var/run/k3s/containerd/containerd.sock images |grep klipper-lb
docker.io/rancher/klipper-lb                 v0.4.4                 af74bd845c4a8       4.92MB
ec2-user@ip-172-31-10-72:~>