Multiple environment setup of kubecf with single/multi-operator not working #1710
Description
Describe the bug
I am trying to get multi-environment setup for kubecf (eirini enabled). Having trouble with the setup.
Trying to achieve multi-env setup with a single quarks operator and 2 pods do not seem to move past CrashLoopBackOff state.
cf-apps-dns pod is in CrashLoopBackOff state and below is its logs:
Listen: listen tcp :53: bind: permission denied
database-0 pod is stuck in CrashLoopBackOff state and below is the logs:
chown: changing ownership of '/var/lib/mysql/public_key.pem': Operation not permitted
chown: changing ownership of '/var/lib/mysql': Operation not permitted
chown: changing ownership of '/var/log/mysqld.log': Operation not permitted
Tried the multi-operator multi-environment setup as well and although installation is successful, we cannot do a cf-push in the first environment. Noticed that some pods although are all up have errors in them. cf-apps-dns pod has the below error:
[INFO] plugin/reload: Running configuration MD5 = 61f83ad89ee44c5a0857c1575d2ed928
CoreDNS-1.7.0
linux/amd64, go1.15.2,
[ERROR] plugin/errors: 2 622515394376455650.4712288795810336393. HINFO: read udp 172.30.239.155:57813->172.21.93.216:53: read: connection refused
[ERROR] plugin/errors: 2 622515394376455650.4712288795810336393. HINFO: read udp 172.30.239.155:52441->172.21.93.216:53: read: connection refused
[ERROR] plugin/errors: 2 622515394376455650.4712288795810336393. HINFO: read udp 172.30.239.155:53313->172.21.93.216:53: read: connection refused
To Reproduce
Followed instructions given on: https://quarks.suse.dev/docs/quarks-operator/install/#multiple-namespaces for quarks
install. Tried both single operator option and multi-operator option while installing kubecf
Expected behavior
Multi-environment kubecf install should be successful and a cf-push of any application should be possible in these multiple environments
Environment
- kubecf - 2.7.12
- quarks - 7.1.3+0.g0ce050b
- eirini - enabled
Additional context
Tried to install 2 environments - dev and test via both single and multi-operator options and both have failed.