Setup Kolla-ansible OpenStack Cluster in Vagrant 2020

Posted on In

This is a note on setting up kolla ansible openstack develop envrionment in your working machine.

I referred to this document: https://docs.openstack.org/kolla-ansible/latest/contributor/vagrant-dev-env.html

I had done this in 2020 May on my old mac mini with Catalina ;-). With 20 GiB disk and 6GiB RAM assigned to one Vagrant spawned (virtualbox), the OpenStack Cluster is running pretty well, comparing to my previous setups ( multi-VMs based manually deployment and VM based Mirantis Fuel 9.0 deployment), it’s obviously more reponsive with the help of the single node setup.

Here I leave the notes as a reference for you to have a playground easier.

Preparation

Install vagrant and plugins needed

Below is an example to do this on a macOS machine, to do that from other OS, refer to here

1
2
3
4
5
6
7
8
brew cask install virtualbox vagrant

vagrant plugin install vagrant-hostmanager vagrant-vbguest

# if we need to resize disks after vagrant up
vagrant plugin install vagrant-disksize
# if we need to make vagrant VM behind a proxy
vagrant plugin install vagrant-proxyconf

Clone kolla repo

We need to clone below three repositories.

1
2
3
git clone https://opendev.org/openstack/kolla-cli
git clone https://opendev.org/openstack/kolla-ansible
git clone https://opendev.org/openstack/kolla

Customise Vagrant scripts

I found the configuration file out-of-box is no longer working/ out of repair for some time, below changes on Vagrantfile, Vagrantfile.custom, and bootstrap.sh are needed.

For Vagrantfile.custom, we need to use Ubuntu 18.04 instead of 16.04, which comes with python3.6+ in apt repo.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
cd kolla-ansible/contrib/dev/vagrant
cp Vagrantfile.custom.example Vagrantfile.custom

cat Vagrantfile.custom | grep -v "^#"
PROVIDER = "virtualbox"

DISTRO = "ubuntu"

PROVIDER_DEFAULTS = {
  virtualbox: {
    ubuntu: {
      base_image: "ubuntu/bionic64",
      bridge_interface: "en0",
      vagrant_shared_folder: "/home/vagrant/sync",
      sync_method: "virtualbox",
      username: "ubuntu"
    }
  }
}

WIFI = true

git diff

VagrantFile was also changed to increase operator VM root disk spec and RAM size.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
diff --git a/contrib/dev/vagrant/Vagrantfile b/contrib/dev/vagrant/Vagrantfile
index 26b6294da..d248b302d 100644
--- a/contrib/dev/vagrant/Vagrantfile
+++ b/contrib/dev/vagrant/Vagrantfile
@@ -234,6 +234,10 @@ Vagrant.configure(2) do |config|
     end
   end

+  # Resize the spec of operator and config proxy
+
+  config.disksize.size = '50GB'
+  config.apt_proxy.http = ""
+  config.apt_proxy.https = ""
+
   # The operator controls the deployment
   config.vm.define "operator", primary: true do |admin|
     admin.vm.hostname = "operator.local"
@@ -251,6 +255,7 @@ Vagrant.configure(2) do |config|
         vm.graphics_ip = GRAPHICSIP
       end
       configure_wifi_if_enabled(vm)
+      vm.customize ["modifyvm", :id, "--memory", 6144]
     end
     admin.hostmanager.aliases = "operator"
   end

bootstrap.sh was modified for adaptations on ubuntu 18.04 with docker and python3 configured.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
diff --git a/contrib/dev/vagrant/bootstrap.sh b/contrib/dev/vagrant/bootstrap.sh
index d7260a323..d4f8b7baf 100644
--- a/contrib/dev/vagrant/bootstrap.sh
+++ b/contrib/dev/vagrant/bootstrap.sh
@@ -80,13 +80,15 @@ function prep_work {
             systemctl disable ufw
         fi
         apt-get update
-        apt-get -y install python-mysqldb python-pip python-dev build-essential libssl-dev libffi-dev libxml2-dev libxslt-dev
+        apt-get -y install python3-mysqldb python3-pip python3-dev build-essential libssl-dev libffi-dev libxml2-dev libxslt-dev
+        update-alternatives --install /usr/bin/python python /usr/bin/python3.6 10
+        update-alternatives --install /usr/bin/pip pip /usr/bin/pip3 10
     else
         echo "Unsupported Distro: $DISTRO" 1>&2
         exit 1
     fi

-    pip install --upgrade docker
+    pip install --upgrade pip docker
 }

 # Do some cleanup after the installation of kolla
@@ -124,11 +126,9 @@ EOF

         usermod -aG docker vagrant
     elif is_ubuntu; then
-        apt-key adv --keyserver hkp://pgp.mit.edu:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D
-        echo "deb https://apt.dockerproject.org/repo ubuntu-xenial main" > /etc/apt/sources.list.d/docker.list
         apt-get update
-        apt-get -y install docker-engine
-        sed -i -r "s|(ExecStart)=(.+)|\1=/usr/bin/docker daemon --insecure-registry ${REGISTRY} --registry-mirror=http://${REGISTRY}|" /lib/systemd/system/docker.service
+        apt-get -y install docker.io
+        sed -i -r "s|(ExecStart)=(.+)|\1=/usr/bin/dockerd --insecure-registry ${REGISTRY} --registry-mirror=http://${REGISTRY} --host fd:// --containerd=/run/containerd/containerd.sock|" /lib/systemd/system/docker.service
     else
         echo "Unsupported Distro: $DISTRO" 1>&2
         exit 1

Configure virtual networks in VirtualBox

Note, below are lines in Vagrantfile, it comes with nic name in eth*, we will change them accordingly later on this to en*.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
def configure_wifi_vbox_networking(vm)
  # Even if adapters 1 & 2 don't need to be modified, if the order is to be
  # maintained, some modification has to be done to them. This will maintain
  # the association inside the guest OS: NIC1 -> eth0, NIC2 -> eth1, NIC3 ->
  # eht2. The modifications for adapters 1 & 2 only change optional properties.
  # Adapter 3 is enabled and connected to the NAT-Network named "OSNetwork",
  # while also changing its optional properties. Since adapter 3 is used by
  # Neutron for the external network, promiscuous mode is set to "allow-all".
  # Also, use virtio as the adapter type, for better performance.
  vm.customize ["modifyvm", :id, "--nictype1", "virtio"]
  vm.customize ["modifyvm", :id, "--cableconnected1", "on"]
  vm.customize ["modifyvm", :id, "--nicpromisc2", "deny"]
  vm.customize ["modifyvm", :id, "--nictype2", "virtio"]
  vm.customize ["modifyvm", :id, "--cableconnected2", "on"]
  vm.customize ["modifyvm", :id, "--nic3", "natnetwork"]
  vm.customize ["modifyvm", :id, "--nat-network3", "OSNetwork"] # <------ this one
  vm.customize ["modifyvm", :id, "--nicpromisc3", "allow-all"]
  vm.customize ["modifyvm", :id, "--nictype3", "virtio"]
  vm.customize ["modifyvm", :id, "--cableconnected3", "on"]
end

Thus a NAT network named OSNetwork should be created, we can create it manually before next steps.

1
2
3
4
5
6
7
8
9
10
VBoxManage natnetwork list
NAT Networks:

Name:        OSNetwork
Network:     100.0.0.0/24
Gateway:     100.0.0.1
IPv6:        No
Enabled:     Yes

1 network found

Vagrant Up and access to Operator node

A VM named operator will be spawned by vagrant up under kolla-ansible/contrib/dev/vagrant:

1
2
vagrant up
vagrant ssh operator  # to access "operator" VM

Build Kolla Docker Images

In this VM, if the bootstrap.sh went well, we should have kolla-build usable out of box.

We could refer to this doc on kolla-build, and to enable minimal usable OpenStack cluster, you could use the profile default or even define your own profiles.

Also, here we are using ubuntu as linux distro type and openstack release in Train cycle a.k.a. 9.1.0.

1
kolla-build --base ubuntu --profile default --openstack-release "9.1.0" --skip-existing

logs for building images

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
INFO:kolla.common.utils:=========================
INFO:kolla.common.utils:Successfully built images
INFO:kolla.common.utils:=========================
INFO:kolla.common.utils:barbican-base
INFO:kolla.common.utils:barbican-keystone-listener
INFO:kolla.common.utils:base
INFO:kolla.common.utils:chrony
INFO:kolla.common.utils:cron
INFO:kolla.common.utils:fluentd
INFO:kolla.common.utils:glance-api
INFO:kolla.common.utils:glance-base
INFO:kolla.common.utils:glance-registry
INFO:kolla.common.utils:haproxy
INFO:kolla.common.utils:heat-api
INFO:kolla.common.utils:heat-api-cfn
INFO:kolla.common.utils:heat-base
INFO:kolla.common.utils:heat-engine
INFO:kolla.common.utils:horizon
INFO:kolla.common.utils:keepalived
INFO:kolla.common.utils:keystone
INFO:kolla.common.utils:keystone-base
INFO:kolla.common.utils:keystone-fernet
INFO:kolla.common.utils:keystone-ssh
INFO:kolla.common.utils:kolla-toolbox
INFO:kolla.common.utils:mariadb
INFO:kolla.common.utils:mariadb-base
INFO:kolla.common.utils:mariadb-clustercheck
INFO:kolla.common.utils:mariadb-server
INFO:kolla.common.utils:memcached
INFO:kolla.common.utils:neutron-base
INFO:kolla.common.utils:neutron-bgp-dragent
INFO:kolla.common.utils:neutron-dhcp-agent
INFO:kolla.common.utils:neutron-infoblox-ipam-agent
INFO:kolla.common.utils:neutron-l3-agent
INFO:kolla.common.utils:neutron-linuxbridge-agent
INFO:kolla.common.utils:neutron-metadata-agent
INFO:kolla.common.utils:neutron-metadata-agent-ovn
INFO:kolla.common.utils:neutron-metering-agent
INFO:kolla.common.utils:neutron-openvswitch-agent
INFO:kolla.common.utils:neutron-server
INFO:kolla.common.utils:neutron-server-opendaylight
INFO:kolla.common.utils:neutron-server-ovn
INFO:kolla.common.utils:neutron-sriov-agent
INFO:kolla.common.utils:nova-api
INFO:kolla.common.utils:nova-base
INFO:kolla.common.utils:nova-compute
INFO:kolla.common.utils:nova-compute-ironic
INFO:kolla.common.utils:nova-conductor
INFO:kolla.common.utils:nova-libvirt
INFO:kolla.common.utils:nova-novncproxy
INFO:kolla.common.utils:nova-scheduler
INFO:kolla.common.utils:nova-serialproxy
INFO:kolla.common.utils:nova-spicehtml5proxy
INFO:kolla.common.utils:nova-ssh
INFO:kolla.common.utils:openstack-base
INFO:kolla.common.utils:openvswitch-base
INFO:kolla.common.utils:openvswitch-db-server
INFO:kolla.common.utils:openvswitch-vswitchd
INFO:kolla.common.utils:placement-api
INFO:kolla.common.utils:placement-base
INFO:kolla.common.utils:prometheus-base
INFO:kolla.common.utils:prometheus-haproxy-exporter
INFO:kolla.common.utils:prometheus-memcached-exporter
INFO:kolla.common.utils:rabbitmq

This will take a while and it depends on your network situation and CPU ;-), then we could have needed images being built

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
root@operator: # docker images
REPOSITORY                                                                TAG                 IMAGE ID            CREATED             SIZE
operator.local:4000/lokolla/ubuntu-binary-nova-compute                    9.1.0               9977333ea15b        9 days ago          921MB
operator.local:4000/lokolla/ubuntu-binary-horizon                         9.1.0               0941e5ae7d17        9 days ago          619MB
operator.local:4000/lokolla/ubuntu-binary-neutron-server-opendaylight     9.1.0               c8e56fa7cd1f        9 days ago          669MB
operator.local:4000/lokolla/ubuntu-binary-nova-compute-ironic             9.1.0               3a8e3df9a0f0        9 days ago          764MB
operator.local:4000/lokolla/ubuntu-binary-nova-api                        9.1.0               ac54264a362a        9 days ago          634MB
operator.local:4000/lokolla/ubuntu-binary-nova-novncproxy                 9.1.0               5aa3c338d32e        9 days ago          645MB
operator.local:4000/lokolla/ubuntu-binary-nova-serialproxy                9.1.0               7215c20ad3f3        9 days ago          621MB
operator.local:4000/lokolla/ubuntu-binary-neutron-server-ovn              9.1.0               37e94257a188        9 days ago          561MB
operator.local:4000/lokolla/ubuntu-binary-nova-ssh                        9.1.0               cf17afc42b35        9 days ago          623MB
operator.local:4000/lokolla/ubuntu-binary-neutron-infoblox-ipam-agent     9.1.0               ecb358c6737e        9 days ago          561MB
operator.local:4000/lokolla/ubuntu-binary-nova-spicehtml5proxy            9.1.0               d31423b9ba82        9 days ago          621MB
operator.local:4000/lokolla/ubuntu-binary-nova-conductor                  9.1.0               2c94a0f01bb5        9 days ago          621MB
operator.local:4000/lokolla/ubuntu-binary-nova-scheduler                  9.1.0               5c02b566ab17        9 days ago          621MB
operator.local:4000/lokolla/ubuntu-binary-neutron-openvswitch-agent       9.1.0               b33f0acd2837        9 days ago          555MB
operator.local:4000/lokolla/ubuntu-binary-neutron-metering-agent          9.1.0               f454ed7952f5        9 days ago          555MB
operator.local:4000/lokolla/ubuntu-binary-neutron-metadata-agent          9.1.0               2725dd9625f7        9 days ago          557MB
operator.local:4000/lokolla/ubuntu-binary-neutron-server                  9.1.0               d6cf6dd854b8        9 days ago          561MB
operator.local:4000/lokolla/ubuntu-binary-neutron-linuxbridge-agent       9.1.0               98b7d2516b36        9 days ago          555MB
operator.local:4000/lokolla/ubuntu-binary-nova-base                       9.1.0               a6927b74ce5f        9 days ago          618MB
operator.local:4000/lokolla/ubuntu-binary-heat-engine                     9.1.0               dd468972a5db        9 days ago          513MB
operator.local:4000/lokolla/ubuntu-binary-neutron-sriov-agent             9.1.0               f060e2b828c3        9 days ago          555MB
operator.local:4000/lokolla/ubuntu-binary-heat-api                        9.1.0               62e36e9c42a5        9 days ago          513MB
operator.local:4000/lokolla/ubuntu-binary-neutron-l3-agent                9.1.0               fc4e3f30a385        9 days ago          561MB
operator.local:4000/lokolla/ubuntu-binary-neutron-dhcp-agent              9.1.0               0ba2190cf331        9 days ago          558MB
operator.local:4000/lokolla/ubuntu-binary-neutron-bgp-dragent             9.1.0               bcd7e971ed94        9 days ago          556MB
operator.local:4000/lokolla/ubuntu-binary-glance-api                      9.1.0               c3e7869f6699        9 days ago          519MB
operator.local:4000/lokolla/ubuntu-binary-keystone-fernet                 9.1.0               1b1f533bb04f        9 days ago          494MB
operator.local:4000/lokolla/ubuntu-binary-neutron-metadata-agent-ovn      9.1.0               24ce264a051c        9 days ago          552MB
operator.local:4000/lokolla/ubuntu-binary-glance-registry                 9.1.0               af21156994b5        9 days ago          503MB
operator.local:4000/lokolla/ubuntu-binary-placement-api                   9.1.0               98f72efcee88        9 days ago          532MB
operator.local:4000/lokolla/ubuntu-binary-keystone                        9.1.0               a9e16ba897c7        9 days ago          490MB
operator.local:4000/lokolla/ubuntu-binary-keystone-ssh                    9.1.0               3d21db1b5ec5        9 days ago          496MB
operator.local:4000/lokolla/ubuntu-binary-neutron-base                    9.1.0               660e301b004a        9 days ago          552MB
operator.local:4000/lokolla/ubuntu-binary-heat-api-cfn                    9.1.0               104f841db4fa        9 days ago          513MB
operator.local:4000/lokolla/ubuntu-binary-kolla-toolbox                   9.1.0               4c3902489674        9 days ago          933MB
operator.local:4000/lokolla/ubuntu-binary-glance-base                     9.1.0               4023044bafab        9 days ago          503MB
operator.local:4000/lokolla/ubuntu-binary-keystone-base                   9.1.0               ff5441d42802        9 days ago          487MB
operator.local:4000/lokolla/ubuntu-binary-barbican-keystone-listener      9.1.0               b1528a8d4e5b        9 days ago          459MB
operator.local:4000/lokolla/ubuntu-binary-placement-base                  9.1.0               00df0fe7ff13        9 days ago          494MB
operator.local:4000/lokolla/ubuntu-binary-heat-base                       9.1.0               743f6a651c8f        9 days ago          435MB
operator.local:4000/lokolla/ubuntu-binary-barbican-base                   9.1.0               8435e7bb5a8c        9 days ago          424MB
operator.local:4000/lokolla/ubuntu-binary-openstack-base                  9.1.0               9a7befd0cc64        9 days ago          422MB
operator.local:4000/lokolla/ubuntu-binary-nova-libvirt                    9.1.0               a414aa4d1512        9 days ago          883MB
operator.local:4000/lokolla/ubuntu-binary-mariadb-server                  9.1.0               c8f1254995ea        9 days ago          536MB
operator.local:4000/lokolla/ubuntu-binary-fluentd                         9.1.0               a3e62fa48f3e        10 days ago         537MB
operator.local:4000/lokolla/ubuntu-binary-openvswitch-db-server           9.1.0               d5280ad49720        10 days ago         224MB
operator.local:4000/lokolla/ubuntu-binary-openvswitch-vswitchd            9.1.0               026b50773723        10 days ago         224MB
operator.local:4000/lokolla/ubuntu-binary-prometheus-haproxy-exporter     9.1.0               7920e8c72603        10 days ago         219MB
operator.local:4000/lokolla/ubuntu-binary-prometheus-memcached-exporter   9.1.0               076e0eded872        10 days ago         220MB
operator.local:4000/lokolla/ubuntu-binary-mariadb-clustercheck            9.1.0               317d9e7365be        10 days ago         241MB
operator.local:4000/lokolla/ubuntu-binary-openvswitch-base                9.1.0               ea128655d138        10 days ago         224MB
operator.local:4000/lokolla/ubuntu-binary-memcached                       9.1.0               b6af2f329240        10 days ago         208MB
operator.local:4000/lokolla/ubuntu-binary-mariadb                         9.1.0               2c2fe1fbf961        10 days ago         535MB
operator.local:4000/lokolla/ubuntu-binary-rabbitmq                        9.1.0               d1b1aaacc73a        10 days ago         249MB
operator.local:4000/lokolla/ubuntu-binary-cron                            9.1.0               d084f268e0dc        10 days ago         208MB
operator.local:4000/lokolla/ubuntu-binary-chrony                          9.1.0               43fc123294e3        10 days ago         213MB
operator.local:4000/lokolla/ubuntu-binary-prometheus-base                 9.1.0               a36c132b3c48        10 days ago         206MB
operator.local:4000/lokolla/ubuntu-binary-haproxy                         9.1.0               507836be5c42        10 days ago         214MB
operator.local:4000/lokolla/ubuntu-binary-mariadb-base                    9.1.0               3b2ea2e71fae        10 days ago         240MB
operator.local:4000/lokolla/ubuntu-binary-keepalived                      9.1.0               5970aa989513        10 days ago         216MB
operator.local:4000/lokolla/ubuntu-binary-base                            9.1.0               d4bed93756bc        10 days ago         206MB
ubuntu                                                                    18.04               c3c304cb4f22        4 weeks ago         64.2MB
registry                                                                  2                   708bc6af7e5e        4 months ago        25.8MB

Deploy Kolla Openstack Cluster

Generate password

1
kolla-genpwd

Configuration

1
2
3
sudo su
cp /etc/kolla/globals.yml /etc/kolla/globals.yml.original
vim /etc/kolla/globals.yml

changed configurations

root@operator:/etc/kolla# diff -u globals.yml.original globals.yml 

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
@@ -684,7 +684,9 @@
 docker_registry: "operator.local:4000"
 docker_namespace: "lokolla"
 docker_insecure_registry: "True"
-network_interface: "eth1"
-neutron_external_interface: "eth2"
-kolla_internal_vip_address: "172.28.128.254"
-
+network_interface: "enp0s3"
+neutron_external_interface: "enp0s8"
+kolla_internal_vip_address: "10.0.2.254"
+kolla_base_distro: "ubuntu"
+neutron_plugin_agent: "linuxbridge"
+openstack_release: "9.1.0"

1
2
root@operator:/etc/kolla# ll /usr/share/kolla-ansible/ansible/inventory/all-in-one
-rw-r--r-- 1 vagrant vagrant 9620 May 14 14:52 /usr/share/kolla-ansible/ansible/inventory/all-in-one

Let’s deploy it

1
2
kolla-ansible deploy -vvv
kolla-ansible post-deploy

Issues and workarounds

  1. rabbitmq cannot restart

    1
    2
    3
    4
    5
    6
    7
    root@operator:/etc/kolla# docker ps
    CONTAINER ID        IMAGE                                                           COMMAND                  CREATED              STATUS                          PORTS                    NAMES
    e8f160fbd3fd        operator.local:4000/lokolla/ubuntu-binary-rabbitmq:9.1.0        "dumb-init --single-…"   About a minute ago   Restarting (1) 28 seconds ago

    root@operator:/etc/kolla# cat /var/log/kolla/rabbitmq/startup_log

    ERROR: epmd error for host: operator address (cannot connect to host/port) kolla

    This was caused by /etc/hosts not properly handled ref.

    We need to modify /etc/hosts and ensure operator to be resolved as 10.0.2.15

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    root@operator:# cat /etc/hosts
    127.0.0.1	localhost	localhost.localdomain	localhost4	localhost4.localdomain4

    # The following lines are desirable for IPv6 capable hosts
    ::1	ip6-localhost	ip6-loopback
    fe00::0	ip6-localnet
    ff00::0	ip6-mcastprefix
    ff02::1	ip6-allnodes
    ff02::2	ip6-allrouters
    ff02::3	ip6-allhosts

    ## vagrant-hostmanager-start
    172.28.128.9	operator.local
    #172.28.128.9	operator
    ## vagrant-hostmanager-end

    #127.0.1.1	operator.local	operator
    127.0.1.1	ubuntu-bionic	ubuntu-bionic

    10.0.2.15 operator

Verify the openstack cluster

All running containers are there ;-).

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
root@operator:/etc/kolla# docker ps
CONTAINER ID        IMAGE                                                                       COMMAND                  CREATED             STATUS              PORTS                    NAMES
7cfde211e496        operator.local:4000/lokolla/ubuntu-binary-horizon:9.1.0                     "dumb-init --single-…"   4 days ago          Up 4 days                                    horizon
2e3ada5b2cdc        operator.local:4000/lokolla/ubuntu-binary-heat-engine:9.1.0                 "dumb-init --single-…"   4 days ago          Up 4 days                                    heat_engine
eadd81997eef        operator.local:4000/lokolla/ubuntu-binary-heat-api-cfn:9.1.0                "dumb-init --single-…"   4 days ago          Up 4 days                                    heat_api_cfn
f672776e5016        operator.local:4000/lokolla/ubuntu-binary-heat-api:9.1.0                    "dumb-init --single-…"   4 days ago          Up 4 days                                    heat_api
306e2ea602ca        operator.local:4000/lokolla/ubuntu-binary-neutron-metadata-agent:9.1.0      "dumb-init --single-…"   4 days ago          Up 4 days                                    neutron_metadata_agent
fec8dd1a453e        operator.local:4000/lokolla/ubuntu-binary-neutron-l3-agent:9.1.0            "dumb-init --single-…"   4 days ago          Up 4 days                                    neutron_l3_agent
61ea63284f97        operator.local:4000/lokolla/ubuntu-binary-neutron-dhcp-agent:9.1.0          "dumb-init --single-…"   4 days ago          Up 4 days                                    neutron_dhcp_agent
8fa34d62a754        operator.local:4000/lokolla/ubuntu-binary-neutron-linuxbridge-agent:9.1.0   "dumb-init --single-…"   4 days ago          Up 4 days                                    neutron_linuxbridge_agent
de7ed9268b49        operator.local:4000/lokolla/ubuntu-binary-neutron-server:9.1.0              "dumb-init --single-…"   4 days ago          Up 4 days                                    neutron_server
e49be1d477cb        operator.local:4000/lokolla/ubuntu-binary-nova-compute:9.1.0                "dumb-init --single-…"   4 days ago          Up 4 days                                    nova_compute
cbc188c0a8a1        operator.local:4000/lokolla/ubuntu-binary-nova-libvirt:9.1.0                "dumb-init --single-…"   4 days ago          Up 4 days                                    nova_libvirt
af34d5d17a15        operator.local:4000/lokolla/ubuntu-binary-nova-ssh:9.1.0                    "dumb-init --single-…"   4 days ago          Up 4 days                                    nova_ssh
9125b5301adc        operator.local:4000/lokolla/ubuntu-binary-nova-novncproxy:9.1.0             "dumb-init --single-…"   4 days ago          Up 4 days                                    nova_novncproxy
aa7f19fc8079        operator.local:4000/lokolla/ubuntu-binary-nova-conductor:9.1.0              "dumb-init --single-…"   4 days ago          Up 4 days                                    nova_conductor
43269b434d5c        operator.local:4000/lokolla/ubuntu-binary-nova-api:9.1.0                    "dumb-init --single-…"   4 days ago          Up 4 days                                    nova_api
650dbf084fa7        operator.local:4000/lokolla/ubuntu-binary-nova-scheduler:9.1.0              "dumb-init --single-…"   4 days ago          Up 4 days                                    nova_scheduler
f84e5f5443ec        operator.local:4000/lokolla/ubuntu-binary-placement-api:9.1.0               "dumb-init --single-…"   4 days ago          Up 4 days                                    placement_api
34af2bc9124e        operator.local:4000/lokolla/ubuntu-binary-glance-api:9.1.0                  "dumb-init --single-…"   4 days ago          Up 4 days                                    glance_api
1ed48ba03c97        operator.local:4000/lokolla/ubuntu-binary-keystone-fernet:9.1.0             "dumb-init --single-…"   4 days ago          Up 4 days                                    keystone_fernet
a7a3b569ae2f        operator.local:4000/lokolla/ubuntu-binary-keystone-ssh:9.1.0                "dumb-init --single-…"   4 days ago          Up 4 days                                    keystone_ssh
e5d4b0e94e2e        operator.local:4000/lokolla/ubuntu-binary-keystone:9.1.0                    "dumb-init --single-…"   4 days ago          Up 4 days                                    keystone
820e8bf1c713        operator.local:4000/lokolla/ubuntu-binary-rabbitmq:9.1.0                    "dumb-init --single-…"   9 days ago          Up 4 days                                    rabbitmq
87d818f7aee9        operator.local:4000/lokolla/ubuntu-binary-memcached:9.1.0                   "dumb-init --single-…"   9 days ago          Up 4 days                                    memcached
36c9d3b5ec48        operator.local:4000/lokolla/ubuntu-binary-mariadb:9.1.0                     "dumb-init -- kolla_…"   9 days ago          Up 4 days                                    mariadb
f34118e04e65        operator.local:4000/lokolla/ubuntu-binary-keepalived:9.1.0                  "dumb-init --single-…"   9 days ago          Up 4 days                                    keepalived
4a835502bbc6        operator.local:4000/lokolla/ubuntu-binary-haproxy:9.1.0                     "dumb-init --single-…"   9 days ago          Up 4 days                                    haproxy
6048403886a0        operator.local:4000/lokolla/ubuntu-binary-chrony:9.1.0                      "dumb-init --single-…"   9 days ago          Up 4 days                                    chrony
20c995a51ddd        operator.local:4000/lokolla/ubuntu-binary-cron:9.1.0                        "dumb-init --single-…"   9 days ago          Up 4 days                                    cron
77670d8cafe8        operator.local:4000/lokolla/ubuntu-binary-kolla-toolbox:9.1.0               "dumb-init --single-…"   9 days ago          Up 4 days                                    kolla_toolbox
93426ea2dae4        operator.local:4000/lokolla/ubuntu-binary-fluentd:9.1.0                     "dumb-init --single-…"   9 days ago          Up 4 days                                    fluentd
f9208a01d0ec        registry:2                                                                  "/entrypoint.sh /etc…"   10 days ago         Up 4 days           0.0.0.0:4000->5000/tcp   registry

And we could try openstack client calls:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
root@operator:/etc/kolla# . /etc/kolla/admin-openrc.sh
root@operator:/etc/kolla# openstack service list
+----------------------------------+-------------+----------------+
| ID                               | Name        | Type           |
+----------------------------------+-------------+----------------+
| 16c0c5e034a145f4815fb3d242d393bf | keystone    | identity       |
| 4adf583360da4e5a95f091efd1fd9343 | placement   | placement      |
| 837d588b2f6f41c7a1d41d85e99e8906 | nova_legacy | compute_legacy |
| 88807288c83b445e8a03fccbc8453cc0 | heat-cfn    | cloudformation |
| b74e3c61de794de3a0bc34a3fdf86ab7 | nova        | compute        |
| d975a75ca12b4b44b5c8423783e47b76 | neutron     | network        |
| e4860fe43a624f19a1001801d6eec511 | glance      | image          |
| f776a802710840ee9003c1b91fa91a41 | heat        | orchestration  |
+----------------------------------+-------------+----------------+

root@operator:/etc/kolla# openstack network agent list
+--------------------------------------+--------------------+----------+-------------------+-------+-------+---------------------------+
| ID                                   | Agent Type         | Host     | Availability Zone | Alive | State | Binary                    |
+--------------------------------------+--------------------+----------+-------------------+-------+-------+---------------------------+
| 05a9fcb8-14a5-46a8-b6b7-1430153d7246 | Linux bridge agent | operator | None              | :-)   | UP    | neutron-linuxbridge-agent |
| 16a0abce-a33c-4dda-b13b-d74523ed9b3b | L3 agent           | operator | nova              | :-)   | UP    | neutron-l3-agent          |
| 8e7f251e-243f-4721-97a7-7cb4060ffa18 | Metadata agent     | operator | None              | :-)   | UP    | neutron-metadata-agent    |
| e4e7c5f0-6c79-40ea-9d8c-1da7673e80a5 | DHCP agent         | operator | nova              | :-)   | UP    | neutron-dhcp-agent        |
+--------------------------------------+--------------------+----------+-------------------+-------+-------+---------------------------+

root@operator:/etc/kolla# openstack compute service list
+----+----------------+----------+----------+---------+-------+----------------------------+
| ID | Binary         | Host     | Zone     | Status  | State | Updated At                 |
+----+----------------+----------+----------+---------+-------+----------------------------+
|  4 | nova-scheduler | operator | internal | enabled | up    | 2020-05-21T15:34:28.000000 |
|  1 | nova-conductor | operator | internal | enabled | up    | 2020-05-21T15:34:35.000000 |
|  2 | nova-compute   | operator | nova     | enabled | up    | 2020-05-21T15:34:36.000000 |
+----+----------------+----------+----------+---------+-------+----------------------------+