Solaris. zone : error: unable to remove ib links

APPLIES TO

Solaris 11.3

SYMPTOMS

When you try to shutdown kernel zone, the following message appears 

# zoneadm list -cv
  ID NAME             STATUS      PATH                         BRAND      IP
   0 global           running     /                            solaris    shared
   1 ha-zone1         running     /zpool1/zones                solaris    excl

# zoneadm -z ha-zone1 shutdown
zone 'ha-zone1': error: unable to destroy zone
zoneadm: zone ha-zone1: call to zoneadmd(1M) failed: zoneadmd(1M) returned an error 1 (unspecified error)

then kernel zone hangs in shutting_down state

root@srv-da-zfs-02:~# zoneadm list -cv
  ID NAME             STATUS      PATH                         BRAND      IP
   0 global           running     /                            solaris    shared
   1 ha-zone1         shutting_down /zpool1/zones                solaris    excl

When you try to halt zone,the following errors appear

root@srv-da-zfs-02:~# zoneadm  -z ha-zone1 halt
zone 'ha-zone1': error: Walking through vhca list failed with status: 25
zone 'ha-zone1': error: unable to remove ib links
zone 'ha-zone1': error: unable to destroy zone
zoneadm: zone ha-zone1: call to zoneadmd(1M) failed: zoneadmd(1M) returned an error 9 (zone state change failed)  

CAUSE

Infiniband service was disabled on system although it was in use by kernel zone 'ha-zone1'. SMF service does not know that a kernel zone is using this service.

SOLUTION

Enable service 'ib-management' and shutdown non-global zone 'ha-zone1'.

root@srv-da-zfs-02:~# svcadm enable svc:/network/ib/ib-management:default
root@srv-da-zfs-02:~# svcs svc:/network/ib/ib-management:default
STATE          STIME    FMRI
online         10:00:29 svc:/network/ib/ib-management:default

root@srv-da-zfs-02:~# zoneadm  -z ha-zone1 halt
root@srv-da-zfs-02:~# zoneadm list -cv
  ID NAME             STATUS      PATH                         BRAND      IP
   0 global           running     /                            solaris    shared
   - ha-zone1         installed   /zpool1/zones                solaris    excl