# PaCkAgE DaTaStReAm opensvc 1 4316 # end of header 070701000244d3000081a40000000000000000000000014faab5bf000000f0000000ae00010002ffffffffffffffff0000001000000000opensvc/pkginfoPKG=opensvc NAME=opensvc Service Manager for logical servers v1.3-120509.1802 ARCH=all VERSION=1.3,REV=120509.1802 CATEGORY=application VENDOR=http://www.opensvc.com EMAIL=support@opensvc.com PSTAMP=OPENSVC-1.3,REV=120509.1802 CLASSES=none 070701000244d2000081a40000000000000000000000014faab5bf00006c66000000ae00010002ffffffffffffffff0000000f00000000opensvc/pkgmap: 1 4316 1 d none /opt/opensvc 0755 root root 1 d none /opt/opensvc/.be 0775 root root 1 d none /opt/opensvc/.be/bugs 0775 root root 1 d none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d 0775 root root 1 d none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments 0775 root root 1 d none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments/53babb48-bd35-4130-9f96-99806d5bc239 0775 root root 1 f none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments/53babb48-bd35-4130-9f96-99806d5bc239/body 0664 root root 157 14121 1336579337 1 f none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments/53babb48-bd35-4130-9f96-99806d5bc239/values 0664 root root 136 10270 1336579337 1 f none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/values 0664 root root 190 14629 1336579337 1 d none /opt/opensvc/.be/bugs/23f6ceaf-d0db-47b6-a127-55a2fae83a03 0775 root root 1 f none /opt/opensvc/.be/bugs/23f6ceaf-d0db-47b6-a127-55a2fae83a03/values 0664 root root 262 21256 1336579337 1 d none /opt/opensvc/.be/bugs/93b834b7-89d4-4462-89fb-d313864f3a51 0775 root root 1 f none /opt/opensvc/.be/bugs/93b834b7-89d4-4462-89fb-d313864f3a51/values 0664 root root 290 23948 1336579337 1 f none /opt/opensvc/.be/settings 0664 root root 19 1295 1336579337 1 f none /opt/opensvc/.be/version 0664 root root 25 2098 1336579337 1 f none /opt/opensvc/.gitignore 0664 root root 134 11530 1336579337 1 d none /opt/opensvc/bin 0775 root root 1 s none /opt/opensvc/bin/alldownservices=svcmgr 1 s none /opt/opensvc/bin/allprimaryservices=svcmgr 1 s none /opt/opensvc/bin/allsecondaryservices=svcmgr 1 s none /opt/opensvc/bin/allservices=svcmgr 1 s none /opt/opensvc/bin/allupservices=svcmgr 1 d none /opt/opensvc/bin/cron 0775 root root 1 f none /opt/opensvc/bin/cron/opensvc 0775 root root 1690 9494 1336579337 1 f none /opt/opensvc/bin/freezer 0775 root root 1364 49689 1336579337 1 f none /opt/opensvc/bin/nodemgr 0775 root root 5574 4060 1336579337 1 f none /opt/opensvc/bin/opensvc.init.AIX 0775 root root 209 18797 1336579337 1 f none /opt/opensvc/bin/opensvc.init.Darwin 0664 root root 441 36791 1336579337 1 f none /opt/opensvc/bin/opensvc.init.FreeBSD 0775 root root 300 25712 1336579337 1 f none /opt/opensvc/bin/opensvc.init.SunOS 0775 root root 396 34372 1336579337 1 f none /opt/opensvc/bin/opensvc.init.debian 0775 root root 454 35881 1336579337 1 f none /opt/opensvc/bin/opensvc.init.hpux 0775 root root 738 60175 1336579337 1 f none /opt/opensvc/bin/opensvc.init.redhat 0775 root root 476 40877 1336579337 1 f none /opt/opensvc/bin/perfagt.Darwin 0775 root root 2523 46695 1336579337 1 f none /opt/opensvc/bin/perfagt.HP-UX 0775 root root 3049 31594 1336579337 1 f none /opt/opensvc/bin/perfagt.Linux 0775 root root 3828 8793 1336579337 1 f none /opt/opensvc/bin/perfagt.SunOS 0775 root root 3290 36795 1336579337 1 d none /opt/opensvc/bin/pkg 0775 root root 1 f none /opt/opensvc/bin/pkg/make.lib 0664 root root 1930 15417 1336579337 1 f none /opt/opensvc/bin/pkg/make_deb 0775 root root 889 7276 1336579337 1 f none /opt/opensvc/bin/pkg/make_depot 0775 root root 1340 37386 1336579337 1 f none /opt/opensvc/bin/pkg/make_pkg 0775 root root 4873 40937 1336579337 1 f none /opt/opensvc/bin/pkg/make_rpm 0775 root root 959 14283 1336579337 1 f none /opt/opensvc/bin/pkg/make_tbz 0775 root root 1936 27386 1336579337 1 f none /opt/opensvc/bin/postinstall 0775 root root 17589 41210 1336579337 1 s none /opt/opensvc/bin/svcfreeze=freezer 1 s none /opt/opensvc/bin/svcfrozen=freezer 1 f none /opt/opensvc/bin/svcmgr 0775 root root 11797 51353 1336579337 1 f none /opt/opensvc/bin/svcmon 0775 root root 5791 56804 1336579337 1 s none /opt/opensvc/bin/svcthaw=freezer 1 d none /opt/opensvc/lib 0775 root root 1 f none /opt/opensvc/lib/checkFmFmadm.py 0664 root root 1791 8251 1336579337 1 s none /opt/opensvc/lib/checkFmFmadmSunOS.py=checkFmFmadm.py 1 f none /opt/opensvc/lib/checkFsInodeAIX.py 0664 root root 1790 507 1336579337 1 f none /opt/opensvc/lib/checkFsInodeDarwin.py 0664 root root 1821 5364 1336579337 1 f none /opt/opensvc/lib/checkFsInodeHP-UX.py 0664 root root 1953 12217 1336579337 1 f none /opt/opensvc/lib/checkFsInodeLinux.py 0664 root root 2140 28807 1336579337 1 f none /opt/opensvc/lib/checkFsInodeSunOS.py 0664 root root 1953 12689 1336579337 1 f none /opt/opensvc/lib/checkFsUsageAIX.py 0664 root root 1790 490 1336579337 1 s none /opt/opensvc/lib/checkFsUsageDarwin.py=checkFsUsageLinux.py 1 s none /opt/opensvc/lib/checkFsUsageFreeBSD.py=checkFsUsageLinux.py 1 s none /opt/opensvc/lib/checkFsUsageHP-UX.py=checkFsUsageLinux.py 1 f none /opt/opensvc/lib/checkFsUsageLinux.py 0664 root root 2139 28714 1336579337 1 f none /opt/opensvc/lib/checkFsUsageSunOS.py 0664 root root 1948 12438 1336579337 1 f none /opt/opensvc/lib/checkFsUsageWindows.py 0664 root root 1746 4595 1336579337 1 f none /opt/opensvc/lib/checkLagSunOS.py 0664 root root 3422 36008 1336579337 1 f none /opt/opensvc/lib/checkMpathAIX.py 0664 root root 2802 2023 1336579337 1 f none /opt/opensvc/lib/checkMpathHP-UX.py 0664 root root 2147 23879 1336579337 1 f none /opt/opensvc/lib/checkMpathLinux.py 0664 root root 2557 46183 1336579337 1 f none /opt/opensvc/lib/checkMpathPowerpath.py 0664 root root 2944 6156 1336579337 1 s none /opt/opensvc/lib/checkMpathPowerpathAIX.py=checkMpathPowerpath.py 1 s none /opt/opensvc/lib/checkMpathPowerpathHP-UX.py=checkMpathPowerpath.py 1 s none /opt/opensvc/lib/checkMpathPowerpathLinux.py=checkMpathPowerpath.py 1 s none /opt/opensvc/lib/checkMpathPowerpathSunOS.py=checkMpathPowerpath.py 1 f none /opt/opensvc/lib/checkMpathSunOS.py 0664 root root 2318 34215 1336579337 1 f none /opt/opensvc/lib/checkRaidMegaRaid.py 0664 root root 5018 12511 1336579337 1 s none /opt/opensvc/lib/checkRaidMegaRaidLinux.py=checkRaidMegaRaid.py 1 s none /opt/opensvc/lib/checkRaidMegaRaidSunOS.py=checkRaidMegaRaid.py 1 f none /opt/opensvc/lib/checkRaidSas2.py 0664 root root 4599 57162 1336579337 1 s none /opt/opensvc/lib/checkRaidSas2SunOS.py=checkRaidSas2.py 1 f none /opt/opensvc/lib/checkRaidSmartArray.py 0664 root root 3386 52800 1336579337 1 s none /opt/opensvc/lib/checkRaidSmartArrayLinux.py=checkRaidSmartArray.py 1 s none /opt/opensvc/lib/checkRaidSmartArraySunOS.py=checkRaidSmartArray.py 1 f none /opt/opensvc/lib/checkVgUsageAIX.py 0664 root root 2118 24558 1336579337 1 f none /opt/opensvc/lib/checkVgUsageHP-UX.py 0664 root root 2635 64776 1336579337 1 f none /opt/opensvc/lib/checkVgUsageLinux.py 0664 root root 1954 14175 1336579337 1 f none /opt/opensvc/lib/checkZfsUsageSunOS.py 0664 root root 3217 34313 1336579337 1 f none /opt/opensvc/lib/checks.py 0664 root root 4337 47937 1336579337 1 f none /opt/opensvc/lib/collector.py 0664 root root 6001 211 1336579337 1 f none /opt/opensvc/lib/compliance.py 0664 root root 17865 60360 1336579337 1 f none /opt/opensvc/lib/freezer.py 0664 root root 1780 9411 1336579337 1 f none /opt/opensvc/lib/hostidAIX.py 0664 root root 1107 26120 1336579337 1 f none /opt/opensvc/lib/hostidDarwin.py 0664 root root 888 9879 1336579337 1 s none /opt/opensvc/lib/hostidFreeBSD.py=hostidLinux.py 1 f none /opt/opensvc/lib/hostidHP-UX.py 0664 root root 1203 33767 1336579337 1 f none /opt/opensvc/lib/hostidLinux.py 0664 root root 888 9879 1336579337 1 f none /opt/opensvc/lib/hostidSunOS.py 0664 root root 888 9879 1336579337 1 f none /opt/opensvc/lib/hostidWindows.py 0664 root root 888 9879 1336579337 1 f none /opt/opensvc/lib/lock.py 0664 root root 3000 30694 1336579337 1 f none /opt/opensvc/lib/loopSunOS.py 0664 root root 1439 52901 1336579337 1 f none /opt/opensvc/lib/node.py 0664 root root 34712 10765 1336579337 1 f none /opt/opensvc/lib/nodeHP-UX.py 0664 root root 1106 25464 1336579337 1 f none /opt/opensvc/lib/nodeLinux.py 0664 root root 1076 23916 1336579337 1 f none /opt/opensvc/lib/provFs.py 0664 root root 3267 41575 1336579337 1 f none /opt/opensvc/lib/provFsExt2.py 0664 root root 143 11721 1336579337 1 f none /opt/opensvc/lib/provFsExt3.py 0664 root root 143 11723 1336579337 1 f none /opt/opensvc/lib/provFsExt4.py 0664 root root 143 11725 1336579337 1 f none /opt/opensvc/lib/provFsZfs.py 0664 root root 1558 61639 1336579337 1 f none /opt/opensvc/lib/provIp.py 0664 root root 125 11090 1336579337 1 f none /opt/opensvc/lib/provKvm.py 0664 root root 4571 1199 1336579337 1 f none /opt/opensvc/lib/provLoopLinux.py 0664 root root 877 65497 1336579337 1 f none /opt/opensvc/lib/provLxc.py 0664 root root 8342 61843 1336579337 1 f none /opt/opensvc/lib/provVgLinux.py 0664 root root 1760 59090 1336579337 1 f none /opt/opensvc/lib/provZone.py 0664 root root 8243 41525 1336579337 1 f none /opt/opensvc/lib/provisioning.py 0664 root root 168 12704 1336579337 1 f none /opt/opensvc/lib/rcAddService.py 0664 root root 911 11569 1336579337 1 f none /opt/opensvc/lib/rcAsset.py 0664 root root 15046 29280 1336579337 1 f none /opt/opensvc/lib/rcAssetAIX.py 0664 root root 3893 21584 1336579337 1 f none /opt/opensvc/lib/rcAssetDarwin.py 0664 root root 3040 34839 1336579337 1 f none /opt/opensvc/lib/rcAssetFreeBSD.py 0664 root root 2856 14962 1336579337 1 f none /opt/opensvc/lib/rcAssetHP-UX.py 0664 root root 8167 38657 1336579337 1 f none /opt/opensvc/lib/rcAssetLinux.py 0664 root root 11711 20103 1336579337 1 f none /opt/opensvc/lib/rcAssetSunOS.py 0664 root root 6151 41534 1336579337 1 f none /opt/opensvc/lib/rcAssetWindows.py 0664 root root 3708 31754 1336579337 1 f none /opt/opensvc/lib/rcCommandWorker.py 0664 root root 1902 14479 1336579337 1 f none /opt/opensvc/lib/rcContainerLinux.py 0664 root root 5010 5843 1336579337 1 f none /opt/opensvc/lib/rcDcs.py 0664 root root 3550 5223 1336579337 1 f none /opt/opensvc/lib/rcDevTree.py 0664 root root 9299 22974 1336579337 1 f none /opt/opensvc/lib/rcDevTreeAIX.py 0664 root root 2029 15977 1336579337 1 f none /opt/opensvc/lib/rcDevTreeHP-UX.py 0664 root root 6072 28790 1336579337 1 f none /opt/opensvc/lib/rcDevTreeLinux.py 0664 root root 10379 7350 1336579337 1 f none /opt/opensvc/lib/rcDevTreeSunOS.py 0664 root root 8566 3899 1336579337 1 f none /opt/opensvc/lib/rcDiskInfo.py 0664 root root 1095 24481 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoAIX.py 0664 root root 2937 21136 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoDarwin.py 0664 root root 888 9990 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoFreeBSD.py 0664 root root 1303 41131 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoHP-UX.py 0664 root root 2953 22235 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoLinux.py 0664 root root 4935 18816 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoSunOS.py 0664 root root 4863 5224 1336579337 1 f none /opt/opensvc/lib/rcEva.py 0664 root root 3758 18476 1336579337 1 f none /opt/opensvc/lib/rcExceptions.py 0664 root root 3580 30536 1336579337 1 f none /opt/opensvc/lib/rcGlobalEnv.py 0664 root root 5917 896 1336579337 1 f none /opt/opensvc/lib/rcIbmSvc.py 0664 root root 3010 27518 1336579337 1 f none /opt/opensvc/lib/rcIfconfig.py 0664 root root 4124 44119 1336579337 1 f none /opt/opensvc/lib/rcIfconfigAIX.py 0664 root root 2810 69 1336579337 1 f none /opt/opensvc/lib/rcIfconfigDarwin.py 0664 root root 2631 51701 1336579337 1 f none /opt/opensvc/lib/rcIfconfigFreeBSD.py 0664 root root 2631 51701 1336579337 1 s none /opt/opensvc/lib/rcIfconfigFreeBSDhpvm.py=rcIfconfigFreeBSDkvm.py 1 f none /opt/opensvc/lib/rcIfconfigFreeBSDkvm.py 0664 root root 1266 39292 1336579337 1 s none /opt/opensvc/lib/rcIfconfigFreeBSDldom.py=rcIfconfigFreeBSDkvm.py 1 s none /opt/opensvc/lib/rcIfconfigFreeBSDxen.py=rcIfconfigFreeBSDkvm.py 1 f none /opt/opensvc/lib/rcIfconfigHP-UX.py 0664 root root 3403 37166 1336579337 1 f none /opt/opensvc/lib/rcIfconfigHP-UXhpvm.py 0664 root root 1779 7622 1336579337 1 f none /opt/opensvc/lib/rcIfconfigLinux.py 0664 root root 2878 1079 1336579337 1 s none /opt/opensvc/lib/rcIfconfigLinuxhpvm.py=rcIfconfigLinuxkvm.py 1 f none /opt/opensvc/lib/rcIfconfigLinuxkvm.py 0664 root root 1281 40272 1336579337 1 s none /opt/opensvc/lib/rcIfconfigLinuxldom.py=rcIfconfigLinuxkvm.py 1 f none /opt/opensvc/lib/rcIfconfigLinuxlxc.py 0664 root root 1567 61437 1336579337 1 s none /opt/opensvc/lib/rcIfconfigLinuxovm.py=rcIfconfigLinuxkvm.py 1 f none /opt/opensvc/lib/rcIfconfigLinuxvz.py 0664 root root 1123 27805 1336579337 1 s none /opt/opensvc/lib/rcIfconfigLinuxxen.py=rcIfconfigLinuxkvm.py 1 f none /opt/opensvc/lib/rcIfconfigSunOS.py 0664 root root 2855 1531 1336579337 1 s none /opt/opensvc/lib/rcIfconfigSunOSkvm.py=rcIfconfigSunOSldom.py 1 f none /opt/opensvc/lib/rcIfconfigSunOSldom.py 0664 root root 1281 40216 1336579337 1 s none /opt/opensvc/lib/rcIfconfigSunOSxen.py=rcIfconfigSunOSldom.py 1 f none /opt/opensvc/lib/rcIfconfigWindowskvm.py 0664 root root 1096 27277 1336579337 1 f none /opt/opensvc/lib/rcLogger.py 0664 root root 2193 42617 1336579337 1 f none /opt/opensvc/lib/rcLoopLinux.py 0664 root root 1694 4675 1336579337 1 f none /opt/opensvc/lib/rcLvmAIX.py 0664 root root 8006 45135 1336579337 1 f none /opt/opensvc/lib/rcMounts.py 0664 root root 1933 18912 1336579337 1 f none /opt/opensvc/lib/rcMountsAIX.py 0664 root root 4585 52348 1336579337 1 f none /opt/opensvc/lib/rcMountsDarwin.py 0664 root root 2436 54804 1336579337 1 f none /opt/opensvc/lib/rcMountsFreeBSD.py 0664 root root 2436 54804 1336579337 1 f none /opt/opensvc/lib/rcMountsHP-UX.py 0664 root root 2250 45165 1336579337 1 f none /opt/opensvc/lib/rcMountsLinux.py 0664 root root 2301 49085 1336579337 1 f none /opt/opensvc/lib/rcMountsSunOS.py 0664 root root 1938 19118 1336579337 1 f none /opt/opensvc/lib/rcNecIsm.py 0664 root root 1591 43604 1336579337 1 f none /opt/opensvc/lib/rcNexenta.py 0775 root root 11720 3539 1336579337 1 f none /opt/opensvc/lib/rcNode.py 0664 root root 1498 60669 1336579337 1 f none /opt/opensvc/lib/rcOptParser.py 0664 root root 9889 54113 1336579337 1 f none /opt/opensvc/lib/rcOs.py 0664 root root 126 9734 1336579337 1 f none /opt/opensvc/lib/rcOsHP-UX.py 0664 root root 122 10053 1336579337 1 f none /opt/opensvc/lib/rcOsLinux.py 0664 root root 216 16341 1336579337 1 f none /opt/opensvc/lib/rcOvm.py 0775 root root 4499 12375 1336579337 1 f none /opt/opensvc/lib/rcPkgAIX.py 0664 root root 1271 37076 1336579337 1 f none /opt/opensvc/lib/rcPkgDarwin.py 0664 root root 1754 9786 1336579337 1 f none /opt/opensvc/lib/rcPkgFreeBSD.py 0664 root root 1308 39656 1336579337 1 f none /opt/opensvc/lib/rcPkgHP-UX.py 0664 root root 1271 36609 1336579337 1 f none /opt/opensvc/lib/rcPkgLinux.py 0664 root root 1822 13831 1336579337 1 f none /opt/opensvc/lib/rcPkgSunOS.py 0664 root root 2359 46410 1336579337 1 f none /opt/opensvc/lib/rcPkgWindows.py 0664 root root 4852 49205 1336579337 1 f none /opt/opensvc/lib/rcPrintTable.py 0664 root root 8256 61780 1336579337 1 f none /opt/opensvc/lib/rcStats.py 0664 root root 3973 40778 1336579337 1 f none /opt/opensvc/lib/rcStatsAIX.py 0664 root root 4851 34443 1336579337 1 f none /opt/opensvc/lib/rcStatsDarwin.py 0664 root root 5463 37133 1336579337 1 f none /opt/opensvc/lib/rcStatsFreeBSD.py 0664 root root 5268 21932 1336579337 1 f none /opt/opensvc/lib/rcStatsHP-UX.py 0664 root root 7637 2991 1336579337 1 f none /opt/opensvc/lib/rcStatsLinux.py 0664 root root 10750 26403 1336579337 1 f none /opt/opensvc/lib/rcStatsSunOS.py 0664 root root 8211 11800 1336579337 1 f none /opt/opensvc/lib/rcStatus.py 0664 root root 5867 61184 1336579337 1 f none /opt/opensvc/lib/rcSymmetrix.py 0664 root root 5751 22013 1336579337 1 f none /opt/opensvc/lib/rcUtilities.py 0664 root root 7510 35539 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesAIX.py 0664 root root 326 23568 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesDarwin.py 0664 root root 376 25693 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesFreeBSD.py 0664 root root 292 21393 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesHP-UX.py 0664 root root 262 18527 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesLinux.py 0664 root root 2756 7980 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesSunOS.py 0664 root root 200 15386 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesWindows.py 0664 root root 758 60618 1336579337 1 f none /opt/opensvc/lib/rcVioServer.py 0664 root root 2877 19987 1336579337 1 f none /opt/opensvc/lib/rcZfs.py 0664 root root 7683 46609 1336579337 1 f none /opt/opensvc/lib/rcZone.py 0664 root root 3816 35934 1336579337 1 f none /opt/opensvc/lib/resApp.py 0664 root root 9635 53798 1336579337 1 f none /opt/opensvc/lib/resAppVm.py 0664 root root 4021 44300 1336579337 1 f none /opt/opensvc/lib/resContainer.py 0664 root root 5831 46462 1336579337 1 f none /opt/opensvc/lib/resContainerEsx.py 0664 root root 4157 45873 1336579337 1 f none /opt/opensvc/lib/resContainerHpVm.py 0664 root root 3903 35665 1336579337 1 f none /opt/opensvc/lib/resContainerJail.py 0664 root root 3913 29078 1336579337 1 f none /opt/opensvc/lib/resContainerKvm.py 0664 root root 5373 13404 1336579337 1 f none /opt/opensvc/lib/resContainerLdom.py 0664 root root 5010 39189 1336579337 1 f none /opt/opensvc/lib/resContainerLxc.py 0664 root root 7136 46496 1336579337 1 f none /opt/opensvc/lib/resContainerOvm.py 0664 root root 4581 14448 1336579337 1 f none /opt/opensvc/lib/resContainerVbox.py 0664 root root 4458 3543 1336579337 1 f none /opt/opensvc/lib/resContainerVz.py 0664 root root 4445 60210 1336579337 1 f none /opt/opensvc/lib/resContainerXen.py 0664 root root 3916 34031 1336579337 1 f none /opt/opensvc/lib/resContainerZone.py 0664 root root 11761 65019 1336579337 1 f none /opt/opensvc/lib/resDg.py 0664 root root 2795 26191 1336579337 1 f none /opt/opensvc/lib/resDrbd.py 0664 root root 6475 25395 1336579337 1 f none /opt/opensvc/lib/resHb.py 0664 root root 2607 64888 1336579337 1 f none /opt/opensvc/lib/resHbLinuxHA.py 0664 root root 1941 26504 1336579337 1 f none /opt/opensvc/lib/resHbOpenHA.py 0664 root root 6719 37649 1336579337 1 f none /opt/opensvc/lib/resHbovm.py 0664 root root 2867 27470 1336579337 1 f none /opt/opensvc/lib/resIp.py 0664 root root 8884 59671 1336579337 1 f none /opt/opensvc/lib/resIpAIX.py 0664 root root 1978 28013 1336579337 1 f none /opt/opensvc/lib/resIpDarwin.py 0664 root root 1986 28226 1336579337 1 f none /opt/opensvc/lib/resIpEsx.py 0664 root root 1553 60513 1336579337 1 f none /opt/opensvc/lib/resIpFreeBSD.py 0664 root root 1986 28226 1336579337 1 f none /opt/opensvc/lib/resIpHP-UX.py 0664 root root 2002 26836 1336579337 1 f none /opt/opensvc/lib/resIpHpVm.py 0664 root root 1544 60631 1336579337 1 f none /opt/opensvc/lib/resIpKvm.py 0664 root root 1572 61663 1336579337 1 f none /opt/opensvc/lib/resIpLdom.py 0664 root root 1573 61617 1336579337 1 f none /opt/opensvc/lib/resIpLinux.py 0664 root root 2338 55186 1336579337 1 f none /opt/opensvc/lib/resIpLinuxLxc.py 0664 root root 1573 61673 1336579337 1 f none /opt/opensvc/lib/resIpSunOS.py 0664 root root 1902 25324 1336579337 1 f none /opt/opensvc/lib/resIpVbox.py 0664 root root 1553 60541 1336579337 1 f none /opt/opensvc/lib/resIpVm.py 0664 root root 3249 58427 1336579337 1 f none /opt/opensvc/lib/resIpXen.py 0664 root root 1612 65334 1336579337 1 f none /opt/opensvc/lib/resIpZone.py 0664 root root 1723 8076 1336579337 1 f none /opt/opensvc/lib/resLoop.py 0664 root root 1901 20297 1336579337 1 f none /opt/opensvc/lib/resLoopFreeBSD.py 0664 root root 3201 49127 1336579337 1 f none /opt/opensvc/lib/resLoopLinux.py 0664 root root 2546 3632 1336579337 1 f none /opt/opensvc/lib/resMount.py 0664 root root 5884 56167 1336579337 1 f none /opt/opensvc/lib/resMountAIX.py 0664 root root 5307 5892 1336579337 1 f none /opt/opensvc/lib/resMountDarwin.py 0664 root root 5664 33046 1336579337 1 f none /opt/opensvc/lib/resMountFreeBSD.py 0664 root root 5664 33046 1336579337 1 f none /opt/opensvc/lib/resMountHP-UX.py 0664 root root 3904 38314 1336579337 1 f none /opt/opensvc/lib/resMountLinux.py 0664 root root 10725 44292 1336579337 1 f none /opt/opensvc/lib/resMountSunOS.py 0664 root root 5509 4654 1336579337 1 f none /opt/opensvc/lib/resScsiReserv.py 0664 root root 6873 54191 1336579337 1 s none /opt/opensvc/lib/resScsiReservFreeBSD.py=resScsiReservLinux.py 1 f none /opt/opensvc/lib/resScsiReservHP-UX.py 0664 root root 5862 49911 1336579337 1 f none /opt/opensvc/lib/resScsiReservLinux.py 0664 root root 5052 60162 1336579337 1 s none /opt/opensvc/lib/resScsiReservSunOS.py=resScsiReservLinux.py 1 f none /opt/opensvc/lib/resStonith.py 0664 root root 2339 50083 1336579337 1 f none /opt/opensvc/lib/resStonithCallout.py 0664 root root 490 38534 1336579337 1 f none /opt/opensvc/lib/resStonithIlo.py 0664 root root 609 48429 1336579337 1 f none /opt/opensvc/lib/resSync.py 0664 root root 5425 12909 1336579337 1 f none /opt/opensvc/lib/resSyncDcs.py 0664 root root 5130 64626 1336579337 1 f none /opt/opensvc/lib/resSyncDcsCkpt.py 0664 root root 7596 44759 1336579337 1 f none /opt/opensvc/lib/resSyncDcsSnap.py 0664 root root 5063 45328 1336579337 1 f none /opt/opensvc/lib/resSyncDds.py 0664 root root 15053 133 1336579337 1 f none /opt/opensvc/lib/resSyncEvasnap.py 0664 root root 11375 60184 1336579337 1 f none /opt/opensvc/lib/resSyncNetapp.py 0664 root root 10927 23290 1336579337 1 f none /opt/opensvc/lib/resSyncNexenta.py 0664 root root 9320 37158 1336579337 1 f none /opt/opensvc/lib/resSyncRsync.py 0664 root root 15455 58967 1336579337 1 f none /opt/opensvc/lib/resSyncSymclone.py 0664 root root 9686 60182 1336579337 1 f none /opt/opensvc/lib/resSyncSymcloneLinux.py 0664 root root 2799 22002 1336579337 1 f none /opt/opensvc/lib/resSyncZfs.py 0664 root root 13802 51747 1336579337 1 f none /opt/opensvc/lib/resVdisk.py 0664 root root 2888 29549 1336579337 1 f none /opt/opensvc/lib/resVgAIX.py 0664 root root 4023 35474 1336579337 1 f none /opt/opensvc/lib/resVgHP-UX.py 0664 root root 11138 10769 1336579337 1 f none /opt/opensvc/lib/resVgHpVm.py 0664 root root 5204 48662 1336579337 1 f none /opt/opensvc/lib/resVgLdom.py 0664 root root 4127 28231 1336579337 1 f none /opt/opensvc/lib/resVgLibvirtVm.py 0664 root root 2876 24248 1336579337 1 f none /opt/opensvc/lib/resVgLinux.py 0664 root root 5911 33976 1336579337 1 f none /opt/opensvc/lib/resVgOvm.py 0664 root root 2954 25473 1336579337 1 f none /opt/opensvc/lib/resVgRaw.py 0664 root root 4250 48158 1336579337 1 f none /opt/opensvc/lib/resVgRawHP-UX.py 0664 root root 1830 7054 1336579337 1 f none /opt/opensvc/lib/resVgRawLinux.py 0664 root root 10338 17083 1336579337 1 f none /opt/opensvc/lib/resVgRawSunOS.py 0664 root root 2383 37673 1336579337 1 f none /opt/opensvc/lib/resVgVeritas.py 0664 root root 4248 45984 1336579337 1 f none /opt/opensvc/lib/resVgZfs.py 0664 root root 5579 18907 1336579337 1 f none /opt/opensvc/lib/resources.py 0664 root root 11854 34146 1336579337 1 f none /opt/opensvc/lib/snap.py 0664 root root 5147 59907 1336579337 1 f none /opt/opensvc/lib/snapJfs2AIX.py 0664 root root 4920 36536 1336579337 1 f none /opt/opensvc/lib/snapLvmLinux.py 0664 root root 3899 36642 1336579337 1 f none /opt/opensvc/lib/snapVxfsHP-UX.py 0664 root root 3569 10405 1336579337 1 f none /opt/opensvc/lib/snapZfsSunOS.py 0664 root root 2189 43488 1336579337 1 f none /opt/opensvc/lib/svc.py 0664 root root 49181 44493 1336579337 1 f none /opt/opensvc/lib/svcBuilder.py 0664 root root 64138 25442 1336579337 1 f none /opt/opensvc/lib/svcDict.py 0664 root root 61990 31021 1336579337 1 f none /opt/opensvc/lib/svcEsx.py 0664 root root 1481 59006 1336579337 1 f none /opt/opensvc/lib/svcHosted.py 0664 root root 1753 7454 1336579337 1 f none /opt/opensvc/lib/svcHpVm.py 0664 root root 1506 61854 1336579337 1 f none /opt/opensvc/lib/svcJail.py 0664 root root 1675 6427 1336579337 1 f none /opt/opensvc/lib/svcKvm.py 0664 root root 2029 35926 1336579337 1 f none /opt/opensvc/lib/svcLdom.py 0664 root root 1506 61860 1336579337 1 f none /opt/opensvc/lib/svcLxc.py 0664 root root 2243 46574 1336579337 1 f none /opt/opensvc/lib/svcOvm.py 0664 root root 2132 43875 1336579337 1 f none /opt/opensvc/lib/svcVbox.py 0664 root root 1415 52098 1336579337 1 f none /opt/opensvc/lib/svcVz.py 0664 root root 1963 24257 1336579337 1 f none /opt/opensvc/lib/svcXen.py 0664 root root 1459 57213 1336579337 1 f none /opt/opensvc/lib/svcZone.py 0664 root root 4566 33521 1336579337 1 f none /opt/opensvc/lib/version.py 0644 root root 28 1722 1336587711 1 f none /opt/opensvc/lib/wmi.py 0664 root root 46919 2312 1336579337 1 f none /opt/opensvc/lib/xmlrpcClient.py 0664 root root 42985 55416 1336579337 1 f none /opt/opensvc/pax_global_header 0666 root root 52 3837 1336579337 1 d none /opt/opensvc/usr 0775 root root 1 d none /opt/opensvc/usr/share 0775 root root 1 f none /opt/opensvc/usr/share/AUTHORS 0664 root root 48 4634 1336579337 1 f none /opt/opensvc/usr/share/BANNER 0664 root root 828 5079 1336579337 1 f none /opt/opensvc/usr/share/COPYING 0664 root root 26436 9725 1336579337 1 d none /opt/opensvc/usr/share/bash_completion.d 0775 root root 1 f none /opt/opensvc/usr/share/bash_completion.d/opensvc 0664 root root 7080 58252 1336579337 1 d none /opt/opensvc/usr/share/doc 0775 root root 1 f none /opt/opensvc/usr/share/doc/node.conf 0664 root root 3283 2076 1336579337 1 f none /opt/opensvc/usr/share/doc/opensvc.haresource 0664 root root 506 43100 1336579337 1 d none /opt/opensvc/usr/share/doc/provisioning 0775 root root 1 f none /opt/opensvc/usr/share/doc/provisioning/provisioning.agent.debian 0775 root root 2602 50922 1336579337 1 f none /opt/opensvc/usr/share/doc/provisioning/provisioning.example 0664 root root 362 30449 1336579337 1 f none /opt/opensvc/usr/share/doc/template.comp_module.py 0775 root root 1235 30145 1336579337 1 f none /opt/opensvc/usr/share/doc/template.comp_module.sh 0664 root root 539 36167 1336579337 1 f none /opt/opensvc/usr/share/doc/template.env 0664 root root 32166 42911 1336579337 1 d none /opt/opensvc/var 0775 root root 1 d none /opt/opensvc/var/compliance 0775 root root 1 d none /opt/opensvc/var/compliance/com.opensvc 0775 root root 1 f none /opt/opensvc/var/compliance/com.opensvc/authkeys.py 0775 root root 9424 25334 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/bios.py 0775 root root 2394 40674 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/chkconfig.py 0775 root root 3424 48943 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/comp.py 0664 root root 1204 31330 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/cron.py 0775 root root 7554 59893 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/etcsystem.py 0775 root root 7322 48329 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/files.py 0775 root root 10950 52400 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/firmware.py 0775 root root 6751 25067 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/fs.py 0775 root root 21255 28515 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/groups.py 0775 root root 6107 53097 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/groups_membership.py 0775 root root 6562 27949 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/packages.py 0775 root root 9073 61915 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/process.py 0775 root root 6823 42355 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/rc.py 0775 root root 3326 51927 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/sysctl.py 0775 root root 8454 4547 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/users.py 0775 root root 9464 16026 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/utilities.py 0664 root root 1683 8796 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/vuln.py 0775 root root 13568 58364 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/xinetd.py 0775 root root 5843 14670 1336579337 1 i pkginfo 240 18970 1336587711 1 i postinstall 238 21059 1336587711 07070100000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000b00000000TRAILER!!!070701000244d3000081a40000000000000000000000014faab5bf000000f0000000ae00010002ffffffffffffffff0000000800000000pkginfoPKG=opensvc NAME=opensvc Service Manager for logical servers v1.3-120509.1802 ARCH=all VERSION=1.3,REV=120509.1802 CATEGORY=application VENDOR=http://www.opensvc.com EMAIL=support@opensvc.com PSTAMP=OPENSVC-1.3,REV=120509.1802 CLASSES=none 070701000244d2000081a40000000000000000000000014faab5bf00006c66000000ae00010002ffffffffffffffff0000000700000000pkgmap: 1 4316 1 d none /opt/opensvc 0755 root root 1 d none /opt/opensvc/.be 0775 root root 1 d none /opt/opensvc/.be/bugs 0775 root root 1 d none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d 0775 root root 1 d none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments 0775 root root 1 d none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments/53babb48-bd35-4130-9f96-99806d5bc239 0775 root root 1 f none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments/53babb48-bd35-4130-9f96-99806d5bc239/body 0664 root root 157 14121 1336579337 1 f none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments/53babb48-bd35-4130-9f96-99806d5bc239/values 0664 root root 136 10270 1336579337 1 f none /opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/values 0664 root root 190 14629 1336579337 1 d none /opt/opensvc/.be/bugs/23f6ceaf-d0db-47b6-a127-55a2fae83a03 0775 root root 1 f none /opt/opensvc/.be/bugs/23f6ceaf-d0db-47b6-a127-55a2fae83a03/values 0664 root root 262 21256 1336579337 1 d none /opt/opensvc/.be/bugs/93b834b7-89d4-4462-89fb-d313864f3a51 0775 root root 1 f none /opt/opensvc/.be/bugs/93b834b7-89d4-4462-89fb-d313864f3a51/values 0664 root root 290 23948 1336579337 1 f none /opt/opensvc/.be/settings 0664 root root 19 1295 1336579337 1 f none /opt/opensvc/.be/version 0664 root root 25 2098 1336579337 1 f none /opt/opensvc/.gitignore 0664 root root 134 11530 1336579337 1 d none /opt/opensvc/bin 0775 root root 1 s none /opt/opensvc/bin/alldownservices=svcmgr 1 s none /opt/opensvc/bin/allprimaryservices=svcmgr 1 s none /opt/opensvc/bin/allsecondaryservices=svcmgr 1 s none /opt/opensvc/bin/allservices=svcmgr 1 s none /opt/opensvc/bin/allupservices=svcmgr 1 d none /opt/opensvc/bin/cron 0775 root root 1 f none /opt/opensvc/bin/cron/opensvc 0775 root root 1690 9494 1336579337 1 f none /opt/opensvc/bin/freezer 0775 root root 1364 49689 1336579337 1 f none /opt/opensvc/bin/nodemgr 0775 root root 5574 4060 1336579337 1 f none /opt/opensvc/bin/opensvc.init.AIX 0775 root root 209 18797 1336579337 1 f none /opt/opensvc/bin/opensvc.init.Darwin 0664 root root 441 36791 1336579337 1 f none /opt/opensvc/bin/opensvc.init.FreeBSD 0775 root root 300 25712 1336579337 1 f none /opt/opensvc/bin/opensvc.init.SunOS 0775 root root 396 34372 1336579337 1 f none /opt/opensvc/bin/opensvc.init.debian 0775 root root 454 35881 1336579337 1 f none /opt/opensvc/bin/opensvc.init.hpux 0775 root root 738 60175 1336579337 1 f none /opt/opensvc/bin/opensvc.init.redhat 0775 root root 476 40877 1336579337 1 f none /opt/opensvc/bin/perfagt.Darwin 0775 root root 2523 46695 1336579337 1 f none /opt/opensvc/bin/perfagt.HP-UX 0775 root root 3049 31594 1336579337 1 f none /opt/opensvc/bin/perfagt.Linux 0775 root root 3828 8793 1336579337 1 f none /opt/opensvc/bin/perfagt.SunOS 0775 root root 3290 36795 1336579337 1 d none /opt/opensvc/bin/pkg 0775 root root 1 f none /opt/opensvc/bin/pkg/make.lib 0664 root root 1930 15417 1336579337 1 f none /opt/opensvc/bin/pkg/make_deb 0775 root root 889 7276 1336579337 1 f none /opt/opensvc/bin/pkg/make_depot 0775 root root 1340 37386 1336579337 1 f none /opt/opensvc/bin/pkg/make_pkg 0775 root root 4873 40937 1336579337 1 f none /opt/opensvc/bin/pkg/make_rpm 0775 root root 959 14283 1336579337 1 f none /opt/opensvc/bin/pkg/make_tbz 0775 root root 1936 27386 1336579337 1 f none /opt/opensvc/bin/postinstall 0775 root root 17589 41210 1336579337 1 s none /opt/opensvc/bin/svcfreeze=freezer 1 s none /opt/opensvc/bin/svcfrozen=freezer 1 f none /opt/opensvc/bin/svcmgr 0775 root root 11797 51353 1336579337 1 f none /opt/opensvc/bin/svcmon 0775 root root 5791 56804 1336579337 1 s none /opt/opensvc/bin/svcthaw=freezer 1 d none /opt/opensvc/lib 0775 root root 1 f none /opt/opensvc/lib/checkFmFmadm.py 0664 root root 1791 8251 1336579337 1 s none /opt/opensvc/lib/checkFmFmadmSunOS.py=checkFmFmadm.py 1 f none /opt/opensvc/lib/checkFsInodeAIX.py 0664 root root 1790 507 1336579337 1 f none /opt/opensvc/lib/checkFsInodeDarwin.py 0664 root root 1821 5364 1336579337 1 f none /opt/opensvc/lib/checkFsInodeHP-UX.py 0664 root root 1953 12217 1336579337 1 f none /opt/opensvc/lib/checkFsInodeLinux.py 0664 root root 2140 28807 1336579337 1 f none /opt/opensvc/lib/checkFsInodeSunOS.py 0664 root root 1953 12689 1336579337 1 f none /opt/opensvc/lib/checkFsUsageAIX.py 0664 root root 1790 490 1336579337 1 s none /opt/opensvc/lib/checkFsUsageDarwin.py=checkFsUsageLinux.py 1 s none /opt/opensvc/lib/checkFsUsageFreeBSD.py=checkFsUsageLinux.py 1 s none /opt/opensvc/lib/checkFsUsageHP-UX.py=checkFsUsageLinux.py 1 f none /opt/opensvc/lib/checkFsUsageLinux.py 0664 root root 2139 28714 1336579337 1 f none /opt/opensvc/lib/checkFsUsageSunOS.py 0664 root root 1948 12438 1336579337 1 f none /opt/opensvc/lib/checkFsUsageWindows.py 0664 root root 1746 4595 1336579337 1 f none /opt/opensvc/lib/checkLagSunOS.py 0664 root root 3422 36008 1336579337 1 f none /opt/opensvc/lib/checkMpathAIX.py 0664 root root 2802 2023 1336579337 1 f none /opt/opensvc/lib/checkMpathHP-UX.py 0664 root root 2147 23879 1336579337 1 f none /opt/opensvc/lib/checkMpathLinux.py 0664 root root 2557 46183 1336579337 1 f none /opt/opensvc/lib/checkMpathPowerpath.py 0664 root root 2944 6156 1336579337 1 s none /opt/opensvc/lib/checkMpathPowerpathAIX.py=checkMpathPowerpath.py 1 s none /opt/opensvc/lib/checkMpathPowerpathHP-UX.py=checkMpathPowerpath.py 1 s none /opt/opensvc/lib/checkMpathPowerpathLinux.py=checkMpathPowerpath.py 1 s none /opt/opensvc/lib/checkMpathPowerpathSunOS.py=checkMpathPowerpath.py 1 f none /opt/opensvc/lib/checkMpathSunOS.py 0664 root root 2318 34215 1336579337 1 f none /opt/opensvc/lib/checkRaidMegaRaid.py 0664 root root 5018 12511 1336579337 1 s none /opt/opensvc/lib/checkRaidMegaRaidLinux.py=checkRaidMegaRaid.py 1 s none /opt/opensvc/lib/checkRaidMegaRaidSunOS.py=checkRaidMegaRaid.py 1 f none /opt/opensvc/lib/checkRaidSas2.py 0664 root root 4599 57162 1336579337 1 s none /opt/opensvc/lib/checkRaidSas2SunOS.py=checkRaidSas2.py 1 f none /opt/opensvc/lib/checkRaidSmartArray.py 0664 root root 3386 52800 1336579337 1 s none /opt/opensvc/lib/checkRaidSmartArrayLinux.py=checkRaidSmartArray.py 1 s none /opt/opensvc/lib/checkRaidSmartArraySunOS.py=checkRaidSmartArray.py 1 f none /opt/opensvc/lib/checkVgUsageAIX.py 0664 root root 2118 24558 1336579337 1 f none /opt/opensvc/lib/checkVgUsageHP-UX.py 0664 root root 2635 64776 1336579337 1 f none /opt/opensvc/lib/checkVgUsageLinux.py 0664 root root 1954 14175 1336579337 1 f none /opt/opensvc/lib/checkZfsUsageSunOS.py 0664 root root 3217 34313 1336579337 1 f none /opt/opensvc/lib/checks.py 0664 root root 4337 47937 1336579337 1 f none /opt/opensvc/lib/collector.py 0664 root root 6001 211 1336579337 1 f none /opt/opensvc/lib/compliance.py 0664 root root 17865 60360 1336579337 1 f none /opt/opensvc/lib/freezer.py 0664 root root 1780 9411 1336579337 1 f none /opt/opensvc/lib/hostidAIX.py 0664 root root 1107 26120 1336579337 1 f none /opt/opensvc/lib/hostidDarwin.py 0664 root root 888 9879 1336579337 1 s none /opt/opensvc/lib/hostidFreeBSD.py=hostidLinux.py 1 f none /opt/opensvc/lib/hostidHP-UX.py 0664 root root 1203 33767 1336579337 1 f none /opt/opensvc/lib/hostidLinux.py 0664 root root 888 9879 1336579337 1 f none /opt/opensvc/lib/hostidSunOS.py 0664 root root 888 9879 1336579337 1 f none /opt/opensvc/lib/hostidWindows.py 0664 root root 888 9879 1336579337 1 f none /opt/opensvc/lib/lock.py 0664 root root 3000 30694 1336579337 1 f none /opt/opensvc/lib/loopSunOS.py 0664 root root 1439 52901 1336579337 1 f none /opt/opensvc/lib/node.py 0664 root root 34712 10765 1336579337 1 f none /opt/opensvc/lib/nodeHP-UX.py 0664 root root 1106 25464 1336579337 1 f none /opt/opensvc/lib/nodeLinux.py 0664 root root 1076 23916 1336579337 1 f none /opt/opensvc/lib/provFs.py 0664 root root 3267 41575 1336579337 1 f none /opt/opensvc/lib/provFsExt2.py 0664 root root 143 11721 1336579337 1 f none /opt/opensvc/lib/provFsExt3.py 0664 root root 143 11723 1336579337 1 f none /opt/opensvc/lib/provFsExt4.py 0664 root root 143 11725 1336579337 1 f none /opt/opensvc/lib/provFsZfs.py 0664 root root 1558 61639 1336579337 1 f none /opt/opensvc/lib/provIp.py 0664 root root 125 11090 1336579337 1 f none /opt/opensvc/lib/provKvm.py 0664 root root 4571 1199 1336579337 1 f none /opt/opensvc/lib/provLoopLinux.py 0664 root root 877 65497 1336579337 1 f none /opt/opensvc/lib/provLxc.py 0664 root root 8342 61843 1336579337 1 f none /opt/opensvc/lib/provVgLinux.py 0664 root root 1760 59090 1336579337 1 f none /opt/opensvc/lib/provZone.py 0664 root root 8243 41525 1336579337 1 f none /opt/opensvc/lib/provisioning.py 0664 root root 168 12704 1336579337 1 f none /opt/opensvc/lib/rcAddService.py 0664 root root 911 11569 1336579337 1 f none /opt/opensvc/lib/rcAsset.py 0664 root root 15046 29280 1336579337 1 f none /opt/opensvc/lib/rcAssetAIX.py 0664 root root 3893 21584 1336579337 1 f none /opt/opensvc/lib/rcAssetDarwin.py 0664 root root 3040 34839 1336579337 1 f none /opt/opensvc/lib/rcAssetFreeBSD.py 0664 root root 2856 14962 1336579337 1 f none /opt/opensvc/lib/rcAssetHP-UX.py 0664 root root 8167 38657 1336579337 1 f none /opt/opensvc/lib/rcAssetLinux.py 0664 root root 11711 20103 1336579337 1 f none /opt/opensvc/lib/rcAssetSunOS.py 0664 root root 6151 41534 1336579337 1 f none /opt/opensvc/lib/rcAssetWindows.py 0664 root root 3708 31754 1336579337 1 f none /opt/opensvc/lib/rcCommandWorker.py 0664 root root 1902 14479 1336579337 1 f none /opt/opensvc/lib/rcContainerLinux.py 0664 root root 5010 5843 1336579337 1 f none /opt/opensvc/lib/rcDcs.py 0664 root root 3550 5223 1336579337 1 f none /opt/opensvc/lib/rcDevTree.py 0664 root root 9299 22974 1336579337 1 f none /opt/opensvc/lib/rcDevTreeAIX.py 0664 root root 2029 15977 1336579337 1 f none /opt/opensvc/lib/rcDevTreeHP-UX.py 0664 root root 6072 28790 1336579337 1 f none /opt/opensvc/lib/rcDevTreeLinux.py 0664 root root 10379 7350 1336579337 1 f none /opt/opensvc/lib/rcDevTreeSunOS.py 0664 root root 8566 3899 1336579337 1 f none /opt/opensvc/lib/rcDiskInfo.py 0664 root root 1095 24481 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoAIX.py 0664 root root 2937 21136 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoDarwin.py 0664 root root 888 9990 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoFreeBSD.py 0664 root root 1303 41131 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoHP-UX.py 0664 root root 2953 22235 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoLinux.py 0664 root root 4935 18816 1336579337 1 f none /opt/opensvc/lib/rcDiskInfoSunOS.py 0664 root root 4863 5224 1336579337 1 f none /opt/opensvc/lib/rcEva.py 0664 root root 3758 18476 1336579337 1 f none /opt/opensvc/lib/rcExceptions.py 0664 root root 3580 30536 1336579337 1 f none /opt/opensvc/lib/rcGlobalEnv.py 0664 root root 5917 896 1336579337 1 f none /opt/opensvc/lib/rcIbmSvc.py 0664 root root 3010 27518 1336579337 1 f none /opt/opensvc/lib/rcIfconfig.py 0664 root root 4124 44119 1336579337 1 f none /opt/opensvc/lib/rcIfconfigAIX.py 0664 root root 2810 69 1336579337 1 f none /opt/opensvc/lib/rcIfconfigDarwin.py 0664 root root 2631 51701 1336579337 1 f none /opt/opensvc/lib/rcIfconfigFreeBSD.py 0664 root root 2631 51701 1336579337 1 s none /opt/opensvc/lib/rcIfconfigFreeBSDhpvm.py=rcIfconfigFreeBSDkvm.py 1 f none /opt/opensvc/lib/rcIfconfigFreeBSDkvm.py 0664 root root 1266 39292 1336579337 1 s none /opt/opensvc/lib/rcIfconfigFreeBSDldom.py=rcIfconfigFreeBSDkvm.py 1 s none /opt/opensvc/lib/rcIfconfigFreeBSDxen.py=rcIfconfigFreeBSDkvm.py 1 f none /opt/opensvc/lib/rcIfconfigHP-UX.py 0664 root root 3403 37166 1336579337 1 f none /opt/opensvc/lib/rcIfconfigHP-UXhpvm.py 0664 root root 1779 7622 1336579337 1 f none /opt/opensvc/lib/rcIfconfigLinux.py 0664 root root 2878 1079 1336579337 1 s none /opt/opensvc/lib/rcIfconfigLinuxhpvm.py=rcIfconfigLinuxkvm.py 1 f none /opt/opensvc/lib/rcIfconfigLinuxkvm.py 0664 root root 1281 40272 1336579337 1 s none /opt/opensvc/lib/rcIfconfigLinuxldom.py=rcIfconfigLinuxkvm.py 1 f none /opt/opensvc/lib/rcIfconfigLinuxlxc.py 0664 root root 1567 61437 1336579337 1 s none /opt/opensvc/lib/rcIfconfigLinuxovm.py=rcIfconfigLinuxkvm.py 1 f none /opt/opensvc/lib/rcIfconfigLinuxvz.py 0664 root root 1123 27805 1336579337 1 s none /opt/opensvc/lib/rcIfconfigLinuxxen.py=rcIfconfigLinuxkvm.py 1 f none /opt/opensvc/lib/rcIfconfigSunOS.py 0664 root root 2855 1531 1336579337 1 s none /opt/opensvc/lib/rcIfconfigSunOSkvm.py=rcIfconfigSunOSldom.py 1 f none /opt/opensvc/lib/rcIfconfigSunOSldom.py 0664 root root 1281 40216 1336579337 1 s none /opt/opensvc/lib/rcIfconfigSunOSxen.py=rcIfconfigSunOSldom.py 1 f none /opt/opensvc/lib/rcIfconfigWindowskvm.py 0664 root root 1096 27277 1336579337 1 f none /opt/opensvc/lib/rcLogger.py 0664 root root 2193 42617 1336579337 1 f none /opt/opensvc/lib/rcLoopLinux.py 0664 root root 1694 4675 1336579337 1 f none /opt/opensvc/lib/rcLvmAIX.py 0664 root root 8006 45135 1336579337 1 f none /opt/opensvc/lib/rcMounts.py 0664 root root 1933 18912 1336579337 1 f none /opt/opensvc/lib/rcMountsAIX.py 0664 root root 4585 52348 1336579337 1 f none /opt/opensvc/lib/rcMountsDarwin.py 0664 root root 2436 54804 1336579337 1 f none /opt/opensvc/lib/rcMountsFreeBSD.py 0664 root root 2436 54804 1336579337 1 f none /opt/opensvc/lib/rcMountsHP-UX.py 0664 root root 2250 45165 1336579337 1 f none /opt/opensvc/lib/rcMountsLinux.py 0664 root root 2301 49085 1336579337 1 f none /opt/opensvc/lib/rcMountsSunOS.py 0664 root root 1938 19118 1336579337 1 f none /opt/opensvc/lib/rcNecIsm.py 0664 root root 1591 43604 1336579337 1 f none /opt/opensvc/lib/rcNexenta.py 0775 root root 11720 3539 1336579337 1 f none /opt/opensvc/lib/rcNode.py 0664 root root 1498 60669 1336579337 1 f none /opt/opensvc/lib/rcOptParser.py 0664 root root 9889 54113 1336579337 1 f none /opt/opensvc/lib/rcOs.py 0664 root root 126 9734 1336579337 1 f none /opt/opensvc/lib/rcOsHP-UX.py 0664 root root 122 10053 1336579337 1 f none /opt/opensvc/lib/rcOsLinux.py 0664 root root 216 16341 1336579337 1 f none /opt/opensvc/lib/rcOvm.py 0775 root root 4499 12375 1336579337 1 f none /opt/opensvc/lib/rcPkgAIX.py 0664 root root 1271 37076 1336579337 1 f none /opt/opensvc/lib/rcPkgDarwin.py 0664 root root 1754 9786 1336579337 1 f none /opt/opensvc/lib/rcPkgFreeBSD.py 0664 root root 1308 39656 1336579337 1 f none /opt/opensvc/lib/rcPkgHP-UX.py 0664 root root 1271 36609 1336579337 1 f none /opt/opensvc/lib/rcPkgLinux.py 0664 root root 1822 13831 1336579337 1 f none /opt/opensvc/lib/rcPkgSunOS.py 0664 root root 2359 46410 1336579337 1 f none /opt/opensvc/lib/rcPkgWindows.py 0664 root root 4852 49205 1336579337 1 f none /opt/opensvc/lib/rcPrintTable.py 0664 root root 8256 61780 1336579337 1 f none /opt/opensvc/lib/rcStats.py 0664 root root 3973 40778 1336579337 1 f none /opt/opensvc/lib/rcStatsAIX.py 0664 root root 4851 34443 1336579337 1 f none /opt/opensvc/lib/rcStatsDarwin.py 0664 root root 5463 37133 1336579337 1 f none /opt/opensvc/lib/rcStatsFreeBSD.py 0664 root root 5268 21932 1336579337 1 f none /opt/opensvc/lib/rcStatsHP-UX.py 0664 root root 7637 2991 1336579337 1 f none /opt/opensvc/lib/rcStatsLinux.py 0664 root root 10750 26403 1336579337 1 f none /opt/opensvc/lib/rcStatsSunOS.py 0664 root root 8211 11800 1336579337 1 f none /opt/opensvc/lib/rcStatus.py 0664 root root 5867 61184 1336579337 1 f none /opt/opensvc/lib/rcSymmetrix.py 0664 root root 5751 22013 1336579337 1 f none /opt/opensvc/lib/rcUtilities.py 0664 root root 7510 35539 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesAIX.py 0664 root root 326 23568 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesDarwin.py 0664 root root 376 25693 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesFreeBSD.py 0664 root root 292 21393 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesHP-UX.py 0664 root root 262 18527 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesLinux.py 0664 root root 2756 7980 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesSunOS.py 0664 root root 200 15386 1336579337 1 f none /opt/opensvc/lib/rcUtilitiesWindows.py 0664 root root 758 60618 1336579337 1 f none /opt/opensvc/lib/rcVioServer.py 0664 root root 2877 19987 1336579337 1 f none /opt/opensvc/lib/rcZfs.py 0664 root root 7683 46609 1336579337 1 f none /opt/opensvc/lib/rcZone.py 0664 root root 3816 35934 1336579337 1 f none /opt/opensvc/lib/resApp.py 0664 root root 9635 53798 1336579337 1 f none /opt/opensvc/lib/resAppVm.py 0664 root root 4021 44300 1336579337 1 f none /opt/opensvc/lib/resContainer.py 0664 root root 5831 46462 1336579337 1 f none /opt/opensvc/lib/resContainerEsx.py 0664 root root 4157 45873 1336579337 1 f none /opt/opensvc/lib/resContainerHpVm.py 0664 root root 3903 35665 1336579337 1 f none /opt/opensvc/lib/resContainerJail.py 0664 root root 3913 29078 1336579337 1 f none /opt/opensvc/lib/resContainerKvm.py 0664 root root 5373 13404 1336579337 1 f none /opt/opensvc/lib/resContainerLdom.py 0664 root root 5010 39189 1336579337 1 f none /opt/opensvc/lib/resContainerLxc.py 0664 root root 7136 46496 1336579337 1 f none /opt/opensvc/lib/resContainerOvm.py 0664 root root 4581 14448 1336579337 1 f none /opt/opensvc/lib/resContainerVbox.py 0664 root root 4458 3543 1336579337 1 f none /opt/opensvc/lib/resContainerVz.py 0664 root root 4445 60210 1336579337 1 f none /opt/opensvc/lib/resContainerXen.py 0664 root root 3916 34031 1336579337 1 f none /opt/opensvc/lib/resContainerZone.py 0664 root root 11761 65019 1336579337 1 f none /opt/opensvc/lib/resDg.py 0664 root root 2795 26191 1336579337 1 f none /opt/opensvc/lib/resDrbd.py 0664 root root 6475 25395 1336579337 1 f none /opt/opensvc/lib/resHb.py 0664 root root 2607 64888 1336579337 1 f none /opt/opensvc/lib/resHbLinuxHA.py 0664 root root 1941 26504 1336579337 1 f none /opt/opensvc/lib/resHbOpenHA.py 0664 root root 6719 37649 1336579337 1 f none /opt/opensvc/lib/resHbovm.py 0664 root root 2867 27470 1336579337 1 f none /opt/opensvc/lib/resIp.py 0664 root root 8884 59671 1336579337 1 f none /opt/opensvc/lib/resIpAIX.py 0664 root root 1978 28013 1336579337 1 f none /opt/opensvc/lib/resIpDarwin.py 0664 root root 1986 28226 1336579337 1 f none /opt/opensvc/lib/resIpEsx.py 0664 root root 1553 60513 1336579337 1 f none /opt/opensvc/lib/resIpFreeBSD.py 0664 root root 1986 28226 1336579337 1 f none /opt/opensvc/lib/resIpHP-UX.py 0664 root root 2002 26836 1336579337 1 f none /opt/opensvc/lib/resIpHpVm.py 0664 root root 1544 60631 1336579337 1 f none /opt/opensvc/lib/resIpKvm.py 0664 root root 1572 61663 1336579337 1 f none /opt/opensvc/lib/resIpLdom.py 0664 root root 1573 61617 1336579337 1 f none /opt/opensvc/lib/resIpLinux.py 0664 root root 2338 55186 1336579337 1 f none /opt/opensvc/lib/resIpLinuxLxc.py 0664 root root 1573 61673 1336579337 1 f none /opt/opensvc/lib/resIpSunOS.py 0664 root root 1902 25324 1336579337 1 f none /opt/opensvc/lib/resIpVbox.py 0664 root root 1553 60541 1336579337 1 f none /opt/opensvc/lib/resIpVm.py 0664 root root 3249 58427 1336579337 1 f none /opt/opensvc/lib/resIpXen.py 0664 root root 1612 65334 1336579337 1 f none /opt/opensvc/lib/resIpZone.py 0664 root root 1723 8076 1336579337 1 f none /opt/opensvc/lib/resLoop.py 0664 root root 1901 20297 1336579337 1 f none /opt/opensvc/lib/resLoopFreeBSD.py 0664 root root 3201 49127 1336579337 1 f none /opt/opensvc/lib/resLoopLinux.py 0664 root root 2546 3632 1336579337 1 f none /opt/opensvc/lib/resMount.py 0664 root root 5884 56167 1336579337 1 f none /opt/opensvc/lib/resMountAIX.py 0664 root root 5307 5892 1336579337 1 f none /opt/opensvc/lib/resMountDarwin.py 0664 root root 5664 33046 1336579337 1 f none /opt/opensvc/lib/resMountFreeBSD.py 0664 root root 5664 33046 1336579337 1 f none /opt/opensvc/lib/resMountHP-UX.py 0664 root root 3904 38314 1336579337 1 f none /opt/opensvc/lib/resMountLinux.py 0664 root root 10725 44292 1336579337 1 f none /opt/opensvc/lib/resMountSunOS.py 0664 root root 5509 4654 1336579337 1 f none /opt/opensvc/lib/resScsiReserv.py 0664 root root 6873 54191 1336579337 1 s none /opt/opensvc/lib/resScsiReservFreeBSD.py=resScsiReservLinux.py 1 f none /opt/opensvc/lib/resScsiReservHP-UX.py 0664 root root 5862 49911 1336579337 1 f none /opt/opensvc/lib/resScsiReservLinux.py 0664 root root 5052 60162 1336579337 1 s none /opt/opensvc/lib/resScsiReservSunOS.py=resScsiReservLinux.py 1 f none /opt/opensvc/lib/resStonith.py 0664 root root 2339 50083 1336579337 1 f none /opt/opensvc/lib/resStonithCallout.py 0664 root root 490 38534 1336579337 1 f none /opt/opensvc/lib/resStonithIlo.py 0664 root root 609 48429 1336579337 1 f none /opt/opensvc/lib/resSync.py 0664 root root 5425 12909 1336579337 1 f none /opt/opensvc/lib/resSyncDcs.py 0664 root root 5130 64626 1336579337 1 f none /opt/opensvc/lib/resSyncDcsCkpt.py 0664 root root 7596 44759 1336579337 1 f none /opt/opensvc/lib/resSyncDcsSnap.py 0664 root root 5063 45328 1336579337 1 f none /opt/opensvc/lib/resSyncDds.py 0664 root root 15053 133 1336579337 1 f none /opt/opensvc/lib/resSyncEvasnap.py 0664 root root 11375 60184 1336579337 1 f none /opt/opensvc/lib/resSyncNetapp.py 0664 root root 10927 23290 1336579337 1 f none /opt/opensvc/lib/resSyncNexenta.py 0664 root root 9320 37158 1336579337 1 f none /opt/opensvc/lib/resSyncRsync.py 0664 root root 15455 58967 1336579337 1 f none /opt/opensvc/lib/resSyncSymclone.py 0664 root root 9686 60182 1336579337 1 f none /opt/opensvc/lib/resSyncSymcloneLinux.py 0664 root root 2799 22002 1336579337 1 f none /opt/opensvc/lib/resSyncZfs.py 0664 root root 13802 51747 1336579337 1 f none /opt/opensvc/lib/resVdisk.py 0664 root root 2888 29549 1336579337 1 f none /opt/opensvc/lib/resVgAIX.py 0664 root root 4023 35474 1336579337 1 f none /opt/opensvc/lib/resVgHP-UX.py 0664 root root 11138 10769 1336579337 1 f none /opt/opensvc/lib/resVgHpVm.py 0664 root root 5204 48662 1336579337 1 f none /opt/opensvc/lib/resVgLdom.py 0664 root root 4127 28231 1336579337 1 f none /opt/opensvc/lib/resVgLibvirtVm.py 0664 root root 2876 24248 1336579337 1 f none /opt/opensvc/lib/resVgLinux.py 0664 root root 5911 33976 1336579337 1 f none /opt/opensvc/lib/resVgOvm.py 0664 root root 2954 25473 1336579337 1 f none /opt/opensvc/lib/resVgRaw.py 0664 root root 4250 48158 1336579337 1 f none /opt/opensvc/lib/resVgRawHP-UX.py 0664 root root 1830 7054 1336579337 1 f none /opt/opensvc/lib/resVgRawLinux.py 0664 root root 10338 17083 1336579337 1 f none /opt/opensvc/lib/resVgRawSunOS.py 0664 root root 2383 37673 1336579337 1 f none /opt/opensvc/lib/resVgVeritas.py 0664 root root 4248 45984 1336579337 1 f none /opt/opensvc/lib/resVgZfs.py 0664 root root 5579 18907 1336579337 1 f none /opt/opensvc/lib/resources.py 0664 root root 11854 34146 1336579337 1 f none /opt/opensvc/lib/snap.py 0664 root root 5147 59907 1336579337 1 f none /opt/opensvc/lib/snapJfs2AIX.py 0664 root root 4920 36536 1336579337 1 f none /opt/opensvc/lib/snapLvmLinux.py 0664 root root 3899 36642 1336579337 1 f none /opt/opensvc/lib/snapVxfsHP-UX.py 0664 root root 3569 10405 1336579337 1 f none /opt/opensvc/lib/snapZfsSunOS.py 0664 root root 2189 43488 1336579337 1 f none /opt/opensvc/lib/svc.py 0664 root root 49181 44493 1336579337 1 f none /opt/opensvc/lib/svcBuilder.py 0664 root root 64138 25442 1336579337 1 f none /opt/opensvc/lib/svcDict.py 0664 root root 61990 31021 1336579337 1 f none /opt/opensvc/lib/svcEsx.py 0664 root root 1481 59006 1336579337 1 f none /opt/opensvc/lib/svcHosted.py 0664 root root 1753 7454 1336579337 1 f none /opt/opensvc/lib/svcHpVm.py 0664 root root 1506 61854 1336579337 1 f none /opt/opensvc/lib/svcJail.py 0664 root root 1675 6427 1336579337 1 f none /opt/opensvc/lib/svcKvm.py 0664 root root 2029 35926 1336579337 1 f none /opt/opensvc/lib/svcLdom.py 0664 root root 1506 61860 1336579337 1 f none /opt/opensvc/lib/svcLxc.py 0664 root root 2243 46574 1336579337 1 f none /opt/opensvc/lib/svcOvm.py 0664 root root 2132 43875 1336579337 1 f none /opt/opensvc/lib/svcVbox.py 0664 root root 1415 52098 1336579337 1 f none /opt/opensvc/lib/svcVz.py 0664 root root 1963 24257 1336579337 1 f none /opt/opensvc/lib/svcXen.py 0664 root root 1459 57213 1336579337 1 f none /opt/opensvc/lib/svcZone.py 0664 root root 4566 33521 1336579337 1 f none /opt/opensvc/lib/version.py 0644 root root 28 1722 1336587711 1 f none /opt/opensvc/lib/wmi.py 0664 root root 46919 2312 1336579337 1 f none /opt/opensvc/lib/xmlrpcClient.py 0664 root root 42985 55416 1336579337 1 f none /opt/opensvc/pax_global_header 0666 root root 52 3837 1336579337 1 d none /opt/opensvc/usr 0775 root root 1 d none /opt/opensvc/usr/share 0775 root root 1 f none /opt/opensvc/usr/share/AUTHORS 0664 root root 48 4634 1336579337 1 f none /opt/opensvc/usr/share/BANNER 0664 root root 828 5079 1336579337 1 f none /opt/opensvc/usr/share/COPYING 0664 root root 26436 9725 1336579337 1 d none /opt/opensvc/usr/share/bash_completion.d 0775 root root 1 f none /opt/opensvc/usr/share/bash_completion.d/opensvc 0664 root root 7080 58252 1336579337 1 d none /opt/opensvc/usr/share/doc 0775 root root 1 f none /opt/opensvc/usr/share/doc/node.conf 0664 root root 3283 2076 1336579337 1 f none /opt/opensvc/usr/share/doc/opensvc.haresource 0664 root root 506 43100 1336579337 1 d none /opt/opensvc/usr/share/doc/provisioning 0775 root root 1 f none /opt/opensvc/usr/share/doc/provisioning/provisioning.agent.debian 0775 root root 2602 50922 1336579337 1 f none /opt/opensvc/usr/share/doc/provisioning/provisioning.example 0664 root root 362 30449 1336579337 1 f none /opt/opensvc/usr/share/doc/template.comp_module.py 0775 root root 1235 30145 1336579337 1 f none /opt/opensvc/usr/share/doc/template.comp_module.sh 0664 root root 539 36167 1336579337 1 f none /opt/opensvc/usr/share/doc/template.env 0664 root root 32166 42911 1336579337 1 d none /opt/opensvc/var 0775 root root 1 d none /opt/opensvc/var/compliance 0775 root root 1 d none /opt/opensvc/var/compliance/com.opensvc 0775 root root 1 f none /opt/opensvc/var/compliance/com.opensvc/authkeys.py 0775 root root 9424 25334 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/bios.py 0775 root root 2394 40674 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/chkconfig.py 0775 root root 3424 48943 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/comp.py 0664 root root 1204 31330 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/cron.py 0775 root root 7554 59893 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/etcsystem.py 0775 root root 7322 48329 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/files.py 0775 root root 10950 52400 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/firmware.py 0775 root root 6751 25067 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/fs.py 0775 root root 21255 28515 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/groups.py 0775 root root 6107 53097 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/groups_membership.py 0775 root root 6562 27949 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/packages.py 0775 root root 9073 61915 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/process.py 0775 root root 6823 42355 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/rc.py 0775 root root 3326 51927 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/sysctl.py 0775 root root 8454 4547 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/users.py 0775 root root 9464 16026 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/utilities.py 0664 root root 1683 8796 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/vuln.py 0775 root root 13568 58364 1336579337 1 f none /opt/opensvc/var/compliance/com.opensvc/xinetd.py 0775 root root 5843 14670 1336579337 1 i pkginfo 240 18970 1336587711 1 i postinstall 238 21059 1336587711 07070100024638000041ed0000000000000000000000024faab5bf00000000000000ae00010002ffffffffffffffff0000000800000000install07070100024639000081a40000000000000000000000014faab5bf000000ee000000ae00010002ffffffffffffffff0000001400000000install/postinstall#!/sbin/sh su - root -c "LD_LIBRARY_PATH=/opt/opensvc/usr/local/lib:$LD_LIBRARY_PATH PATH=/opt/opensvc/usr/local/bin:/opt/opensvc:/usr/sbin:/usr/bin:/opt/opensvc/bin:/opt/sfw/bin:/usr/sfw/bin:/usr/local/bin /opt/opensvc/bin/postinstall" 070701000244d4000041ed0000000000000000000000034faab5bf00000000000000ae00010002ffffffffffffffff0000000500000000root070701000244d5000041ed0000000000000000000000034faab5bf00000000000000ae00010002ffffffffffffffff0000000900000000root/opt070701000244d6000041ed0000000000000000000000074faab5bf00000000000000ae00010002ffffffffffffffff0000001100000000root/opt/opensvc070701000244e5000081b40000000000000000000000014faa950900000086000000ae00010002ffffffffffffffff0000001c00000000root/opt/opensvc/.gitignore*.pyc *.class *.swp etc/ log/ var/ test/ tmp/ bin/python lib/version.py bin/pkg/release_* bin/python .hg/ .hgignore lib/rcLocalEnv.py 070701000244d7000041ed0000000000000000000000034faab5bf00000000000000ae00010002ffffffffffffffff0000001500000000root/opt/opensvc/.be070701000244e4000081b40000000000000000000000014faa950900000019000000ae00010002ffffffffffffffff0000001d00000000root/opt/opensvc/.be/versionBugs Everywhere Tree 1 0 070701000244d8000041ed0000000000000000000000054faab5bf00000000000000ae00010002ffffffffffffffff0000001a00000000root/opt/opensvc/.be/bugs070701000244d9000041ed0000000000000000000000034faab5bf00000000000000ae00010002ffffffffffffffff0000003f00000000root/opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d070701000244de000081b40000000000000000000000014faa9509000000be000000ae00010002ffffffffffffffff0000004600000000root/opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/values creator=Christophe Varoqui severity=wishlist status=closed summary=add ack service action time=Thu, 20 Oct 2011 15:44:54 +0000 070701000244da000041ed0000000000000000000000034faab5bf00000000000000ae00010002ffffffffffffffff0000004800000000root/opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments070701000244db000041ed0000000000000000000000024faab5bf00000000000000ae00010002ffffffffffffffff0000006d00000000root/opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments/53babb48-bd35-4130-9f96-99806d5bc239070701000244dc000081b40000000000000000000000014faa95090000009d000000ae00010002ffffffffffffffff0000007200000000root/opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments/53babb48-bd35-4130-9f96-99806d5bc239/bodythis new ack service action inserts a unavailability range acknowledgement. it should support params: --comment --author --duration or/and --begin + --end 070701000244dd000081b40000000000000000000000014faa950900000088000000ae00010002ffffffffffffffff0000007400000000root/opt/opensvc/.be/bugs/1edaf8af-367e-4d9b-8604-5b29e089215d/comments/53babb48-bd35-4130-9f96-99806d5bc239/values Content-type=text/plain Date=Thu, 20 Oct 2011 15:48:13 +0000 From=Christophe Varoqui 070701000244e1000041ed0000000000000000000000024faab5bf00000000000000ae00010002ffffffffffffffff0000003f00000000root/opt/opensvc/.be/bugs/93b834b7-89d4-4462-89fb-d313864f3a51070701000244e2000081b40000000000000000000000014faa950900000122000000ae00010002ffffffffffffffff0000004600000000root/opt/opensvc/.be/bugs/93b834b7-89d4-4462-89fb-d313864f3a51/values assigned=Christophe Varoqui creator=Christophe Varoqui severity=minor status=closed summary=nodemgr fs_u check should not report osvc_sync_* snapshots time=Sun, 09 Oct 2011 12:51:53 +0000 070701000244df000041ed0000000000000000000000024faab5bf00000000000000ae00010002ffffffffffffffff0000003f00000000root/opt/opensvc/.be/bugs/23f6ceaf-d0db-47b6-a127-55a2fae83a03070701000244e0000081b40000000000000000000000014faa950900000106000000ae00010002ffffffffffffffff0000004600000000root/opt/opensvc/.be/bugs/23f6ceaf-d0db-47b6-a127-55a2fae83a03/values assigned=Christophe Varoqui creator=Christophe Varoqui severity=wishlist status=open summary=ocfs2 reflink snapshot driver time=Sun, 09 Oct 2011 17:55:12 +0000 070701000244e3000081b40000000000000000000000014faa950900000013000000ae00010002ffffffffffffffff0000001e00000000root/opt/opensvc/.be/settings rcs_name=git 07070100024622000041ed0000000000000000000000034faab5bf00000000000000ae00010002ffffffffffffffff0000001500000000root/opt/opensvc/var07070100024623000041ed0000000000000000000000034faab5bf00000000000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/var/compliance07070100024624000041ed0000000000000000000000024faab5bf00000000000000ae00010002ffffffffffffffff0000002c00000000root/opt/opensvc/var/compliance/com.opensvc07070100024637000081fd0000000000000000000000014faa9509000016d3000000ae00010002ffffffffffffffff0000003600000000root/opt/opensvc/var/compliance/com.opensvc/xinetd.py#!/opt/opensvc/bin/python """ module use OSVC_COMP_USER_... vars which define {"gssftp": {"disable": "no", "server_args": "-l -a -u 022", ...}, ...} supported dictionnary keys: - disable - server_args """ import os import sys import json import pwd from subprocess import Popen, list2cmdline sys.path.append(os.path.dirname(__file__)) from comp import * class Xinetd(object): def __init__(self, prefix='OSVC_COMP_XINETD_'): self.prefix = prefix.upper() self.base = os.path.join(os.sep, "etc", "xinetd.d") if not os.path.exists(self.base): print >>sys.stderr, self.base, 'does not exist' raise NotApplicable() self.svcs = {} for k in [ key for key in os.environ if key.startswith(self.prefix)]: try: self.svcs.update(json.loads(os.environ[k])) except ValueError: print >>sys.stderr, 'xinetd service syntax error on var[', k, '] = ',os.environ[k] if len(self.svcs) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() self.cf_d = {} self.known_props = ( "flags", "socket_type", "wait", "user", "server", "server_args", "disable") def fixable(self): return RET_NA def get_svc(self, svc): if svc in self.cf_d: return self.cf_d[svc] p = os.path.join(self.base, svc) if not os.path.exists(p): self.cf_d[svc] = {} return self.cf_d[svc] if svc not in self.cf_d: self.cf_d[svc] = {} with open(p, 'r') as f: for line in f.read().split('\n'): if '=' not in line: continue l = line.split('=') if len(l) != 2: continue var = l[0].strip() val = l[1].strip() self.cf_d[svc][var] = val return self.cf_d[svc] def fix_item(self, svc, item, target): if item not in self.known_props: print >>sys.stderr, 'xinetd service', svc, item+': unknown property in compliance rule' return RET_ERR cf = self.get_svc(svc) if item in cf and cf[item] == target: return RET_OK p = os.path.join(self.base, svc) if not os.path.exists(p): print >>sys.stderr, p, "does not exist" return RET_ERR done = False with open(p, 'r') as f: buff = f.read().split('\n') for i, line in enumerate(buff): if '=' not in line: continue l = line.split('=') if len(l) != 2: continue var = l[0].strip() if var != item: continue l[1] = target buff[i] = "= ".join(l) done = True if not done: with open(p, 'r') as f: buff = f.read().split('\n') for i, line in enumerate(buff): if '=' not in line: continue l = line.split('=') if len(l) != 2: continue buff.insert(i, item+" = "+target) done = True break if not done: print >>sys.stderr, "failed to set", item, "=", target, "in", p return RET_ERR with open(p, 'w') as f: f.write("\n".join(buff)) print "set", item, "=", target, "in", p return RET_OK def check_item(self, svc, item, target, verbose=False): if item not in self.known_props: print >>sys.stderr, 'xinetd service', svc, item+': unknown property in compliance rule' return RET_ERR cf = self.get_svc(svc) if item in cf and target == cf[item]: if verbose: print 'xinetd service', svc, item+':', cf[item] return RET_OK elif item in cf: if verbose: print >>sys.stderr, 'xinetd service', svc, item+':', cf[item], 'target:', target else: if verbose: print >>sys.stderr, 'xinetd service', svc, item+': unset', 'target:', target return RET_ERR def check_svc(self, svc, props): r = 0 for prop in props: r |= self.check_item(svc, prop, props[prop], verbose=True) return r def fix_svc(self, svc, props): r = 0 for prop in props: r |= self.fix_item(svc, prop, props[prop]) return r def check(self): r = 0 for svc, props in self.svcs.items(): r |= self.check_svc(svc, props) return r def fix(self): r = 0 for svc, props in self.svcs.items(): r |= self.fix_svc(svc, props) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = Xinetd(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024634000081fd0000000000000000000000014faa9509000024f8000000ae00010002ffffffffffffffff0000003500000000root/opt/opensvc/var/compliance/com.opensvc/users.py#!/opt/opensvc/bin/python """ module use OSVC_COMP_USER_... vars which define {'username':{'propname':'propval',... }, ...} example: {"tibco":{"shell":"/bin/ksh","gecos":"agecos",}, "tibco1":{"shell":"/bin/tcsh","gecos":"another gecos",}, } supported dictionnary keys: - uid - gid - gecos - home - shell """ import os import sys import json import pwd import re from utilities import which try: import spwd cap_shadow = True except: cap_shadow = False from subprocess import Popen, list2cmdline sys.path.append(os.path.dirname(__file__)) from comp import * class CompUser(object): def __init__(self, prefix='OSVC_COMP_USER_'): self.prefix = prefix.upper() self.pwt = { 'shell': 'pw_shell', 'home': 'pw_dir', 'uid': 'pw_uid', 'gid': 'pw_gid', 'gecos': 'pw_gecos', 'password': 'pw_passwd', } self.spwt = { 'spassword': 'sp_pwd', } self.usermod_p = { 'shell': '-s', 'home': '-m -d', 'uid': '-u', 'gid': '-g', 'gecos': '-c', 'password': '-p', 'spassword': '-p', } self.sysname, self.nodename, x, x, self.machine = os.uname() if self.sysname not in ['SunOS', 'Linux', 'HP-UX', 'AIX']: print >>sys.stderr, 'module not supported on', self.sysname raise NotApplicable() self.users = {} for k in [ key for key in os.environ if key.startswith(self.prefix)]: try: d = json.loads(os.environ[k]) for user in d: if user not in self.users: self.users[user] = d[user] else: for key in self.usermod_p.keys(): if key in d and key not in self.users[user]: self.users[user][key] = d[key] except ValueError: print >>sys.stderr, 'user syntax error on var[', k, '] = ',os.environ[k] if len(self.users) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() p = re.compile('%%ENV:\w+%%') for user, d in self.users.items(): for k in d: if type(d[k]) not in [str, unicode]: continue for m in p.findall(d[k]): s = m.strip("%").replace('ENV:', '') if s in os.environ: v = os.environ[s] elif 'OSVC_COMP_'+s in os.environ: v = os.environ['OSVC_COMP_'+s] else: print >>sys.stderr, s, 'is not an env variable' raise NotApplicable() d[k] = d[k].replace(m, v) for user, d in self.users.items(): if cap_shadow: if "password" in d and len(d["password"]) > 0 and \ ("spassword" not in d or len(d["spassword"]) == 0): self.users[user]["spassword"] = self.users[user]["password"] del self.users[user]["password"] else: if "spassword" in d and len(d["spassword"]) > 0 and \ ("password" not in d or len(d["password"]) == 0): self.users[user]["password"] = self.users[user]["spassword"] del self.users[user]["spassword"] def fixable(self): if not which('usermod'): print >>sys.stderr, "usermod program not found" return RET_ERR return RET_OK def grpconv(self): if not cap_shadow or not os.path.exists('/etc/gshadow'): return if not which('grpconv'): return with open('/etc/group', 'r') as f: buff = f.read() l = [] for line in buff.split('\n'): u = line.split(':')[0] if u in l: print >>sys.stderr, "duplicate group %s in /etc/group. skip grpconv (grpconv bug workaround)"%u return l.append(u) p = Popen(['grpconv']) p.communicate() def pwconv(self): if not cap_shadow or not os.path.exists('/etc/shadow'): return if not which('pwconv'): return p = Popen(['pwconv']) p.communicate() def fix_item(self, user, item, target): cmd = ['usermod'] + self.usermod_p[item].split() + [str(target), user] print list2cmdline(cmd) p = Popen(cmd) out, err = p.communicate() r = p.returncode self.pwconv() self.grpconv() if r == 0: return RET_OK else: return RET_ERR def check_item(self, user, item, target, current, verbose=False): if type(current) == int and current < 0: current += 4294967296 if target == current: if verbose: print 'user', user, item+':', current return RET_OK else: if verbose: print >>sys.stderr, 'user', user, item+':', current, 'target:', target return RET_ERR def check_user(self, user, props): r = 0 try: userinfo=pwd.getpwnam(user) except KeyError: if self.try_create_user(props): print >>sys.stderr, 'user', user, 'does not exist' return RET_ERR else: print >>sys.stderr, 'user', user, 'does not exist and not enough info to create it' return RET_ERR for prop in self.pwt: if prop in props: r |= self.check_item(user, prop, props[prop], getattr(userinfo, self.pwt[prop]), verbose=True) if not cap_shadow: return r try: usersinfo=spwd.getspnam(user) except KeyError: if "spassword" in props: print >>sys.stderr, user, "not declared in /etc/shadow" r |= RET_ERR usersinfo = None if usersinfo is not None: for prop in self.spwt: if prop in props: r |= self.check_item(user, prop, props[prop], getattr(usersinfo, self.spwt[prop]), verbose=True) return r def try_create_user(self, props): # # don't try to create user if passwd db is not 'files' # beware: 'files' db is the implicit default # if 'db' in props and props['db'] != 'files': return False return True def create_user(self, user, props): cmd = ['useradd'] for item in props: prop = str(props[item]) if len(prop) == 0: continue cmd = cmd + self.usermod_p[item].split() + [prop] cmd += [user] print list2cmdline(cmd) p = Popen(cmd) out, err = p.communicate() r = p.returncode if r == 0: return RET_OK else: return RET_ERR def fix_user(self, user, props): r = 0 try: userinfo = pwd.getpwnam(user) except KeyError: if self.try_create_user(props): return self.create_user(user, props) else: print 'user', user, 'does not exist and not enough info to create it' return RET_OK for prop in self.pwt: if prop in props and \ self.check_item(user, prop, props[prop], getattr(userinfo, self.pwt[prop])) != RET_OK: r |= self.fix_item(user, prop, props[prop]) if not cap_shadow: return r try: usersinfo = spwd.getspnam(user) except KeyError: if "spassword" in props: self.fix_item(user, "spassword", props["spassword"]) usersinfo = spwd.getspnam(user) else: usersinfo = None if usersinfo is not None: for prop in self.spwt: if prop in props and \ self.check_item(user, prop, props[prop], getattr(usersinfo, self.spwt[prop])) != RET_OK: r |= self.fix_item(user, prop, props[prop]) return r def check(self): r = 0 for user, props in self.users.items(): r |= self.check_user(user, props) return r def fix(self): r = 0 for user, props in self.users.items(): r |= self.fix_user(user, props) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompUser(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024635000081b40000000000000000000000014faa950900000693000000ae00010002ffffffffffffffff0000003900000000root/opt/opensvc/var/compliance/com.opensvc/utilities.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import sys class NoRule(Exception): pass def is_exe(fpath): """Returns True if file path is executable, False otherwize does not follow symlink """ return os.path.exists(fpath) and os.access(fpath, os.X_OK) def which(program): """Returns True if program is in PATH and executable, False otherwize """ fpath, fname = os.path.split(program) if fpath and is_exe(program): return program for path in os.environ["PATH"].split(os.pathsep): exe_file = os.path.join(path, program) if is_exe(exe_file): return exe_file return None def get_rule(rule_var): """ Return the value if set in the environment. Print some useful message if not set. """ if rule_var not in os.environ: print >>sys.stderr, rule_var, "is not present in this node's ruleset" raise NoRule() return os.environ[rule_var] 0707010002462f000081fd0000000000000000000000014faa9509000019a2000000ae00010002ffffffffffffffff0000004100000000root/opt/opensvc/var/compliance/com.opensvc/groups_membership.py#!/opt/opensvc/bin/python """ module use OSVC_COMP_GROUP_... vars which define {'groupname':{'propname':'propval',... }, ...} example: {"tibco":{"gid":1000,"members":"tibco,tibadm",}, "tibco1":{"gid":1001,"members":"tibco",}, } supported dictionnary keys: - members dictionnary keys used by another module: - gid """ import os import sys import json import grp from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class CompGroupMembership(object): def __init__(self, prefix='OSVC_COMP_GROUP_'): self.prefix = prefix.upper() self.grt = { 'members': 'gr_mem', } self.sysname, self.nodename, x, x, self.machine = os.uname() if self.sysname not in ['SunOS', 'Linux', 'HP-UX', 'AIX']: print >>sys.stderr, 'module not supported on', self.sysname raise NotApplicable # # initialize a hash to store all group membership # of users # self.load_member_of() self.groups = {} for k in [ key for key in os.environ if key.startswith(self.prefix)]: try: self.groups.update(json.loads(os.environ[k])) except ValueError: print 'group syntax error on var[', k, '] = ', os.environ[k] if len(self.groups) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable def load_member_of(self): self.member_of = {} for group in grp.getgrall(): for user in group.gr_mem: if user in self.member_of: self.member_of[user].append(group.gr_name) else: self.member_of[user] = [group.gr_name] def fixable(self): return RET_NA def del_member(self, group, user): if user not in self.member_of: return 0 g = set(self.member_of[user]) - set([group]) g = ','.join(g) return self.fix_member(g, user) def add_member(self, group, user): if 0 != self._check_member_accnt(user): print >>sys.stderr, 'group', group+':', 'cannot add inexistant user "%s"'%user return RET_ERR if user in self.member_of: g = set(self.member_of[user]) | set([group]) g = ','.join(g) else: g = group return self.fix_member(g, user) def fix_member(self, g, user): cmd = ['usermod', '-G', g, user] print ' '.join(cmd) p = Popen(cmd) out, err = p.communicate() r = p.returncode self.load_member_of() if r == 0: return RET_OK else: return RET_ERR def fix_members(self, group, target): r = 0 for user in target: if user in self.member_of and group in self.member_of[user]: continue r += self.add_member(group, user) #for user in [u for u in self.member_of if group in self.member_of[u] and u not in target]: # r += self.del_member(group, user) return r def fix_item(self, group, item, target): if item == 'members': return self.fix_members(group, target) else: print >>sys.stderr, 'no fix implemented for', item return RET_ERR def _check_member_accnt(self, user): xcmd = ['getent', 'passwd', user] xp = Popen(xcmd, stdout=PIPE, stderr=PIPE, close_fds=True) xout, xerr = xp.communicate() return xp.returncode def _check_members_accnts(self, group, list, which, verbose): r = RET_OK for user in list: rc = self._check_member_accnt(user) if rc != 0: r |= RET_ERR if verbose: print >>sys.stderr, 'group', group, 'inexistant user "%s" which is %s'%(user, which) return r def check_item(self, group, item, target, current, verbose=False): r = RET_OK if item == 'members': r |= self._check_members_accnts(group, current, 'INCLUDED', verbose) r |= self._check_members_accnts(group, target, 'REQUIRED', verbose) if not isinstance(current, list): current = [current] if set(target) <= set(current): if verbose: print 'group', group, item+':', current return r else: if verbose: print >>sys.stderr, 'group', group, item+':', current, 'target:', target return r|RET_ERR def check_group(self, group, props): r = 0 try: groupinfo = grp.getgrnam(group) except KeyError: print 'group', group, 'does not exist' return RET_OK for prop in self.grt: if prop in props: r |= self.check_item(group, prop, props[prop], getattr(groupinfo, self.grt[prop]), verbose=True) return r def fix_group(self, group, props): r = 0 try: groupinfo = grp.getgrnam(group) except KeyError: print 'group', group, 'does not exist' return RET_OK for prop in self.grt: if prop in props and \ self.check_item(group, prop, props[prop], getattr(groupinfo, self.grt[prop])) != RET_OK: r |= self.fix_item(group, prop, props[prop]) return r def check(self): r = 0 for group, props in self.groups.items(): r |= self.check_group(group, props) return r def fix(self): r = 0 for group, props in self.groups.items(): r |= self.fix_group(group, props) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompGroupMembership(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 0707010002462c000081fd0000000000000000000000014faa950900001a5f000000ae00010002ffffffffffffffff0000003800000000root/opt/opensvc/var/compliance/com.opensvc/firmware.py#!/opt/opensvc/bin/python import os import sys import json from distutils.version import LooseVersion as V from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class CompFirmware(object): def __init__(self, var): self.versions = {} if var not in os.environ: print var, 'not found in environment' raise NotApplicable() try: self.target_versions = json.loads(os.environ[var]) except: print >>sys.stderr, var, 'mis-formatted variable:', os.environ[var] raise NotApplicable() for key in self.target_versions: if type(self.target_versions[key]) != list: continue self.target_versions[key] = map(lambda x: str(x), self.target_versions[key]) self.sysname, self.nodename, x, x, self.machine = os.uname() if self.sysname not in ['Linux']: print >>sys.stderr, 'module not supported on', self.sysname raise NotApplicable() def get_versions(self): self.get_bios_version_Linux() self.get_qla_version_Linux() self.get_lpfc_version_Linux() def get_qla_version_Linux(self): self.versions['qla2xxx'] = None self.versions['qla2xxx_fw'] = None import glob hosts = glob.glob('/sys/bus/pci/drivers/qla2*/*:*:*/host*') if len(hosts) == 0: return hosts_proc = map(lambda x: '/proc/scsi/qla2xxx/'+os.path.basename(x).replace('host', ''), hosts) hosts = map(lambda x: '/sys/class/fc_host/'+os.path.basename(x)+'/symbolic_name', hosts) for i, host in enumerate(hosts): if os.path.exists(host): with open(host, 'r') as f: buff = f.read() l = buff.split() for e in l: if e.startswith("DVR:"): self.versions['qla2xxx'] = e.replace("DVR:", "") elif e.startswith("FW:"): v = e.replace("FW:", "") # store the lowest firmware version if self.versions['qla2xxx_fw'] is None or V(self.versions['qla2xxx_fw']) > V(v): self.versions['qla2xxx_fw'] = v elif os.path.exists(hosts_proc[i]): with open(hosts_proc[i], 'r') as f: buff = f.read() for line in buff.split('\n'): if "Firmware version" not in line: continue l = line.split() n_words = len(l) idx = l.index("Driver") + 2 if idx <= n_words: self.versions['qla2xxx'] = l[idx] idx = l.index("Firmware") + 2 if idx <= n_words: v = l[idx] if self.versions['qla2xxx_fw'] is None or V(self.versions['qla2xxx_fw']) > V(v): self.versions['qla2xxx_fw'] = v def get_lpfc_version_Linux(self): self.versions['lpfc'] = None self.versions['lpfc_fw'] = None import glob hosts = glob.glob('/sys/class/scsi_host/host*/fwrev') if len(hosts) == 0: return for host in hosts: with open(host, 'r') as f: buff = f.read() l = buff.split() if self.versions['lpfc_fw'] is None or V(self.versions['lpfc_fw']) > V(l[0]): self.versions['lpfc_fw'] = l[0] if self.versions['lpfc_fw'] is None: # no need to fetch module version if no hardware return cmd = ['modinfo', 'lpfc'] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: return for line in out.split('\n'): if line.startswith('version:'): self.versions['lpfc'] = line.split()[1] return def get_bios_version_Linux(self): p = os.path.join(os.sep, 'sys', 'class', 'dmi', 'id', 'bios_version') try: f = open(p, 'r') ver = f.read().strip() f.close() self.versions['server'] = ver return except: pass try: cmd = ['dmidecode'] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: raise for line in out.split('\n'): if 'Version:' in line: self.versions['server'] = line.split(':')[-1].strip() return raise except: print >>sys.stderr, 'can not fetch bios version' return def fixable(self): return RET_NA def check(self): self.get_versions() r = RET_OK for key in self.target_versions: if key not in self.versions: print >>sys.stderr, "TODO: get", key, "version" continue if type(self.versions[key]) not in (str, unicode): print "no", key continue if type(self.target_versions[key]) == list and \ self.versions[key] not in self.target_versions[key]: print >>sys.stderr, key, "version is %s, target %s"%(self.versions[key], ' or '.join(self.target_versions[key])) r |= RET_ERR elif type(self.target_versions[key]) != list and \ self.versions[key] != self.target_versions[key]: print >>sys.stderr, key, "version is %s, target %s"%(self.versions[key], self.target_versions[key]) r |= RET_ERR else: print key, "version is %s, on target"%self.versions[key] continue return r def fix(self): return RET_NA if __name__ == "__main__": syntax = """syntax: %s TARGET check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompFirmware(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 0707010002462a000081fd0000000000000000000000014faa950900001c9a000000ae00010002ffffffffffffffff0000003900000000root/opt/opensvc/var/compliance/com.opensvc/etcsystem.py#!/opt/opensvc/bin/python """ OSVC_COMP_ETCSYSTEM='[{"key": "fcp:fcp_offline_delay", "op": ">=", "value": 21}, {"key": "ssd:ssd_io_time", "op": "=", "value": "0x3C"}]' ./etcsystem.py OSVC_COMP_ETCSYSTEM check """ import os import sys import json from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class EtcSystem(object): def __init__(self, prefix='OSVC_COMP_FILELINE_'): self.prefix = prefix.upper() self.data = {} self.cf = os.path.join(os.sep, 'etc', 'system') self.keys = [] self.load_file(self.cf) for k in [ key for key in os.environ if key.startswith(self.prefix)]: try: self.keys += json.loads(os.environ[k]) except ValueError: print >>sys.stderr, 'key syntax error on var[', k, '] = ',os.environ[k] if len(self.keys) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() def fixable(self): return RET_OK def load_file(self, p): if not os.path.exists(p): print >>sys.stderr, p, "does not exist" return with open(p, 'r') as f: buff = f.read() self.lines = buff.split('\n') for i, line in enumerate(self.lines): line = line.strip() if line.startswith('*'): continue if len(line) == 0: continue l = line.split() if l[0] != "set": continue if len(l) < 2: continue line = ' '.join(l[1:]) var, val = line.split('=') var = var.strip() val = val.strip() try: val = int(val) except: pass if var in self.data: self.data[var].append([val, i]) else: self.data[var] = [[val, i]] def set_val(self, keyname, target, op): newline = 'set %s = %s'%(keyname, str(target)) if keyname not in self.data: print "add '%s' to /etc/system"%newline self.lines.insert(-1, newline + " * added by opensvc") else: ok = 0 for value, ref in self.data[keyname]: r = self._check_key(keyname, target, op, value, ref, verbose=False) if r == RET_ERR: print "comment out line %d: %s"%(ref, self.lines[ref]) self.lines[ref] = '* '+self.lines[ref]+' * commented out by opensvc' else: ok += 1 if ok == 0: print "add '%s' to /etc/system"%newline self.lines.insert(-1, newline + " * added by opensvc") def get_val(self, keyname): if keyname not in self.data: return [] return self.data[keyname] def _check_key(self, keyname, target, op, value, ref, verbose=True): r = RET_OK if value is None: if verbose: print >>sys.stderr, "%s not set"%keyname r |= RET_ERR if op == '=': if str(value) != str(target): if verbose: print >>sys.stderr, "%s=%s, target: %s"%(keyname, str(value), str(target)) r |= RET_ERR elif verbose: print "%s=%s on target"%(keyname, str(value)) else: if type(value) != int: if verbose: print >>sys.stderr, "%s=%s value must be integer"%(keyname, str(value)) r |= RET_ERR elif op == '<=' and value > target: if verbose: print >>sys.stderr, "%s=%s target: <= %s"%(keyname, str(value), str(target)) r |= RET_ERR elif op == '>=' and value < target: if verbose: print >>sys.stderr, "%s=%s target: >= %s"%(keyname, str(value), str(target)) r |= RET_ERR elif verbose: print "%s=%s on target"%(keyname, str(value)) return r def check_key(self, key, verbose=True): if 'key' not in key: if verbose: print >>sys.stderr, "'key' not set in rule %s"%str(key) return RET_NA if 'value' not in key: if verbose: print >>sys.stderr, "'value' not set in rule %s"%str(key) return RET_NA if 'op' not in key: op = "=" else: op = key['op'] target = key['value'] if op not in ('>=', '<=', '='): if verbose: print >>sys.stderr, "'value' list member 0 must be either '=', '>=' or '<=': %s"%str(key) return RET_NA keyname = key['key'] data = self.get_val(keyname) if len(data) == 0: print >>sys.stderr, "%s key is not set"%keyname return RET_ERR r = RET_OK ok = 0 for value, ref in data: r |= self._check_key(keyname, target, op, value, ref, verbose) if r == RET_OK: ok += 1 if ok > 1: print >>sys.stderr, "duplicate lines for key %s"%keyname r |= RET_ERR return r def fix_key(self, key): self.set_val(key['key'], key['value'], key['op']) def check(self): r = 0 for key in self.keys: r |= self.check_key(key, verbose=True) return r def fix(self): for key in self.keys: if self.check_key(key, verbose=False) == RET_ERR: self.fix_key(key) if len(self.keys) > 0: import datetime backup = self.cf+str(datetime.datetime.now()) try: import shutil shutil.copy(self.cf, backup) except: print >>sys.stderr, "failed to backup %s"%self.cf return RET_ERR try: with open(self.cf, 'w') as f: f.write('\n'.join(self.lines)) except: print >>sys.stderr, "failed to write %s"%self.cf return RET_ERR return RET_OK if __name__ == "__main__": """ test: OSVC_COMP_SYSCTL='[{"key": "net.unix.max_dgram_qlen", "value": [">=", 9]}, {"key": "kernel.ctrl-alt-del", "value": ["=", 1]}, {"key": "kernel.printk", "value": [[], [] , [], [">=", 12]]}]' ./sysctl.py OSVC_COMP_SYSCTL check """ syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = EtcSystem(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024625000081fd0000000000000000000000014faa9509000024d0000000ae00010002ffffffffffffffff0000003800000000root/opt/opensvc/var/compliance/com.opensvc/authkeys.py#!/opt/opensvc/bin/python """ module use OSVC_COMP_AUTHKEY_... vars which define { "action": "add", # optional, defaults to "add" "authfile": "authorized_keys", # optional, defaults to "authorized_keys2" "user": "foo", # mandatory "key": "XXXX..." # mandatory } where: - user: the username the key authorize to log as - key: a single pub key to authorize """ import os import sys import json import pwd import codecs from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class CompAuthKeys(object): def __init__(self, prefix='OSVC_COMP_AUTHKEY_', authfile="authorized_keys2"): self.prefix = prefix.upper() self.authkeys = [] for k in [key for key in os.environ if key.startswith(self.prefix)]: try: self.authkeys += [json.loads(os.environ[k])] except ValueError: print >>sys.stderr, 'failed to concatenate', os.environ[k], 'to authkey list' if len(self.authkeys) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() self.installed_keys_d = {} if authfile not in ("authorized_keys", "authorized_keys2"): print >>sys.stderr, "unsupported authfile:", authfile, "(use authorized_keys or authorized_keys2)" raise NotApplicable() self.authfile = authfile def sanitize(self, ak): if 'user' not in ak: print >>sys.stderr, "no user set in rule" return False if 'key' not in ak: print >>sys.stderr, "no key set in rule" return False if 'action' not in ak: ak['action'] = 'add' if 'authfile' not in ak: ak['authfile'] = self.authfile if ak['authfile'] not in ("authorized_keys", "authorized_keys2"): print >>sys.stderr, "unsupported authfile:", ak['authfile'], "(default to", self.authfile+")" ak['authfile'] = self.authfile for key in ('user', 'key', 'action', 'authfile'): ak[key] = ak[key].strip() return ak def fixable(self): return RET_NA def truncate_key(self, key): if len(key) < 50: s = key else: s = "'"+key[0:17] + "..." + key[-30:]+"'" return s.encode('utf8') def _get_authkey_file(self, key): if key == "authorized_keys": # default return ".ssh/authorized_keys" elif key == "authorized_keys2": key = "AuthorizedKeysFile" else: print >>sys.stderr, "unknown key", key return None cfs = [os.path.join(os.sep, 'etc', 'ssh', 'sshd_config'), os.path.join(os.sep, 'etc', 'opt', 'ssh', 'sshd_config')] cf = None for _cf in cfs: if os.path.exists(_cf): cf = _cf break if cf is None: print >>sys.stderr, "sshd_config not found" return None with open(cf, 'r') as f: buff = f.read() for line in buff.split('\n'): l = line.split() if len(l) != 2: continue if l[0].strip() == key: return l[1] # not found, return default return ".ssh/authorized_keys2" def get_authkey_file(self, key, user): p = self._get_authkey_file(key) if p is None: return None p = p.replace('%u', user) p = p.replace('%H', os.path.expanduser(user)) if not p.startswith('/'): p = os.path.join(os.path.expanduser('~'+user), p) return p def get_authkey_files(self, user): l = [] p = self.get_authkey_file('authorized_keys', user) if p is not None: l.append(p) p = self.get_authkey_file('authorized_keys2', user) if p is not None: l.append(p) return l def get_installed_keys(self, user): if user in self.installed_keys_d: return self.installed_keys_d[user] else: self.installed_keys_d[user] = [] ps = self.get_authkey_files(user) for p in ps: if not os.path.exists(p): continue with codecs.open(p, 'r', encoding="utf8") as f: self.installed_keys_d[user] += f.read().split('\n') return self.installed_keys_d[user] def check_authkey(self, ak, verbose=True): ak = self.sanitize(ak) installed_keys = self.get_installed_keys(ak['user']) if ak['action'] == 'add': if ak['key'] not in installed_keys: if verbose: print >>sys.stderr, 'key', self.truncate_key(ak['key']), 'must be installed for user', ak['user'] r = RET_ERR else: if verbose: print 'key', self.truncate_key(ak['key']), 'is correctly installed for user', ak['user'] r = RET_OK elif ak['action'] == 'del': if ak['key'] in installed_keys: if verbose: print >>sys.stderr, 'key', self.truncate_key(ak['key']), 'must be uninstalled for user', ak['user'] r = RET_ERR else: if verbose: print 'key', self.truncate_key(ak['key']), 'is correctly not installed for user', ak['user'] r = RET_OK else: print >>sys.stderr, "unsupported action:", ak['action'] return RET_ERR return r def fix_authkey(self, ak): ak = self.sanitize(ak) if ak['action'] == 'add': return self.add_authkey(ak) elif ak['action'] == 'del': return self.del_authkey(ak) else: print >>sys.stderr, "unsupported action:", ak['action'] return RET_ERR def add_authkey(self, ak): if self.check_authkey(ak, verbose=False) == RET_OK: return RET_OK try: userinfo=pwd.getpwnam(ak['user']) except KeyError: print >>sys.stderr, 'user', ak['user'], 'does not exist' return RET_ERR p = self.get_authkey_file(ak['authfile'], ak['user']) if p is None: print >>sys.stderr, "could not determine", ak['authfile'], "location" return RET_ERR base = os.path.dirname(p) if not os.path.exists(base): os.makedirs(base, 0700) print base, "created" if p.startswith(os.path.expanduser('~'+ak['user'])): os.chown(base, userinfo.pw_uid, userinfo.pw_gid) print base, "ownership set to %d:%d"%(userinfo.pw_uid, userinfo.pw_gid) if not os.path.exists(p): with open(p, 'w') as f: f.write("") print p, "created" os.chmod(p, 0600) print p, "mode set to 0600" os.chown(p, userinfo.pw_uid, userinfo.pw_gid) print p, "ownetship set to %d:%d"%(userinfo.pw_uid, userinfo.pw_gid) with open(p, 'a') as f: f.write(ak['key'].encode('utf8')) if not ak['key'].endswith('\n'): f.write('\n') print 'key', self.truncate_key(ak['key']), 'installed for user', ak['user'] return RET_OK def del_authkey(self, ak): if self.check_authkey(ak, verbose=False) == RET_OK: print 'key', self.truncate_key(ak['key']), 'is already not installed for user', ak['user'] return RET_OK ps = self.get_authkey_files(ak['user']) for p in ps: base = os.path.basename(p) if not os.path.exists(p): continue with open(p, 'r') as f: l = f.read().split('\n') n = len(l) while True: try: l.remove(ak['key'].replace('\n', '')) except ValueError: break if len(l) == n: # nothing changed continue with open(p, 'w') as f: f.write('\n'.join(l)) print 'key', self.truncate_key(ak['key']), 'uninstalled for user', ak['user'] return RET_OK def check(self): r = 0 for ak in self.authkeys: r |= self.check_authkey(ak) return r def fix(self): r = 0 for ak in self.authkeys: r |= self.fix_authkey(ak) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompAuthKeys(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024633000081fd0000000000000000000000014faa950900002106000000ae00010002ffffffffffffffff0000003600000000root/opt/opensvc/var/compliance/com.opensvc/sysctl.py#!/opt/opensvc/bin/python """ module use OSVC_COMP_USER_... vars which define {"gssftp": {"disable": "no", "server_args": "-l -a -u 022", ...}, ...} supported dictionnary keys: - disable - server_args """ import os import sys import json import pwd from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class Sysctl(object): def __init__(self, prefix='OSVC_COMP_XINETD_'): self.prefix = prefix.upper() self.need_reload = False self.cf = os.path.join(os.sep, "etc", "sysctl.conf") if not os.path.exists(self.cf): print >>sys.stderr, self.cf, 'does not exist' raise NotApplicable() self.keys = [] self.cache = None for k in [ key for key in os.environ if key.startswith(self.prefix)]: try: self.keys += json.loads(os.environ[k]) except ValueError: print >>sys.stderr, 'sysctl key syntax error on var[', k, '] = ',os.environ[k] if len(self.keys) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() def fixable(self): return RET_OK def parse_val(self, val): val = map(lambda x: x.strip(), val.strip().split()) for i, e in enumerate(val): try: val[i] = int(e) except: pass return val def get_keys(self): with open(self.cf, 'r') as f: buff = f.read() if self.cache is None: self.cache = {} for line in buff.split('\n'): line = line.strip() if line.startswith('#'): continue l = line.split('=') if len(l) != 2: continue key = l[0].strip() val = self.parse_val(l[1]) self.cache[key] = val def set_live_key(self, key, val): if " " in val: val = '"'+val+'"' cmd = ['sysctl', '-w', key+'='+val] print "sysctl:", " ".join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: print >>sys.stderr, "failed" raise def get_live_key(self, key): p = Popen(['sysctl', key], stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return None l = out.split('=') if len(l) != 2: return None val = self.parse_val(l[1]) return val def get_key(self, key): if self.cache is None: self.get_keys() if key not in self.cache: return None return self.cache[key] def fix_key(self, key): done = False value = key['value'] if type(value) != list or len(value) == 0: print >>sys.stderr, "sysctl rule misformatted: %s"%value raise if type(value[0]) != list: value = [value] with open(self.cf, 'r') as f: buff = f.read() lines = buff.split('\n') for i, line in enumerate(lines): line = line.strip() if line.startswith('#'): continue l = line.split('=') if len(l) != 2: continue keyname = l[0].strip() if key['key'] != keyname: continue if done: print "sysctl: remove redundant key %s"%keyname del lines[i] continue val = self.parse_val(l[1]) for j, e in enumerate(value): if len(e) != 2: continue if e[1] == val[j]: continue print "sysctl: set %s[%d] = %s"%(keyname, j, str(e[1])) val[j] = e[1] lines[i] = "%s = %s"%(keyname, " ".join(map(str, val))) done = True if not done: # if key is not in sysctl.conf, get the value from kernel val = self.get_live_key(key['key']) for j, e in enumerate(value): if len(e) != 2: continue if e[1] == val[j]: continue val[j] = e[1] print "sysctl: set %s = %s"%(key['key'], " ".join(map(str, val))) lines += ["%s = %s"%(key['key'], " ".join(map(str, val)))] with open(self.cf, 'w') as f: f.write('\n'.join(lines)) try: self.set_live_key(key['key'], " ".join(map(str, val))) except: return RET_ERR return RET_OK def check_key(self, key, verbose=False): r = RET_OK keyname = key['key'] value = key['value'] if type(value) != list or len(value) == 0: print >>sys.stderr, "sysctl rule misformatted: %s"%value raise if type(value[0]) != list: value = [value] current_value = self.get_key(keyname) current_live_value = self.get_live_key(keyname) if current_value is None: if verbose: print >>sys.stderr, "key '%s' not found in sysctl.conf"%keyname return RET_ERR for i, v in enumerate(value): if type(v) != list or len(v) != 2: continue op = v[0] target = v[1] if op == "=" and str(current_value[i]) != str(target): if verbose: print >>sys.stderr, "sysctl err: %s[%d] = %s, target: %s"%(keyname, i, str(current_value[i]), str(target)) r |= RET_ERR elif op == ">=" and type(target) == int and current_value[i] < target: if verbose: print >>sys.stderr, "sysctl err: %s[%d] = %s, target: >= %s"%(keyname, i, str(current_value[i]), str(target)) r |= RET_ERR elif op == "<=" and type(target) == int and current_value[i] > target: if verbose: print >>sys.stderr, "sysctl err: %s[%d] = %s, target: <= %s"%(keyname, i, str(current_value[i]), str(target)) r |= RET_ERR else: if verbose: print "sysctl ok: %s[%d] = %s, on target"%(keyname, i, str(current_value[i])) if r == RET_OK and current_live_value is not None and current_value != current_live_value: if verbose: print >>sys.stderr, "sysctl err: %s on target in sysctl.conf but kernel value is different"%(keyname) self.need_reload = True r |= RET_ERR return r def check(self): r = 0 for key in self.keys: r |= self.check_key(key, verbose=True) return r def reload_sysctl(self): cmd = ['sysctl', '-p'] print "sysctl:", " ".join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) p.communicate() if p.returncode != 0: print >>sys.stderr, "reload failed" return RET_ERR return RET_OK def fix(self): r = 0 for key in self.keys: if self.check_key(key, verbose=False) == RET_ERR: self.need_reload = True r |= self.fix_key(key) if self.need_reload: r |= self.reload_sysctl() return r if __name__ == "__main__": """ test: OSVC_COMP_SYSCTL='[{"key": "net.unix.max_dgram_qlen", "value": [">=", 9]}, {"key": "kernel.ctrl-alt-del", "value": ["=", 1]}, {"key": "kernel.printk", "value": [[], [] , [], [">=", 12]]}]' ./sysctl.py OSVC_COMP_SYSCTL check """ syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = Sysctl(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024636000081fd0000000000000000000000014faa950900003500000000ae00010002ffffffffffffffff0000003400000000root/opt/opensvc/var/compliance/com.opensvc/vuln.py#!/opt/opensvc/bin/python """ OSVC_COMP_VULN_11_117=\ [{"pkgname": "kernel", "minver": "2.6.18-238.19.1.el5"},\ {"pkgname": "kernel-xen", "minver": "2.6.18-238.19.1.el5"}] """ import os import sys import json import pwd import sys from subprocess import * from distutils.version import LooseVersion as V sys.path.append(os.path.dirname(__file__)) from comp import * class CompVuln(object): def __init__(self, prefix='OSVC_COMP_VULN_', uri=None): self.uri = uri self.prefix = prefix.upper() self.highest_avail_version = "0" self.fix_list = [] self.sysname, self.nodename, x, x, self.machine = os.uname() if self.sysname not in ['Linux', 'HP-UX', 'AIX', 'SunOS']: print >>sys.stderr, 'module not supported on', self.sysname raise NotApplicable() if 'OSVC_COMP_VULN_STRICT' in os.environ and \ os.environ['OSVC_COMP_VULN_STRICT'] == "true": self.strict = True else: self.strict = False if 'OSVC_COMP_VULN_PKG_TYPE' in os.environ and \ os.environ['OSVC_COMP_VULN_PKG_TYPE'] == "bundle": self.pkg_type = 'bundle' else: self.pkg_type = 'product' self.packages = [] for k in [key for key in os.environ if key.startswith(self.prefix)]: try: o = json.loads(os.environ[k]) except ValueError: print >>sys.stderr, 'failed to concatenate', os.environ[k], 'to rules list' for i, d in enumerate(o): o[i]["rule"] = k.replace("OSVC_COMP_", "") self.packages += o if len(self.packages) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() if 'OSVC_COMP_NODES_OS_VENDOR' not in os.environ: print >>sys.stderr, "OS_VENDOR is not set. Check your asset" raise NotApplicable() vendor = os.environ['OSVC_COMP_NODES_OS_VENDOR'] if vendor in ['Debian', 'Ubuntu']: self.get_installed_packages = self.deb_get_installed_packages self.fix_pkg = self.apt_fix_pkg self.fixable_pkg = self.apt_fixable_pkg self.fix_all = None elif vendor in ['CentOS', 'Redhat', 'Red Hat']: self.get_installed_packages = self.rpm_get_installed_packages self.fix_pkg = self.yum_fix_pkg self.fixable_pkg = self.yum_fixable_pkg self.fix_all = None elif vendor in ['HP']: if self.uri is None: print >>sys.stderr, "URI is not set" raise NotApplicable() self.get_installed_packages = self.hp_get_installed_packages self.fix_pkg = self.hp_fix_pkg self.fixable_pkg = self.hp_fixable_pkg self.fix_all = self.hp_fix_all elif vendor in ['IBM']: self.get_installed_packages = self.aix_get_installed_packages self.fix_pkg = self.aix_fix_pkg self.fixable_pkg = self.aix_fixable_pkg self.fix_all = self.aix_fix_all elif vendor in ['Oracle']: self.get_installed_packages = self.sol_get_installed_packages self.fix_pkg = self.sol_fix_pkg self.fixable_pkg = self.sol_fixable_pkg self.fix_all = self.sol_fix_all else: print >>sys.stderr, vendor, "not supported" raise NotApplicable() self.installed_packages = self.get_installed_packages() def sol_fix_pkg(self, pkg): return RET_NA def sol_fixable_pkg(self, pkg): return RET_ERR def sol_fix_all(self): return RET_NA def sol_get_installed_packages(self): p = Popen(['pkginfo', '-l'], stdout=PIPE) (out, err) = p.communicate() if p.returncode != 0: print >>sys.stderr, 'can not fetch installed packages list' return {} return self.sol_parse_pkginfo(out) def sol_parse_pkginfo(self, out): l = {} for line in out.split('\n'): v = line.split(':') if len(v) != 2: continue f = v[0].strip() if f == "PKGINST": pkgname = v[1].strip() elif f == "ARCH": pkgarch = v[1].strip() elif f == "VERSION": pkgvers = v[1].strip() if pkgname in l: l[pkgname] += [(pkgvers, pkgarch)] else: l[pkgname] = [(pkgvers, pkgarch)] return l def aix_fix_pkg(self, pkg): return RET_NA def aix_fixable_pkg(self, pkg): return RET_ERR def aix_fix_all(self): return RET_NA def aix_get_installed_packages(self): p = Popen(['lslpp', '-L', '-c'], stdout=PIPE) (out, err) = p.communicate() if p.returncode != 0: print >>sys.stderr, 'can not fetch installed packages list' return {} return self.aix_parse_lslpp(out) def aix_parse_lslpp(self, out): l = {} for line in out.split('\n'): if line.startswith('#') or len(line) == 0: continue v = line.split(':') if len(v) < 3: continue pkgname = v[1].replace('-'+v[2], '') if pkgname in l: l[pkgname] += [(v[2], "")] else: l[pkgname] = [(v[2], "")] return l def hp_fix_pkg(self, pkg): if self.check_pkg(pkg, verbose=False) == RET_OK: return RET_OK if self.fixable_pkg(pkg) == RET_ERR: return RET_ERR if self.highest_avail_version == "0": return RET_ERR if self.strict: self.fix_list.append(pkg["pkgname"]+',r='+pkg["minver"]) else: self.fix_list.append(pkg["pkgname"]+',r='+self.highest_avail_version) return RET_OK def hp_fix_all(self): r = call(['swinstall', '-x', 'allow_downdate=true', '-x', 'autoreboot=true', '-x', 'mount_all_filesystems=false', '-s', self.uri] + self.fix_list) if r != 0: return RET_ERR return RET_OK def hp_fixable_pkg(self, pkg): self.highest_avail_version = "0" if self.check_pkg(pkg, verbose=False) == RET_OK: return RET_OK cmd = ['swlist', '-l', self.pkg_type, '-s', self.uri, pkg['pkgname']] p = Popen(cmd, stdout=PIPE, stderr=PIPE) (out, err) = p.communicate() if p.returncode != 0: if "not found on host" in err: print >>sys.stderr, '%s > %s not available in repositories'%(pkg['pkgname'], pkg['minver']) else: print >>sys.stderr, 'can not fetch available packages list' return RET_ERR l = self.hp_parse_swlist(out) if len(l) == 0: print >>sys.stderr, '%s > %s not available in repositories'%(pkg['pkgname'], pkg['minver']) return RET_ERR for v in map(lambda x: x[0], l.values()[0]): if V(v) > V(self.highest_avail_version): self.highest_avail_version = v if V(self.highest_avail_version) < V(pkg['minver']): print >>sys.stderr, '%s > %s not available in repositories'%(pkg['pkgname'], pkg['minver']) return RET_ERR return RET_OK def hp_get_installed_packages(self): p = Popen(['swlist', '-l', self.pkg_type], stdout=PIPE) (out, err) = p.communicate() if p.returncode != 0: print >>sys.stderr, 'can not fetch installed packages list' return {} return self.hp_parse_swlist(out) def hp_parse_swlist(self, out): l = {} for line in out.split('\n'): if line.startswith('#') or len(line) == 0: continue v = line.split() if len(v) < 2: continue if v[0] in l: l[v[0]] += [(v[1], "")] else: l[v[0]] = [(v[1], "")] return l def rpm_get_installed_packages(self): p = Popen(['rpm', '-qa', '--qf', '%{n} %{v}-%{r} %{arch}\n'], stdout=PIPE) (out, err) = p.communicate() if p.returncode != 0: print >>sys.stderr, 'can not fetch installed packages list' return {} l = {} for line in out.split('\n'): v = line.split(' ') if len(v) != 3: continue if v[0] in l: l[v[0]] += [(v[1], v[2])] else: l[v[0]] = [(v[1], v[2])] return l def deb_get_installed_packages(self): p = Popen(['dpkg', '-l'], stdout=PIPE) (out, err) = p.communicate() if p.returncode != 0: print >>sys.stderr, 'can not fetch installed packages list' return {} l = {} for line in out.split('\n'): if not line.startswith('ii'): continue v = line.split()[1:2] l[v[0]] = [(v[1], "")] return l def apt_fixable_pkg(self, pkg, version): # TODO return RET_NA def yum_fixable_pkg(self, pkg): if self.check_pkg(pkg, verbose=False) == RET_OK: return RET_OK cmd = ['yum', 'list', 'available', pkg['pkgname']] p = Popen(cmd, stdout=PIPE, stderr=PIPE) (out, err) = p.communicate() if p.returncode != 0: if "No matching Packages" in err: print >>sys.stderr, '%s > %s not available in repositories'%(pkg['pkgname'], pkg['minver']) else: print >>sys.stderr, 'can not fetch available packages list' return RET_ERR highest_avail_version = "0" for line in out.split('\n'): l = line.split() if len(l) != 3: continue if V(l[1]) > V(highest_avail_version): highest_avail_version = l[1] if V(highest_avail_version) < V(pkg['minver']): print >>sys.stderr, '%s > %s not available in repositories'%(pkg['pkgname'], pkg['minver']) return RET_ERR return RET_OK def yum_fix_pkg(self, pkg): if self.check_pkg(pkg, verbose=False) == RET_OK: return RET_OK if self.fixable_pkg(pkg) == RET_ERR: return RET_ERR r = call(['yum', 'install', '-y', pkg["pkgname"]]) if r != 0: return RET_ERR return RET_OK def apt_fix_pkg(self, pkg): if self.check_pkg(pkg, verbose=False) == RET_OK: return RET_OK r = call(['apt-get', 'install', '-y', pkg["pkgname"]]) if r != 0: return RET_ERR return RET_OK def get_kver(self): s = os.uname()[2] s = s.replace('xen', '') s = s.replace('hugemem', '') s = s.replace('PAE', '') s = s.replace('.x86_64','') return s def check_pkg(self, pkg, verbose=True): if not pkg["pkgname"] in self.installed_packages: return RET_OK name = pkg["pkgname"] r = RET_OK max = "0" max_v = V(max) ok = [] for vers, arch in self.installed_packages[pkg["pkgname"]]: target = V(pkg["minver"]) actual = V(vers) if actual > max_v or max == "0": max = vers max_v = actual if target <= actual: ok.append(vers) if max == "0": # not installed return RET_OK if len(ok) > 0: kver = self.get_kver() if name.startswith("kernel") and kver not in ok: if verbose: print >>sys.stderr, "kernel", ', '.join(ok), "installed and not vulnerable but vulnerable kernel", kver, "booted" return RET_ERR return RET_OK if arch != "": name += "."+arch if verbose: print >>sys.stderr, 'package', name, vers, 'is vulnerable. upgrade to', pkg["minver"], "(%s)"%pkg["rule"] return RET_ERR def check(self): r = 0 for pkg in self.packages: r |= self.check_pkg(pkg) return r def fix(self): r = 0 for pkg in self.packages: r |= self.fix_pkg(pkg) if self.fix_all is not None and len(self.fix_list) > 0: self.fix_all() return r def fixable(self): r = 0 for pkg in self.packages: r |= self.fixable_pkg(pkg) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix [uri]"""%sys.argv[0] if len(sys.argv) not in (3, 4): print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: if len(sys.argv) == 4: o = CompVuln(sys.argv[1], sys.argv[3]) else: o = CompVuln(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024631000081fd0000000000000000000000014faa950900001aa7000000ae00010002ffffffffffffffff0000003700000000root/opt/opensvc/var/compliance/com.opensvc/process.py#!/opt/opensvc/bin/python """ Checks if a process is present, specifying its comm, and optionnaly its owner's uid and/or username. [{"command": "foo", "uid": "2345", "user": "foou"}, {"command": "bar", "uid": "2345"}, ...] """ import os import sys import json from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class CompProcess(object): def __init__(self, prefix='OSVC_COMP_PROCESS_'): self.prefix = prefix.upper() self.sysname, self.nodename, x, x, self.machine = os.uname() if self.sysname not in ['Linux', 'AIX', 'SunOS', 'FreeBSD', 'Darwin', 'HP-UX']: print >>sys.stderr, 'module not supported on', self.sysname raise NotApplicable() if self.sysname == 'HP-UX' and 'UNIX95' not in os.environ: os.environ['UNIX95'] = "" self.process = [] for k in [key for key in os.environ if key.startswith(self.prefix)]: try: self.process += json.loads(os.environ[k]) except ValueError: print >>sys.stderr, 'failed to concatenate', os.environ[k], 'to process list' self.validate_process() if len(self.process) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() self.load_ps() def load_ps(self): self.ps = {} cmd = ['ps', '-e', '-o', 'comm,pid,uid,user'] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: print >>sys.stderr, "unable to fetch ps" raise ComplianceError lines = out.split('\n') if len(lines) < 2: return for line in lines[1:]: l = line.split() if len(l) != 4: continue comm, pid, uid, user = l if comm not in self.ps: self.ps[comm] = [(pid, int(uid), user)] else: self.ps[comm].append((pid, int(uid), user)) def validate_process(self): l = [] for process in self.process: if self._validate_process(process) == RET_OK: l.append(process) self.process = l def _validate_process(self, process): if 'comm' not in process: print >>sys.stderr, process, 'rule is malformed ... comm key not present' return RET_ERR if 'uid' in process and type(process['uid']) != int: print >>sys.stderr, process, 'rule is malformed ... uid value must be integer' return RET_ERR return RET_OK def check_present(self, comm, verbose): if comm not in self.ps: if verbose: print >>sys.stderr, 'process', comm, 'is not started ... should be' return RET_ERR else: if verbose: print 'process', comm, 'is started ... on target' return RET_OK def check_not_present(self, comm, verbose): if comm not in self.ps: if verbose: print 'process', comm, 'is not started ... on target' return RET_ERR else: if verbose: print >>sys.stderr, 'process', comm, 'is started ... shoud be' return RET_OK def check_process(self, process, verbose=True): r = RET_OK if process['state'] == 'on': r |= self.check_present(process['comm'], verbose) if r == RET_ERR: return RET_ERR if 'uid' in process: r |= self.check_uid(process['comm'], process['uid'], verbose) if 'user' in process: r |= self.check_user(process['comm'], process['user'], verbose) else: r |= self.check_not_present(process['comm'], verbose) return r def check_uid(self, comm, uid, verbose): found = False for _pid, _uid, _user in self.ps[comm]: if uid == _uid: found = True continue if found: print 'process', comm, 'runs with uid', _uid, '... on target' else: print >>sys.stderr, 'process', comm, 'does not run with uid', _uid, '... should be' return RET_ERR return RET_OK def check_user(self, comm, user, verbose): found = False for _pid, _uid, _user in self.ps[comm]: if user == _user: found = True continue if found: print 'process', comm, 'runs with user', _user, '... on target' else: print >>sys.stderr, 'process', comm, 'does not run with user', _user, '... should be' return RET_ERR return RET_OK def fix_process(self, process): if self.check_present(process['comm'], verbose=False) == RET_OK: if ('uid' in process and self.check_uid(process['comm'], process['uid'], verbose=False) == RET_ERR) or \ ('user' in process and self.check_user(process['comm'], process['user'], verbose=False) == RET_ERR): print >>sys.stderr, process['comm'], "runs with the wrong user. can't fix." return RET_ERR return RET_OK if 'start' not in process: print >>sys.stderr, "undefined startup method for process", process['comm'] return RET_ERR print 'exec:', process['start'] p = Popen(process['start'].split(' '), stdout=PIPE) out, err = p.communicate() if p.returncode != 0: print >>sys.stderr, "start up command returned with error code", p.returncode print out print >>sys.stderr, err return RET_ERR return RET_OK def check(self): r = 0 for process in self.process: r |= self.check_process(process) return r def fix(self): r = 0 for process in self.process: r |= self.fix_process(process) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompProcess(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024628000081b40000000000000000000000014faa9509000004b4000000ae00010002ffffffffffffffff0000003400000000root/opt/opensvc/var/compliance/com.opensvc/comp.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # RET_OK = 0 RET_ERR = 1 RET_NA = 2 RET = RET_OK class NotApplicable(Exception): def __init__(self, s=""): self.s = s def __str__(self): return self.s class Unfixable(Exception): def __init__(self, s=""): self.s = s def __str__(self): return self.s class ComplianceError(Exception): def __init__(self, s=""): self.s = s def __str__(self): return self.s 07070100024626000081fd0000000000000000000000014faa95090000095a000000ae00010002ffffffffffffffff0000003400000000root/opt/opensvc/var/compliance/com.opensvc/bios.py#!/opt/opensvc/bin/python import os import sys from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class CompBios(object): def __init__(self, target): self.target = target self.sysname, self.nodename, x, x, self.machine = os.uname() if self.sysname not in ['Linux']: print >>sys.stderr, 'module not supported on', self.sysname raise NotApplicable() def get_bios_version_Linux(self): p = os.path.join(os.sep, 'sys', 'class', 'dmi', 'id', 'bios_version') try: f = open(p, 'r') ver = f.read().strip() f.close() return ver except: pass try: cmd = ['dmidecode', '-t', 'bios'] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: raise for line in out.split('\n'): if 'Version:' in line: return line.split(':')[-1].strip() raise except: print >>sys.stderr, 'can not fetch bios version' return None return ver def fixable(self): return RET_NA def check(self): ver = self.get_bios_version_Linux() if ver is None: return RET_NA if ver == self.target: print "bios version is %s, on target"%ver return RET_OK print >>sys.stderr, "bios version is %s, target %s"%(ver, self.target) return RET_ERR def fix(self): return RET_NA if __name__ == "__main__": syntax = """syntax: %s TARGET check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompBios(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024630000081fd0000000000000000000000014faa950900002371000000ae00010002ffffffffffffffff0000003800000000root/opt/opensvc/var/compliance/com.opensvc/packages.py#!/opt/opensvc/bin/python """ module use OSVC_COMP_PACKAGES_... vars which define ['pkg1', 'pkg2', ...] """ import os import sys import json import pwd from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class CompPackages(object): def __init__(self, prefix='OSVC_COMP_PACKAGES_', uri=None): self.uri = uri self.prefix = prefix.upper() self.sysname, self.nodename, x, x, self.machine = os.uname() self.known_archs = ['i386', 'i586', 'i686', 'x86_64', 'noarch'] if self.sysname not in ['Linux', 'AIX', 'HP-UX']: print >>sys.stderr, __file__, 'module not supported on', self.sysname raise NotApplicable() if 'OSVC_COMP_PACKAGES_PKG_TYPE' in os.environ and \ os.environ['OSVC_COMP_PACKAGES_PKG_TYPE'] == "bundle": self.pkg_type = 'bundle' else: self.pkg_type = 'product' self.packages = [] for k in [key for key in os.environ if key.startswith(self.prefix)]: try: self.packages += json.loads(os.environ[k]) except ValueError: print >>sys.stderr, 'failed to concatenate', os.environ[k], 'to package list' if len(self.packages) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() vendor = os.environ['OSVC_COMP_NODES_OS_VENDOR'] if vendor in ['Debian', 'Ubuntu']: self.get_installed_packages = self.deb_get_installed_packages self.fix_pkg = self.apt_fix_pkg elif vendor in ['CentOS', 'Redhat', 'Red Hat']: self.get_installed_packages = self.rpm_get_installed_packages self.fix_pkg = self.yum_fix_pkg elif vendor in ['IBM']: self.get_installed_packages = self.aix_get_installed_packages self.fix_pkg = self.aix_fix_pkg elif vendor in ['HP']: self.get_installed_packages = self.hp_get_installed_packages self.fix_pkg = self.hp_fix_pkg else: print >>sys.stderr, vendor, "not supported" raise NotApplicable() self.load_reloc() self.packages = map(lambda x: x.strip(), self.packages) self.expand_pkgnames() self.installed_packages = self.get_installed_packages() def load_reloc(self): self.reloc = {} for i, pkgname in enumerate(self.packages): l = pkgname.split(':') if len(l) != 2: continue self.packages[i] = l[0] self.reloc[l[0]] = l[1] def expand_pkgnames(self): """ Expand wildcards and implicit arch """ l = [] for pkgname in self.packages: l += self.expand_pkgname(pkgname) self.packages = l def expand_pkgname(self, pkgname): vendor = os.environ['OSVC_COMP_NODES_OS_VENDOR'] if vendor in ['CentOS', 'Redhat', 'Red Hat']: return self.yum_expand_pkgname(pkgname) return [pkgname] def yum_expand_pkgname(self, pkgname): arch_specified = False for arch in self.known_archs: if pkgname.endswith(arch): arch_specified = True cmd = ['yum', 'list', pkgname] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: print >>sys.stderr, 'can not expand', pkgname return [] lines = out.split('\n') if len(lines) < 2: print >>sys.stderr, 'can not expand', pkgname return [] lines = lines[1:] l = [] for line in lines: words = line.split() if len(words) != 3: continue if words[0] in ("Installed", "Available", "Loaded"): continue l.append(words[0]) if arch_specified or len(l) == 1: return l if os.environ['OSVC_COMP_NODES_OS_ARCH'] in ('i386', 'i586', 'i686', 'ia32'): archs = ('i386', 'i586', 'i686', 'ia32', 'noarch') else: archs = (os.environ['OSVC_COMP_NODES_OS_ARCH'], 'noarch') ll = [] for pkgname in l: if pkgname.split('.')[-1] in archs: # keep only packages matching the arch ll.append(pkgname) return ll def hp_parse_swlist(self, out): l = {} for line in out.split('\n'): if line.startswith('#') or len(line) == 0: continue v = line.split() if len(v) < 2: continue if v[0] in l: l[v[0]] += [(v[1], "")] else: l[v[0]] = [(v[1], "")] return l def hp_fix_pkg(self, pkg): if pkg in self.reloc: pkg = ':'.join((pkg, self.reloc[pkg])) cmd = ['swinstall', '-x', 'allow_downdate=true', '-x', 'mount_all_filesystems=false', '-s', self.uri, pkg] print " ".join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if len(out) > 0: print out if len(err) > 0: print >>sys.stderr, err if p.returncode != 0: return RET_ERR return RET_OK def hp_get_installed_packages(self): p = Popen(['swlist', '-l', self.pkg_type], stdout=PIPE) (out, err) = p.communicate() if p.returncode != 0: print >>sys.stderr, 'can not fetch installed packages list' return [] return self.hp_parse_swlist(out).keys() def aix_fix_pkg(self, pkg): print "TODO: aix_fix_pkg" def aix_get_installed_packages(self): cmd = ['lslpp', '-Lc'] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: print >>sys.stderr, 'can not fetch installed packages list' return [] pkgs = [] for line in out.split('\n'): l = line.split(':') if len(l) < 5: continue pkgvers = l[2] pkgname = l[1].replace('-'+pkgvers, '') pkgs.append(pkgname) return pkgs def rpm_get_installed_packages(self): p = Popen(['rpm', '-qa', '--qf', '%{n}.%{ARCH}\n'], stdout=PIPE) (out, err) = p.communicate() if p.returncode != 0: print >>sys.stderr, 'can not fetch installed packages list' return [] return out.split('\n') def deb_get_installed_packages(self): p = Popen(['dpkg', '-l'], stdout=PIPE) (out, err) = p.communicate() if p.returncode != 0: print >>sys.stderr, 'can not fetch installed packages list' return [] l = [] for line in out.split('\n'): if not line.startswith('ii'): continue l.append(line.split()[1]) return l def yum_fix_pkg(self, pkg): cmd = ['yum', 'install', '-y', pkg] print ' '.join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: if len(err) > 0: print err return RET_ERR return RET_OK def apt_fix_pkg(self, pkg): r = call(['apt-get', 'install', '-y', pkg]) if r != 0: return RET_ERR return RET_OK def fixable(self): return RET_NA def check_pkg(self, pkg, verbose=True): if not pkg in self.installed_packages: if verbose: print >>sys.stderr, 'package', pkg, 'is not installed' return RET_ERR if verbose: print 'package', pkg, 'is installed' return RET_OK def check(self): r = 0 for pkg in self.packages: r |= self.check_pkg(pkg) return r def fix(self): r = 0 for pkg in self.packages: if self.check_pkg(pkg, verbose=False) == RET_OK: continue r |= self.fix_pkg(pkg) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix [uri]"""%sys.argv[0] if len(sys.argv) not in [3, 4]: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: argv = [sys.argv[1]] if len(sys.argv) == 4: argv.append(sys.argv[3]) o = CompPackages(*argv) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 0707010002462b000081fd0000000000000000000000014faa950900002ac6000000ae00010002ffffffffffffffff0000003500000000root/opt/opensvc/var/compliance/com.opensvc/files.py#!/opt/opensvc/bin/python """ Verify file content. The collector provides the format with wildcards. The module replace the wildcards with contextual values. The variable format is json-serialized: { "path": "/some/path/to/file", "fmt": "root@corp.com %%HOSTNAME%%@corp.com", "uid": 500, "gid": 500, } Wildcards: %%ENV:VARNAME%% Any environment variable value %%HOSTNAME%% Hostname %%SHORT_HOSTNAME%% Short hostname """ import os import sys import json import stat import re import urllib import tempfile import pwd import grp from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class InitError(Exception): pass class CompFiles(object): def __init__(self, prefix='OSVC_COMP_FILES_'): self.prefix = prefix.upper() self._usr = {} self._grp = {} self.sysname, self.nodename, x, x, self.machine = os.uname() self.files = [] if "OSVC_COMP_SERVICES_SVC_NAME" not in os.environ: os.environ["OSVC_COMP_SERVICES_SVC_NAME"] = "" for k in [ key for key in os.environ if key.startswith(self.prefix)]: try: self.files += self.add_file(os.environ[k]) except InitError: continue except ValueError: print >>sys.stderr, 'failed to parse variable', os.environ[k] if len(self.files) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() def subst(self, v): if type(v) == list: l = [] for _v in v: l.append(self.subst(_v)) return l if type(v) != str and type(v) != unicode: return v p = re.compile('%%ENV:\w+%%') for m in p.findall(v): s = m.strip("%").replace('ENV:', '') if s in os.environ: _v = os.environ[s] elif 'OSVC_COMP_'+s in os.environ: _v = os.environ['OSVC_COMP_'+s] else: print >>sys.stderr, s, 'is not an env variable' raise NotApplicable() v = v.replace(m, _v) return v def parse_fmt(self, d): if isinstance(d['fmt'], int): d['fmt'] = str(d['fmt'])+'\n' d['fmt'] = d['fmt'].replace('%%HOSTNAME%%', self.nodename) d['fmt'] = d['fmt'].replace('%%SHORT_HOSTNAME%%', self.nodename.split('.')[0]) if not d['fmt'].endswith('\n'): d['fmt'] += '\n' return [d] def parse_ref(self, d): f = tempfile.NamedTemporaryFile() tmpf = f.name try: fname, headers = urllib.urlretrieve(d['ref'], tmpf) except IOError: import traceback e = sys.exc_info() print >>sys.stderr, "can not download", d['ref'], ":", e[1] raise InitError() if 'invalid file' in headers.values(): print >>sys.stderr, d['ref'], "not found on collector" raise InitError() d['fmt'] = f.read() f.close() return self.parse_fmt(d) def get_env_item(self, d, item): if item not in d: return d if type(d[item]) != str and type(d[item]) != unicode: return d if not d[item].startswith("%%"): return d s = d[item].strip('%').replace('ENV:', '') if not s.startswith('OSVC_COMP_'): s = 'OSVC_COMP_'+s if s not in os.environ: print >>sys.stderr, "%s is not set"%s raise d[item] = os.environ[s] try: d[item] = int(d[item]) except: pass return d def add_file(self, v): d = json.loads(v) if 'path' not in d: print >>sys.stderr, 'path should be in the dict:', d RET = RET_ERR return [] if 'fmt' not in d and 'ref' not in d and not d['path'].endswith("/"): print >>sys.stderr, 'fmt or ref should be in the dict:', d RET = RET_ERR return [] if 'fmt' in d and 'ref' in d: print >>sys.stderr, 'fmt and ref are exclusive:', d RET = RET_ERR return [] try: d = self.get_env_item(d, 'uid') d = self.get_env_item(d, 'gid') except: return [] for k in ('ref', 'path', 'uid', 'gid', 'fmt'): if k in d: d[k] = self.subst(d[k]) if 'fmt' in d: return self.parse_fmt(d) if 'ref' in d: return self.parse_ref(d) return [d] def fixable(self): return RET_NA def check_file_fmt(self, f, verbose=False): if not os.path.exists(f['path']): return RET_ERR if f['path'].endswith('/'): # don't check content if it's a directory return RET_OK if "OSVC_COMP_OS_VENDOR" in os.environ and os.environ['OSVC_COMP_OS_VENDOR'] in ("Linux"): cmd = ['diff', '-u', f['path'], '-'] else: cmd = ['diff', f['path'], '-'] p = Popen(cmd, stdin=PIPE, stdout=PIPE, stderr=PIPE) out, err = p.communicate(input=f['fmt']) if verbose and len(out) > 0: print >>sys.stderr, " ".join(cmd) print >>sys.stderr, out return p.returncode def check_file_mode(self, f, verbose=False): if 'mode' not in f: return RET_OK try: mode = oct(stat.S_IMODE(os.stat(f['path']).st_mode)) except: if verbose: print >>sys.stderr, f['path'], 'can not stat file' return RET_ERR mode = str(mode).lstrip("0") if mode != str(f['mode']): if verbose: print >>sys.stderr, f['path'], 'mode should be %s but is %s'%(f['mode'], mode) return RET_ERR return RET_OK def get_uid(self, uid): if uid in self._usr: return self._usr[uid] tuid = uid if isinstance(uid, (str, unicode)): try: info=pwd.getpwnam(uid) tuid = info[2] self._usr[uid] = tuid except: print >>sys.stderr, "user %s does not exist"%uid raise ComplianceError() return tuid def get_gid(self, gid): if gid in self._grp: return self._grp[gid] tgid = gid if isinstance(gid, (str, unicode)): try: info=grp.getgrnam(gid) tgid = info[2] self._grp[gid] = tgid except: print >>sys.stderr, "group %s does not exist"%gid raise ComplianceError() return tgid def check_file_uid(self, f, verbose=False): if 'uid' not in f: return RET_OK tuid = self.get_uid(f['uid']) uid = os.stat(f['path']).st_uid if uid != tuid: if verbose: print >>sys.stderr, f['path'], 'uid should be %s but is %s'%(tuid, str(uid)) return RET_ERR return RET_OK def check_file_gid(self, f, verbose=False): if 'gid' not in f: return RET_OK tgid = self.get_gid(f['gid']) gid = os.stat(f['path']).st_gid if gid != tgid: if verbose: print >>sys.stderr, f['path'], 'gid should be %s but is %s'%(tgid, str(gid)) return RET_ERR return RET_OK def check_file(self, f, verbose=False): if not os.path.exists(f['path']): print >>sys.stderr, f['path'], "does not exist" return RET_ERR r = 0 r |= self.check_file_fmt(f, verbose) r |= self.check_file_mode(f, verbose) r |= self.check_file_uid(f, verbose) r |= self.check_file_gid(f, verbose) if r == 0 and verbose: print f['path'], "is ok" return r def fix_file_mode(self, f): if 'mode' not in f: return RET_OK if self.check_file_mode(f) == RET_OK: return RET_OK try: print "%s mode set to %s"%(f['path'], str(f['mode'])) os.chmod(f['path'], int(str(f['mode']), 8)) except: return RET_ERR return RET_OK def fix_file_owner(self, f): uid = -1 gid = -1 if 'uid' not in f and 'gid' not in f: return RET_OK if 'uid' in f and self.check_file_uid(f) != RET_OK: uid = self.get_uid(f['uid']) if 'gid' in f and self.check_file_gid(f) != RET_OK: gid = self.get_gid(f['gid']) if uid == -1 and gid == -1: return RET_OK try: os.chown(f['path'], uid, gid) except: print >>sys.stderr, "failed to set %s ownership to %d:%d"%(f['path'], uid, gid) return RET_ERR print "%s ownership set to %d:%d"%(f['path'], uid, gid) return RET_OK def fix_file_fmt(self, f): if f['path'].endswith("/") and not os.path.exists(f['path']): try: os.makedirs(f['path']) print f['path'], "created" except: print >>sys.stderr, "failed to create", f['path'] return RET_ERR return RET_OK if self.check_file_fmt(f) == RET_OK: return RET_OK d = os.path.dirname(f['path']) if not os.path.exists(d): os.makedirs(d) try: os.chown(d, f['uid'], f['gid']) except: pass try: with open(f['path'], 'w') as fi: fi.write(f['fmt']) except: return RET_ERR print f['path'], "rewritten" return RET_OK def check(self): r = 0 for f in self.files: r |= self.check_file(f, verbose=True) return r def fix(self): r = 0 for f in self.files: r |= self.fix_file_fmt(f) r |= self.fix_file_mode(f) r |= self.fix_file_owner(f) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompFiles(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except ComplianceError: sys.exit(RET_ERR) except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 0707010002462e000081fd0000000000000000000000014faa9509000017db000000ae00010002ffffffffffffffff0000003600000000root/opt/opensvc/var/compliance/com.opensvc/groups.py#!/opt/opensvc/bin/python """ module use OSVC_COMP_GROUP_... vars which define {'groupname':{'propname':'propval',... }, ...} example: { "tibco":{"gid":1000,"members":"tibco,tibadm",}, "tibco1":{"gid":1001,"members":"tibco",}, } supported dictionnary keys: - gid dictionnary keys used by another module: - members """ import os import sys import json import grp from subprocess import Popen sys.path.append(os.path.dirname(__file__)) from comp import * class CompGroup(object): def __init__(self, prefix='OSVC_COMP_GROUP_'): self.prefix = prefix.upper() self.groupmod = 'groupmod' self.groupadd = 'groupadd' self.grt = { 'gid': 'gr_gid', } self.groupmod_p = { 'gid': '-g', } self.sysname, self.nodename, x, x, self.machine = os.uname() if self.sysname == 'AIX': self.groupmod = 'chgroup' self.groupadd = 'mkgroup' self.groupmod_p = { 'gid': 'id', } if self.sysname not in ['SunOS', 'Linux', 'HP-UX', 'AIX']: print >>sys.stderr, 'module not supported on', self.sysname raise NotApplicable self.groups = {} for k in [key for key in os.environ if key.startswith(self.prefix)]: try: self.groups.update(json.loads(os.environ[k])) except ValueError: print >>sys.stderr, 'group syntax error on var[', k, '] = ', os.environ[k] if len(self.groups) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable def fixable(self): return RET_NA def fmt_opt_gen(self, item, target): return [item, target] def fmt_opt_aix(self, item, target): return ['='.join((item, target))] def fmt_opt(self, item, target): if self.sysname == 'AIX': return self.fmt_opt_aix(item, target) else: return self.fmt_opt_gen(item, target) def fix_item(self, group, item, target): if item in self.groupmod_p: cmd = [getattr(self, 'groupmod')] cmd += self.fmt_opt(self.groupmod_p[item], str(target)) cmd += [group] print ' '.join(cmd) p = Popen(cmd) out, err = p.communicate() r = p.returncode if r == 0: return RET_OK else: return RET_ERR else: print >>sys.stderr, 'no fix implemented for', item return RET_ERR def check_item(self, group, item, target, current, verbose=False): if type(current) == int and current < 0: current += 4294967296 if target == current: if verbose: print 'group', group, item+':', current return RET_OK else: if verbose: print >>sys.stderr, 'group', group, item+':', current, 'target:', target return RET_ERR def try_create_group(self, props): # # don't try to create group if passwd db is not 'files' # beware: 'files' db is the implicit default # if 'db' in props and props['db'] != 'files': return False if set(self.grt.keys()) <= set(props.keys()): return True return False def check_group(self, group, props): r = 0 try: groupinfo = grp.getgrnam(group) except KeyError: if self.try_create_group(props): print >>sys.stderr, 'group', group, 'does not exist' return RET_ERR else: print 'group', group, 'does not exist and not enough info to create it' return RET_OK for prop in self.grt: if prop in props: r |= self.check_item(group, prop, props[prop], getattr(groupinfo, self.grt[prop]), verbose=True) return r def create_group(self, group, props): cmd = [getattr(self, 'groupadd')] for item in self.grt: cmd += self.fmt_opt(self.groupmod_p[item], str(props[item])) cmd += [group] print ' '.join(cmd) p = Popen(cmd) out, err = p.communicate() r = p.returncode if r == 0: return RET_OK else: return RET_ERR def fix_group(self, group, props): r = 0 try: groupinfo = grp.getgrnam(group) except KeyError: if self.try_create_group(props): return self.create_group(group, props) else: print >>sys.stderr, 'group', group, 'does not exist' return RET_OK for prop in self.grt: if prop in props and \ self.check_item(group, prop, props[prop], getattr(groupinfo, self.grt[prop])) != RET_OK: r |= self.fix_item(group, prop, props[prop]) return r def check(self): r = 0 for group, props in self.groups.items(): r |= self.check_group(group, props) return r def fix(self): r = 0 for group, props in self.groups.items(): r |= self.fix_group(group, props) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompGroup(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 0707010002462d000081fd0000000000000000000000014faa950900005307000000ae00010002ffffffffffffffff0000003200000000root/opt/opensvc/var/compliance/com.opensvc/fs.py#!/opt/opensvc/bin/python """ Verify file content. The collector provides the format with wildcards. The module replace the wildcards with contextual values. The variable format is json-serialized: [{ "dev": "lv_applisogm", "size": "1024M", "mnt": "/%%ENV:SVCNAME%%/applis/ogm", "vg": ["%%ENV:SVCNAME%%", "vgAPPLIS", "vgCOMMUN01", "vgLOCAL"] }] Wildcards: %%ENV:VARNAME%% Any environment variable value Toggle: %%ENV:FS_STRIP_SVCNAME_FROM_DEV_IF_IN_VG%% """ import os import sys import json import stat import re from subprocess import * from stat import * sys.path.append(os.path.dirname(__file__)) from comp import * class CompFs(object): def __init__(self, prefix='OSVC_COMP_FS_'): self.prefix = prefix.upper() self.sysname, self.nodename, x, x, self.machine = os.uname() self.sysname = self.sysname.replace('-', '') self.fs = [] self.res = {} self.res_status = {} if 'OSVC_COMP_SERVICES_SVC_NAME' in os.environ: self.svcname = os.environ['OSVC_COMP_SERVICES_SVC_NAME'] self.osvc_service = True else: os.environ['OSVC_COMP_SERVICES_SVC_NAME'] = "" self.svcname = None self.osvc_service = False self.vglist() for k in [ key for key in os.environ if key.startswith(self.prefix)]: try: self.fs += self.add_fs(os.environ[k]) except ValueError: print >>sys.stderr, 'failed to parse variable', os.environ[k] if len(self.fs) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() self.fs.sort(lambda x, y: cmp(x['mnt'], y['mnt'])) def vglist_HPUX(self): import glob l = glob.glob("/dev/*/group") l = map(lambda x: x.split('/')[2], l) self.vg = l def vglist_Linux(self): cmd = ['vgs', '-o', 'vg_name', '--noheadings'] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: raise self.vg = out.split() def vglist(self): if not hasattr(self, 'vglist_'+self.sysname): print >>sys.stderr, self.sysname, 'not supported' raise NotApplicable() getattr(self, 'vglist_'+self.sysname)() def subst(self, v): if type(v) == list: l = [] for _v in v: l.append(self.subst(_v)) return l if type(v) != str and type(v) != unicode: return v p = re.compile('%%ENV:\w+%%') for m in p.findall(v): s = m.strip("%").replace('ENV:', '') if s in os.environ: _v = os.environ[s] elif 'OSVC_COMP_'+s in os.environ: _v = os.environ['OSVC_COMP_'+s] else: print >>sys.stderr, s, 'is not an env variable' raise NotApplicable() v = v.replace(m, _v) return v.strip() def add_fs(self, v): if type(v) == str or type(v) == unicode: d = json.loads(v) else: d = v l = [] # recurse if multiple fs are specified in a list of dict if type(d) == list: for _d in d: l += self.add_fs(_d) return l if type(d) != dict: print >>sys.stderr, "not a dict:", d return l if 'dev' not in d: print >>sys.stderr, 'dev should be in the dict:', d return l if 'mnt' not in d: print >>sys.stderr, 'mnt should be in the dict:', d return l if 'size' not in d: print >>sys.stderr, 'size should be in the dict:', d return l if 'vg' not in d: print >>sys.stderr, 'vg should be in the dict:', d return l if 'type' not in d: print >>sys.stderr, 'type should be in the dict:', d return l if 'opts' not in d: print >>sys.stderr, 'opts should be in the dict:', d return l if type(d['vg']) != list: d['vg'] = [d['vg']] d['vg_orig'] = d['vg'] d['vg'] = self.subst(d['vg']) d['prefvg'] = self.prefvg(d) d['dev'] = self.strip_svcname(d) for k in ('dev', 'mnt', 'size', 'type', 'opts'): d[k] = self.subst(d[k]) d['mnt'] = self.normpath(d['mnt']) d['devpath'] = self.devpath(d) d['rdevpath'] = self.rdevpath(d) d['size'] = self.size_to_mb(d) return [d] def strip_svcname(self, fs): key = "OSVC_COMP_FS_STRIP_SVCNAME_FROM_DEV_IF_IN_VG" if key not in os.environ or os.environ[key] != "true": return fs['dev'] if "%%ENV:SERVICES_SVC_NAME%%" not in fs['vg_orig'][fs['prefvg_idx']]: return fs['dev'] # the vg is dedicated to the service. no need to embed # the service name in the lv name too s = fs['dev'].replace("%%ENV:SERVICES_SVC_NAME%%", "") if s == "lv_": s = "root" return s def normpath(self, p): l = p.split('/') p = os.path.normpath(os.path.join(os.sep, *l)) return p def rdevpath(self, d): return '/dev/%s/r%s'%(d['prefvg'], d['dev']) def devpath(self, d): return '/dev/%s/%s'%(d['prefvg'], d['dev']) def prefvg(self, d): lc_candidate_vg = map(lambda x: x.lower(), d['vg']) lc_existing_vg = map(lambda x: x.lower(), self.vg) for i, vg in enumerate(lc_candidate_vg): if vg in lc_existing_vg: d['prefvg_idx'] = i # return capitalized vg name return self.vg[lc_existing_vg.index(vg)] print >>sys.stderr, "no candidate vg is available on this node for dev %s"%d['dev'] raise NotApplicable() def check_fs_mnt(self, fs, verbose=False): if not os.path.exists(fs['mnt']): if verbose: print >>sys.stderr, "mount point", fs['mnt'], "does not exist" return 1 if verbose: print "mount point", fs['mnt'], "exists" return 0 def check_fs_dev_exists(self, fs, verbose=False): if not os.path.exists(fs['devpath']): if verbose: print >>sys.stderr, "device", fs['devpath'], "does not exist" return 1 if verbose: print "device", fs['devpath'], "exists" return 0 def check_fs_dev_stat(self, fs, verbose=False): mode = os.stat(fs['devpath'])[ST_MODE] if not S_ISBLK(mode): if verbose: print >>sys.stderr, "device", fs['devpath'], "is not a block device" return 1 if verbose: print "device", fs['devpath'], "is a block device" return 0 def find_vg_rid(self, vgname): rids = [ rid for rid in self.res_status.keys() if rid.startswith('vg#') ] for rid in rids: if self.get_res_item(rid, 'vgname') == vgname: return rid return None def private_svc_vg_down(self, fs): if self.svcname is None or not self.osvc_service: return False rid = self.find_vg_rid(fs['prefvg']) if rid is None: # vg is not driven by the service return False if self.res_status[rid] not in ('up', 'stdby up'): return False return True def check_fs_dev(self, fs, verbose=False): if self.private_svc_vg_down(fs): # don't report error on passive node with private svc prefvg return 0 if self.check_fs_dev_exists(fs, verbose) == 1: return 1 if self.check_fs_dev_stat(fs, verbose) == 1: return 1 return 0 def fix_fs_dev(self, fs): if self.check_fs_dev(fs, False) == 0: return 0 if self.check_fs_dev_exists(fs, False) == 0: print >>sys.stderr, "device", fs['devpath'], "already exists. won't fix." return 1 return self.createlv(fs) def createlv(self, fs): if not hasattr(self, 'createlv_'+self.sysname): print >>sys.stderr, self.sysname, 'not supported' raise NotApplicable() return getattr(self, 'createlv_'+self.sysname)(fs) def size_to_mb(self, fs): s = fs['size'] unit = s[-1] size = int(s[:-1]) if unit == 'T': s = str(size*1024*1024) elif unit == 'G': s = str(size*1024) elif unit == 'M': s = str(size) elif unit == 'K': s = str(size//1024) else: print >>sys.stderr, "unknown size unit in rule: %s (use T, G, M or K)"%s raise CompError() return s def createlv_HPUX(self, fs): cmd = ['lvcreate', '-n', fs['dev'], '-L', fs['size'], fs['prefvg']] print ' '.join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if len(out) > 0: print out if len(err) > 0: print err if p.returncode != 0: return 1 return 0 def createlv_Linux(self, fs): os.environ["LVM_SUPPRESS_FD_WARNINGS"] = "1" cmd = ['lvcreate', '-n', fs['dev'], '-L', fs['size']+'M', fs['prefvg']] print ' '.join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if len(out) > 0: print out if len(err) > 0: print err if p.returncode != 0: return 1 return 0 def fix_fs_mnt(self, fs, verbose=False): if self.check_fs_mnt(fs, False) == 0: return 0 print "create", fs['mnt'], "mount point" os.makedirs(fs['mnt']) return 0 def check_fs_fmt_HPUX_vxfs(self, fs, verbose=False): cmd = ['fstyp', fs['devpath']] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0 or "vxfs" not in out: if verbose: print >>sys.stderr, fs['devpath'], "is not formatted" return 1 if verbose: print fs['devpath'], "is correctly formatted" return 0 def check_fs_fmt_HPUX(self, fs, verbose=False): if fs['type'] == 'vxfs': return self.check_fs_fmt_HPUX_vxfs(fs, verbose) print >>sys.stderr, "unsupported fs type: %s"%fs['type'] return 1 def check_fs_fmt_Linux(self, fs, verbose=False): if fs['type'] in ('ext2', 'ext3', 'ext4'): return self.check_fs_fmt_Linux_ext(fs, verbose) print >>sys.stderr, "unsupported fs type: %s"%fs['type'] return 1 def check_fs_fmt_Linux_ext(self, fs, verbose=False): cmd = ['tune2fs', '-l', fs['devpath']] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: if verbose: print >>sys.stderr, fs['devpath'], "is not formatted" return 1 if verbose: print fs['devpath'], "is correctly formatted" return 0 def fix_fs_fmt_Linux_ext(self, fs): cmd = ['mkfs.'+fs['type'], '-q', '-b', '4096', fs['devpath']] print ' '.join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if len(out) > 0: print out if len(err) > 0: print err if p.returncode != 0: return 1 cmd = ['tune2fs', '-m', '0', '-c', '0', '-i', '0', fs['devpath']] print ' '.join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if len(out) > 0: print out if len(err) > 0: print err if p.returncode != 0: return 1 return 0 def fix_fs_fmt_Linux(self, fs): if fs['type'] in ('ext2', 'ext3', 'ext4'): return self.fix_fs_fmt_Linux_ext(fs) print >>sys.stderr, "unsupported fs type: %s"%fs['type'] return 1 def check_fs_fmt(self, fs, verbose=False): if not hasattr(self, 'check_fs_fmt_'+self.sysname): print >>sys.stderr, self.sysname, 'not supported' raise NotApplicable() return getattr(self, 'check_fs_fmt_'+self.sysname)(fs, verbose) def fix_fs_fmt_HPUX_vxfs(self, fs): cmd = ['newfs', '-F', 'vxfs', '-b', '8192', fs['rdevpath']] print ' '.join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if len(out) > 0: print out if len(err) > 0: print err if p.returncode != 0: return 1 return 0 def fix_fs_fmt_HPUX(self, fs): if fs['type'] == 'vxfs': return self.fix_fs_fmt_HPUX_vxfs(fs) print >>sys.stderr, "unsupported fs type: %s"%fs['type'] return 1 if not hasattr(self, 'check_fs_fmt_'+self.sysname): print >>sys.stderr, self.sysname, 'not supported' raise NotApplicable() return getattr(self, 'check_fs_fmt_'+self.sysname)(fs, verbose) def fix_fs_fmt(self, fs): if self.check_fs_fmt(fs) == 0: return 0 if not hasattr(self, 'fix_fs_fmt_'+self.sysname): print >>sys.stderr, self.sysname, 'not supported' raise NotApplicable() return getattr(self, 'fix_fs_fmt_'+self.sysname)(fs) def get_res_item(self, rid, item): cmd = ['/opt/opensvc/bin/svcmgr', '-s', self.svcname, 'get', '--param', '.'.join((rid, item))] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: print >>sys.stderr, ' '.join(cmd), 'failed' return 1 return out.strip() def get_res(self, rid): if rid in self.res: return self.res[rid] d = {} d['mnt'] = self.get_res_item(rid, 'mnt') d['dev'] = self.get_res_item(rid, 'dev') self.res[rid] = d return d def get_fs_rids(self, refresh=False): if not refresh and hasattr(self, 'rids'): return self.rids cmd = ['/opt/opensvc/bin/svcmgr', '-s', self.svcname, 'json_status'] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() try: # json_status returns 0, even when it outs no data self.res_status = json.loads(out)['resources'] except: self.rids = [] self.osvc_service = False return self.rids self.rids = [ k for k in self.res_status.keys() if k.startswith('fs#') ] return self.rids def find_rid(self, fs): found = False for rid in self.rids: d = self.get_res(rid) if d['mnt'] == fs['mnt'] and d['dev'] == fs['devpath']: return rid return None def fix_fs_local(self, fs): if self.svcname is not None and self.osvc_service: return 0 if self.check_fs_local(fs, False) == 0: return 0 with open("/etc/fstab", "r") as f: lines = f.read().split('\n') if len(lines[-1]) == 0: del(lines[-1]) p = re.compile(r'\s*%s\s+'%(fs['devpath'])) newline = "%s %s %s %s 0 2"%(fs['devpath'], fs['mnt'], fs['type'], fs['opts']) for i, line in enumerate(lines): if line == newline: return 0 if re.match(p, line) is not None: print "remove '%s' from fstab"%line del lines[i] lines.append(newline) print "append '%s' to fstab"%newline try: with open("/etc/fstab", "w") as f: f.write("\n".join(lines)+'\n') except: print >>sys.stderr, "failed to rewrite fstab" return 1 print "fstab rewritten" return 0 def check_fs_local(self, fs, verbose=False): if self.svcname is not None and self.osvc_service: return 0 p = re.compile(r'\s*%s\s+%s'%(fs['devpath'], fs['mnt'])) with open("/etc/fstab", "r") as f: buff = f.read() if re.search(p, buff) is not None: if verbose: print "%s@%s resource correctly set in fstab"%(fs['mnt'], fs['devpath']) return 0 if verbose: print >>sys.stderr, "%s@%s resource correctly set in fstab"%(fs['mnt'], fs['devpath']) return 1 def check_fs_svc(self, fs, verbose=False): if self.svcname is None: return 0 rids = self.get_fs_rids() if not self.osvc_service: return 0 rid = self.find_rid(fs) if rid is None: if verbose: print >>sys.stderr, "%s@%s resource not found in service %s"%(fs['mnt'], fs['devpath'], self.svcname) return 1 if verbose: print "%s@%s resource correctly set in service %s"%(fs['mnt'], fs['devpath'], self.svcname) return 0 def fix_fs_svc(self, fs): if not self.osvc_service or self.check_fs_svc(fs, False) == 0: return 0 cmd = ['/opt/opensvc/bin/svcmgr', '-s', self.svcname, 'update', '--resource', '{"rtype": "fs", "mnt": "%s", "dev": "%s", "type": "%s", "mntopt": "%s"}'%(fs['mnt'], fs['devpath'], fs['type'], fs['opts'])] print ' '.join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: print >>sys.stderr, "unable to fetch %s json status"%self.svcname return 1 return 0 def check_fs_mounted(self, fs, verbose=False): if os.path.ismount(fs['mnt']): if verbose: print fs['mnt'], "is mounted" return 0 if verbose: print >>sys.stderr, fs['mnt'], "is not mounted" return 1 def fix_fs_mounted(self, fs): if self.check_fs_mounted(fs, False) == 0: return 0 if self.svcname is None or not self.osvc_service: return self.fix_fs_mounted_local(fs) else: return self.fix_fs_mounted_svc(fs) def fix_fs_mounted_svc(self, fs): rids = self.get_fs_rids(refresh=True) rid = self.find_rid(fs) if rid is None: print >>sys.stderr, "fs resource with mnt=%s not found in service %s"%(fs['mnt'], self.svcname) return 1 cmd = ['/opt/opensvc/bin/svcmgr', '-s', self.svcname, '--rid', rid, 'mount', '--cluster'] print ' '.join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: print >>sys.stderr, "unable to mount %s"%fs['mnt'] return 1 return 0 def fix_fs_mounted_local(self, fs): cmd = ['mount', fs['mnt']] print ' '.join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if len(out) > 0: print out if len(err) > 0: print >>sys.stderr, err if p.returncode != 0: print >>sys.stderr, "unable to mount %s"%fs['mnt'] return 1 return 0 def check_fs(self, fs, verbose=False): r = 0 r |= self.check_fs_mnt(fs, verbose) r |= self.check_fs_dev(fs, verbose) r |= self.check_fs_fmt(fs, verbose) r |= self.check_fs_svc(fs, verbose) r |= self.check_fs_local(fs, verbose) r |= self.check_fs_mounted(fs, verbose) return r def fix_fs(self, fs): if self.fix_fs_mnt(fs) != 0: return 1 if self.fix_fs_dev(fs) != 0: return 1 if self.fix_fs_fmt(fs) != 0: return 1 if self.fix_fs_svc(fs) != 0: return 1 if self.fix_fs_local(fs) != 0: return 1 if self.fix_fs_mounted(fs) != 0: return 1 return 0 def fixable(self): return RET_NA def check(self): r = 0 for f in self.fs: r |= self.check_fs(f, verbose=True) return r def fix(self): r = 0 for f in self.fs: r |= self.fix_fs(f) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompFs(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024632000081fd0000000000000000000000014faa950900000cfe000000ae00010002ffffffffffffffff0000003200000000root/opt/opensvc/var/compliance/com.opensvc/rc.py#!/opt/opensvc/bin/python """ [{"service": "foo", "level": "2345", "state": "on"}, {"service": "foo", "level": "016", "state": "off"}, {"service": "bar", "state": "on"}, ...] """ import os import sys import json import pwd from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class CompRc(object): def __init__(self, prefix='OSVC_COMP_RC_'): self.prefix = prefix.upper() self.sysname, self.nodename, x, x, self.machine = os.uname() self.services = [] for k in [key for key in os.environ if key.startswith(self.prefix)]: try: self.services += json.loads(os.environ[k]) except ValueError: print >>sys.stderr, 'failed to concatenate', os.environ[k], 'to service list' self.validate_svcs() if len(self.services) == 0: print "no applicable variable found in rulesets", self.prefix raise NotApplicable() if self.sysname not in ['Linux']: print >>sys.stderr, __file__, 'module not supported on', self.sysname raise NotApplicable() vendor = os.environ['OSVC_COMP_NODES_OS_VENDOR'] if vendor in ['CentOS', 'Redhat', 'Red Hat']: import chkconfig self.o = chkconfig.Chkconfig() else: print >>sys.stderr, vendor, "not supported" raise NotApplicable() def validate_svcs(self): l = [] for svc in self.services: if self.validate_svc(svc) == RET_OK: l.append(svc) self.svcs = l def validate_svc(self, svc): if 'service' not in svc: print >>sys.stderr, svc, ' rule is malformed ... service key not present' return RET_ERR if 'state' not in svc: print >>sys.stderr, svc, ' rule is malformed ... state key not present' return RET_ERR return RET_OK def check_svc(self, svc, verbose=True): return self.o.check_state(svc['service'], svc['level'], svc['state'], verbose=verbose) def fix_svc(self, svc, verbose=True): if self.check_svc(svc, verbose=False) == RET_OK: return RET_OK return self.o.fix_state(svc['service'], svc['level'], svc['state']) def check(self): r = 0 for svc in self.services: r |= self.check_svc(svc) return r def fix(self): r = 0 for svc in self.services: r |= self.fix_svc(svc) return r if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompRc(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024629000081fd0000000000000000000000014faa950900001d82000000ae00010002ffffffffffffffff0000003400000000root/opt/opensvc/var/compliance/com.opensvc/cron.py#!/opt/opensvc/bin/python import os import sys import shutil import glob from subprocess import * sys.path.append(os.path.dirname(__file__)) from comp import * class CompCron(object): def __init__(self, prefix='OSVC_COMP_CRON_ENTRY_'): self.prefix = prefix.upper() self.ce = [] self.sysname, self.nodename, x, x, self.machine = os.uname() if self.sysname == 'SunOS' : self.crontab_locs = [ '/var/spool/cron/crontabs' ] else: self.crontab_locs = [ '/etc/cron.d', '/var/spool/cron/crontabs', '/var/spool/cron', '/var/cron/tabs', ] for k in os.environ: if k[:len(prefix)] == prefix: e = os.environ[k].split(':') if len(e) < 5: print >>sys.stderr, "malformed variable %s. format: action:user:sched:cmd:[file]"%k continue if e[0] not in ('add', 'del'): print >>sys.stderr, "unsupported action in variable %s. set 'add' or 'del'"%k continue if len(e[2].split()) != 5: print >>sys.stderr, "malformed schedule in variable %s"%k continue self.ce += [{ 'var': k, 'action': e[0], 'user': e[1], 'sched': e[2], 'cmd': e[3], 'file': e[4], }] if len(self.ce) == 0: print "no applicable variable found in rulesets" raise NotApplicable() def activate_cron(self, cron_file): """ Activate changes (actually only needed on HP-UX) """ if '/var/spool/' in cron_file: print "tell crond about the change" cmd = ['crontab', cron_file] process = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) buff = process.communicate() def fixable(self): r = RET_OK for e in self.ce: try: self._fixable_cron(e) except ComplianceError, e: print >>sys.stderr, str(e) r = RET_ERR except Unfixable, e: print >>sys.stderr, str(e) return r return r def fix(self): r = RET_OK for e in self.ce: try: if e['action'] == 'add': self._add_cron(e) elif e['action'] == 'del': self._del_cron(e) except ComplianceError, e: print >>sys.stderr, str(e) r = RET_ERR except Unfixable, e: print >>sys.stderr, str(e) return r return r def check(self): r = RET_OK for e in self.ce: try: self._check_cron(e) except ComplianceError, e: print >>sys.stderr, str(e) r = RET_ERR except Unfixable, e: print >>sys.stderr, str(e) return r return r def get_cron_file(self, e): """ order of preference """ cron_file = None for loc in self.crontab_locs: if not os.path.exists(loc): continue if loc == '/etc/cron.d': cron_file = os.path.join(loc, e['file']) else: cron_file = os.path.join(loc, e['user']) break return cron_file def format_entry(self, cron_file, e): if 'cron.d' in cron_file: s = ' '.join([e['sched'], e['user'], e['cmd']]) else: s = ' '.join([e['sched'], e['cmd']]) return s def _fixable_cron(self, e): cron_file = self.get_cron_file(e) if cron_file is None: raise Unfixable("no crontab usual location found (%s)"%str(self.crontab_locs)) def _check_cron(self, e): cron_file = self.get_cron_file(e) if cron_file is None: raise Unfixable("no crontab usual location found (%s)"%str(self.crontab_locs)) s = self.format_entry(cron_file, e) if not os.path.exists(cron_file): raise ComplianceError("cron entry not found '%s' in '%s'"%(s, cron_file)) with open(cron_file, 'r') as f: new = f.readlines() found = False for line in new: if s == line[:-1]: found = True break if not found and e['action'] == 'add': raise ComplianceError("wanted cron entry not found: '%s' in '%s'"%(s, cron_file)) if found and e['action'] == 'del': raise ComplianceError("unwanted cron entry found: '%s' in '%s'"%(s, cron_file)) def _del_cron(self, e): cron_file = self.get_cron_file(e) if cron_file is None: raise Unfixable("no crontab usual location found (%s)"%str(self.crontab_locs)) s = self.format_entry(cron_file, e) if not os.path.exists(cron_file): return new = [] with open(cron_file, 'r') as f: lines = f.readlines() for line in lines: if s == line[:-1]: print "delete entry '%s' from '%s'"%(s, cron_file) continue new.append(line) if len(new) == 0: print 'deleted last entry of %s. delete file too.'%cron_file os.unlink(cron_file) else: with open(cron_file, 'w') as f: f.write(''.join(new)) self.activate_cron(cron_file) def _add_cron(self, e): cron_file = self.get_cron_file(e) if cron_file is None: raise Unfixable("no crontab usual location found (%s)"%str(self.crontab_locs)) s = self.format_entry(cron_file, e) new = False if os.path.exists(cron_file): with open(cron_file, 'r') as f: new = f.readlines() found = False for line in new: if s == line[:-1]: found = True break if not found: new.append(s+'\n') else: new = [s+'\n'] if not new: raise ComplianceError("problem preparing the new crontab '%s'"%cron_file) print "add entry '%s' to '%s'"%(s, cron_file) with open(cron_file, 'w') as f: f.write(''.join(new)) self.activate_cron(cron_file) if __name__ == "__main__": syntax = """syntax: %s PREFIX check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 3: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) try: o = CompCron(sys.argv[1]) if sys.argv[2] == 'check': RET = o.check() elif sys.argv[2] == 'fix': RET = o.fix() elif sys.argv[2] == 'fixable': RET = o.fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[2] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 07070100024627000081fd0000000000000000000000014faa950900000d60000000ae00010002ffffffffffffffff0000003900000000root/opt/opensvc/var/compliance/com.opensvc/chkconfig.pyfrom subprocess import * import sys class InitError(Exception): pass class UnknownService(Exception): pass class SetError(Exception): pass class Chkconfig(object): def __init__(self): self.load() def __str__(self): s = "" for svc in self.services: s += "%-20s %s\n"%(svc, ' '.join(map(lambda x: '%-4s'%x, self.services[svc]))) return s def load(self): self.services = {} p = Popen(['/sbin/chkconfig', '--list'], stdout=PIPE) out, err = p.communicate() if p.returncode != 0: raise InitError() for line in out.split('\n'): words = line.split() if len(words) != 8: continue self.services[words[0]] = [] for w in words[1:]: level, state = w.split(':') self.services[words[0]].append(state) def load_one(self, service): p = Popen(['/sbin/chkconfig', '--list', service], stdout=PIPE) out, err = p.communicate() if p.returncode != 0: if 'not referenced' in out: self.services[service] = ['off', 'off', 'off', 'off', 'off', 'off'] return raise InitError() def activate(self, service): p = Popen(['chkconfig', service, 'on'], stdout=PIPE) out, err = p.communicate() if p.returncode != 0: raise SetError() def set_state(self, service, level, state): curstate = self.get_state(service, level) if curstate == state: return p = Popen(['chkconfig', '--level', level, service, state], stdout=PIPE) out, err = p.communicate() if p.returncode != 0: raise SetError() def get_state(self, service, level): if service not in self.services: try: self.load_one(service) except InitError: pass if service not in self.services: raise UnknownService() return self.services[service][level] def check_state(self, service, levels, state, verbose=False): r = 0 for level in levels: try: level = int(level) except: continue try: curstate = self.get_state(service, level) except UnknownService: if verbose: print >>sys.stderr, "can not get service", service, "runlevels" return 1 if curstate != state: if verbose: print >>sys.stderr, "service", service, "at runlevel", level, "is in state", curstate, "! target state is", state r |= 1 else: print "service", service, "at runlevel", level, "is in state", curstate return r def fix_state(self, service, levels, state): cmd = ['chkconfig', '--level', levels, service, state] print "exec:", ' '.join(cmd) p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: print >>sys.stderr, "failed to set", service, "runlevels" print out print >>sys.stderr, err return 1 return 0 if __name__ == "__main__": o = Chkconfig() print o print 'xfs@rc3 =', o.get_state('xfs', 3) 070701000244e6000041ed0000000000000000000000044faab5bf00000000000000ae00010002ffffffffffffffff0000001500000000root/opt/opensvc/bin070701000244e7000041ed0000000000000000000000024faab5bf00000000000000ae00010002ffffffffffffffff0000001a00000000root/opt/opensvc/bin/cron070701000244e8000081fd0000000000000000000000014faa95090000069a000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/bin/cron/opensvc#!/opt/opensvc/bin/python # # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import sys import os """ When installed in /etc/cron.daily/ this must be a symlink to the file in the opensvc distrib, wherever installed, so that we can compute relative paths to locate libs """ pathsvc = os.path.realpath(os.path.join(os.path.dirname(__file__), '..', '..')) pathlib = os.path.join(pathsvc, 'lib') sys.path.append(pathlib) import node n = node.Node() n.options.cron = True for action in ["pushstats", "pushpkg", "pushpatch", "pushservices", "pushasset", "checks", "syncservices", "compliance_check", "push_appinfo", "pushdisks"]: try: n.action(action) except: import traceback traceback.print_exc() for s in n.svcs: s.cron = True try: s.action('compliance_check') except: import traceback traceback.print_exc() n.close() 070701000244f4000081fd0000000000000000000000014faa950900000ef4000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/bin/perfagt.Linux#!/opt/opensvc/bin/python import os import sys import datetime pathsvc = os.path.realpath(os.path.join(os.path.dirname(__file__), '..')) sys.path.append(os.path.join(pathsvc, 'lib')) import node from rcUtilities import justcall, which node = node.Node() now = str(datetime.datetime.now()) def fs_u(): vars = ['date', 'nodename', 'mntpt', 'size', 'used'] cmd = ['df', '-lP'] (out, err, ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef vals = [] for line in lines[1:]: l = line.split() if len(l) != 6: continue vals.append([now, node.nodename, l[5], l[1], l[4].replace('%','')]) return (vars, vals) node.collector.call('push_stats_fs_u', fs_u()) """ xentop NAME STATE CPU(sec) CPU(%) MEM(k) MEM(%) MAXMEM(k) MAXMEM(%) VCPUS NETS NETTX(k) NETRX(k) VBDS VBD_OO VBD_RD VBD_WR VBD_RSECT VBD_WSECT SSID """ def xentop(node): import os, sys, platform import select import logging import time import datetime import subprocess if not which('xentop'): return node.build_services() svcnames = {} for svc in node.svcs: if hasattr(svc, 'vmuuid') and svc.svcmode in ("ovm", "xen"): svcnames[svc.vmuuid] = svc.svcname zs_d = os.path.join(pathsvc, 'log', 'xentop') zs_prefix = 'xentop' zs_f = os.path.join(zs_d, zs_prefix + datetime.datetime.now().strftime("%d")) datenow = datetime.datetime.now().strftime("%Y-%m-%d %H:%M:%S") n = datetime.datetime.now() tn = time.mktime(n.timetuple()) if not os.path.exists(zs_d): os.makedirs(zs_d) try: t = os.path.getmtime(zs_f) d = tn - t except: d = 0 if d > 27*24*3600: os.remove(zs_f) f = open(zs_f, "a") stor = {} p = subprocess.Popen('xentop -b -d.1 -i2 -f', stdout=subprocess.PIPE, stderr=subprocess.STDOUT, shell=True, bufsize=0) out = p.stdout.readline() pr = 0 while out: line = out line = line.rstrip("\n") if "NAME" in line: pr += 1 out = p.stdout.readline() continue line = line.replace("no limit", "0") fields = line.split() if len(fields) == 19 and pr > 1: uuid = fields[0] if uuid in svcnames: uuid = svcnames[uuid] stor[uuid] = { 'STATE': fields[1], 'CPU_SEC': fields[2], 'CPU_PCT': fields[3], 'MEM': str(int(fields[4])//1024), 'MEM_PCT': fields[5], 'MEM_MAX': str(int(fields[6])//1024), 'MEM_MAX_PCT': fields[7], 'VCPUS': fields[8], 'NETS': fields[9], 'NET_TX': fields[10], 'NET_RX': fields[11], 'VBDS': fields[12], 'VBD_OO': fields[13], 'VBD_RD': fields[14], 'VBD_WR': fields[15], 'VBD_RSECT': fields[16], 'VBD_WSECT': fields[17], 'SSID': fields[18] } print >>f, datenow, uuid, stor[uuid]['STATE'], stor[uuid]['CPU_SEC'], stor[uuid]['CPU_PCT'], stor[uuid]['MEM'], stor[uuid]['MEM_PCT'], stor[uuid]['MEM_MAX'], stor[uuid]['MEM_MAX_PCT'], stor[uuid]['VCPUS'], stor[uuid]['NETS'], stor[uuid]['NET_TX'], stor[uuid]['NET_RX'], stor[uuid]['VBDS'], stor[uuid]['VBD_OO'], stor[uuid]['VBD_RD'], stor[uuid]['VBD_WR'], stor[uuid]['VBD_RSECT'], stor[uuid]['VBD_WSECT'], stor[uuid]['SSID'] out = p.stdout.readline() p.wait() xentop(node) node.close() 070701000244ed000081fd0000000000000000000000014faa95090000012c000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/bin/opensvc.init.FreeBSD#!/bin/sh # # PROVIDE: opensvc # REQUIRE: LOGIN sshd cleanvar # BEFORE: # KEYWORD: shutdown osvc_path=/opt/opensvc/bin osvc_opts="--parallel" allservices=${osvc_path}/allservices case $1 in faststart) ${allservices} ${osvc_opts} boot ;; faststop) ${allservices} ${osvc_opts} shutdown ;; esac 070701000244f1000081fd0000000000000000000000014faa9509000001dc000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/bin/opensvc.init.redhat#!/bin/bash # # /etc/rc.d/init.d/opensvc # # Starts the services driven by OpenSVC # # chkconfig: 345 99 01 # description: Starts the services driven by OpenSVC whose # autostart node is this node. # processname: # Source function library. . /etc/init.d/functions osvc_path=/opt/opensvc/bin osvc_opts="--parallel" allservices=${osvc_path}/allservices case $1 in start) ${allservices} ${osvc_opts} boot ;; stop) ${allservices} ${osvc_opts} shutdown ;; esac 070701000244eb000081fd0000000000000000000000014faa9509000000d1000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/bin/opensvc.init.AIX#!/bin/ksh osvc_path=/opt/opensvc/bin osvc_opts="--parallel" allservices=${osvc_path}/allservices case $1 in start) ${allservices} ${osvc_opts} boot ;; stop) ${allservices} ${osvc_opts} shutdown ;; esac 070701000244f2000081fd0000000000000000000000014faa9509000009db000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/bin/perfagt.Darwin#!/opt/opensvc/bin/python import os import sys import datetime pathsvc = os.path.realpath(os.path.join(os.path.dirname(__file__), '..')) sys.path.append(os.path.join(pathsvc, 'lib')) import node from rcUtilities import justcall node = node.Node() now = datetime.datetime.now() def fs_u(): vars = ['date', 'nodename', 'mntpt', 'size', 'used'] cmd = ['df', '-lkP'] (out, err, ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef vals = [] for line in lines[1:]: l = line.split() if len(l) != 6: continue if l[5].startswith('/Volumes'): # Darwin automount package files under /Volumes continue vals.append([str(now), node.nodename, l[5], l[1], l[4].replace('%','')]) return (vars, vals) def mem_u(): basedir = os.path.join(pathsvc, 'var', 'stats') if not os.path.exists(basedir): os.makedirs(basedir) fname = os.path.join(basedir, 'mem_u%0.2d'%now.day) if not os.path.exists(fname): try: f = open(fname, 'w') except: return else: mtime = os.stat(fname).st_mtime if datetime.datetime.fromtimestamp(mtime) < now - datetime.timedelta(days=1): os.unlink(fname) try: f = open(fname, 'w') except: return else: try: f = open(fname, 'a') except: return cmd = ['/usr/sbin/sysctl', '-n', 'hw.pagesize'] (out, err, ret) = justcall(cmd) if ret != 0: return pagesize = int(out.split()[0]) cmd = ['vm_stat'] (out, err, ret) = justcall(cmd) if ret != 0: return h = {} for line in out.split('\n'): l = line.split(':') if len(l) != 2: continue key = l[0] try: val = int(l[1].strip(' .')) except: continue h[key] = val f.write(' '.join((now.strftime('%H:%M:%S'), str(h['Pages free']*pagesize/1024), str(h['Pages active']*pagesize/1024), str(h['Pages inactive']*pagesize/1024), str(h['Pages speculative']*pagesize/1024), str(h['Pages wired down']*pagesize/1024) ))+'\n') node.collector.call('push_stats_fs_u', fs_u()) mem_u() 070701000244ea000081fd0000000000000000000000014faa9509000015c6000000ae00010002ffffffffffffffff0000001d00000000root/opt/opensvc/bin/nodemgr#!/opt/opensvc/bin/python # # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import sys import os import optparse # # add project lib to path # pathsvc = os.path.realpath(os.path.join(os.path.dirname(__file__), '..')) pathetc = os.path.join(pathsvc, 'etc') sys.path.append(os.path.join(pathsvc, 'lib')) prog = os.path.basename(__file__) import rcExceptions as ex from rcGlobalEnv import * from rcUtilities import check_privs, ximport check_privs() node_mod = ximport('node') try: from version import version except: version = "dev" n = node_mod.Node() __ver = prog + " version " + version __usage = "%prog [options] command\n\n" + n.format_desc() parser = optparse.OptionParser(version=__ver, usage=__usage) parser.add_option("--debug", default=False, action="store_true", dest="debug", help="debug mode") parser.add_option("--stats-dir", default=None, action="store", dest="stats_dir", help="points the directory where the metrics files are stored for pushstats") parser.add_option("--module", default="", action="store", dest="module", help="compliance, set module list") parser.add_option("--moduleset", default="", action="store", dest="moduleset", help="compliance, set moduleset list. The 'all' value can be used in conjonction with detach.") parser.add_option("--ruleset", default="", action="store", dest="ruleset", help="compliance, set ruleset list. The 'all' value can be used in conjonction with detach.") parser.add_option("--ruleset-date", default="", action="store", dest="ruleset_date", help="compliance, use rulesets valid on specified date") parser.add_option("--attach", default=False, action="store_true", dest="attach", help="attach the modulesets specified during a compliance check/fix/fixable command") parser.add_option("--cron", default=False, action="store_true", dest="cron", help="cron mode") parser.add_option("--force", default=False, action="store_true", dest="force", help="force action") parser.add_option("--symcli-db-file", default=None, action="store", dest="symcli_db_file", help="[pushsym option] use symcli offline mode with the specified file. aclx files are expected to be found in the same directory and named either .aclx or .aclx") parser.add_option("--param", default=None, action="store", dest="param", help="point a node configuration parameter for the 'get' and 'set' actions") parser.add_option("--value", default=None, action="store", dest="value", help="set a node configuration parameter value for the 'set --param' action") parser.add_option("--duration", default=None, action="store", dest="duration", type="int", help="a duration expressed in minutes. used with the 'collector ack action' action") parser.add_option("--begin", default=None, action="store", dest="begin", help="a begin date expressed as 'YYYY-MM-DD hh:mm'. used with the 'collector ack action' and pushstats action") parser.add_option("--end", default=None, action="store", dest="end", help="a end date expressed as 'YYYY-MM-DD hh:mm'. used with the 'collector ack action' and pushstats action") parser.add_option("--comment", default=None, action="store", dest="comment", help="a comment to log when used with the 'collector ack action' action") parser.add_option("--author", default=None, action="store", dest="author", help="the acker name to log when used with the 'collector ack action' action") parser.add_option("--id", default=0, action="store", dest="id", type="int", help="specify an id to act on") (options, args) = parser.parse_args() n.options = options def do_symcli_db_file(symcli_db_file): if symcli_db_file is None: return if not os.path.exists(symcli_db_file): print "File does not exist: %s"%symcli_db_file return os.environ['SYMCLI_DB_FILE'] = symcli_db_file os.environ['SYMCLI_OFFLINE'] = '1' do_symcli_db_file(options.symcli_db_file) if len(args) is 0: n.close() parser.error("Missing action") action = '_'.join(args) if not action in n.supported_actions(): n.close() parser.error("unsupported action: %s"%action) def _exit(r): n.close() sys.exit(r) err = 0 try: err = n.action(action) except KeyboardInterrupt: sys.stderr.write("Keybord Interrupt\n") err = 1 except ex.excError: import traceback exc_type, exc_value, exc_traceback = sys.exc_info() sys.stderr.write(str(exc_value)+'\n') err = 1 except: raise err = 1 _exit(err) 070701000244f3000081fd0000000000000000000000014faa950900000be9000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/bin/perfagt.HP-UX#!/opt/opensvc/bin/python import os import sys import datetime from subprocess import * pathsvc = os.path.realpath(os.path.join(os.path.dirname(__file__), '..')) sys.path.append(os.path.join(pathsvc, 'lib')) import node from rcUtilities import justcall, is_exe node = node.Node() now = str(datetime.datetime.now()) def fs_u(): vars = ['date', 'nodename', 'mntpt', 'size', 'used'] cmd = ['df', '-lP'] (out, err, ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef vals = [] for line in lines[1:]: l = line.split() if len(l) != 6: continue vals.append([now, node.nodename, l[5], l[1], l[4].replace('%','')]) return (vars, vals) def glance_running(cmd_str): (out, err, ret) = justcall(['ps', '-ef']) if ret != 0: print 'ps error' return for line in out.split('\n'): l = line.split() if len(l) < 6: continue if cmd_str in ' '.join(l[6:]): return True return False def run_glance(): glance = '/opt/perf/bin/glance' syn = '/opt/opensvc/tmp/glance.syntax' now = datetime.datetime.now() iterations = (23-now.hour)*6+(60-now.minute)//10 cmd = ['/opt/perf/bin/glance', '-aos', syn, '-j', '600', '-iterations'] cmd_str = ' '.join(cmd) if not is_exe(glance): print 'glance executable not found' return if glance_running(cmd_str): print 'glance is already running' return buff = """print GBL_STATTIME, // usr 0.00+GBL_CPU_NORMAL_UTIL+GBL_CPU_REALTIME_UTIL, // nice 0.00+GBL_CPU_NICE_UTIL+GBL_CPU_NNICE_UTIL, // sys 0.00+GBL_CPU_SYSCALL_UTIL+GBL_CPU_CSWITCH_UTIL+GBL_CPU_TRAP_UTIL+GBL_CPU_VFAULT_UTIL, // irq 0.00+GBL_CPU_INTERRUPT_UTIL, // wait 0.00+GBL_CPU_WAIT_UTIL, // idle 0.00+GBL_CPU_IDLE_UTIL-GBL_CPU_WAIT_UTIL, // mem 0+GBL_MEM_PHYS, 0+GBL_MEM_FREE, 0+GBL_MEM_CACHE, 0+GBL_MEM_FILE_PAGE_CACHE, 0+GBL_MEM_SYS, 0+GBL_MEM_USER, // swap 0+GBL_MEM_SWAP, 0+GBL_SWAP_SPACE_AVAIL-GBL_MEM_PHYS, // load GBL_LOADAVG, GBL_LOADAVG5, GBL_LOADAVG15, GBL_CPU_QUEUE, // process list TBL_PROC_TABLE_USED, // disk io GBL_DISK_PHYS_READ_RATE, GBL_DISK_PHYS_WRITE_RATE, // disk kB/s GBL_DISK_PHYS_READ_BYTE_RATE, GBL_DISK_PHYS_WRITE_BYTE_RATE """ try: with open(syn, 'w') as f: f.write(buff) except: print 'error writing %s'%syn return collect_d = '/opt/opensvc/var/' collect_f = 'glance%0.2d'%now.day collect_p = os.path.join(collect_d, collect_f) if os.path.exists(collect_p): mtime = os.stat(collect_p).st_mtime if datetime.datetime.fromtimestamp(mtime) < now - datetime.timedelta(days=1): os.unlink(collect_p) _cmd = 'nohup %s %d >>%s &'%(cmd_str, iterations, collect_p) process = Popen(_cmd, shell=True, stdout=PIPE, stderr=PIPE) run_glance() node.collector.call('push_stats_fs_u', fs_u()) node.close() 070701000244f0000081fd0000000000000000000000014faa9509000002e2000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/bin/opensvc.init.hpux#!/bin/sh PATH=/sbin:/usr/sbin:/bin:/usr/bin export PATH if [ -r /etc/rc.config.d/opensvc ] ; then . /etc/rc.config.d/opensvc fi osvc_path=/opt/opensvc/bin osvc_opts="--parallel" allservices=${osvc_path}/allservices agt=${osvc_path}/perfagt.`uname -s` case $1 in start_msg) if [ "$RUN_OPENSVC" -ne 0 ] ; then echo "Starting opensvc services" fi ;; start) if [ "$RUN_OPENSVC" -ne 0 ] ; then echo "Starting opensvc services" fi if [ -x $agt ] ; then $agt fi ${allservices} ${osvc_opts} boot ;; stop_msg) if [ "$RUN_OPENSVC" -ne 0 ] ; then echo "Shutting down opensvc services" fi ;; stop) if [ "$RUN_OPENSVC" -ne 0 ] ; then echo "Starting opensvc services" fi ${allservices} ${osvc_opts} shutdown ;; esac 070701000244ff000081fd0000000000000000000000014faa95090000169f000000ae00010002ffffffffffffffff0000001c00000000root/opt/opensvc/bin/svcmon#!/opt/opensvc/bin/python # # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import sys import os import optparse import string # # add project lib to path # pathsvc = os.path.realpath(os.path.join(os.path.dirname(__file__), '..')) pathetc = os.path.join(pathsvc, 'etc') sys.path.append(os.path.join(pathsvc, 'lib')) prog = os.path.basename(__file__) import svcBuilder import rcExceptions as ex from rcUtilities import * from lock import * import node try: from version import version except: version = "dev" def svcmon_verbose(svcs): for svc in svcs: try: svc.print_status() except: pass def max_len(svcs, attr): _len = 7 for svc in svcs: if _len < len(getattr(svc, attr)): _len = len(getattr(svc, attr)) return _len def svcmon_normal1(svc, upddb=False, fmt=None, queue=None): status = svc.group_status() print fmt % ( svc.svcname, svc.svctype, svc.svcmode, status["container"], status["ip"], status["disk"], status["fs"], status["app"], status["hb"], status["sync"], status["avail"], status["overall"], svc.frozen()) if upddb: if queue is None: # multiprocess Queue not supported, can't combine results g_vars, g_vals, r_vars, r_vals = svc.svcmon_push_lists(status) svc.node.collector.call('svcmon_update_combo', g_vars, g_vals, r_vars, r_vals) else: queue.put(svc.svcmon_push_lists(status)) def svcmon_normal(svcs, upddb=False): fmt = '%-' + str(max_len(svcs, "svcname")) + 's' fmt += ' %-7s %-9s %-9s %-9s %-10s %-10s %-10s %-9s %-9s %-10s %-10s %-6s' print fmt % ("service", "service", "container", "container", "ip ", "disk ", "fs ", "app ", "hb ", "sync ", "avail ", "overall", " ") print fmt % ("name ", "type ", "type ", "status ", "status", "status", "status", "status", "status", "status", "status", "status ", "frozen") print fmt % ("-------", "-------", "---------", "---------", "------", "------", "------", "------", "------", "------", "------", "-------", "------") from multiprocessing import Process, Queue ps = [] queues = {} for svc in svcs: try: queues[svc.svcname] = Queue() except: # some platform don't support Queue's synchronize (bug 3770) queues[svc.svcname] = None p = Process(target=svcmon_normal1, args=(svc, upddb, fmt, queues[svc.svcname])) p.start() ps.append(p) for p in ps: p.join() if upddb: g_vals = [] r_vals = [] if options.delay > 0: import random import time delay = int(random.random()*options.delay) time.sleep(delay) for svc in svcs: if queues[svc.svcname] is None: continue g_vars, _g_vals, r_vars, _r_vals = queues[svc.svcname].get() g_vals.append(_g_vals) r_vals.append(_r_vals) if len(g_vals) > 0: svc.node.collector.call('svcmon_update_combo', g_vars, g_vals, r_vars, r_vals) __ver = prog + " version " + version __usage = "%prog [options]\n\nDisplay services status" parser = optparse.OptionParser(version=__ver, usage=__usage) parser.add_option("--service", default="", action="store", dest="parm_svcs", help="comma-separated list of service to display status of") parser.add_option("--updatedb", default=False, action="store_true", dest="upddb", help="update resource status in central database") parser.add_option("--verbose", default=False, action="store_true", dest="verbose", help="display per-resource status for each selected service") parser.add_option("--maxdelaydb", default=0, action="store", type="int", dest="delay", help="introduce a random delay before pushing to database to level the load on the collector") parser.add_option("--debug", default=False, action="store_true", dest="debug", help="debug mode") (options, args) = parser.parse_args() if options.upddb: lockf = 'svcmon.lock' try: lockfd = monlock(fname=lockf) except ex.excError: sys.exit(1) except: import traceback traceback.print_exc() sys.exit(1) node = node.Node() if len(options.parm_svcs) > 0: node.build_services(svcnames=options.parm_svcs.split(',')) else: node.build_services() for s in node.svcs: s.options.debug = options.debug if options.verbose: svcmon_verbose(node.svcs) else: svcmon_normal(node.svcs, options.upddb) node.close() if options.upddb: try: monunlock(lockfd) except ex.excError: sys.exit(1) except: import traceback traceback.print_exc() sys.exit(1) sys.exit(0) 070701000244e9000081fd0000000000000000000000014faa950900000554000000ae00010002ffffffffffffffff0000001d00000000root/opt/opensvc/bin/freezer#!/opt/opensvc/bin/python # # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import sys import os # # add project lib to path # sys.path.append(os.path.join(os.path.dirname(__file__), '..', 'lib')) from freezer import Freezer from rcUtilities import check_privs check_privs() if len(sys.argv) == 1: f = Freezer() elif len(sys.argv) == 2: f = Freezer(sys.argv[1]) else: print __file__ + " [service]" sys.exit(1) cmd = os.path.basename(__file__) if cmd == 'svcfreeze': sys.exit(f.freeze()) elif cmd == 'svcthaw': sys.exit(f.thaw()) elif cmd == 'svcfrozen': sys.exit(int(f.frozen())) 070701000244ec000081b40000000000000000000000014faa9509000001b9000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/bin/opensvc.init.Darwin Disabled Label com.opensvc.svcmgr ProgramArguments /opt/opensvc/bin/allprimaryservices --parallel boot 070701000244fe000081fd0000000000000000000000014faa950900002e15000000ae00010002ffffffffffffffff0000001c00000000root/opt/opensvc/bin/svcmgr#!/opt/opensvc/bin/python # # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import sys import os import optparse # # add project lib to path # pathsvc = os.path.realpath(os.path.join(os.path.dirname(__file__), '..')) pathetc = os.path.join(pathsvc, 'etc') sys.path.append(os.path.join(pathsvc, 'lib')) prog = os.path.basename(__file__) action = None import svcBuilder import rcStatus import rcOptParser from rcUtilities import ximport node_mod = ximport('node') try: from version import version except: version = "dev" def _exit(r): node.close() sys.exit(r) node = node_mod.Node() __ver = prog + " version " + version __usage = "%prog [options] command\n\n" + rcOptParser.format_desc() parser = optparse.OptionParser(version=__ver, usage=__usage) parser.add_option("--debug", default=False, action="store_true", dest="debug", help="debug mode") parser.add_option("-p", "--parallel", default=False, action="store_true", dest="parallel", help="start actions on specified services in parallel") parser.add_option("-f", "--force", default=False, action="store_true", dest="force", help="force action, ignore sanity check warnings") parser.add_option("--cron", default=False, action="store_true", dest="cron", help="used by cron'ed action to tell the collector to treat the log entries as such") parser.add_option("-c", "--cluster", default=False, action="store_true", dest="cluster", help="option to set when excuting from a clusterware to disable safety net") parser.add_option("-i", "--interactive", default=False, action="store_true", dest="interactive", help="prompt user for a choice instead of going for defaults or failing") parser.add_option("--rid", default=None, action="store", dest="parm_rid", help="comma-separated list of resource to limit action to") parser.add_option("--tags", default=None, action="store", dest="parm_tags", help="comma-separated list of resource tags to limit action to") parser.add_option("--resource", default=[], action="append", help="a resource definition in json dictionary format fed to create or update") parser.add_option("--provision", default=False, action="store_true", dest="provision", help="provision the service in addition to env file creation. defaults to False.") parser.add_option("--waitlock", default=60, action="store", dest="parm_waitlock", type="int", help="comma-separated list of resource tags to limit action to") parser.add_option("--to", default=None, action="store", dest="parm_destination_node", help="remote node to start or migrate the service to") parser.add_option("--attach", default=False, action="store_true", dest="attach", help="attach the modulesets specified during a compliance check/fix/fixable command") parser.add_option("--module", default="", action="store", dest="module", help="compliance, set module list") parser.add_option("--moduleset", default="", action="store", dest="moduleset", help="compliance, set moduleset list. The 'all' value can be used in conjonction with detach.") parser.add_option("--ruleset", default="", action="store", dest="ruleset", help="compliance, set ruleset list. The 'all' value can be used in conjonction with detach.") parser.add_option("--ruleset-date", default="", action="store", dest="ruleset_date", help="compliance, use rulesets valid on specified date") parser.add_option("--param", default=None, action="store", dest="param", help="point a service configuration parameter for the 'get' and 'set' actions") parser.add_option("--value", default=None, action="store", dest="value", help="set a service configuration parameter value for the 'set --param' action") parser.add_option("--duration", default=None, action="store", dest="duration", type="int", help="a duration expressed in minutes. used with the 'collector ack unavailability' action") parser.add_option("--account", default=False, action="store_true", dest="account", help="decides that the unavailabity period should be deduced from the service availability anyway. used with the 'collector ack unavailability' action") parser.add_option("--begin", default=None, action="store", dest="begin", help="a begin date expressed as 'YYYY-MM-DD hh:mm'. used with the 'collector ack unavailability' action") parser.add_option("--end", default=None, action="store", dest="end", help="a end date expressed as 'YYYY-MM-DD hh:mm'. used with the 'collector ack unavailability' action") parser.add_option("--comment", default=None, action="store", dest="comment", help="a comment to log when used with the 'collector ack unavailability' action") parser.add_option("--author", default=None, action="store", dest="author", help="the acker name to log when used with the 'collector ack unavailability' action") parser.add_option("--id", default=0, action="store", dest="id", type="int", help="specify an id to act on") cluster = False svcnames = [] cmd = os.path.basename(__file__) if cmd == 'allservices': node.build_services() elif cmd == 'allupservices': node.build_services(status=rcStatus.UP) node.build_services(status=rcStatus.WARN) elif cmd == 'alldownservices': node.build_services(status=rcStatus.DOWN) elif cmd == 'allprimaryservices': node.build_services(onlyprimary=True) elif cmd == 'allsecondaryservices': node.build_services(onlysecondary=True) elif cmd == 'svcmgr': parser.add_option("-s", "--service", default=None, action="store", dest="parm_svcs", help="comma-separated list of service to operate on") parser.add_option("--status", default=None, action="store", dest="parm_status", help="operate only on service in the specified status (up/down/warn)") parser.add_option("--onlyprimary", default=None, action="store_true", dest="parm_primary", help="operate only on service flagged for autostart on this node") parser.add_option("--onlysecondary", default=None, action="store_true", dest="parm_secondary", help="operate only on service not flagged for autostart on this node") else: svcname = cmd.split('.') if len(svcname) == 2: if svcname[1] == 'cluster': cluster = True svcname = svcname[0] elif svcname[1] == 'stonith': cluster = True svcname = svcname[0] action = "stonith" else: svcname = cmd node.build_services(svcnames=svcname) (options, args) = parser.parse_args() if action is not None: args = ['stonith'] if node.svcs is None: parm_primary = False parm_secondary = False parm_status = None if hasattr(options, "parm_svcs") and options.parm_svcs is not None: svcnames = options.parm_svcs.split(',') if hasattr(options, "parm_status") and options.parm_status is not None: status = rcStatus.status_value(options.parm_status) else: status = None if hasattr(options, "parm_primary") and options.parm_primary is not None and \ hasattr(options, "parm_secondary") and options.parm_secondary is not None: node.close() parser.error("--onlyprimary and --onlysecondary are exclusive") if hasattr(options, "parm_primary") and options.parm_primary is not None: onlyprimary = options.parm_primary else: onlyprimary = False if hasattr(options, "parm_secondary") and options.parm_secondary is not None: onlysecondary = options.parm_secondary else: onlysecondary = False node.build_services(svcnames=svcnames, status=status, onlyprimary=onlyprimary, onlysecondary=onlysecondary) if len(args) is 0: node.close() parser.error("Missing action") if action is None: action = '_'.join(args) if not action in rcOptParser.supported_actions(): node.close() parser.error("unsupported action") if node.svcs is not None: svcnames = map(lambda x: x.svcname, node.svcs) if action == "create" and hasattr(options, "parm_svcs") and options.parm_svcs is not None: svcnames = options.parm_svcs.split(',') if cmd == 'svcmgr' and len(svcnames) == 0: sys.stderr.write("""No service specified. Try: allservices allupservices alldownservices allprimaryservices allsecondaryservices svcmgr -s svcname,... svcname """) _exit(1) if hasattr(options, "parm_rid") and options.parm_rid is not None: rid = options.parm_rid.split(',') else: rid = [] if hasattr(options, "parm_tags") and options.parm_tags is not None: tags = set(options.parm_tags.split(',')) else: tags = set([]) if options.parallel: from multiprocessing import Process p = {} if action in ['create', 'update']: r = getattr(svcBuilder, action)(svcnames, options.resource, interactive=options.interactive, provision=options.provision) if options.provision: if action == 'create': # force a refresh of node.svcs # don't push to the collector yet del(node.svcs) node.svcs = None node.build_services(svcnames=svcnames, autopush=False) if len(node.svcs) == 1: node.svcs[0].action("provision") _exit(r) elif action in ['disable', 'enable', 'delete']: r = getattr(svcBuilder, action)(svcnames, rid) _exit(r) err = 0 for s in node.svcs: s.options = options s.force = options.force s.cron = options.cron if cluster: s.cluster = cluster else: s.cluster = options.cluster s.destination_node = options.parm_destination_node if options.parallel: d = {'action':action, 'rid':rid, 'tags':tags, 'waitlock':options.parm_waitlock} p[s.svcname] = Process(target=node.service_action_worker, name='worker_'+s.svcname, args=[s], kwargs=d) p[s.svcname].start() else: try: err += s.action(action, rid=rid, tags=tags, waitlock=options.parm_waitlock) except s.exMonitorAction: s.cluster = True s.action('toc') s.action(s.monitor_action) if options.parallel: for svcname in p: p[svcname].join() r = p[svcname].exitcode if r > 0: # r is negative when p[svcname] is killed by signal. # in this case, we don't want to decrement the err counter. err += r try: import logging logging.shutdown() except: pass _exit(err) 070701000244ee000081fd0000000000000000000000014faa95090000018c000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/bin/opensvc.init.SunOS#!/bin/bash # # /etc/init.d/opensvc # # Starts the services driven by OpenSVC # # description: Starts the services driven by OpenSVC whose # autostart node is this node. # processname: osvc_path=/opt/opensvc/bin osvc_opts="--parallel" allservices=${osvc_path}/allservices case $1 in start) ${allservices} ${osvc_opts} boot ;; stop) ${allservices} ${osvc_opts} shutdown ;; esac 070701000244f5000081fd0000000000000000000000014faa950900000cda000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/bin/perfagt.SunOS#!/opt/opensvc/bin/python """ YYYY-MM-DD hh:mm:ss ZONE SWAP RSS CAP at avgat pg avgpg NPROC mem% cpu% TIME LastReboot """ import os, sys, platform import select import logging import time import datetime import subprocess zs_d = os.path.join(os.sep, 'var', 'adm', 'zonestat') zs_prefix = 'zs' zs_f = os.path.join(zs_d, zs_prefix + datetime.datetime.now().strftime("%d")) datenow = datetime.datetime.now().strftime("%Y-%m-%d %H:%M:%S") n = datetime.datetime.now() tn = time.mktime(n.timetuple()) if not os.path.exists(zs_d): os.makedirs(zs_d) try: t = os.path.getmtime(zs_f) d = tn - t except: d = 0 if d > 27*24*3600: os.remove(zs_f) f = open(zs_f, "a") stor = {} p = subprocess.Popen('/usr/bin/prstat -Z -n1,60 1 1', stdout=subprocess.PIPE, stderr=subprocess.STDOUT, shell=True, bufsize=0) out = p.stdout.readline() pr = 0 while out: line = out line = line.rstrip("\n") if "ZONEID" in line: pr = 1 out = p.stdout.readline() continue if "Total:" in line: pr = 0 out = p.stdout.readline() continue if "%" in line and pr == 1: fields = line.split() stor[fields[7]] = { 'SWAP': fields[2], 'RSS': fields[3], 'CAP': '0', 'at': '0', 'avgat': '0', 'pg': '0', 'avgpg': '0', 'NPROC': fields[1], 'mem': fields[4], 'cpu': fields[6], 'TIME': fields[5] } out = p.stdout.readline() p.wait() fi=1 pr=0 p = subprocess.Popen('/usr/bin/rcapstat -z 1 2', stdout=subprocess.PIPE, stderr=subprocess.STDOUT, bufsize=0, shell=True) out = p.stdout.readline() while out: line = out line = line.rstrip("\n") if "id zone" in line and fi == 1: fi = 0 out = p.stdout.readline() continue if "id zone" in line and fi == 0: pr = 1 out = p.stdout.readline() continue if not "id zone" in line and pr == 1: fields = line.split() stor[fields[1]]['CAP'] = fields[5] stor[fields[1]]['at'] = fields[6] stor[fields[1]]['avgat'] = fields[7] stor[fields[1]]['pg'] = fields[8] stor[fields[1]]['avgpg'] = fields[9] out = p.stdout.readline() p.wait() for z in stor: zn = z if z == 'global' : zn = platform.node() p = subprocess.Popen('/usr/bin/who -b', stdout=subprocess.PIPE, stderr=subprocess.STDOUT, bufsize=0, shell=True) else : p = subprocess.Popen('/usr/sbin/zlogin ' + z + ' /usr/bin/who -b', stdout=subprocess.PIPE, stderr=subprocess.STDOUT, bufsize=0, shell=True) out = p.stdout.readline() txt = out.split() print >>f, datenow, zn, stor[z]['SWAP'], stor[z]['RSS'], stor[z]['CAP'], stor[z]['at'], stor[z]['avgat'], stor[z]['pg'], stor[z]['avgpg'], stor[z]['NPROC'], stor[z]['mem'], stor[z]['cpu'], stor[z]['TIME'], txt[-3], txt[-2], txt[-1] p.wait() 070701000244f6000041ed0000000000000000000000024faab5bf00000000000000ae00010002ffffffffffffffff0000001900000000root/opt/opensvc/bin/pkg070701000244fa000081fd0000000000000000000000014faa950900001309000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/bin/pkg/make_pkg#!/bin/ksh -p PATH_SCRIPT="$(cd $(/usr/bin/dirname $(type -p -- $0 || echo $0));pwd)" . $PATH_SCRIPT/make.lib NAWK=nawk; PKGNAME=opensvc ARCH=${ARCH:-all} BASE=/opt/opensvc IPSREV=$(echo $RELEASE|sed s/\.//) P=${PKGNAME}-$VERSION-$RELEASE.SunOS.pkg IPSP=${PKGNAME}@$(uname -r),$(uname -r)-$VERSION.$IPSREV #IPSP=pkgname@osrev,osrev,version[:timestampiso8601] REPODIR=$(cd $(dirname $0);pwd) export REPODIR PATH=$PWD:$PATH:/opt/sfw/bin TMPARCHIVE=/var/tmp/tmparchive$$ TMPROOT=$TMPARCHIVE LANG=C export LANG function date_to_release { date -d "$*" +%y%m%d.%H%M } HEAD=$(git log -1 --pretty=format:%aD || exit 1) function my_log { echo $@ } function question { # usage: question default_value Comment typeset DEFAULT=$1 typeset READ shift read READ?"$* [${SGRAS}$DEFAULT${EGRAS}]:" echo ${READ:-$DEFAULT} } function create_pkg { typeset SGRAS="" typeset EGRAS="" typeset POSTINSTALL="" typeset PREINSTALL="" typeset PRE_REMOVE="" typeset POST_REMOVE="" while getopts hp:P:r:R: ARGS do case $ARGS in h) usage return 1 ;; p) PREINSTALL="$OPTARG" ;; P) POSTINSTALL="$OPTARG" ;; r) PRE_REMOVE="$OPTARG" ;; R) POST_REMOVE="$OPTARG" ;; ?) usage ;; esac done shift `expr $OPTIND - 1` set -- $* [ $# -lt 2 ] && usage PROTOTYPE=/tmp/prototype.$$ PKGINFO=/tmp/pkginfo.$$ PKG_FILE_NAME=$1 shift FILES=$* if [ "$FILES" = "" ] ; then my_log "no file names..." usage fi [ -f $PROTOTYPE ] && my_log "deleting $PROTOTYPE" && rm $PROTOTYPE PKG=`question $PKG_FILE_NAME "The name you have chosen for the pkg directory"` NAME=`question $PKG "The program name"` ARCH=`question sparc "The operating systeme version"` VERSION=`question "1" "The version number for your program"` CATEGORY=`question application "The program is an application"` VENDOR=`question "$LOGNAME@$(uname -n)" "whoever wrote the software"` EMAIL=`question "$VENDOR" "An email contact"` PSTAMP=`question "$VENDOR" "The person who did the port perhaps"` RULES=`question "$FILES=$FILES" "rules for source->dest ex: /usrlocalbin=/usr/local/bin /optlocal=/opt/local "` CLASSES=`question "none" "Classe"` my_log "creating prototype in $PROTOTYPE" > $PROTOTYPE [ "$PKGINFO" != "" ] && echo "i pkginfo=$PKGINFO" >> $PROTOTYPE [ "$POSTINSTALL" != "" ] && echo "i postinstall=$POSTINSTALL" >> $PROTOTYPE [ "$PREINSTALL" != "" ] && echo "i preinstall=$PREINSTALL" >> $PROTOTYPE [ "$PRE_REMOVE" != "" ] && echo "i preremove=$PRE_REMOVE" >> $PROTOTYPE [ "$POST_REMOVE" != "" ] && echo "i postremove=$POST_REMOVE" >> $PROTOTYPE [ ! -s $PROTOTYPE ] && my_log "warning $PROTOTYPE size null" && return 1 pkgproto $RULES >> $PROTOTYPE my_log "creating pkginfo file : $PKGINFO" echo "PKG=$PKG\nNAME=$NAME\nARCH=$ARCH\nVERSION=$VERSION\nCATEGORY=$CATEGORY" > $PKGINFO echo "VENDOR=$VENDOR\nEMAIL=$EMAIL\nPSTAMP=$PSTAMP\nCLASSES=$CLASSES" >> $PKGINFO my_log "running pkgmk to create /var/spool/pkg/$PKG : pkgmk -o -f $PROTOTYPE" pkgmk -o -f $PROTOTYPE my_log "running pkgtrans to create /tmp/$PKG_FILE_NAME : pkgtrans -s /var/spool/pkg /tmp/$PKG_FILE_NAME $PKG" pkgtrans -s /var/spool/pkg /tmp/$PKG_FILE_NAME $PKG STATUS=$? if [ $STATUS -eq 0 ] ; then echo "Cleaning temp files: $PROTOTYPE $PKGINFO" rm $PKGINFO $PROTOTYPE echo echo "Package $PKG created successfully" pkginfo -d /tmp/$PKG_FILE_NAME -l else echo echo "Warning some errors in create_pkg" fi return $STATUS } if [ -d $TMPARCHIVE ] ; then echo "Error $TMPARCHIVE already exists" echo "It should be removed first" exit 1 fi echo "----- git archive current to $TMPARCHIVE ..." mkdir $TMPARCHIVE cd $BASE && git archive --format=tar HEAD | ( cd $TMPARCHIVE && tar xf - \ && rm $TMPARCHIVE/.gitignore \ && chown -R root:root $TMPARCHIVE \ && chmod -R og-w $TMPARCHIVE ) cd $REPODIR echo "version = \"$VERSION-$RELEASE\"" > $TMPARCHIVE/lib/version.py cat > $REPODIR/postinstall < /dev/null <$CHROOT/../$PSF vendor tag opensvc title Opensvc SARL description opensvc nodeware end product tag opensvc title opensvc revision $VERSION-$RELEASE category system_management description tools to drive OpenSVC services copyright Opensvc SARL architecture HP-UX_10.20_700/800 machine_type * os_name HP-UX os_release * directory / is_locatable false fileset tag commands title Commands (management utilities) revision 1.0 prerequisite Python.PYTHON-RUN postinstall /tmp/$CHROOT_BN/opt/opensvc/bin/postinstall file_permissions -o root -g sys directory /tmp/$CHROOT_BN=/ file * end end EOF cd $CHROOT/.. || exit 1 tar cf - $CHROOT_BN $PSF | ssh root@$REMOTEHOST "cd /tmp && tar xf -" ssh root@$REMOTEHOST "cd /tmp && swpackage -vv -s opensvc.psf -x target_type=tape @/tmp/$DEPOT" scp root@$REMOTEHOST:/tmp/$DEPOT $OSVC/tmp/ || exit 1 [ -x $PATH_SCRIPT/release_depot ] && $PATH_SCRIPT/release_depot $OSVC/tmp/$DEPOT 070701000244f7000081b40000000000000000000000014faa95090000078a000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/bin/pkg/make.libfunction changelog { git log --pretty=format:"* %ad - %ae%n- %s" | sed -e "s/ [0-9]*:[0-9]*:[0-9]*//" -e "s/ +[0-9]* -/ -/" } function date_to_release { /opt/opensvc/bin/python -c "import datetime ; print datetime.datetime.fromtimestamp($1).strftime('%y%m%d.%H%M')" } HEAD=$(git log -1 --pretty=format:%at || exit 1) VERSION=$(git describe --tags --abbrev=0) MASTER=0 git branch | grep "\* master" >/dev/null 2>&1 && MASTER=1 if [ $MASTER -eq 1 ] ; then RELEASE=$(date_to_release $HEAD) else RELEASE=$(git describe --tags|cut -d- -f2) if [ "$RELEASE" = "$VERSION" ] ; then RELEASE="0" fi fi OSVC=$PATH_SCRIPT/../.. CHROOT_BN=opensvc-$VERSION-$RELEASE.noarch CHROOT=$OSVC/tmp/BUILDROOT/$CHROOT_BN if [ "$(id -u)" == "0" ] ; then SUDO="" else SUDO="sudo" fi function prepare_chroot { # # prepare skeleton (data.tar.gz) # [ "${CHROOT%%noarch}" != "$CHROOT" ] && $SUDO rm -rf $CHROOT mkdir -p $CHROOT/opt/opensvc/etc || return 1 mkdir -p $CHROOT/opt/opensvc/var || return 1 mkdir -p $CHROOT/opt/opensvc/log || return 1 mkdir -p $CHROOT/opt/opensvc/tmp || return 1 mkdir -p $CHROOT/opt/opensvc/var/cache || return 1 # install tracked files EXCL= EXCL="$EXCL --exclude=.be/" EXCL="$EXCL --exclude=bin/pkg" EXCL="$EXCL --exclude=bin/sssu" EXCL="$EXCL --exclude=bin/python" EXCL="$EXCL --exclude=*.pyc" EXCL="$EXCL --exclude='log/*'" EXCL="$EXCL --exclude='etc/*'" EXCL="$EXCL --exclude='etc/.*'" EXCL="$EXCL --exclude='tmp/*'" EXCL="$EXCL --exclude=var/host_mode" EXCL="$EXCL --exclude='var/lock/*'" EXCL="$EXCL --exclude='var/cache/*'" EXCL="$EXCL --exclude=lib/rcLocalEnv.py" cd $OSVC || return 1 tar cf - $EXCL bin lib usr var/compliance/*com.opensvc* | tar xf - -C $CHROOT/opt/opensvc || return 1 echo "version = \"$VERSION-$RELEASE\"" > $CHROOT/opt/opensvc/lib/version.py || return 1 $SUDO chown -R 0:0 $CHROOT/opt/opensvc || return 1 return 0 } 070701000244f8000081fd0000000000000000000000014faa950900000379000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/bin/pkg/make_deb#!/bin/bash PATH_SCRIPT="$(cd $(/usr/bin/dirname $(type -p -- $0 || echo $0));pwd)" . $PATH_SCRIPT/make.lib DEB=opensvc-$VERSION-$RELEASE.noarch.deb prepare_chroot || exit 1 # prepare control.tar.gz mkdir -p $CHROOT/DEBIAN || exit 1 cat - <<-EOF >$CHROOT/DEBIAN/conffiles EOF cat - <<-EOF >$CHROOT/DEBIAN/postinst #!/bin/sh /opt/opensvc/bin/postinstall EOF chmod 755 $CHROOT/DEBIAN/postinst cat - <<-EOF >$CHROOT/DEBIAN/control Package: opensvc Version: $VERSION-$RELEASE Section: system Priority: optional Architecture: all Essential: no Depends: python2.6 Pre-Depends: Recommends: sg3-utils Suggests: Installed-Size: 50 Maintainer: Christophe Varoqui [christophe.varoqui@opensvc.com] Conflicts: Replaces: Provides: opensvc Description: tools to drive OpenSVC services EOF dpkg -b $CHROOT || exit 1 [ -x $PATH_SCRIPT/release_deb ] && $PATH_SCRIPT/release_deb $CHROOT/../$DEB 070701000244fb000081fd0000000000000000000000014faa9509000003bf000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/bin/pkg/make_rpm#!/bin/bash PATH_SCRIPT="$(cd $(/usr/bin/dirname $(type -p -- $0 || echo $0));pwd)" . $PATH_SCRIPT/make.lib prepare_chroot || exit 1 SPEC_D=$OSVC/tmp/SPECS SPEC=$SPEC_D/opensvc.spec [ ! -d $SPEC_D ] && { mkdir -p $SPEC_D || exit 1 } cat - <<-EOF >$SPEC Summary: OpenSVC node tools Name: opensvc Version: $VERSION Release: $RELEASE License: GPLv2 Group: Administration/Tools BuildRoot: $CHROOT Provides: /opt/opensvc/bin/python %description These are the tools to drive OpenSVC services %post /opt/opensvc/bin/postinstall %files %docdir /opt/opensvc/usr/share %defattr(-,root,root) %attr(0755,root,root) /opt/opensvc/bin /opt/opensvc/lib /opt/opensvc/etc /opt/opensvc/log /opt/opensvc/tmp /opt/opensvc/var /opt/opensvc/usr #%changelog #\$(changelog) EOF sudo rpmbuild --target=noarch --define "_topdir $OSVC/tmp" --clean -bb $SPEC [ -x $PATH_SCRIPT/release_rpm ] && $PATH_SCRIPT/release_rpm $OSVC/tmp/RPMS/noarch/opensvc-$VERSION-$RELEASE.noarch.rpm 070701000244fc000081fd0000000000000000000000014faa950900000790000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/bin/pkg/make_tbz#!/usr/bin/env bash PATH_SCRIPT="$(cd $(/usr/bin/dirname $(type -p -- $0 || echo $0));pwd)" . $PATH_SCRIPT/make.lib TBZ=$CHROOT/opensvc-$VERSION.$RELEASE.tbz CHROOT=$CHROOT/opensvc-$VERSION.$RELEASE DISTFILES_D=/usr/ports/distfiles TAR=opensvc-$VERSION.$RELEASE.tar.gz prepare_chroot || exit 1 cd $CHROOT/.. || exit 1 tar czf $DISTFILES_D/$TAR opensvc-$VERSION.$RELEASE || exit 1 cat - <Makefile # New ports collection makefile for: opensvc # Date created: $(date +"%d %B %Y") # Whom: opensvc # # \$FreeBSD$ # PORTNAME= opensvc PORTVERSION= $VERSION.$RELEASE CATEGORIES= sysutils MASTER_SITES= http://repo.opensvc.com/tgz MAINTAINER= admin@opensvc.com COMMENT= OpenSVC service manager #MAN1= svcmgr.3 #MANCOMPRESSED= yes USE_PYTHON= 2.6+ DEST_DIR= / PREFIX= / NO_BUILD= yes do-install: \${CP} -a \${WRKSRC}/* \${PREFIX}/ \${PREFIX}/opt/opensvc/bin/postinstall .include EOF cat - <<-EOF >pkg-descr OpenSVC is a 'service' manager, as in clustered service manager, designed for real-world heterogeneous datacenters and large-scale operations like disaster recovery. Services are collections of resources (virtual machine, ip, disk groups, filesystems, file synchronizations, and application launchers). Services can be started, stopped and queried for status, providing a consistent command set for wildly different service integration types. Service configurations, status and logs are pushed to a central database coupled to a web front-end (collector). Services can be administered using the stand-alone GPLv2 software stack deployed on the nodes (nodeware), or through the web-front end. WWW: http://www.opensvc.com/ EOF cd $CHROOT find opt -type f -o -type l >../pkg-plist find opt/opensvc -type d | sed "s/^/@dirrm /" >>../pkg-plist cd .. make package [ -x $PATH_SCRIPT/release_tbz ] && $PATH_SCRIPT/release_tbz $TBZ 070701000244ef000081fd0000000000000000000000014faa9509000001c6000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/bin/opensvc.init.debian#!/bin/sh -e ### BEGIN INIT INFO # Provides: opensvc # Required-Start: $all # Required-Stop: # Default-Start: 2 3 4 5 # Default-Stop: 0 1 6 # Short-Description: OpenSVC services startup script ### END INIT INFO osvc_path=/opt/opensvc/bin osvc_opts="--parallel" allservices=${osvc_path}/allservices case $1 in start) ${allservices} ${osvc_opts} boot ;; stop) ${allservices} ${osvc_opts} shutdown ;; esac 070701000244fd000081fd0000000000000000000000014faa9509000044b5000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/bin/postinstall#!/usr/bin/env python import os import shutil import glob import sys python_names = ['python2.7', 'python2.6'] sysname, nodename, x, x, machine = os.uname() def python_path(): for n in python_names: p = _python_path(n) if p is not None: return p def _python_path(python_exe): for path in os.environ["PATH"].split(os.pathsep): exe_file = os.path.join(path, python_exe) if os.path.exists(exe_file) and os.access(exe_file, os.X_OK): return exe_file return None def install_cron(): """install opensvc cron jobs """ agt = '/opt/opensvc/bin/perfagt.'+sysname ce = [{ 'sched': "0,10,20,30,40,50 * * * *", 'reset_sched': False, 'user': "", 'cmd': "[ -x /opt/opensvc/bin/svcmon ] && /opt/opensvc/bin/svcmon --updatedb --maxdelaydb 120 >/dev/null 2>&1", 'marker': 'svcmon --updatedb', 'ok': False },{ 'sched': "0,10,20,30,40,50 * * * *", 'reset_sched': True, 'user': "", 'cmd': "[ -x /opt/opensvc/bin/cron/opensvc ] && /opt/opensvc/bin/cron/opensvc >/dev/null 2>&1", 'marker': '/opt/opensvc/bin/cron/opensvc', 'ok': False },{ 'sched': "0,10,20,30,40,50 * * * *", 'reset_sched': False, 'user': "", 'cmd': "[ -x %(agt)s ] && %(agt)s >/dev/null 2>&1"%dict(agt=agt), 'marker': agt, 'ok': False }] remove_entries = ['bin/nodemgr compliance check'] purge = [] root_crontab = False """ order of preference """ if sysname == 'SunOS' : root_crontab_locs = [ '/var/spool/cron/crontabs/root' ] else: root_crontab_locs = [ '/etc/cron.d/opensvc', '/var/spool/cron/crontabs/root', '/var/spool/cron/root', '/var/cron/tabs/root', '/usr/lib/cron/tabs/root', ] for loc in root_crontab_locs: if os.path.exists(os.path.dirname(loc)): if not root_crontab: root_crontab = loc if root_crontab == '/etc/cron.d/opensvc': ce[0]['user'] = "root" ce[1]['user'] = "root" ce[2]['user'] = "root" elif os.path.exists(loc): purge.append(loc) if not root_crontab: print "no root crontab found in usual locations %s"%str(root_crontab_locs) return False ce[0]['full'] = ' '.join([ce[0]['sched'], ce[0]['user'], ce[0]['cmd']]) ce[1]['full'] = ' '.join([ce[1]['sched'], ce[1]['user'], ce[1]['cmd']]) if os.path.exists(agt): ce[2]['full'] = ' '.join([ce[2]['sched'], ce[2]['user'], ce[2]['cmd']]) else: ce[2]['full'] = None new = False if os.path.exists(root_crontab): try: f = open(root_crontab, 'r') new = f.readlines() f.close() except: f.close() import traceback traceback.print_exc() for i, line in enumerate(new): for c in ce: if c['full'] is None: continue if c['marker'] in line: if c['cmd'] in line: sched = ' '.join(line.split()[:5]) if c['reset_sched'] and sched != c['sched']: new[i] = ' '.join([c['sched'], c['user'], c['cmd']])+'\n' c['ok'] = True else: # preserve scheduling if c['reset_sched']: sched = c['sched'] else: sched = ' '.join(line.split()[:5]) new[i] = ' '.join([sched, c['user'], c['cmd']])+'\n' c['ok'] = True for c in ce: if c['full'] is not None and not c['ok']: new.append(c['full']+'\n') else: new = [] for c in ce: if c['full'] is not None and not c['ok']: new.append(c['full']+'\n') if not new: print "problem preparing the new crontab" return False for i, line in enumerate(new): for re in remove_entries: if re in line: print 'delete line "%s" from %s'%(re,root_crontab) del new[i] try: f = open(root_crontab, 'w') f.write(''.join(new)) f.close() except: f.close() import traceback traceback.print_exc() """ Activate changes (actually only needed on HP-UX) """ if '/var/spool/' in root_crontab: cmd = ['crontab', root_crontab] ret = os.system(' '.join(cmd)) for loc in purge: try: f = open(loc, 'r') new = [ line for line in f.readlines() if not 'opensvc.daily' in line and not 'svcmon --updatedb' in line ] f.close() f = open(loc, 'w') f.write(''.join(new)) f.close() except: f.close() import traceback traceback.print_exc() """ Clean up old standard file locations """ for f in ['/etc/cron.daily/opensvc', '/etc/cron.daily/opensvc.daily']: if os.path.exists(f): os.unlink(f) def activate_chkconfig(svc): cmd = ['chkconfig', '--add', svc] ret = os.system(' '.join(cmd)) if ret > 0: return False return True def activate_ovm(): activate_chkconfig('zopensvc') def activate_redhat(): activate_chkconfig('opensvc') def activate_debian(): cmd = ['update-rc.d', '-f', 'opensvc', 'remove'] ret = os.system(' '.join(cmd)) if ret > 0: return False cmd = ['update-rc.d', 'opensvc', 'defaults', '99', '01'] ret = os.system(' '.join(cmd)) if ret > 0: return False return True def activate_hpux(): rc = "/sbin/init.d/opensvc" links = ["/sbin/rc1.d/K010opensvc", "/sbin/rc2.d/K010opensvc", "/sbin/rc3.d/S990opensvc"] if os.path.exists("/sbin/rc2.d/S990opensvc"): os.unlink("/sbin/rc2.d/S990opensvc") for l in links: if not os.path.islink(l): if os.path.exists(l): os.unlink(l) os.symlink(rc, l) try: f = open("/etc/rc.config.d/opensvc", "w") f.write("RUN_OPENSVC=1\n") f.close() except: f.close() import traceback traceback.print_exc() return True def activate_AIX(): rc = "/etc/rc.d/init.d/opensvc" links = ["/etc/rc.d/rc2.d/S990opensvc"] for l in links: if not os.path.islink(l): if os.path.exists(l): os.unlink(l) print "create link %s -> %s"%(l, rc) os.symlink(rc, l) return True def activate_SunOS(): rc = "/etc/init.d/opensvc" links = ["/etc/rc0.d/K00opensvc", "/etc/rc3.d/S99opensvc"] for l in links: if not os.path.islink(l): if os.path.exists(l): os.unlink(l) os.symlink(rc, l) return True def activate_FreeBSD(): return True def activate_Darwin(): return True def update_file(filename, srctext, replacetext): """ replace into filename srctext by replacetext """ import fileinput for line in fileinput.input(filename, inplace=1): if line.rstrip('\n') == srctext.rstrip('\n') : line = replacetext print line.rstrip('\n') fileinput.close() def install_rc(): """install startup script """ if os.path.exists('/etc/debian_version'): rc = '/etc/init.d/opensvc' src = '/opt/opensvc/bin/opensvc.init.debian' activate = activate_debian elif os.path.exists('/etc/SuSE-release'): rc = '/etc/init.d/opensvc' src = '/opt/opensvc/bin/opensvc.init.debian' activate = activate_redhat elif os.path.exists('/etc/redhat-release'): try: f = open('/etc/redhat-release', 'r') buff = f.read() f.close() except: buff = "" if 'Oracle VM server' in buff: rc = '/etc/init.d/zopensvc' activate = activate_ovm else: rc = '/etc/init.d/opensvc' activate = activate_redhat src = '/opt/opensvc/bin/opensvc.init.redhat' elif sysname == "HP-UX": rc = '/sbin/init.d/opensvc' src = '/opt/opensvc/bin/opensvc.init.hpux' activate = activate_hpux elif sysname == "SunOS": rc = '/etc/init.d/opensvc' src = '/opt/opensvc/bin/opensvc.init.SunOS' activate = activate_SunOS elif sysname == "FreeBSD": rc = '/etc/rc.d/opensvc' src = '/opt/opensvc/bin/opensvc.init.FreeBSD' activate = activate_FreeBSD elif sysname == "AIX": rc = '/etc/rc.d/init.d/opensvc' src = '/opt/opensvc/bin/opensvc.init.AIX' activate = activate_AIX elif sysname == "Darwin": rc = '/System/Library/LaunchDaemons/opensvc.plist' src = '/opt/opensvc/bin/opensvc.init.Darwin' activate = activate_Darwin else: print "could not select an init script: unsupported operating system" return False if os.path.islink(rc): os.unlink(rc) shutil.copyfile(src, rc) os.chmod(rc, 0755) activate() def gen_keys(): home = os.path.expanduser("~root") priv = os.path.join(home, ".ssh", "id_dsa") pub = os.path.join(home, ".ssh", "id_dsa.pub") if os.path.exists(pub) or os.path.exists(priv): return cmd = ['ssh-keygen', '-t', 'dsa', '-b', '1024', '-P', '""', '-f', priv] ret = os.system(' '.join(cmd)) def missing_dir(sub): pathd = os.path.join(os.sep, 'opt', 'opensvc', sub) if not os.path.exists(pathd): os.makedirs(pathd, 755) def missing_dirs(): missing_dir('log') missing_dir('tmp') def convert_svclinks(): missing_dir('etc') svcmgr = os.path.join('..', 'bin', 'svcmgr') if not os.path.exists(svcmgr): return 1 rcService = os.path.realpath(os.path.join(os.sep, 'opt', 'opensvc', 'bin', 'rcService')) if not os.path.exists(rcService): return 1 for fname in os.listdir(pathetc): fpath = os.path.join(pathetc, fname) if not os.path.islink(fpath): continue rpath = os.path.realpath(fpath) if rpath != rcService: continue os.unlink(fpath) os.symlink(svcmgr, fpath) def move_usr_to_opt(): linksvc = os.path.join(os.sep, 'service') pathsvc = os.path.join(os.sep, 'opt', 'opensvc') pathvar = os.path.join(pathsvc, 'var') pathetc = os.path.join(pathsvc, 'etc') old_pathsvc = os.path.join(os.sep, 'usr', 'local', 'opensvc') old_pathvar = os.path.join(old_pathsvc, 'var') old_pathetc = os.path.join(old_pathsvc, 'etc') if os.path.exists(old_pathvar): for f in glob.glob(old_pathvar+'/*'): dst = os.path.join(pathvar, os.path.basename(f)) if os.path.exists(dst) and 'host_mode' not in dst: continue if os.path.isdir(f): shutil.copytree(f, dst, symlinks=True) elif os.path.islink(f): linkto = os.readlink(f) os.symlink(linkto, dst) else: shutil.copy2(f, dst) if os.path.exists(old_pathetc): for f in glob.glob(old_pathetc+'/*'): dst = os.path.join(pathetc, os.path.basename(f)) if os.path.exists(dst): continue if os.path.islink(f): linkto = os.readlink(f) os.symlink(linkto, dst) elif os.path.isdir(f): shutil.copytree(f, dst, symlinks=True) else: shutil.copy2(f, dst) if os.path.exists(old_pathsvc): shutil.rmtree(old_pathsvc) if os.path.islink(linksvc) and os.path.realpath(linksvc) == old_pathsvc: os.unlink(linksvc) def install_etc_path(): p = os.path.join(os.sep, 'etc', 'PATH') if not os.path.exists(p): return try: f = open(p, "r") buff = f.read() f.close() except: return l = buff.strip().split(":") n = len(l) for op in ('/opt/opensvc/bin', '/opt/opensvc/etc'): if op in l: continue l.append(op) if len(l) == n: return try: f = open(p, "w") f.write(":".join(l)+'\n') f.close() except: return def install_profile(): prof_d = os.path.join(os.sep, 'etc', 'profile.d') prof = os.path.join(prof_d, 'opensvc.sh') buff = "export PATH=$PATH:/opt/opensvc/bin:/opt/opensvc/etc\n" if not os.path.exists(prof_d): return try: f = open(prof, 'w') f.write(buff) f.close() except: f.close() import traceback traceback.print_exc() def install_user_linux(): cmd = ['useradd', '-m', 'opensvc', '-s', '/bin/bash'] ret = os.system(' '.join(cmd)) def install_user(): cmd = ['id', 'opensvc'] ret = os.system(' '.join(cmd)) if ret == 0: return if sysname == 'Linux': install_user_linux() def install_bash_completion(): src = '/opt/opensvc/usr/share/bash_completion.d/opensvc' ds = [os.path.join(os.sep, 'etc', 'bash_completion.d'), os.path.join(os.sep, 'etc', 'bash', 'bash_completion.d')] for d in ds: dst = os.path.join(d, 'opensvc') if not os.path.exists(d): d = None continue else: break if d is None: return shutil.copyfile(src, dst) os.chmod(dst, 0644) def install_link(source, target): if source == '' or target == '': return False if os.path.realpath(source) == os.path.realpath(target): return True if os.path.islink(target) or os.path.exists(target): os.unlink(target) os.symlink(source,target) def install_pythonlink(): p = python_path() if p is None: print >>sys.stderr, "could not find a valid python installation" sys.exit(1) target = '/opt/opensvc/bin/python' return install_link(source=p, target=target) def move_host_mode(): hm = '/opt/opensvc/var/host_mode' cf = '/opt/opensvc/etc/node.conf' if not os.path.exists(hm): return try: fp = open(hm, 'r') mode = fp.read().split()[0] fp.close() except: print 'failed to read old host_mode. renamed to', hm+'.old' shutil.move(hm, hm+'.old') return cmd = ['/opt/opensvc/bin/nodemgr', 'set', '--param', 'node.host_mode', '--value', mode] ret = os.system(' '.join(cmd)) if ret != 0: print 'failed to set host_mode in node.conf' return shutil.move(hm, hm+'.old') def nodeconf_params(): nodeconf = os.path.join(os.sep, 'opt', 'opensvc', 'etc', 'node.conf') dotnodeconf = os.path.join(os.sep, 'opt', 'opensvc', 'etc', '.node.conf') # reset etc/.node.conf (autogenerated) if os.path.exists(dotnodeconf): os.unlink(dotnodeconf) if not os.path.exists(nodeconf): return import ConfigParser import copy config = ConfigParser.RawConfigParser() config.read(nodeconf) changed = False # no DEFAULT in etc/node.conf for o in copy.copy(config.defaults()): config.remove_option('DEFAULT', o) changed = True # sync section goes to etc/.node.conf if config.has_section('sync'): config.remove_section('sync') changed = True for s in config.sections(): for o in config.options(s): if o in ['sync_interval', 'push_interval', 'comp_check_interval']: v = config.getint(s, o) config.remove_option(s, o) config.set(s, 'interval', v) changed = True if o in ['sync_days', 'push_days', 'comp_check_days']: v = config.get(s, o) config.remove_option(s, o) config.set(s, 'days', v) changed = True if o in ['sync_period', 'push_period', 'comp_check_period']: v = config.get(s, o) config.remove_option(s, o) config.set(s, 'period', v) changed = True if changed: try: fp = open(nodeconf, 'w') config.write(fp) fp.close() except: print >>sys.stderr, "failed to write new %s"%nodeconf def save_exc(): import traceback try: import tempfile try: import datetime now = str(datetime.datetime.now()).replace(' ', '-') except: now ="" pathtmp = os.path.join(os.sep, 'opt', 'opensvc', 'tmp') try: f = tempfile.NamedTemporaryFile(dir=pathtmp, prefix='exc-'+now+'-') except: return f.close() f = open(f.name, 'w') traceback.print_exc(file=f) print >>sys.stderr, "unexpected error. stack saved in %s"%f.name f.close() except: print >>sys.stderr, "unexpected error" traceback.print_exc() try: install_pythonlink() move_usr_to_opt() missing_dirs() convert_svclinks() install_cron() install_rc() gen_keys() install_profile() install_etc_path() install_user() install_bash_completion() move_host_mode() nodeconf_params() except: save_exc() sys.exit(1) 07070100024612000041ed0000000000000000000000034faab5bf00000000000000ae00010002ffffffffffffffff0000001500000000root/opt/opensvc/usr07070100024613000041ed0000000000000000000000044faab5bf00000000000000ae00010002ffffffffffffffff0000001b00000000root/opt/opensvc/usr/share07070100024619000041ed0000000000000000000000034faab5bf00000000000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/usr/share/doc07070100024621000081b40000000000000000000000014faa950900007da6000000ae00010002ffffffffffffffff0000002c00000000root/opt/opensvc/usr/share/doc/template.env# # OpenSVC config files are written in standard ini file format: # # "The configuration file consists of sections, led by a [section] header and # followed by name: value entries, with continuations in the style of RFC 822 # (see section 3.1.1, “LONG HEADER FIELDS”); name=value is also accepted. Note # that leading whitespace is removed from values. # Lines beginning with '#' or ';' are ignored and may be used to provide # comments." # extract from http://docs.python.org/library/configparser.html # # Resource are label [resource_name#index_in_resourse_set], like [ip#1], # [ip#2], [fs#1], [fs#2]... # # Every resource accept these options: # 'disable' # optional. Possible values are 'true' or 'false'. Default is 'false'. # A disabled resource will be ignored on service startup and shutdown. # # 'disable_on' # optional. A list of nodenames where to consider the 'disable' value is # True. Also accepts the keywords 'nodes' and 'drpnodes'. # # 'optional' # optional. Possible values are 'true' or 'false'. Default is 'false'. # Actions on resource will be tried upon service startup and shutdown, # but action failures will be logged and passed over. Useful for resources # like dump filesystems for example. # # 'optional_on' # optional. A list of nodenames where to consider the 'optional' value is # True. Also accepts the keywords 'nodes' and 'drpnodes'. # # 'monitor' # optional. Possible values are 'true' or 'false'. Default is 'false'. # If set to 'true' the resource being down when the heartbeat thinks the # service should be 'up' triggers the execution of the 'monitor_action'. # # 'monitor_on' # optional. A list of nodenames where to consider the 'monitor' value is # True. Also accepts the keywords 'nodes' and 'drpnodes'. # # 'pre_start' # 'post_start' # 'pre_stop' # 'post_stop' # 'pre_syncnodes' # 'post_syncnodes' # 'pre_syncdrp' # 'post_syncdrp' # 'pre_syncresync' # 'post_syncresync' # optional. A command or script to exec before or after the resource # action. Arguments can be passed, but a single command is accepted. # # # Every service config file must have a DEFAULT section. # ############################################################################## # # Main service definition # ############################################################################## [DEFAULT] # # 'app' # is used to identify who is responsible for is service, who is billable # and provides a most useful filtering key. Better keep it a short code. # ;app = OSVC # # 'comment' # is optional, but helps users understand the role of the service, # which is nice to on-call support people having to operate on a # service they are usualy responsible for. # ;comment = opensvc web front-end # # 'mode' # supported modes are 'lxc', 'zone', 'kvm', 'ldom', 'xen', 'hpvm', 'ovm', # 'esx', or 'hosted'. The default is 'hosted'. # the mode decides upon disposition OpenSVC takes to bring a service up # or down : virtualized services need special actions to prepare and boot # the container for example, which is not needed for 'hosted' services. # ;mode = lxc # # 'drp_type' # supported values are 'standby' or 'srdf'. The default is 'standby'. # Not used for the moment. # ;drp_type = standby # # 'service_type' # supported values are 'DEV' and 'PRD'. There is no default, and this # setting is mandatory, as important rules apply to it : # 1/ a DEV service can not be brought up on a PRD node, but a PRD service # can be startup on a DEV node (in a DRP situation). # ;service_type = DEV # # 'nodes' # mandatory list of cluster nodes able to start the service when not in # a DRP situation # ;nodes = zezette # # 'autostart_node' # A subset of 'nodes' where the service will try to start on upon node # reboot. On a failover cluster only one autostart_node should be # defined, and the start-up will fail if the service is already up on another # node. # If not specified, the service will never be started at node boot-time, # which is rarely the expected behaviour. # ;autostart_node = zezette # # 'cluster_type' # Optional. Defaults to 'failover'. # Allowed values: # # 'failover' # The service can be up only on one node at a time. # # 'flex' # The service can be up on multiple nodes simultaneously. # # 'autoflex' # Like flex, and allows the collector to start and stop instances. # # ;cluster_type = failover # # 'flex_primary' # the nodename of the node allowed to sync to other flex nodes. # ;flex_primary = zezette # # 'flex_min_nodes' # Default: 1 # the minimum number of nodes where the service should be up. # Alerts are raised on the collector upon crossing this limit. # On autoflex, the collector would not trigger actions that would # put the service out of bounds. # ;flex_min_nodes = 1 # # 'flex_max_nodes' # Default: the total number of nodes # the maximum number of nodes where the service should be up. # Alerts are raised on the collector upon crossing this limit. # On autoflex, the collector would not trigger actions that would # put the service out of bounds. # ;flex_max_nodes = 10 # # 'flex_cpu_low_threshold' # Default: 10 # the minimum percentile of average node cpu usage. # Alerts are raised on the collector upon crossing this limit. # On autoflex, the collector would trigger actions to keep the cpu # usage in bounds. # ;flex_cpu_low_threshold = 10 # # 'flex_cpu_high_threshold' # Default: 10 # the maximum percentile of average node cpu usage. # Alerts are raised on the collector upon crossing this limit. # On autoflex, the collector would trigger actions to keep the cpu # usage in bounds. # ;flex_cpu_high_threshold = 90 # # 'drpnode' # optional. The backup node where the service is activated in a DRP # situation. This node is also a data synchronization target for 'sync' # resources (see below) # ;drpnode = vm5 # # 'drpnodes' # optional. Alternate backup nodes, where the service could be activated # in a DRP situation if the 'drpnode' is not available. These nodes are # also data synchronization targets for 'sync' resources (see below) # ;drpnodes = vm6 vm7 # # 'scsireserv' # optional. Possible values are 'true' or 'false'. Default is 'false'. # If set to 'true', OpenSVC will try to acquire a type-5 (write exclusive, # registrant only) scsi3 persistent reservation on every path to disks of # every disk group attached to this service. Existing reservations are # preempted to not block service start-up. If the start-up was not # legitimate the data are still protected from being written over from both # nodes. # If set to 'false' or not set, 'scsireserv' can be activated on a per- # resource basis. # ;scsireserv = false # # 'no_preempt_abort' # optional. Possible values are 'true' or 'false'. Default is 'false'. # If set to 'true', OpenSVC will preempt scsi reservation with a preempt # command instead of a preempt and and abort. Some scsi target # implementations do not support this last mode. # If set to 'false' or not set, 'no_preempt_abort' can be activated on a # per-resource basis. # ;no_preempt_abort = False # # 'bwlimit' # optional. Bandwidth limit in KB applied to all rsync transfers # ;bwlimit = 3000 # # 'sync_interval' # optional. Set the minimum delay between syncs in minutes. If a sync is # triggered through crond or manually, it is skipped if last sync occured # less than 'sync_interval' ago. # The mecanism is enforced by a timestamp created upon each sync completion # in /opt/opensvc/var/sync/[service]![dst] # ;sync_interval = 30 # # 'sync_days' # optional. Defaults to 'every week day'. # Set the days this resource synchronization is allowed. # ;sync_days = ["monday", "friday"] # # 'sync_period' # optional. Defaults to 4am to 6am. # Set the time ranges this resource synchronization is allowed. # ;sync_period = ["04:00", "06:00"] ;sync_period = [["04:00", "06:00"], ["18:00", "20:00"]] # # 'sync_interval' # optional. Set the minimum delay between syncs in minutes. If a sync is # triggered through crond or manually, it is skipped if last sync occured # less than 'sync_interval' ago. # The mecanism is enforced by a timestamp created upon each sync completion # in /opt/opensvc/var/sync/[service]![dst] # ;sync_interval = 30 # # 'sync_max_delay' # optional. Default value is 1440 minutes (1 day). Unit is minutes. # This sets to delay above which the sync status of the resource is to be # considered down. Should be set according to your application service # level agreement. The cron job frequency should be set between # 'sync_interval' and 'sync_max_delay'. # ;sync_max_delay = 1440 # # 'vm_name' # optional. Defaults to service name. This need to be set if the virtual # machine name is different from the service name. # ;vm_name = teddybear # # 'presnap_trigger' # optional. Defaults to None. Define a command to run before creating # snapshots. This is most likely what you need to use plug a script to # put you data in a coherent state (alter begin backup and the like). # ;presnap_trigger = /bin/true # # 'postsnap_trigger' # optional. Defaults to None. Define a command to run after snapshots are # created. This is most likely what you need to use plug a script to # undo the actions of 'presnap_trigger'. # ;postsnap_trigger = /bin/true # # 'containerize' # optional. Defaults to true. Use process containers when possible. # Containers allow capping memory, swap and cpu usage per service. # Lxc containers are naturally containerized, so skip containerization # of their startapp. # ;containerize = false # # 'container_cpus' # optional. Defaults to all cpus. Allow service process to bind only # the specified cpus. Cpus are specified as list or range : 0,1,2 or # 0-2 # ;container_cpus = 0-1 # # 'container_mems' # optional. Defaults to all memory nodes. Allow service process to bind # only the specified memory nodes. Memory nodes are specified as list or # range : 0,1,2 or 0-2 # ;container_mems = 0 # # 'container_cpu_share' # optional. No default, kernel default value is used, which usually is # 1024 shares. In a cpu-bound situation, ensure the service does not # use more than its share of cpu ressource. The actual percentile depends # on shares allowed to other services. # ;container_cpu_share = 1024 # # 'container_mem_limit' # optional. Defaults to all available memory. Ensures the service does # not use more than specified memory (in bytes). The Out-Of-Memory killer # get triggered in case of tresspassing. # ;container_mem_limit = 100000000 # # 'container_vmem_limit' # optional. Defaults to all available memory+swap. Ensures the service does # not use more than specified memory+swap (in bytes). The Out-Of-Memory killer # get triggered in case of tresspassing. The specified value must be greater # than container_mem_limit # ;container_vmem_limit = 200000000 # # 'monitor_action' # optional. Possible values are 'freezestop', 'reboot' or 'crash'. # If the service has a heartbeat resource and some resources are flagged # as monitored, in the event the heartbeat reports 'up' and some # monitored resource reports 'not up', the monitor action is triggered # through svcmon cron job or a user-added 'resource_monitor' action # schedule. # ;monitor_action = freezestop ############################################################################## # # Service resources # ############################################################################## ############################################################################## # # 'ip' resources # describe which ip to plumb for the service. Any number of ips can be # attached to the service, but ips are to be uniquely assigned to it. # In case of ip conflict, the service refuses to start. # ;[ip#1] ;disable = true ;disable_on = node12 node21 ;optional = true ;optional_on = node12 node21 ;monitor = true ;monitor_on = node12 node21 # # 'ipname' # the DNS name of the ip resource. Can be different from one node to the # other, in which case '@nodename' can be specified. This is most # useful to specify a different ip when the service starts in DRP mode, # where subnets are likely to be different than those of the production # datacenter. # ;ipname@zezette = unxdevweb ;ipname@vm5 = unxdrpweb # # 'ipdev' # the interface name over which OpenSVC will try to stack the service # ip. Can be different from one node to the other, in which case the # '@nodename' can be specified. # ;ipdev@zezette = br0 ;ipdev@vm5 = eth0 # # 'netmask' # optional if an ip is already plumbed on the root interface (if which # case the netmask is deduced from this ip). Mandatory if the interface # is dedicated to the service (dummy interface are likely to be in this # case). # the format is decimal, ex: 255.255.252.0 # ;netmask = 255.255.255.0 # # 'always_on' # optional. Possible values are 'nodes', 'drpnodes' or 'nodes drpnodes', # or a list of nodes. # Sets the nodes on which the resource is always kept up. Primary usage is # file synchronization receiving on non-shared disks. Don't set this on # shared disk !! danger !! # ;always_on = drpnodes ############################################################################## # # 'vg' resource # Disk group in the sense of volume managers, whatever the implementation. # Attaching a 'vg' to a service will make OpenSVC check and drive its # imported/exported status. # ;[vg#1] ;disable = true ;disable_on = node12 node21 ;optional = true ;optional_on = node12 node21 ;monitor = true ;monitor_on = node12 node21 # # 'vgname' # mandatory, expect for the raw vg type. # The name of the volume group, as seen by the volume manager. # ;vgname = unxtstsvc02 # # 'dsf' # optional. Boolean. HP-UX only. Default value is True. # 'dsf' must be set to false for LVM to use never-multipathed /dev/dsk/... # devices. Otherwize, ad-hoc multipathed /dev/disk/... devices. # ;dsf = true # # 'scsireserv' # optional. Possible values are 'true' or 'false'. Default is 'false'. # If set to 'true', OpenSVC will try to acquire a type-5 (write exclusive, # registrant only) scsi3 persistent reservation on every path to disks of # every disk group attached to this service. Existing reservations are # preempted to not block service start-up. If the start-up was not # legitimate the data are still protected from being written over from both # nodes. # If set to 'false' or not set, 'scsireserv' can still be activated globally # from the 'default' section. # ;scsireserv = false # # 'no_preempt_abort' # optional. Possible values are 'true' or 'false'. Default is 'false'. # If set to 'true', OpenSVC will preempt scsi reservation with a preempt # command instead of a preempt and and abort. Some scsi target # implementations do not support this last mode. # If set to 'false' or not set, 'no_preempt_abort' can be activated on a # per-resource basis. # ;no_preempt_abort = False # # 'always_on' # optional. Possible values are 'nodes', 'drpnodes' or 'nodes drpnodes', # or a list of nodes. # Sets the nodes on which the resource is always kept up. Primary usage is # file synchronization receiving on non-shared disks. Don't set this on # shared disk !! danger !! # ;always_on = drpnodes # # 'type' # optional. # values: veritas, raw # 'type' may be set to veritas to use veritas volume group instead of native # os volume group or raw to provide explicitely a set of device paths through # the 'devs' parameter. # ;type = veritas # # 'devs' # mandatory for the 'raw' vg type. # values: a list of device paths, whitespace separated. # 'devs' contains the raw-type volume group device paths list. Those devices # are thus listed as owned by the service and scsi reservation policy is # applied to them. # ;devs = /dev/mapper/svc.d0 /dev/mapper/svc.d1 ############################################################################## # # 'pool' resource # zfs pool the sense of volume managers, whatever the implementation. # Attaching a ZFS 'pool' to a service will make OpenSVC check and drive its # imported/exported status. # ;[pool#1] ;disable = true ;disable_on = node12 node21 ;optional = true ;optional_on = node12 node21 ;monitor = true ;monitor_on = node12 node21 # # 'poolname' # nothing special there # ;poolname = zpool # # tags = preboot may be used when zfs pool is required before container boot # else postboot is presumed # ;tags = preboot # # 'scsireserv' # optional. Possible values are 'true' or 'false'. Default is 'false'. # If set to 'true', OpenSVC will try to acquire a type-5 (write exclusive, # registrant only) scsi3 persistent reservation on every path to disks of # every disk group attached to this service. Existing reservations are # preempted to not block service start-up. If the start-up was not # legitimate the data are still protected from being written over from both # nodes. # If set to 'false' or not set, 'scsireserv' can still be activated globally # from the 'default' section. # ;scsireserv = false # # 'no_preempt_abort' # optional. Possible values are 'true' or 'false'. Default is 'false'. # If set to 'true', OpenSVC will preempt scsi reservation with a preempt # command instead of a preempt and and abort. Some scsi target # implementations do not support this last mode. # If set to 'false' or not set, 'no_preempt_abort' can be activated on a # per-resource basis. # ;no_preempt_abort = False # # 'always_on' # optional. Possible values are 'nodes', 'drpnodes' or 'nodes drpnodes', # or a list of nodes. # Sets the nodes on which the resource is always kept up. Primary usage is # file synchronization receiving on non-shared disks. Don't set this on # shared disk !! danger !! # ;always_on = drpnodes ############################################################################## # # 'vmdg' resource # HP-UX only, HP-VM only. The virtual machine disk group is the group of # disks given to a VM (pass-through device). As such, there can be only one # vmdg section for a hpvm-mode service. # This resource type is only present to allow setting the scsireserv option. # ;[vmdg] ;scsireserv = false ;no_preemt_abort = false ############################################################################## # # 'drbd' resource # Linux only. Set up the attachment, connection and role of a defined drbd # resource. Depending on weather this resource is stacked over or under # other disk group resources we need to start it respectively late or early. # This is controlled by a set of tags: 'prevg', 'postvg'. # [drbd#0] # # 'res' # mandatory. String. The name of the drbd resource associated with this # service resource. OpenSVC expect the resource configuration file to # reside in '/etc/drbd.d/resname.res'. The 'sync#i0' resource will take # care of replicating this file to remote nodes. # res = data # # 'always_on' # state the expected status on nodes specified as value is 'up'. With drbd # the 'up' status is granted when the drbd driver reports UpToDate/UpToDate, # so always_on should point to all nodes participating in the drbd resource. # always_on = drpnodes nodes # # 'tags' # prevg: upon service 'start', drbd 'start' is scheduled before volume # group 'start'. To use when the volume group is layered over the # drbd. # postvg: upon service 'start', drbd 'start' is scheduled after volume # group 'start'. To use when the the drbd is layered over the # volume group. # tags = prevg ############################################################################## # # 'fs' resource # describes filesystems to mount on service startup and umount on service # shutdown. # The options are aligned to the Unix fstab fields. Whatever is possibly # described in the fstab should be supported in there. # ;[fs#1] ;disable = true ;disable_on = node12 node21 ;optional = true ;optional_on = node12 node21 ;monitor = true ;monitor_on = node12 node21 ;dev = /opt/unxtstsvc01.img ;mnt = /opt/unxtstsvc01 ;mnt_opt = rw,loop ;type = ext4 ;[fs#2] ;dev = zpool/app ;mnt = /unxtstsvc01/app ;type = zfs # # 'type' # possible values: # zfs lofs ext3 ext4 ... # # # 'dev' # can have per-node value, using the 'dev@node' parameter syntax for # each node. You can mix 'dev' with 'dev@node' syntax to obtain a default # plus exceptions behaviour. This facility is most useful for replicating # nas heads, when you want the nodes to use the closest head. # ;dev@prdnode = prdnas:/vol/vol1 ;dev@drpnode = drpnas:/vol/vol1 # # 'always_on' # optional. Possible values are 'nodes', 'drpnodes' or 'nodes drpnodes', # or a list of nodes. # Sets the nodes on which the resource is always kept up. Primary usage is # file synchronization receiving on non-shared disks. Don't set this on # shared disk !! danger !! # ;always_on = drpnodes ############################################################################## # # 'loop' resource # linux-only. # describes a loop device attached to the service. startup triggers the # allocation of a block device (usualy major 7) mapped over the specified # file. The created loop dev can be used to stack disk group also attached # to the service. # ;[loop#1] ;disable = true ;disable_on = node12 node21 ;optional = true ;optional_on = node12 node21 ;monitor = true ;monitor_on = node12 node21 ;file = /opt/unxtstsvc02.img ############################################################################## # # 'sync' resource # describes a rsync-based data synchronization job. By default the sync # is run daily. # ;[sync#1] ;disable = true ;disable_on = node12 node21 ;optional = true ;optional_on = node12 node21 ;monitor = true ;monitor_on = node12 node21 # # 'tags' # the sync resource supports the 'delay_snap' tag. This tag is used to # delay the snapshot creation just before the rsync, thus after 'postsnap_trigger' # execution. The default behaviour (no tags) is to group all snapshots creation # before copying data to remote nodes, thus between 'presnap_trigger' and # 'postsnap_trigger'. # ;tags = delay_snap # # 'src' # source of the sync. Can be a whitespace-separated list of files or dirs # passed as-is to rsync. Beware of the meaningful ending '/'. Refer to # the rsync man page for details. # ;src = /unxdevweb/ # # 'dst' # destination of the sync. Beware of the meaningful ending '/'. Refer to # the rsync man page for details. # ;dst = /unxdevweb # # 'exclude' # !deprecated!, optional. A whitespace-separated list of --exclude params # passed unchanged to rsync. The 'options' keyword is preferred now. # ;exclude = --exclude=cache # # 'options' # optional. A whitespace-separated list of params passed unchanged to rsync. # Typical usage is ACL preservation activation. # ;options = -A # # 'target' # mandatory. Possible values are 'nodes', 'drpnodes' or 'nodes drpnodes'. # Describes which nodes should receive this data sync from the PRD node # where the service is up and running. # # SAN storage shared 'nodes' must not be sync to 'nodes'. # SRDF-like paired storage must not be sync to 'drpnodes'. # ;target = nodes drpnodes # # 'snap' # optional. Possible values are 'true' or 'false'. Default is 'false'. # If set to true, OpenSVC will try to snapshot the first snapshottable # parent of the source of the sync and try to sync from the snap. # ;snap = true # # 'dstfs' # optional. If set to a remote mount point, OpenSVC will verify that the # specified mount point is really hosting a mounted FS. This can be used # as a safety net to not overflow the parent FS (may be root). # ;dstfs = /remote/dir # # 'bwlimit' # optional. Bandwidth limit in KB applied to this rsync transfer. Takes # precedence over 'bwlimit' set in [DEFAULT]. # ;bwlimit = 3000 # # 'sync_interval' # optional. Set the minimum delay between syncs in minutes. If a sync is # triggered through crond or manually, it is skipped if last sync occured # less than 'sync_interval' ago. If no set in a resource section, fallback # to the value set in the 'default' section. The mecanism is enforced by a # timestamp created upon each sync completion in # /opt/opensvc/var/sync/[service]![dst] # ;sync_interval = 30 # # 'type' # optional. Default is 'rsync'. Specify a data sync mode. Supported values # are: zfs, netapp, rsync, dds # ;type = netapp ;type = zfs # # 'zfs' type specific parameter. # The synchronization mecanism used is zfs send / zfs receive. # src and dst may refer a dataset instead of directory # src and dst can be different from one node to the # other, in which case '@nodename' can be specified. # # # 'recursive' # optional. (used when type = 'zfs') # Default is 'True'. So snapshots are created recursivly # ;recursive = False # # 'netapp' type specific parameter. # The synchronization mecanism used is snapmirror. # # # 'filer' # mandatory. 'filer' points the nas head to pass commands to. In most case # you need to specify localized filers using the 'filer@node' syntax. # ;filer@vm4 = nasprd ;filer@vm5 = nasdrp # # 'path' # mandatory. Specifies the volume or qtree to drive snapmirror on. # ;path = /vol/vol1 # # 'user' # mandatory. Specifies the user used to ssh connect the filers. Nodes should # be trusted by keys to access the filer with this user. # ;user = nasadm ############################################################################## # # Symmetrix clones # ;[sync#2] ;type = symclone # # 'symdg' # mandatory. name of the symmetrix device group where the source and target # devices are grouped. # ;symdg = DGCVI # # 'precopy_timeout' # optional. default 300 secs. seconds to wait for a precopy (syncresync) to # finish before returning with an error. In this case, the precopy proceeds # normally, but the opensvc leftover actions must be retried. The precopy # time depends on the amount of changes logged at the source, which is # context-dependent. Tune to your needs. # ;precopy_timeout = 300 # # 'symdevs' # 'symdevs@node' # mandatory. whitespace-separated list of devices to drive with this resource. # devices are specified as 'symmetrix identifier:symmetrix device identifier' # ;symdevs@lmwbica0 = 000290101370:380D ;sync_interval = 30 ;sync_max_delay = 1440 ############################################################################## # # DataCore snapshots # Refresh snapshots on a DataCore storage virtualization appliance farm. # Snap wwid and lu number are static so that the OS does not have to handle # device renamings. If those snaps are presented on the same host than source # logical units and are used in a volume group, a trigger should take care # of relabelling the PV and VG. # # All DCS commands are submitted through a DCS manager (first available # from the 'manager' list, using a ssh trusted connexion and powershell # commands from here. Manager authentifaction credentials are to be stored # in auth.conf # # ex: # [dcsmanager1.opensvc.com] # username = dcsadmin # password = xxxxxxx # ;[sync#1] ;type = dcssnap ;sync_interval = 5 ;sync_max_delay = 60 # # 'manager' # mandatory. A whitespace-separated list of DCS managers. # Also used as a section name in etc/auth.conf # ;manager = dcsmanager1.opensvc.com dcsmanager2.opensvc.com # # 'dcs' # mandatory. A whitespace-separated list of DCS appliances. # Commands will be submitted from the manager to the first available dcs # appliance. # ;dcs = dcs1.opensvc.com dcs2.opensvc.com # # 'snapname' # mandatory. A whitespace-separated list of DCS snapshot names. # All snapshots listed will be refreshed in a single powershell command, # but that does not guaranty any cross-snap data integrity. Applications # must be quiesced before 'syncresync' action. # ;snapname = svc1-snap1 svc1-snap2 ############################################################################## # # HP StorageWorks EVA snapshots # (Re)create snapshots of Logical Units in a EVA class HP storage array. # Snap wwid and lu number are static so that the OS does not have to handle # device renamings. If those snaps are presented on the same host than source # logical units and are used in a volume group, a trigger should take care # of relabelling the PV and VG. # # All EVA commands are submitted to the Command View server (manager). It's # location and privileged account must be described per-EVA in the # etc/sssu.conf configuration file (which should be root/600). # # ex: # [EVA11] # manager = manager.opensvc.com # username = hpadmin # password = xxxxxxx # # The sssu binary is expected to be /opt/opensvc/bin/sssu. A symlink is fair # enough. # ;[sync#1] ;type = evasnap ;sync_interval = 5 ;sync_max_delay = 60 # # 'eva_name' # mandatory. The name of the EVA storage array, as seen by the manager. # Also used as a section name in etc/sssu.conf # ;eva_name = EVA11 # # 'pairs' # mandatory. A JSON-serialized list descibing the origin-snap relationships. # Also used as a section name in etc/sssu.conf # ;eva_name = EVA11 ;pairs = [ ; { ; "src": "6001438005ffffff0000800003ee0000", ; "dst": "6001438005ffffff00008000040f0000", ; "mask": ["\\Hosts\\Opensvc\\n1\\101", ; "\\Hosts\\Opensvc\\n2\\106"] ; }, ; { ; "src": "6001438005ffffff0000800003f80000", ; "dst": "6001438005ffffff0000800004130000", ; "mask": ["\\Hosts\\Opensvc\\n1\\102"] ; } ; ] ############################################################################## # # Binary deltas based sync resource for Linux LVM. # ;[sync#3] ;type = dds # # 'src' # source logical volume. Mandatory. Points the origin of the snapshots to # replicate from. # ;src = /dev/mapper/unxtstsvc02-data # # 'dst' # target file or block device. Optional. Defaults to src. Points the media # to replay the binary-delta received from source node to. This media must have # a size superior or equal to source. # ;dst = /tmp/dds.img # # 'target' # Mandatory. Accepted values are 'drpnodes', 'nodes' or both, whitespace-separated. # Points the target nodes to replay the binary-deltas on. Be warned that starting # the service on a target node without a 'stop-syncupdate-start cycle, will break # the synchronization, so this mode is usually restricted to drpnodes sync, and # should not be used to replicate data between nodes with automated services failover. # ;target = drpnodes # # 'snap_size' # Optional. Default to 10% of origin. In MB, rounded to physical extent boundaries # by lvm tools. # Size of the snapshots created by OpenSVC to extract binary deltas from. Opensvc # creates at most 2 snapshots : one short-lived to gather changed data from, and one # long-lived to gather changed chunks list from. Volume groups should have the # necessary space always available. # ;snap_size = 4 ;sync_interval = 1450 ;sync_max_delay = 1 ############################################################################## # # Virtual disk. # remap devices or files used as virtual machines devices # ;[vdisk#1] # # 'path@node' # Mandatory. # path of the device or file used as a virtual machine disk on node 'node' # ;path@node1 = /dev/mapper/unxtstsvc02-data ;path@node2 = /dev/mapper/vg0-unxtstsvc02_data ############################################################################## # # Heart beat. # check the status of a clusterware piloting the service # ;[hb#1] # # 'type' # Mandatory. # Specify the heartbeat driver to use. Supported driver are 'OpenHA' and # 'LinuxHA'. # ;type = OpenHA # # 'name' # Optional. Applies to the OpenHA driver # Specify the service name used by the heartbeat. Defaults to the service name. # ;name = SVCNAME 0707010002461c000041ed0000000000000000000000024faab5bf00000000000000ae00010002ffffffffffffffff0000002c00000000root/opt/opensvc/usr/share/doc/provisioning0707010002461e000081b40000000000000000000000014faa95090000016a000000ae00010002ffffffffffffffff0000004100000000root/opt/opensvc/usr/share/doc/provisioning/provisioning.example/opt/opensvc/bin/svcmgr -s test create --resource '{"mode": "lxc", "template": "http://download.openvz.org/template/precreated/debian-6.0-x86_64.tar.gz", "rootfs": "/opt/lxc/rootfs.test"}' --resource '{"rtype": "loop", "file": "/tmp/fooloop", "size": 11}' --resource '{"rtype": "fs", "type": "ext4", "dev": "/tmp/fooloop", "mnt": "/tmp/fooloopmnt"}' --provision 0707010002461d000081fd0000000000000000000000014faa950900000a2a000000ae00010002ffffffffffffffff0000004600000000root/opt/opensvc/usr/share/doc/provisioning/provisioning.agent.debian#!/usr/bin/python import os import sys from subprocess import Popen class provAgent(object): dev = "/dev/fd0" data = {} def __init__(self): self.get_cfdisk() def get_cfdisk(self): if not os.path.exists(self.dev): print >>sys.stderr, 'no cfdisk' sys.exit(1) with open(self.dev) as f: buff = f.read(1024) if not buff.startswith('todo'): print >>sys.stderr, 'nothing to do' sys.exit(1) for line in buff.split('\n'): if len(line) == 0: continue l = line.split(';') if len(l) < 2: print >>sys.stderr, 'malformed line:', line continue self.data[l[0]] = l[1:] def set_done(self): with open(self.dev) as f: buff = f.read(1024) buff = "done"+buff[4:] with open(self.dev, "w") as f: f.write(buff) def set_vm(self): if 'vm' not in self.data: print >>sys.stderr, 'no vm in cfdisk' return h = self.data['vm'][0] with open('/etc/hostname', 'w') as f: f.write(h+'\n') def set_ns(self): if 'ns' not in self.data: print >>sys.stderr, 'no ns in cfdisk' return h = self.data['ns'][0] with open('/etc/resolv.conf', 'w') as f: f.write('nameserver %s\n'%h) def set_pub(self): if 'hv_root_pubkey' not in self.data: print >>sys.stderr, 'no hv_root_pubkey in cfdisk' return try: os.makedirs('/root/.ssh') except: pass h = self.data['hv_root_pubkey'][0] with open('/root/.ssh/authorized_keys', 'a') as f: f.write('%s\n'%h) def set_ip(self, l): if len(l) != 3: return dev, addr, mask = l buff = """ auto %(dev)s iface %(dev)s inet static address %(addr)s netmask %(mask)s gateway %(gw)s """%dict(dev=dev, addr=addr, mask=mask, gw=self.data['gw'][0]) with open('/etc/network/interfaces', 'w')as f: f.write(buff) def set_ips(self): for i, l in self.data.items(): if not i.startswith('ip#'): continue self.set_ip(l) def reboot(self): cmd = ['reboot'] p = Popen(cmd) p.communicate() def setup(self): self.set_vm() self.set_ns() self.set_pub() self.set_ips() self.set_done() self.reboot() provAgent().setup() 0707010002461a000081b40000000000000000000000014faa950900000cd3000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/usr/share/doc/node.conf# # Template etc/node.conf # # This configuration file describes node-wide parameters. # # The interval-days-period tuple is used to tune the schedule of # jobs run by the 'opensvc' cron-job. # # This file can be left empty except for node.host_mode. The sync # schedule is autogenerated, based on the schedules described in the # sync#* resources defined in the service configurations. So no # sync schedule should be explicitely defined here. # # The internal schedule defaults for sync and push* actions are: # days: all # period: 4am to 6am # interval: 1 day # # The internal schedule defaults for 'compliance check' action are: # days: sunday # period: 5am to 6am # interval: 1 week # # Schedule parameters details: # interval # type: integer # unit: minutes # days # type: json list # unit: weekday in C locale (%A) # period # type: json list or list of list # unit: %H:%M # [node] # # A PRD host mode will only allow PRD services to run. A not-PRD mode # allows any service to run. # ;host_mode = DEV # # The team responsible set here will be pushed to the collector's asset # table. An admin allowed to edit opensvc configuration files on a node # can set this team_responsible and gain the edit privilege on the asset # in the collector. # ;team_responsible = Homies # # You can optionally define asset information. They will be pushed to the # collector, so that the compliance ruleset can use this information just # after opensvc is bootstraped. # # A postinstall workflow would look like this: # # vanilla install # install opensvc # nodemgr set --param node.loc_city = Paris # nodemgr set --param node.team_responsible = Homies # nodemgr pushasset --force # nodemgr compliance attach moduleset --moduleset sys.core # nodemgr compliance fix # ;loc_country = France ;loc_city = Paris ;loc_zip = 75017 ;loc_addr = 7 rue blanche ;loc_building = crystal ;loc_floor = 21 ;loc_room = 102 ;loc_rack = R42 # # Set the uri of the collectors' xmlrpc servers # Default values as example. # ;dbopensvc = https://collector.opensvc.com/feed/default/call/xmlrpc ;dbcompliance = https://collector.opensvc.com/init/compliance/call/xmlrpc # # Schedule parameters for the 'compliance check' node action # [compliance] ;interval = 1439 ;period = ["00:00", "23:59"] ;days = ["saturday", "sunday"] [stats] ;interval = 30 ;period = [["04:00", "08:00"], ["23:00", "01:30"]] ;days = ["saturday", "sunday"] [checks] ;interval = 120 ;period = [["04:00", "08:00"], ["23:00", "01:30"]] ;days = ["saturday", "sunday"] [packages] ;interval = 120 ;period = [["04:00", "08:00"], ["23:00", "01:30"]] ;days = ["saturday", "sunday"] [patches] ;interval = 120 ;period = [["04:00", "08:00"], ["23:00", "01:30"]] ;days = ["saturday", "sunday"] [asset] ;interval = 120 ;period = [["04:00", "08:00"], ["23:00", "01:30"]] ;days = ["saturday", "sunday"] [sym] ;interval = 120 ;period = [["04:00", "08:00"], ["23:00", "01:30"]] ;days = ["saturday", "sunday"] [svcconf] ;interval = 120 ;period = [["04:00", "08:00"], ["23:00", "01:30"]] ;days = ["saturday", "sunday"] [appinfo] ;interval = 120 ;period = [["04:00", "08:00"], ["23:00", "01:30"]] ;days = ["saturday", "sunday"] 07070100024620000081b40000000000000000000000014faa95090000021b000000ae00010002ffffffffffffffff0000003700000000root/opt/opensvc/usr/share/doc/template.comp_module.sh#!/bin/bash PATH_SCRIPT="$(cd $(/usr/bin/dirname $(type -p -- $0 || echo $0));pwd)" PATH_LIB=$PATH_SCRIPT/com.opensvc PREFIX=OSVC_COMP_FOO typeset -i r=0 case $1 in check) $PATH_LIB/files ${PREFIX}_FILES check [ $? -eq 1 ] && r=1 $PATH_LIB/packages ${PREFIX}_PKG check [ $? -eq 1 ] && r=1 exit $r ;; fix) $PATH_LIB/files ${PREFIX}_FILES check [ $? -eq 1 ] && exit 1 $PATH_LIB/packages ${PREFIX}_PKG check [ $? -eq 1 ] && exit 1 ;; fixable) exit 2 ;; esac 0707010002461f000081fd0000000000000000000000014faa9509000004d3000000ae00010002ffffffffffffffff0000003700000000root/opt/opensvc/usr/share/doc/template.comp_module.py#!/opt/opensvc/bin/python import os import sys sys.path.append(os.path.join(os.path.dirname(__file__), 'com.opensvc')) from comp import * import files import packages syntax = """syntax: %s check|fixable|fix"""%sys.argv[0] if len(sys.argv) != 2: print >>sys.stderr, "wrong number of arguments" print >>sys.stderr, syntax sys.exit(RET_ERR) objs = [] try: o = packages.CompPackages(prefix='OSVC_COMP_BDC_DHCPD_PACKAGE') objs.append(o) except NotApplicable: pass try: o = files.CompFiles(prefix='OSVC_COMP_BDC_DHCPD_FILE') objs.append(o) except NotApplicable: pass def check(): r = 0 for o in objs: r |= o.check() return r def fixable(): return RET_NA def fix(): r = 0 for o in objs: r |= o.fix() return r try: if sys.argv[1] == 'check': RET = check() elif sys.argv[1] == 'fix': RET = fix() elif sys.argv[1] == 'fixable': RET = fixable() else: print >>sys.stderr, "unsupported argument '%s'"%sys.argv[1] print >>sys.stderr, syntax RET = RET_ERR except NotApplicable: sys.exit(RET_NA) except: import traceback traceback.print_exc() sys.exit(RET_ERR) sys.exit(RET) 0707010002461b000081b40000000000000000000000014faa9509000001fa000000ae00010002ffffffffffffffff0000003200000000root/opt/opensvc/usr/share/doc/opensvc.haresource#!/bin/sh -e # # This script is to be copied to /etc/ha.d/resource.d/ in # LinuxHA cluster setup and referenced in /etc/ha.d/haresources # with the line: # # node1 opensvc MailTo::root@localhost::Alert_Cluster_Failover # # (replace node1 with the appropriate node name) # osvc_path=/opt/opensvc/bin osvc_opts="--parallel --cluster" allservices=${osvc_path}/allservices case $1 in start) ${allservices} ${osvc_opts} start ;; stop) ${allservices} ${osvc_opts} stop ;; esac 07070100024615000081b40000000000000000000000014faa95090000033c000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/usr/share/BANNER# # Copyright (c) 2011 Christophe Varoqui # Copyright (c) 2011 Cyril Galibern # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # 07070100024616000081b40000000000000000000000014faa950900006744000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/usr/share/COPYING GNU LESSER GENERAL PUBLIC LICENSE Version 2.1, February 1999 Copyright (C) 1991, 1999 Free Software Foundation, Inc. 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA Everyone is permitted to copy and distribute verbatim copies of this license document, but changing it is not allowed. [This is the first released version of the Lesser GPL. It also counts as the successor of the GNU Library Public License, version 2, hence the version number 2.1.] Preamble The licenses for most software are designed to take away your freedom to share and change it. By contrast, the GNU General Public Licenses are intended to guarantee your freedom to share and change free software--to make sure the software is free for all its users. This license, the Lesser General Public License, applies to some specially designated software packages--typically libraries--of the Free Software Foundation and other authors who decide to use it. You can use it too, but we suggest you first think carefully about whether this license or the ordinary General Public License is the better strategy to use in any particular case, based on the explanations below. When we speak of free software, we are referring to freedom of use, not price. Our General Public Licenses are designed to make sure that you have the freedom to distribute copies of free software (and charge for this service if you wish); that you receive source code or can get it if you want it; that you can change the software and use pieces of it in new free programs; and that you are informed that you can do these things. To protect your rights, we need to make restrictions that forbid distributors to deny you these rights or to ask you to surrender these rights. These restrictions translate to certain responsibilities for you if you distribute copies of the library or if you modify it. For example, if you distribute copies of the library, whether gratis or for a fee, you must give the recipients all the rights that we gave you. You must make sure that they, too, receive or can get the source code. If you link other code with the library, you must provide complete object files to the recipients, so that they can relink them with the library after making changes to the library and recompiling it. And you must show them these terms so they know their rights. We protect your rights with a two-step method: (1) we copyright the library, and (2) we offer you this license, which gives you legal permission to copy, distribute and/or modify the library. To protect each distributor, we want to make it very clear that there is no warranty for the free library. Also, if the library is modified by someone else and passed on, the recipients should know that what they have is not the original version, so that the original author's reputation will not be affected by problems that might be introduced by others. Finally, software patents pose a constant threat to the existence of any free program. We wish to make sure that a company cannot effectively restrict the users of a free program by obtaining a restrictive license from a patent holder. Therefore, we insist that any patent license obtained for a version of the library must be consistent with the full freedom of use specified in this license. Most GNU software, including some libraries, is covered by the ordinary GNU General Public License. This license, the GNU Lesser General Public License, applies to certain designated libraries, and is quite different from the ordinary General Public License. We use this license for certain libraries in order to permit linking those libraries into non-free programs. When a program is linked with a library, whether statically or using a shared library, the combination of the two is legally speaking a combined work, a derivative of the original library. The ordinary General Public License therefore permits such linking only if the entire combination fits its criteria of freedom. The Lesser General Public License permits more lax criteria for linking other code with the library. We call this license the "Lesser" General Public License because it does Less to protect the user's freedom than the ordinary General Public License. It also provides other free software developers Less of an advantage over competing non-free programs. These disadvantages are the reason we use the ordinary General Public License for many libraries. However, the Lesser license provides advantages in certain special circumstances. For example, on rare occasions, there may be a special need to encourage the widest possible use of a certain library, so that it becomes a de-facto standard. To achieve this, non-free programs must be allowed to use the library. A more frequent case is that a free library does the same job as widely used non-free libraries. In this case, there is little to gain by limiting the free library to free software only, so we use the Lesser General Public License. In other cases, permission to use a particular library in non-free programs enables a greater number of people to use a large body of free software. For example, permission to use the GNU C Library in non-free programs enables many more people to use the whole GNU operating system, as well as its variant, the GNU/Linux operating system. Although the Lesser General Public License is Less protective of the users' freedom, it does ensure that the user of a program that is linked with the Library has the freedom and the wherewithal to run that program using a modified version of the Library. The precise terms and conditions for copying, distribution and modification follow. Pay close attention to the difference between a "work based on the library" and a "work that uses the library". The former contains code derived from the library, whereas the latter must be combined with the library in order to run. GNU LESSER GENERAL PUBLIC LICENSE TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION 0. This License Agreement applies to any software library or other program which contains a notice placed by the copyright holder or other authorized party saying it may be distributed under the terms of this Lesser General Public License (also called "this License"). Each licensee is addressed as "you". A "library" means a collection of software functions and/or data prepared so as to be conveniently linked with application programs (which use some of those functions and data) to form executables. The "Library", below, refers to any such software library or work which has been distributed under these terms. A "work based on the Library" means either the Library or any derivative work under copyright law: that is to say, a work containing the Library or a portion of it, either verbatim or with modifications and/or translated straightforwardly into another language. (Hereinafter, translation is included without limitation in the term "modification".) "Source code" for a work means the preferred form of the work for making modifications to it. For a library, complete source code means all the source code for all modules it contains, plus any associated interface definition files, plus the scripts used to control compilation and installation of the library. Activities other than copying, distribution and modification are not covered by this License; they are outside its scope. The act of running a program using the Library is not restricted, and output from such a program is covered only if its contents constitute a work based on the Library (independent of the use of the Library in a tool for writing it). Whether that is true depends on what the Library does and what the program that uses the Library does. 1. You may copy and distribute verbatim copies of the Library's complete source code as you receive it, in any medium, provided that you conspicuously and appropriately publish on each copy an appropriate copyright notice and disclaimer of warranty; keep intact all the notices that refer to this License and to the absence of any warranty; and distribute a copy of this License along with the Library. You may charge a fee for the physical act of transferring a copy, and you may at your option offer warranty protection in exchange for a fee. 2. You may modify your copy or copies of the Library or any portion of it, thus forming a work based on the Library, and copy and distribute such modifications or work under the terms of Section 1 above, provided that you also meet all of these conditions: a) The modified work must itself be a software library. b) You must cause the files modified to carry prominent notices stating that you changed the files and the date of any change. c) You must cause the whole of the work to be licensed at no charge to all third parties under the terms of this License. d) If a facility in the modified Library refers to a function or a table of data to be supplied by an application program that uses the facility, other than as an argument passed when the facility is invoked, then you must make a good faith effort to ensure that, in the event an application does not supply such function or table, the facility still operates, and performs whatever part of its purpose remains meaningful. (For example, a function in a library to compute square roots has a purpose that is entirely well-defined independent of the application. Therefore, Subsection 2d requires that any application-supplied function or table used by this function must be optional: if the application does not supply it, the square root function must still compute square roots.) These requirements apply to the modified work as a whole. If identifiable sections of that work are not derived from the Library, and can be reasonably considered independent and separate works in themselves, then this License, and its terms, do not apply to those sections when you distribute them as separate works. But when you distribute the same sections as part of a whole which is a work based on the Library, the distribution of the whole must be on the terms of this License, whose permissions for other licensees extend to the entire whole, and thus to each and every part regardless of who wrote it. Thus, it is not the intent of this section to claim rights or contest your rights to work written entirely by you; rather, the intent is to exercise the right to control the distribution of derivative or collective works based on the Library. In addition, mere aggregation of another work not based on the Library with the Library (or with a work based on the Library) on a volume of a storage or distribution medium does not bring the other work under the scope of this License. 3. You may opt to apply the terms of the ordinary GNU General Public License instead of this License to a given copy of the Library. To do this, you must alter all the notices that refer to this License, so that they refer to the ordinary GNU General Public License, version 2, instead of to this License. (If a newer version than version 2 of the ordinary GNU General Public License has appeared, then you can specify that version instead if you wish.) Do not make any other change in these notices. Once this change is made in a given copy, it is irreversible for that copy, so the ordinary GNU General Public License applies to all subsequent copies and derivative works made from that copy. This option is useful when you wish to copy part of the code of the Library into a program that is not a library. 4. You may copy and distribute the Library (or a portion or derivative of it, under Section 2) in object code or executable form under the terms of Sections 1 and 2 above provided that you accompany it with the complete corresponding machine-readable source code, which must be distributed under the terms of Sections 1 and 2 above on a medium customarily used for software interchange. If distribution of object code is made by offering access to copy from a designated place, then offering equivalent access to copy the source code from the same place satisfies the requirement to distribute the source code, even though third parties are not compelled to copy the source along with the object code. 5. A program that contains no derivative of any portion of the Library, but is designed to work with the Library by being compiled or linked with it, is called a "work that uses the Library". Such a work, in isolation, is not a derivative work of the Library, and therefore falls outside the scope of this License. However, linking a "work that uses the Library" with the Library creates an executable that is a derivative of the Library (because it contains portions of the Library), rather than a "work that uses the library". The executable is therefore covered by this License. Section 6 states terms for distribution of such executables. When a "work that uses the Library" uses material from a header file that is part of the Library, the object code for the work may be a derivative work of the Library even though the source code is not. Whether this is true is especially significant if the work can be linked without the Library, or if the work is itself a library. The threshold for this to be true is not precisely defined by law. If such an object file uses only numerical parameters, data structure layouts and accessors, and small macros and small inline functions (ten lines or less in length), then the use of the object file is unrestricted, regardless of whether it is legally a derivative work. (Executables containing this object code plus portions of the Library will still fall under Section 6.) Otherwise, if the work is a derivative of the Library, you may distribute the object code for the work under the terms of Section 6. Any executables containing that work also fall under Section 6, whether or not they are linked directly with the Library itself. 6. As an exception to the Sections above, you may also combine or link a "work that uses the Library" with the Library to produce a work containing portions of the Library, and distribute that work under terms of your choice, provided that the terms permit modification of the work for the customer's own use and reverse engineering for debugging such modifications. You must give prominent notice with each copy of the work that the Library is used in it and that the Library and its use are covered by this License. You must supply a copy of this License. If the work during execution displays copyright notices, you must include the copyright notice for the Library among them, as well as a reference directing the user to the copy of this License. Also, you must do one of these things: a) Accompany the work with the complete corresponding machine-readable source code for the Library including whatever changes were used in the work (which must be distributed under Sections 1 and 2 above); and, if the work is an executable linked with the Library, with the complete machine-readable "work that uses the Library", as object code and/or source code, so that the user can modify the Library and then relink to produce a modified executable containing the modified Library. (It is understood that the user who changes the contents of definitions files in the Library will not necessarily be able to recompile the application to use the modified definitions.) b) Use a suitable shared library mechanism for linking with the Library. A suitable mechanism is one that (1) uses at run time a copy of the library already present on the user's computer system, rather than copying library functions into the executable, and (2) will operate properly with a modified version of the library, if the user installs one, as long as the modified version is interface-compatible with the version that the work was made with. c) Accompany the work with a written offer, valid for at least three years, to give the same user the materials specified in Subsection 6a, above, for a charge no more than the cost of performing this distribution. d) If distribution of the work is made by offering access to copy from a designated place, offer equivalent access to copy the above specified materials from the same place. e) Verify that the user has already received a copy of these materials or that you have already sent this user a copy. For an executable, the required form of the "work that uses the Library" must include any data and utility programs needed for reproducing the executable from it. However, as a special exception, the materials to be distributed need not include anything that is normally distributed (in either source or binary form) with the major components (compiler, kernel, and so on) of the operating system on which the executable runs, unless that component itself accompanies the executable. It may happen that this requirement contradicts the license restrictions of other proprietary libraries that do not normally accompany the operating system. Such a contradiction means you cannot use both them and the Library together in an executable that you distribute. 7. You may place library facilities that are a work based on the Library side-by-side in a single library together with other library facilities not covered by this License, and distribute such a combined library, provided that the separate distribution of the work based on the Library and of the other library facilities is otherwise permitted, and provided that you do these two things: a) Accompany the combined library with a copy of the same work based on the Library, uncombined with any other library facilities. This must be distributed under the terms of the Sections above. b) Give prominent notice with the combined library of the fact that part of it is a work based on the Library, and explaining where to find the accompanying uncombined form of the same work. 8. You may not copy, modify, sublicense, link with, or distribute the Library except as expressly provided under this License. Any attempt otherwise to copy, modify, sublicense, link with, or distribute the Library is void, and will automatically terminate your rights under this License. However, parties who have received copies, or rights, from you under this License will not have their licenses terminated so long as such parties remain in full compliance. 9. You are not required to accept this License, since you have not signed it. However, nothing else grants you permission to modify or distribute the Library or its derivative works. These actions are prohibited by law if you do not accept this License. Therefore, by modifying or distributing the Library (or any work based on the Library), you indicate your acceptance of this License to do so, and all its terms and conditions for copying, distributing or modifying the Library or works based on it. 10. Each time you redistribute the Library (or any work based on the Library), the recipient automatically receives a license from the original licensor to copy, distribute, link with or modify the Library subject to these terms and conditions. You may not impose any further restrictions on the recipients' exercise of the rights granted herein. You are not responsible for enforcing compliance by third parties with this License. 11. If, as a consequence of a court judgment or allegation of patent infringement or for any other reason (not limited to patent issues), conditions are imposed on you (whether by court order, agreement or otherwise) that contradict the conditions of this License, they do not excuse you from the conditions of this License. If you cannot distribute so as to satisfy simultaneously your obligations under this License and any other pertinent obligations, then as a consequence you may not distribute the Library at all. For example, if a patent license would not permit royalty-free redistribution of the Library by all those who receive copies directly or indirectly through you, then the only way you could satisfy both it and this License would be to refrain entirely from distribution of the Library. If any portion of this section is held invalid or unenforceable under any particular circumstance, the balance of the section is intended to apply, and the section as a whole is intended to apply in other circumstances. It is not the purpose of this section to induce you to infringe any patents or other property right claims or to contest validity of any such claims; this section has the sole purpose of protecting the integrity of the free software distribution system which is implemented by public license practices. Many people have made generous contributions to the wide range of software distributed through that system in reliance on consistent application of that system; it is up to the author/donor to decide if he or she is willing to distribute software through any other system and a licensee cannot impose that choice. This section is intended to make thoroughly clear what is believed to be a consequence of the rest of this License. 12. If the distribution and/or use of the Library is restricted in certain countries either by patents or by copyrighted interfaces, the original copyright holder who places the Library under this License may add an explicit geographical distribution limitation excluding those countries, so that distribution is permitted only in or among countries not thus excluded. In such case, this License incorporates the limitation as if written in the body of this License. 13. The Free Software Foundation may publish revised and/or new versions of the Lesser General Public License from time to time. Such new versions will be similar in spirit to the present version, but may differ in detail to address new problems or concerns. Each version is given a distinguishing version number. If the Library specifies a version number of this License which applies to it and "any later version", you have the option of following the terms and conditions either of that version or of any later version published by the Free Software Foundation. If the Library does not specify a license version number, you may choose any version ever published by the Free Software Foundation. 14. If you wish to incorporate parts of the Library into other free programs whose distribution conditions are incompatible with these, write to the author to ask for permission. For software which is copyrighted by the Free Software Foundation, write to the Free Software Foundation; we sometimes make exceptions for this. Our decision will be guided by the two goals of preserving the free status of all derivatives of our free software and of promoting the sharing and reuse of software generally. NO WARRANTY 15. BECAUSE THE LIBRARY IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY FOR THE LIBRARY, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE LIBRARY "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE LIBRARY IS WITH YOU. SHOULD THE LIBRARY PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION. 16. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR REDISTRIBUTE THE LIBRARY AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE LIBRARY (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE LIBRARY TO OPERATE WITH ANY OTHER SOFTWARE), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. END OF TERMS AND CONDITIONS How to Apply These Terms to Your New Libraries If you develop a new library, and you want it to be of the greatest possible use to the public, we recommend making it free software that everyone can redistribute and change. You can do so by permitting redistribution under these terms (or, alternatively, under the terms of the ordinary General Public License). To apply these terms, attach the following notices to the library. It is safest to attach them to the start of each source file to most effectively convey the exclusion of warranty; and each file should have at least the "copyright" line and a pointer to where the full notice is found. Copyright (C) This library is free software; you can redistribute it and/or modify it under the terms of the GNU Lesser General Public License as published by the Free Software Foundation; either version 2.1 of the License, or (at your option) any later version. This library is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Lesser General Public License for more details. You should have received a copy of the GNU Lesser General Public License along with this library; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA Also add information on how to contact you by electronic and paper mail. You should also get your employer (if you work as a programmer) or your school, if any, to sign a "copyright disclaimer" for the library, if necessary. Here is a sample; alter the names: Yoyodyne, Inc., hereby disclaims all copyright interest in the library `Frob' (a library for tweaking knobs) written by James Random Hacker. , 1 April 1990 Ty Coon, President of Vice That's all there is to it! 07070100024617000041ed0000000000000000000000024faab5bf00000000000000ae00010002ffffffffffffffff0000002d00000000root/opt/opensvc/usr/share/bash_completion.d07070100024618000081b40000000000000000000000014faa950900001ba8000000ae00010002ffffffffffffffff0000003500000000root/opt/opensvc/usr/share/bash_completion.d/opensvcsvcs=$(ls /opt/opensvc/etc/*env 2>/dev/null|xargs -n1 basename 2>/dev/null|sed -e "s/.env//") svcmgr_opts="--force --debug --waitlock --rid --tags --service" nodemgr_opts="--force --debug --cron" _svcmgr() { local a b c d prev COMPREPLY=() a="${COMP_WORDS[COMP_CWORD]}" prev="${COMP_WORDS[COMP_CWORD-1]}" # # Complete the arguments to some of the basic commands. # case "${prev}" in --tags) local tags=$(grep -h "tag" /opt/opensvc/etc/*env|cut -d= -f2) COMPREPLY=( $(compgen -W "${tags}" -- ${a}) ) return 0 ;; --rid) local rid=$(grep -h "\[.*\]" /opt/opensvc/etc/*env|sed -e "s/\[//"|sed -e "s/\]//") COMPREPLY=( $(compgen -W "${rid}" -- ${a}) ) return 0 ;; --service) COMPREPLY=( $(compgen -W "${svcs}" -- ${a}) ) return 0 ;; *) ;; esac if [ $COMP_CWORD -eq 1 ]; then local opts="configure create disklist freeze frozen mount postsync presync print_status printsvc prstart prstatus prstop push restart start startapp startcontainer startdisk startip startloop startpool startstandby startvg status stop stopapp stopcontainer stopdisk stopip stoploop stoppool stopvg syncall syncbreak syncdrp syncfullsync syncnodes syncquiesce syncresync syncupdate syncverify thaw umount collector compliance" elif [ $COMP_CWORD -eq 2 ]; then b="${COMP_WORDS[COMP_CWORD-1]}" case "${b}" in collector) local opts="ack alerts checks events status list show" ;; compliance) local opts="check fixable fix show list attach detach" ;; push) local opts="appinfo" ;; set) local opts="--param --value" ;; get|unset) local opts="--param" ;; resource) local opts="monitor" ;; print|json) local opts="disklist status" ;; *) ;; esac elif [ $COMP_CWORD -eq 3 ]; then b="${COMP_WORDS[COMP_CWORD-1]}" c="${COMP_WORDS[COMP_CWORD-2]}" case "${c} ${b}" in "collector ack") local opts="action" ;; "collector list") local opts="actions" ;; "collector show") local opts="actions" ;; "collector events") local opts="--begin --end" ;; "compliance list") local opts="ruleset moduleset" ;; "compliance show") local opts="ruleset moduleset" ;; "compliance fixable") local opts="--module --moduleset" ;; "compliance fix") local opts="--module --moduleset --attach" ;; "compliance check") local opts="--module --moduleset" ;; "compliance attach") local opts="moduleset ruleset" ;; "compliance detach") local opts="moduleset ruleset" ;; *) ;; esac elif [ $COMP_CWORD -eq 4 ]; then b="${COMP_WORDS[COMP_CWORD-1]}" c="${COMP_WORDS[COMP_CWORD-2]}" d="${COMP_WORDS[COMP_CWORD-3]}" case "${d} ${c} ${b}" in "collector ack action") local opts="--comment --author --duration" ;; "collector list actions") local opts="--begin --end" ;; "collector show action") local opts="--id --begin --end" ;; "compliance detach moduleset") local opts="--moduleset" ;; "compliance detach ruleset") local opts="--ruleset" ;; "compliance attach moduleset") local opts="--moduleset" ;; "compliance attach ruleset") local opts="--ruleset" ;; "compliance list moduleset") local opts="--moduleset" ;; "compliance list ruleset") local opts="--ruleset" ;; esac fi COMPREPLY=($(compgen -W "${opts}" -- ${a})) return 0 } _nodemgr() { local a b c d prev COMPREPLY=() a="${COMP_WORDS[COMP_CWORD]}" prev="${COMP_WORDS[COMP_CWORD-1]}" # # Complete the arguments to some of the basic commands. # case "${prev}" in --module) local opts=$(ls /opt/opensvc/var/compliance/[0-9]* | xargs -n1 basename | sed "s/^[0-9]*[-]//") COMPREPLY=( $(compgen -W "${opts}" -- ${a}) ) return 0 ;; *) ;; esac if [ $COMP_CWORD -eq 1 ]; then local opts="compliance collector pushasset pusheva pushsym pushservices syncservices pushstats pushpkg pushpatch push get set unset register reboot shutdown prkey updateservices" elif [ $COMP_CWORD -eq 2 ]; then b="${COMP_WORDS[COMP_CWORD-1]}" case "${b}" in collector) local opts="ack alerts checks events status list show" ;; compliance) local opts="check fixable fix show list attach detach" ;; push) local opts="appinfo" ;; set) local opts="--param --value" ;; get|unset) local opts="--param" ;; pushstats) local opts="--stats-dir --begin --end" ;; pushsym) local opts="--symcli-db-file" ;; *) ;; esac elif [ $COMP_CWORD -eq 3 ]; then b="${COMP_WORDS[COMP_CWORD-1]}" c="${COMP_WORDS[COMP_CWORD-2]}" case "${c} ${b}" in "collector ack") local opts="action" ;; "collector list") local opts="actions" ;; "collector show") local opts="actions" ;; "collector events") local opts="--begin --end" ;; "compliance list") local opts="ruleset moduleset" ;; "compliance show") local opts="ruleset moduleset" ;; "compliance fixable") local opts="--module --moduleset" ;; "compliance fix") local opts="--module --moduleset --attach" ;; "compliance check") local opts="--module --moduleset" ;; "compliance attach") local opts="moduleset ruleset" ;; "compliance detach") local opts="moduleset ruleset" ;; *) ;; esac elif [ $COMP_CWORD -eq 4 ]; then b="${COMP_WORDS[COMP_CWORD-1]}" c="${COMP_WORDS[COMP_CWORD-2]}" d="${COMP_WORDS[COMP_CWORD-3]}" case "${d} ${c} ${b}" in "collector ack action") local opts="--comment --author --duration" ;; "collector list actions") local opts="--begin --end" ;; "collector show action") local opts="--id --begin --end" ;; "compliance detach moduleset") local opts="--moduleset" ;; "compliance detach ruleset") local opts="--ruleset" ;; "compliance attach moduleset") local opts="--moduleset" ;; "compliance attach ruleset") local opts="--ruleset" ;; "compliance list moduleset") local opts="--moduleset" ;; "compliance list ruleset") local opts="--ruleset" ;; esac fi COMPREPLY=($(compgen -W "${opts}" -- ${a})) return 0 } opts=$svcmgr_opts complete -F _svcmgr svcmgr opts=$svcmgr_opts for s in ${svcs} ; do complete -F _svcmgr $s done opts=$nodemgr_opts complete -F _nodemgr nodemgr 07070100024614000081b40000000000000000000000014faa950900000030000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/usr/share/AUTHORSChristophe Varoqui 07070100024611000081b60000000000000000000000014faa950900000034000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/pax_global_header52 comment=f9197014d872d8f92098bbded2a27ca7fed78c83 07070100024500000041ed0000000000000000000000024faab5bf00000000000000ae00010002ffffffffffffffff0000001500000000root/opt/opensvc/lib0707010002450b000081b40000000000000000000000014faa950900000d5e000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/checkLagSunOS.py# # Copyright (c) 2012 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks import os from rcUtilities import justcall, which from rcGlobalEnv import rcEnv """ key: 1 (0x0001) policy: L4 address: 0:15:17:bb:82:d2 (auto) device address speed duplex link state e1000g0 0:15:17:bb:82:d2 1000 Mbps full up attached bnx0 0:24:e8:35:61:3b 1000 Mbps full up attached """ class check(checks.check): chk_type = "lag" chk_name = "Solaris network interface lag" def do_check(self): if not which("dladm"): return self.undef cmd = ['dladm', 'show-aggr'] out, err, ret = justcall(cmd) if ret != 0: return self.undef self.lines = out.split('\n') if len(self.lines) == 0: return self.undef r = [] r += self.do_check_speed() r += self.do_check_duplex() r += self.do_check_link() r += self.do_check_attach() return r def do_check_speed(self): r = [] lag = "" i = 0 for line in self.lines: l = line.split() if len(l) < 4: continue elif line.startswith('key'): lag = l[1] i = 0 continue elif l[0] == 'device': continue val = l[2] r.append({ 'chk_instance': 'lag %s.%d speed'%(lag, i), 'chk_value': str(val), 'chk_svcname': '', }) i += 1 return r def do_check_duplex(self): return self._do_check("duplex", "full", 4) def do_check_link(self): return self._do_check("link", "up", 5) def do_check_attach(self): return self._do_check("attach", "attached", 6) def _do_check(self, key, target, col): r = [] lag = "" i = 0 for line in self.lines: l = line.split() if len(l) < col+1: continue elif line.startswith('key'): lag = l[1] i = 0 continue elif l[0] == 'device': continue else: if l[col] != target: val = 1 else: val = 0 r.append({ 'chk_instance': 'lag %s.%d %s'%(lag, i, key), 'chk_value': str(val), 'chk_svcname': '', }) i += 1 return r 07070100024539000081b40000000000000000000000014faa950900002dbf000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcAssetLinux.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import datetime from rcUtilities import justcall, which import rcAsset def is_container(): p = '/proc/1/cgroup' if not os.path.exists(p): return False with open(p, 'r') as f: lines = f.readlines() if len(lines) != 1: return False l = lines[0].split(':') if l[-1].strip('\n') != '/': return True return False class Asset(rcAsset.Asset): def __init__(self, node): rcAsset.Asset.__init__(self, node) self.container = is_container() self.detect_xen() if self.container: self.dmidecode = [] else: (out, err, ret) = justcall(['dmidecode']) if ret != 0: self.dmidecode = [] else: self.dmidecode = out.split('\n') def _get_mem_bytes_esx(self): cmd = ['vmware-cmd', '-s', 'getresource', 'system.mem.totalMem'] (out, err, ret) = justcall(cmd) if ret != 0: return '0' l = out.split(' = ') if len(l) < 2: return '0' try: size = str(int(l[-1])/1024) except: size = '0' return size def _get_mem_bytes_hv(self): if which('virsh'): return self._get_mem_bytes_virsh() if which('xm'): return self._get_mem_bytes_xm() else: return '0' def _get_mem_bytes_virsh(self): cmd = ['virsh', 'nodeinfo'] (out, err, ret) = justcall(cmd) if ret != 0: return '0' lines = out.split('\n') for line in lines: if 'Memory size' not in line: continue l = line.split() if len(l) < 2: continue return l[-2] return '0' def _get_mem_bytes_xm(self): cmd = ['xm', 'info'] (out, err, ret) = justcall(cmd) if ret != 0: return '0' lines = out.split('\n') for line in lines: if 'total_mem' not in line: continue l = line.split(':') if len(l) < 2: continue return l[-1] return '0' def _get_mem_bytes_phy(self): cmd = ['free', '-m'] (out, err, ret) = justcall(cmd) if ret != 0: return '0' lines = out.split('\n') if len(lines) < 2: return '0' line = lines[1].split() if len(line) < 2: return '0' return line[1] def detect_xen(self): c = os.path.join(os.sep, 'proc', 'xen', 'capabilities') self.xenguest = False self.xenhv = False if not os.path.exists(c): return with open(c, 'r') as f: if 'control_d' in f.read(): self.xenhv = True else: self.xenguest = True def is_esx_hv(self): return which('vmware-cmd') def _get_mem_bytes(self): if self.xenhv: return self._get_mem_bytes_hv() elif self.is_esx_hv(): return self._get_mem_bytes_esx() else: return self._get_mem_bytes_phy() def _get_mem_banks(self): if self.container: return 'n/a' banks = 0 inBlock = False for l in self.dmidecode: if not inBlock and l == "Memory Device": inBlock = True if inBlock and "Size:" in l: e = l.split() if len(e) == 3: try: size = int(e[1]) banks += 1 except: pass return str(banks) def _get_mem_slots(self): if self.container: return 'n/a' for l in self.dmidecode: if 'Number Of Devices:' in l: return l.split()[-1] return '0' def _get_os_vendor(self): if os.path.exists('/etc/lsb-release'): with open('/etc/lsb-release') as f: for line in f.readlines(): if 'DISTRIB_ID' in line: return line.split('=')[-1].replace('\n','').strip('"') if os.path.exists('/etc/debian_version'): return 'Debian' if os.path.exists('/etc/SuSE-release'): return 'SuSE' if os.path.exists('/etc/vmware-release'): return 'VMware' if os.path.exists('/etc/oracle-release'): return 'Oracle' if os.path.exists('/etc/redhat-release'): with open('/etc/redhat-release', 'r') as f: buff = f.read() if 'CentOS' in buff: return 'CentOS' else: return 'Red Hat' return 'Unknown' def _get_os_release(self): files = ['/etc/debian_version', '/etc/vmware-release', '/etc/oracle-release', '/etc/redhat-release'] if os.path.exists('/etc/SuSE-release'): v = [] with open('/etc/SuSE-release') as f: for line in f.readlines(): if 'VERSION' in line: v += [line.split('=')[-1].replace('\n','').strip('" ')] if 'PATCHLEVEL' in line: v += [line.split('=')[-1].replace('\n','').strip('" ')] return '.'.join(v) if os.path.exists('/etc/lsb-release'): with open('/etc/lsb-release') as f: for line in f.readlines(): if 'DISTRIB_DESCRIPTION' in line: r = line.split('=')[-1].replace('\n','').strip('"') r = r.replace(self._get_os_vendor(), '').strip() return r for f in files: if os.path.exists(f): (out, err, ret) = justcall(['cat', f]) if ret != 0: return 'Unknown' return out.split('\n')[0].replace(self._get_os_vendor(), '').strip() return 'Unknown' def _get_os_kernel(self): (out, err, ret) = justcall(['uname', '-r']) if ret != 0: return 'Unknown' return out.split('\n')[0] def _get_os_arch(self): if which('arch') is not None: cmd = ['arch'] else: cmd = ['uname', '-m'] (out, err, ret) = justcall(cmd) if ret != 0: return 'Unknown' return out.split('\n')[0] def _get_cpu_freq(self): p = '/proc/cpuinfo' if not os.path.exists(p): return 'Unknown' with open(p, 'r') as f: for line in f.readlines(): if 'cpu MHz' in line: return line.split(':')[1].strip().split('.')[0] return 'Unknown' def _get_cpu_cores(self): if self.is_esx_hv(): return '0' with open('/proc/cpuinfo') as f: lines = f.readlines() lines = [l for l in lines if 'core id' in l] if len(lines) == 0: return self._get_cpu_dies() c = len(lines) return str(c) return '0' def _get_cpu_dies_dmi(self): if self.container: return 'n/a' n = 0 for l in self.dmidecode: if 'Processor Information' in l: n += 1 return str(n) def _get_cpu_dies_cpuinfo(self): if self.container: return 'n/a' (out, err, ret) = justcall(['grep', 'processor', '/proc/cpuinfo']) if ret != 0: return '1' lines = out.split('\n') c = lines[-2].split(':')[-1].replace('\n','').strip() c = int(c) + 1 return str(c) def _get_cpu_dies(self): try: return self._get_cpu_dies_dmi() except: return self._get_cpu_dies_cpuinfo() def _get_cpu_model(self): (out, err, ret) = justcall(['grep', 'model name', '/proc/cpuinfo']) if ret != 0: return 'Unknown' lines = out.split('\n') l = lines[0].split(':') return l[1].strip() def _get_serial(self): if self.container: return 'n/a' for l in self.dmidecode: if 'Serial Number:' in l: return l.split(':')[-1].strip() return 'Unknown' def _get_model(self): if self.container: return 'container' elif self.xenguest: return "Xen Virtual Machine (PVM)" for l in self.dmidecode: if 'Product Name:' in l: return l.split(':')[-1].strip() return 'Unknown' def get_iscsi_hba_id(self): path = os.path.join(os.sep, 'etc', 'iscsi', 'initiatorname.iscsi') hba_id = None if os.path.exists(path): with open(path, 'r') as f: hba_id = f.read().split('=')[-1].strip() return hba_id def _get_hba(self): # fc / fcoe l = [] import glob paths = glob.glob('/sys/class/fc_host/host*/port_name') for path in paths: host_link = '/'.join(path.split('/')[0:5]) if '/eth' in os.path.realpath(host_link): hba_type = 'fcoe' else: hba_type = 'fc' with open(path, 'r') as f: hba_id = f.read().strip('0x').strip('\n') l.append((hba_id, hba_type)) # iscsi path = os.path.join(os.sep, 'etc', 'iscsi', 'initiatorname.iscsi') hba_type = 'iscsi' hba_id = self.get_iscsi_hba_id() if hba_id is not None: l.append((hba_id, hba_type)) return l def _get_targets(self): # fc / fcoe l = [] import glob paths = glob.glob('/sys/class/fc_host/host*/port_name') for path in paths: with open(path, 'r') as f: hba_id = f.read().strip('0x').strip('\n') host = path.replace('/sys/class/fc_host/host', '') host = host[0:host.index('/')] for target in glob.glob('/sys/class/fc_transport/target%s:*/port_name'%host): with open(target, 'r') as f: tgt_id = f.read().strip('0x').strip('\n') l.append((hba_id, tgt_id)) # iscsi hba_id = self.get_iscsi_hba_id() if hba_id is not None: cmd = ['iscsiadm', '-m', 'session'] out, err, ret = justcall(cmd) if ret == 0: """ tcp: [1] 192.168.231.141:3260,1 iqn.2000-08.com.datacore:sds1-1 tcp: [2] 192.168.231.142:3260,1 iqn.2000-08.com.datacore:sds2-1 """ for line in out.split('\n'): if len(line) == 0: continue l.append((hba_id, line.split()[-1])) return l 07070100024540000081b40000000000000000000000014faa9509000007ed000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcDevTreeAIX.pyimport rcDevTree import rcLvmAIX import os import re from subprocess import * from rcUtilities import which from rcGlobalEnv import rcEnv class DevTree(rcDevTree.DevTree): def load_lvm(self): lvm = rcLvmAIX.Lvm() for vg in lvm.vg.values(): for lv in vg.lv.values(): d = self.add_dev(lv.name, self.disk_size(lv.name), "linear") d.set_devpath('/dev/'+lv.name) for parentname in lv.pv_size: size = lv.pv_size[parentname] d.add_parent(parentname, size, "linear") parent = self.get_dev(parentname) parent.add_child(d.devname, size, "linear") def load_lsdev(self): if not which("lsdev"): return cmd = ["lsdev", "-Cc", "disk"] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode: return """ hdisk0 Available Virtual SCSI Disk Drive hdisk1 Available Virtual SCSI Disk Drive """ for line in out.split('\n'): if len(line) == 0: continue l = line.split() devname = l[0] d = self.add_dev(devname, self.disk_size(devname), "linear") d.set_devpath('/dev/'+devname) def disk_size(self, devname): cmd = ["bootinfo", "-s", devname] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode: return 0 return int(out.strip()) def load(self): self.load_lsdev() self.load_lvm() def blacklist(self, devname): bl = [r'^loop[0-9]*.*', r'^ram[0-9]*.*', r'^scd[0-9]*', r'^sr[0-9]*'] for b in bl: if re.match(b, devname): return True return False if __name__ == "__main__": tree = DevTree() tree.load() #print tree tree.print_tree_bottom_up() #print map(lambda x: x.alias, tree.get_top_devs()) 0707010002460f000081b40000000000000000000000014faa95090000b747000000ae00010002ffffffffffffffff0000001c00000000root/opt/opensvc/lib/wmi.py""" Windows Management Instrumentation (WMI) is Microsoft's answer to the DMTF's Common Information Model. It allows you to query just about any conceivable piece of information from any computer which is running the necessary agent and over which have you the necessary authority. Since the COM implementation doesn't give much away to Python programmers, I've wrapped it in some lightweight classes with some getattr / setattr magic to ease the way. In particular: * The :class:`_wmi_namespace` object itself will determine its classes and allow you to return all instances of any of them by using its name as an attribute:: disks = wmi.WMI ().Win32_LogicalDisk () * In addition, you can specify what would become the WHERE clause as keyword parameters:: fixed_disks = wmi.WMI ().Win32_LogicalDisk (DriveType=3) * The objects returned by a WMI lookup are wrapped in a Python class which determines their methods and classes and allows you to access them as though they were Python classes. The methods only allow named parameters:: for p in wmi.WMI ().Win32_Process (Name="notepad.exe"): p.Terminate (Result=1) * Doing a print on one of the WMI objects will result in its `GetObjectText\_` method being called, which usually produces a meaningful printout of current values. The repr of the object will include its full WMI path, which lets you get directly to it if you need to. * You can get the associators and references of an object as a list of python objects by calling the associators () and references () methods on a WMI Python object:: for p in wmi.WMI ().Win32_Process (Name="notepad.exe"): for r in p.references (): print r .. note:: Don't do this on a Win32_ComputerSystem object; it will take all day and kill your machine! * WMI classes (as opposed to instances) are first-class objects, so you can get hold of a class, and call its methods or set up a watch against it:: process = wmi.WMI ().Win32_Process process.Create (CommandLine="notepad.exe") * To make it easier to use in embedded systems and py2exe-style executable wrappers, the module will not force early Dispatch. To do this, it uses a handy hack by Thomas Heller for easy access to constants. Typical usage will be:: import wmi vodev1 = wmi.WMI ("vodev1") for disk in vodev1.Win32_LogicalDisk (): if disk.DriveType == 3: space = 100 * long (disk.FreeSpace) / long (disk.Size) print "%s has %d%% free" % (disk.Name, space) Many thanks, obviously to Mark Hammond for creating the win32all extensions, but also to Alex Martelli and Roger Upole, whose c.l.py postings pointed me in the right direction. Thanks especially in release 1.2 to Paul Tiemann for his code contributions and robust testing. """ __VERSION__ = __version__ = "1.4.9" _DEBUG = False import sys import datetime import re import struct import warnings from win32com.client import GetObject, Dispatch import pywintypes def signed_to_unsigned (signed): """Convert a (possibly signed) long to unsigned hex. Useful when converting a COM error code to the more conventional 8-digit hex:: print "%08X" % signed_to_unsigned (-2147023174) """ unsigned, = struct.unpack ("L", struct.pack ("l", signed)) return unsigned class SelfDeprecatingDict (object): """Provides for graceful degradation of objects which are currently dictionaries (and therefore accessed via `.keys`, `.items`, etc.) into lists. Wraps an existing `dict` and allows it to be addressed as a `dict` or as a `list` during an interregnum, issuing a `DeprecationWarning` if accessed as a `dict`. """ dict_only = set (dir (dict)).difference (dir (list)) def __init__ (self, dictlike): self.dict = dict (dictlike) self.list = list (self.dict) def __getattr__ (self, attribute): if attribute in self.dict_only: warnings.warn ("In future this will be a list and not a dictionary", DeprecationWarning) return getattr (self.dict, attribute) else: return getattr (self.list, attribute) def __iter__ (self): return iter (self.list) def __str__ (self): return str (self.list) def __repr__ (self): return repr (self.list) def __getitem__ (self, item): try: return self.list[item] except TypeError: return self.dict[item] class ProvideConstants (object): """When called on a ``win32com.client.Dispatch`` object, provides lazy access to constants defined in the typelib. They can then be accessed as attributes of the :attr:`_constants` property. (From Thomas Heller on c.l.py). """ def __init__(self, comobj): comobj.__dict__["_constants"] = self self.__typecomp = \ comobj._oleobj_.GetTypeInfo().GetContainingTypeLib()[0].GetTypeComp() def __getattr__(self, name): if name.startswith("__") and name.endswith("__"): raise AttributeError (name) result = self.__typecomp.Bind(name) if not result[0]: raise AttributeError (name) return result[1].value obj = GetObject ("winmgmts:") ProvideConstants (obj) wbemErrInvalidQuery = obj._constants.wbemErrInvalidQuery wbemErrTimedout = obj._constants.wbemErrTimedout wbemFlagReturnImmediately = obj._constants.wbemFlagReturnImmediately wbemFlagForwardOnly = obj._constants.wbemFlagForwardOnly # # Exceptions # class x_wmi (Exception): """Ancestor of all wmi-related exceptions. Keeps track of an info message and the underlying COM error if any, exposed as the :attr:`com_error` attribute. """ def __init__ (self, info="", com_error=None): self.info = info self.com_error = com_error def __str__ (self): return "" % ( self.info or "Unexpected COM Error", self.com_error or "(no underlying exception)" ) class x_wmi_invalid_query (x_wmi): "Raised when a WMI returns `wbemErrInvalidQuery`" pass class x_wmi_timed_out (x_wmi): "Raised when a watcher times out" pass class x_wmi_no_namespace (x_wmi): """Raised when an attempt is made to query or watch from a class without a namespace. """ pass class x_access_denied (x_wmi): "Raised when WMI raises 80070005" pass class x_wmi_authentication (x_wmi): "Raised when an invalid combination of authentication properties is attempted when connecting" pass class x_wmi_uninitialised_thread (x_wmi): """Raised when WMI returns 800401E4 on connection, usually indicating that no COM threading model has been initialised """ pass WMI_EXCEPTIONS = { signed_to_unsigned (wbemErrInvalidQuery) : x_wmi_invalid_query, signed_to_unsigned (wbemErrTimedout) : x_wmi_timed_out, 0x80070005 : x_access_denied, 0x80041003 : x_access_denied, 0x800401E4 : x_wmi_uninitialised_thread, } def handle_com_error (err=None): """Convenience wrapper for displaying all manner of COM errors. Raises a :exc:`x_wmi` exception with more useful information attached :param err: The structure attached to a `pywintypes.com_error` """ if err is None: _, err, _ = sys.exc_info () hresult_code, hresult_name, additional_info, parameter_in_error = err.args hresult_code = signed_to_unsigned (hresult_code) exception_string = ["%s - %s" % (hex (hresult_code), hresult_name)] scode = None if additional_info: wcode, source_of_error, error_description, whlp_file, whlp_context, scode = additional_info scode = signed_to_unsigned (scode) exception_string.append (" Error in: %s" % source_of_error) exception_string.append (" %s - %s" % (hex (scode), (error_description or "").strip ())) for error_code, klass in WMI_EXCEPTIONS.items (): if error_code in (hresult_code, scode): break else: klass = x_wmi raise klass (com_error=err) BASE = datetime.datetime (1601, 1, 1) def from_1601 (ns100): return BASE + datetime.timedelta (microseconds=int (ns100) / 10) def from_time (year=None, month=None, day=None, hours=None, minutes=None, seconds=None, microseconds=None, timezone=None): """Convenience wrapper to take a series of date/time elements and return a WMI time of the form `yyyymmddHHMMSS.mmmmmm+UUU`. All elements may be int, string or omitted altogether. If omitted, they will be replaced in the output string by a series of stars of the appropriate length. :param year: The year element of the date/time :param month: The month element of the date/time :param day: The day element of the date/time :param hours: The hours element of the date/time :param minutes: The minutes element of the date/time :param seconds: The seconds element of the date/time :param microseconds: The microseconds element of the date/time :param timezone: The timeezone element of the date/time :returns: A WMI datetime string of the form: `yyyymmddHHMMSS.mmmmmm+UUU` """ def str_or_stars (i, length): if i is None: return "*" * length else: return str (i).rjust (length, "0") wmi_time = "" wmi_time += str_or_stars (year, 4) wmi_time += str_or_stars (month, 2) wmi_time += str_or_stars (day, 2) wmi_time += str_or_stars (hours, 2) wmi_time += str_or_stars (minutes, 2) wmi_time += str_or_stars (seconds, 2) wmi_time += "." wmi_time += str_or_stars (microseconds, 6) if timezone >= 0: wmi_time += "+" else: wmi_time += "-" timezone = abs (timezone) wmi_time += str_or_stars (timezone, 3) return wmi_time def to_time (wmi_time): """Convenience wrapper to take a WMI datetime string of the form yyyymmddHHMMSS.mmmmmm+UUU and return a 9-tuple containing the individual elements, or None where string contains placeholder stars. :param wmi_time: The WMI datetime string in `yyyymmddHHMMSS.mmmmmm+UUU` format :returns: A 9-tuple of (year, month, day, hours, minutes, seconds, microseconds, timezone) """ def int_or_none (s, start, end): try: return int (s[start:end]) except ValueError: return None year = int_or_none (wmi_time, 0, 4) month = int_or_none (wmi_time, 4, 6) day = int_or_none (wmi_time, 6, 8) hours = int_or_none (wmi_time, 8, 10) minutes = int_or_none (wmi_time, 10, 12) seconds = int_or_none (wmi_time, 12, 14) microseconds = int_or_none (wmi_time, 15, 21) timezone = wmi_time[22:] if timezone == "***": timezone = None return year, month, day, hours, minutes, seconds, microseconds, timezone def _set (obj, attribute, value): """Helper function to add an attribute directly into the instance dictionary, bypassing possible `__getattr__` calls :param obj: Any python object :param attribute: String containing attribute name :param value: Any python object """ obj.__dict__[attribute] = value class _wmi_method: """A currying sort of wrapper around a WMI method name. It abstract's the method's parameters and can be called like a normal Python object passing in the parameter values. Output parameters are returned from the call as a tuple. In addition, the docstring is set up as the method's signature, including an indication as to whether any given parameter is expecting an array, and what special privileges are required to call the method. """ def __init__ (self, ole_object, method_name): """ :param ole_object: The WMI class/instance whose method is to be called :param method_name: The name of the method to be called """ try: self.ole_object = Dispatch (ole_object) self.method = ole_object.Methods_ (method_name) self.qualifiers = {} for q in self.method.Qualifiers_: self.qualifiers[q.Name] = q.Value self.provenance = "\n".join (self.qualifiers.get ("MappingStrings", [])) self.in_parameters = self.method.InParameters self.out_parameters = self.method.OutParameters if self.in_parameters is None: self.in_parameter_names = [] else: self.in_parameter_names = [(i.Name, i.IsArray) for i in self.in_parameters.Properties_] if self.out_parameters is None: self.out_parameter_names = [] else: self.out_parameter_names = [(i.Name, i.IsArray) for i in self.out_parameters.Properties_] doc = "%s (%s) => (%s)" % ( method_name, ", ".join ([name + ("", "[]")[is_array] for (name, is_array) in self.in_parameter_names]), ", ".join ([name + ("", "[]")[is_array] for (name, is_array) in self.out_parameter_names]) ) privileges = self.qualifiers.get ("Privileges", []) if privileges: doc += " | Needs: " + ", ".join (privileges) self.__doc__ = doc except pywintypes.com_error: handle_com_error () def __call__ (self, *args, **kwargs): """Execute the call to a WMI method, returning a tuple (even if is of only one value) containing the out and return parameters. """ try: if self.in_parameters: parameter_names = {} for name, is_array in self.in_parameter_names: parameter_names[name] = is_array parameters = self.in_parameters # # Check positional parameters first # for n_arg in range (len (args)): arg = args[n_arg] parameter = parameters.Properties_[n_arg] if parameter.IsArray: try: list (arg) except TypeError: raise TypeError ("parameter %d must be iterable" % n_arg) parameter.Value = arg # # If any keyword param supersedes a positional one, # it'll simply overwrite it. # for k, v in kwargs.items (): is_array = parameter_names.get (k) if is_array is None: raise AttributeError ("%s is not a valid parameter for %s" % (k, self.__doc__)) else: if is_array: try: list (v) except TypeError: raise TypeError ("%s must be iterable" % k) parameters.Properties_ (k).Value = v result = self.ole_object.ExecMethod_ (self.method.Name, self.in_parameters) else: result = self.ole_object.ExecMethod_ (self.method.Name) results = [] for name, is_array in self.out_parameter_names: value = result.Properties_ (name).Value if is_array: # # Thanks to Jonas Bjering for bug report and patch # results.append (list (value or [])) else: results.append (value) return tuple (results) except pywintypes.com_error: handle_com_error () def __repr__ (self): return "" % self.__doc__ class _wmi_property (object): def __init__ (self, property): self.property = property self.name = property.Name self.value = property.Value self.qualifiers = dict ((q.Name, q.Value) for q in property.Qualifiers_) self.type = self.qualifiers.get ("CIMTYPE", None) def set (self, value): self.property.Value = value def __repr__ (self): return "" % self.name def __getattr__ (self, attr): return getattr (self.property, attr) # # class _wmi_object # class _wmi_object: """The heart of the WMI module: wraps the objects returned by COM ISWbemObject interface and provide readier access to their properties and methods resulting in a more Pythonic interface. Not usually instantiated directly, rather as a result of calling a :class:`_wmi_class` on the parent :class:`_wmi_namespace`. If you get hold of a WMI-related COM object from some other source than this module, you can wrap it in one of these objects to get the benefits of the module:: import win32com.client import wmi wmiobj = win32com.client.GetObject ("winmgmts:Win32_LogicalDisk.DeviceID='C:'") c_drive = wmi._wmi_object (wmiobj) print c_drive """ def __init__ (self, ole_object, instance_of=None, fields=[], property_map={}): try: _set (self, "ole_object", ole_object) _set (self, "id", ole_object.Path_.DisplayName.lower ()) _set (self, "_instance_of", instance_of) _set (self, "properties", {}) _set (self, "methods", {}) _set (self, "property_map", property_map) _set (self, "_associated_classes", None) _set (self, "_keys", None) if fields: for field in fields: self.properties[field] = None else: for p in ole_object.Properties_: self.properties[p.Name] = None for m in ole_object.Methods_: self.methods[m.Name] = None _set (self, "_properties", self.properties.keys ()) _set (self, "_methods", self.methods.keys ()) _set (self, "qualifiers", dict ((q.Name, q.Value) for q in self.ole_object.Qualifiers_)) except pywintypes.com_error: handle_com_error () def __lt__ (self, other): return self.id < other.id def __str__ (self): """For a call to print [object] return the OLE description of the properties / values of the object """ try: return self.ole_object.GetObjectText_ () except pywintypes.com_error: handle_com_error () def __repr__ (self): """ Indicate both the fact that this is a wrapped WMI object and the WMI object's own identifying class. """ try: return "<%s: %s>" % (self.__class__.__name__, self.Path_.Path.encode ("ascii", "backslashreplace")) except pywintypes.com_error: handle_com_error () def _cached_properties (self, attribute): if self.properties[attribute] is None: self.properties[attribute] = _wmi_property (self.ole_object.Properties_ (attribute)) return self.properties[attribute] def _cached_methods (self, attribute): if self.methods[attribute] is None: self.methods[attribute] = _wmi_method (self.ole_object, attribute) return self.methods[attribute] def __getattr__ (self, attribute): """ Attempt to pass attribute calls to the proxied COM object. If the attribute is recognised as a property, return its value; if it is recognised as a method, return a method wrapper which can then be called with parameters; otherwise pass the lookup on to the underlying object. """ try: if attribute in self.properties: property = self._cached_properties (attribute) factory = self.property_map.get (attribute, self.property_map.get (property.type, lambda x: x)) value = factory (property.value) # # If this is an association, certain of its properties # are actually the paths to the aspects of the association, # so translate them automatically into WMI objects. # if property.type.startswith ("ref:"): return WMI (moniker=value) else: return value elif attribute in self.methods: return self._cached_methods (attribute) else: return getattr (self.ole_object, attribute) except pywintypes.com_error: handle_com_error () def __setattr__ (self, attribute, value): """If the attribute to be set is valid for the proxied COM object, set that objects's parameter value; if not, raise an exception. """ try: if attribute in self.properties: self._cached_properties (attribute).set (value) if self.ole_object.Path_.Path: self.ole_object.Put_ () else: raise AttributeError (attribute) except pywintypes.com_error: handle_com_error () def __eq__ (self, other): return self.id == other.id def __hash__ (self): return hash (self.id) def _getAttributeNames (self): """Return list of methods/properties for IPython completion""" attribs = [str (x) for x in self.methods.keys ()] attribs.extend ([str (x) for x in self.properties.keys ()]) return attribs def _get_keys (self): """A WMI object is uniquely defined by a set of properties which constitute its keys. Lazily retrieves the keys for this instance or class. :returns: list of key property names """ # NB You can get the keys of an instance more directly, via # Path\_.Keys but this doesn't apply to classes. The technique # here appears to work for both. if self._keys is None: _set (self, "_keys", []) for property in self.ole_object.Properties_: for qualifier in property.Qualifiers_: if qualifier.Name == "key" and qualifier.Value: self._keys.append (property.Name) return self._keys keys = property (_get_keys) def wmi_property (self, property_name): """Return the cached object representing one property of this object """ return _wmi_property (self.ole_object.Properties_ (property_name)) def put (self): """Push all outstanding property updates back to the WMI database. """ self.ole_object.Put_ () def set (self, **kwargs): """Set several properties of the underlying object at one go. This is particularly useful in combination with the new () method below. However, an instance which has been spawned in this way won't have enough information to write pack, so only try if the instance has a path. """ if kwargs: try: for attribute, value in kwargs.items (): if attribute in self.properties: self._cached_properties (attribute).set (value) else: raise AttributeError (attribute) # # Only try to write the attributes # back if the object exists. # if self.ole_object.Path_.Path: self.ole_object.Put_ () except pywintypes.com_error: handle_com_error () def path (self): """Return the WMI URI to this object. Can be used to determine the path relative to the parent namespace:: pp0 = wmi.WMI ().Win32_ParallelPort ()[0] print pp0.path ().RelPath .. Do more with this """ try: return self.ole_object.Path_ except pywintypes.com_error: handle_com_error () def derivation (self): """Return a tuple representing the object derivation for this object, with the most specific object first:: pp0 = wmi.WMI ().Win32_ParallelPort ()[0] print ' <- '.join (pp0.derivation ()) """ try: return self.ole_object.Derivation_ except pywintypes.com_error: handle_com_error () def _cached_associated_classes (self): if self._associated_classes is None: if isinstance (self, _wmi_class): params = {'bSchemaOnly' : True} else: params = {'bClassesOnly' : True} try: associated_classes = dict ( (assoc.Path_.Class, _wmi_class (self._namespace, assoc)) for assoc in self.ole_object.Associators_ (**params) ) _set (self, "_associated_classes", associated_classes) except pywintypes.com_error: handle_com_error () return self._associated_classes associated_classes = property (_cached_associated_classes) def associators (self, wmi_association_class="", wmi_result_class=""): """Return a list of objects related to this one, optionally limited either by association class (ie the name of the class which relates them) or by result class (ie the name of the class which would be retrieved):: c = wmi.WMI () pp = c.Win32_ParallelPort ()[0] for i in pp.associators (wmi_association_class="Win32_PortResource"): print i for i in pp.associators (wmi_result_class="Win32_PnPEntity"): print i """ try: return [ _wmi_object (i) for i in \ self.ole_object.Associators_ ( strAssocClass=wmi_association_class, strResultClass=wmi_result_class ) ] except pywintypes.com_error: handle_com_error () def references (self, wmi_class=""): """Return a list of associations involving this object, optionally limited by the result class (the name of the association class). NB Associations are treated specially; although WMI only returns the string corresponding to the instance of each associated object, this module will automatically convert that to the object itself:: c = wmi.WMI () sp = c.Win32_SerialPort ()[0] for i in sp.references (): print i for i in sp.references (wmi_class="Win32_SerialPortSetting"): print i """ # # FIXME: Allow an actual class to be passed in, using # its .Path_.RelPath property to determine the string # try: return [_wmi_object (i) for i in self.ole_object.References_ (strResultClass=wmi_class)] except pywintypes.com_error: handle_com_error () # # class _wmi_event # class _wmi_event (_wmi_object): """Slight extension of the _wmi_object class to allow objects which are the result of events firing to return extra information such as the type of event. """ event_type_re = re.compile ("__Instance(Creation|Modification|Deletion)Event") def __init__ (self, event, event_info, fields=[]): _wmi_object.__init__ (self, event, fields=fields) _set (self, "event_type", None) _set (self, "timestamp", None) _set (self, "previous", None) if event_info: event_type = self.event_type_re.match (event_info.Path_.Class).group (1).lower () _set (self, "event_type", event_type) if hasattr (event_info, "TIME_CREATED"): _set (self, "timestamp", from_1601 (event_info.TIME_CREATED)) if hasattr (event_info, "PreviousInstance"): _set (self, "previous", event_info.PreviousInstance) # # class _wmi_class # class _wmi_class (_wmi_object): """Currying class to assist in issuing queries against a WMI namespace. The idea is that when someone issues an otherwise unknown method against the WMI object, if it matches a known WMI class a query object will be returned which may then be called with one or more params which will form the WHERE clause:: c = wmi.WMI () c_drives = c.Win32_LogicalDisk (Name='C:') """ def __init__ (self, namespace, wmi_class): _wmi_object.__init__ (self, wmi_class) _set (self, "_class_name", wmi_class.Path_.Class) if namespace: _set (self, "_namespace", namespace) else: class_moniker = wmi_class.Path_.DisplayName winmgmts, namespace_moniker, class_name = class_moniker.split (":") namespace = _wmi_namespace (GetObject (winmgmts + ":" + namespace_moniker), False) _set (self, "_namespace", namespace) def __getattr__ (self, attribute): try: if attribute in self.properties: return _wmi_property (self.Properties_ (attribute)) else: return _wmi_object.__getattr__ (self, attribute) except pywintypes.com_error: handle_com_error () def query (self, fields=[], **where_clause): """Make it slightly easier to query against the class, by calling the namespace's query with the class preset. Won't work if the class has been instantiated directly. """ # # FIXME: Not clear if this can ever happen # if self._namespace is None: raise x_wmi_no_namespace ("You cannot query directly from a WMI class") try: field_list = ", ".join (fields) or "*" wql = "SELECT " + field_list + " FROM " + self._class_name if where_clause: wql += " WHERE " + " AND ". join (["%s = %r" % (k, str (v)) for k, v in where_clause.items ()]) return self._namespace.query (wql, self, fields) except pywintypes.com_error: handle_com_error () __call__ = query def watch_for ( self, notification_type="operation", delay_secs=1, fields=[], **where_clause ): if self._namespace is None: raise x_wmi_no_namespace ("You cannot watch directly from a WMI class") valid_notification_types = ("operation", "creation", "deletion", "modification") if notification_type.lower () not in valid_notification_types: raise x_wmi ("notification_type must be one of %s" % ", ".join (valid_notification_types)) return self._namespace.watch_for ( notification_type=notification_type, wmi_class=self, delay_secs=delay_secs, fields=fields, **where_clause ) def instances (self): """Return a list of instances of the WMI class """ try: return [_wmi_object (instance, self) for instance in self.Instances_ ()] except pywintypes.com_error: handle_com_error () def new (self, **kwargs): """This is the equivalent to the raw-WMI SpawnInstance\_ method. Note that there are relatively few uses for this, certainly fewer than you might imagine. Most classes which need to create a new *real* instance of themselves, eg Win32_Process, offer a .Create method. SpawnInstance\_ is generally reserved for instances which are passed as parameters to such `.Create` methods, a common example being the `Win32_SecurityDescriptor`, passed to `Win32_Share.Create` and other instances which need security. The example here is `Win32_ProcessStartup`, which controls the shown/hidden state etc. of a new `Win32_Process` instance:: import win32con import wmi c = wmi.WMI () startup = c.Win32_ProcessStartup.new (ShowWindow=win32con.SW_SHOWMINIMIZED) pid, retval = c.Win32_Process.Create ( CommandLine="notepad.exe", ProcessStartupInformation=startup ) .. warning:: previous versions of this docstring illustrated using this function to create a new process. This is *not* a good example of its use; it is better handled with something like the example above. """ try: obj = _wmi_object (self.SpawnInstance_ (), self) obj.set (**kwargs) return obj except pywintypes.com_error: handle_com_error () # # class _wmi_result # class _wmi_result: """Simple, data only result for targeted WMI queries which request data only result classes via fetch_as_classes. """ def __init__(self, obj, attributes): if attributes: for attr in attributes: self.__dict__[attr] = obj.Properties_ (attr).Value else: for p in obj.Properties_: attr = p.Name self.__dict__[attr] = obj.Properties_(attr).Value # # class WMI # class _wmi_namespace: """A WMI root of a computer system. The classes attribute holds a list of the classes on offer. This means you can explore a bit with things like this:: c = wmi.WMI () for i in c.classes: if "user" in i.lower (): print i """ def __init__ (self, namespace, find_classes): _set (self, "_namespace", namespace) # # wmi attribute preserved for backwards compatibility # _set (self, "wmi", namespace) self._classes = None self._classes_map = {} # # Pick up the list of classes under this namespace # so that they can be queried, and used as though # properties of the namespace by means of the __getattr__ # hook below. # If the namespace does not support SubclassesOf, carry on # regardless # if find_classes: _ = self.classes def __repr__ (self): return "<_wmi_namespace: %s>" % self.wmi def __str__ (self): return repr (self) def _get_classes (self): if self._classes is None: self._classes = self.subclasses_of () return SelfDeprecatingDict (dict.fromkeys (self._classes)) classes = property (_get_classes) def get (self, moniker): try: return _wmi_object (self.wmi.Get (moniker)) except pywintypes.com_error: handle_com_error () def handle (self): """The raw OLE object representing the WMI namespace""" return self._namespace def subclasses_of (self, root="", regex=r".*"): try: SubclassesOf = self._namespace.SubclassesOf except AttributeError: return set () else: return set ( c.Path_.Class for c in SubclassesOf (root) if re.match (regex, c.Path_.Class) ) def instances (self, class_name): """Return a list of instances of the WMI class. This is (probably) equivalent to querying with no qualifiers:: wmi.WMI ().instances ("Win32_LogicalDisk") # should be the same as wmi.WMI ().Win32_LogicalDisk () """ try: return [_wmi_object (obj) for obj in self._namespace.InstancesOf (class_name)] except pywintypes.com_error: handle_com_error () def new (self, wmi_class, **kwargs): """This is now implemented by a call to :meth:`_wmi_class.new`""" return getattr (self, wmi_class).new (**kwargs) new_instance_of = new def _raw_query (self, wql): """Execute a WQL query and return its raw results. Use the flags recommended by Microsoft to achieve a read-only, semi-synchronous query where the time is taken while looping through. NB Backslashes need to be doubled up. """ flags = wbemFlagReturnImmediately | wbemFlagForwardOnly wql = wql.replace ("\\", "\\\\") try: return self._namespace.ExecQuery (strQuery=wql, iFlags=flags) except pywintypes.com_error: handle_com_error () def query (self, wql, instance_of=None, fields=[]): """Perform an arbitrary query against a WMI object, and return a list of _wmi_object representations of the results. """ return [ _wmi_object (obj, instance_of, fields) for obj in self._raw_query(wql) ] def fetch_as_classes (self, wmi_classname, fields=(), **where_clause): """Build and execute a wql query to fetch the specified list of fields from the specified wmi_classname + where_clause, then return the results as a list of simple class instances with attributes matching field_list. If fields is left empty, select * and pre-load all class attributes for each class returned. """ wql = "SELECT %s FROM %s" % (fields and ", ".join (fields) or "*", wmi_classname) if where_clause: wql += " WHERE " + " AND ".join (["%s = '%s'" % (k, v) for k, v in where_clause.items()]) return [_wmi_result (obj, fields) for obj in self._raw_query(wql)] def fetch_as_lists (self, wmi_classname, fields, **where_clause): """Build and execute a wql query to fetch the specified list of fields from the specified wmi_classname + where_clause, then return the results as a list of lists whose values correspond to field_list. """ wql = "SELECT %s FROM %s" % (", ".join (fields), wmi_classname) if where_clause: wql += " WHERE " + " AND ".join (["%s = '%s'" % (k, v) for k, v in where_clause.items()]) results = [] for obj in self._raw_query(wql): results.append ([obj.Properties_ (field).Value for field in fields]) return results def watch_for ( self, raw_wql=None, notification_type="operation", wmi_class=None, delay_secs=1, fields=[], **where_clause ): """Set up an event tracker on a WMI event. This function returns an wmi_watcher which can be called to get the next event:: c = wmi.WMI () raw_wql = "SELECT * FROM __InstanceCreationEvent WITHIN 2 WHERE TargetInstance ISA 'Win32_Process'" watcher = c.watch_for (raw_wql=raw_wql) while 1: process_created = watcher () print process_created.Name # or watcher = c.watch_for ( notification_type="Creation", wmi_class="Win32_Process", delay_secs=2, Name='calc.exe' ) calc_created = watcher () Now supports timeout on the call to watcher:: import pythoncom import wmi c = wmi.WMI (privileges=["Security"]) watcher1 = c.watch_for ( notification_type="Creation", wmi_class="Win32_NTLogEvent", Type="error" ) watcher2 = c.watch_for ( notification_type="Creation", wmi_class="Win32_NTLogEvent", Type="warning" ) while 1: try: error_log = watcher1 (500) except wmi.x_wmi_timed_out: pythoncom.PumpWaitingMessages () else: print error_log try: warning_log = watcher2 (500) except wmi.x_wmi_timed_out: pythoncom.PumpWaitingMessages () else: print warning_log """ if isinstance (wmi_class, _wmi_class): class_name = wmi_class._class_name else: class_name = wmi_class wmi_class = getattr (self, class_name) is_extrinsic = "__ExtrinsicEvent" in wmi_class.derivation () if raw_wql: wql = raw_wql else: fields = set (['TargetInstance'] + (fields or ["*"])) field_list = ", ".join (fields) if is_extrinsic: if where_clause: where = " WHERE " + " AND ".join (["%s = '%s'" % (k, v) for k, v in where_clause.items ()]) else: where = "" wql = "SELECT " + field_list + " FROM " + class_name + where else: if where_clause: where = " AND " + " AND ".join (["TargetInstance.%s = '%s'" % (k, v) for k, v in where_clause.items ()]) else: where = "" wql = \ "SELECT %s FROM __Instance%sEvent WITHIN %d WHERE TargetInstance ISA '%s' %s" % \ (field_list, notification_type, delay_secs, class_name, where) try: return _wmi_watcher ( self._namespace.ExecNotificationQuery (wql), is_extrinsic=is_extrinsic, fields=fields ) except pywintypes.com_error: handle_com_error () def __getattr__ (self, attribute): """Offer WMI classes as simple attributes. Pass through any untrapped unattribute to the underlying OLE object. This means that new or unmapped functionality is still available to the module user. """ # # Don't try to match against known classes as was previously # done since the list may not have been requested # (find_classes=False). # try: return self._cached_classes (attribute) except pywintypes.com_error: return getattr (self._namespace, attribute) def _cached_classes (self, class_name): """Standard caching helper which keeps track of classes already retrieved by name and returns the existing object if found. If this is the first retrieval, store it and pass it back """ if class_name not in self._classes_map: self._classes_map[class_name] = _wmi_class (self, self._namespace.Get (class_name)) return self._classes_map[class_name] def _getAttributeNames (self): """Return list of classes for IPython completion engine""" return [x for x in self.classes if not x.startswith ('__')] # # class _wmi_watcher # class _wmi_watcher: """Helper class for WMI.watch_for below (qv)""" _event_property_map = { "TargetInstance" : _wmi_object, "PreviousInstance" : _wmi_object } def __init__ (self, wmi_event, is_extrinsic, fields=[]): self.wmi_event = wmi_event self.is_extrinsic = is_extrinsic self.fields = fields def __call__ (self, timeout_ms=-1): """When called, return the instance which caused the event. Supports timeout in milliseconds (defaulting to infinite). If the watcher times out, :exc:`x_wmi_timed_out` is raised. This makes it easy to support watching for multiple objects. """ try: event = self.wmi_event.NextEvent (timeout_ms) if self.is_extrinsic: return _wmi_event (event, None, self.fields) else: return _wmi_event ( event.Properties_ ("TargetInstance").Value, _wmi_object (event, property_map=self._event_property_map), self.fields ) except pywintypes.com_error: handle_com_error () PROTOCOL = "winmgmts:" def connect ( computer="", impersonation_level="", authentication_level="", authority="", privileges="", moniker="", wmi=None, namespace="", suffix="", user="", password="", find_classes=False, debug=False ): """The WMI constructor can either take a ready-made moniker or as many parts of one as are necessary. Eg:: c = wmi.WMI (moniker="winmgmts:{impersonationLevel=Delegate}//remote") # or c = wmi.WMI (computer="remote", privileges=["!RemoteShutdown", "Security"]) I daren't link to a Microsoft URL; they change so often. Try Googling for WMI construct moniker and see what it comes back with. For complete control, a named argument "wmi" can be supplied, which should be a SWbemServices object, which you create yourself. Eg:: loc = win32com.client.Dispatch("WbemScripting.SWbemLocator") svc = loc.ConnectServer(...) c = wmi.WMI(wmi=svc) This is the only way of connecting to a remote computer with a different username, as the moniker syntax does not allow specification of a user name. If the `wmi` parameter is supplied, all other parameters are ignored. """ global _DEBUG _DEBUG = debug try: try: if wmi: obj = wmi elif moniker: if not moniker.startswith (PROTOCOL): moniker = PROTOCOL + moniker obj = GetObject (moniker) else: if user: if privileges or suffix: raise x_wmi_authentication ("You can't specify privileges or a suffix as well as a username") elif computer in (None, '', '.'): raise x_wmi_authentication ("You can only specify user/password for a remote connection") else: obj = connect_server ( server=computer, namespace=namespace, user=user, password=password, authority=authority, impersonation_level=impersonation_level, authentication_level=authentication_level ) else: moniker = construct_moniker ( computer=computer, impersonation_level=impersonation_level, authentication_level=authentication_level, authority=authority, privileges=privileges, namespace=namespace, suffix=suffix ) obj = GetObject (moniker) wmi_type = get_wmi_type (obj) if wmi_type == "namespace": return _wmi_namespace (obj, find_classes) elif wmi_type == "class": return _wmi_class (None, obj) elif wmi_type == "instance": return _wmi_object (obj) else: raise x_wmi ("Unknown moniker type") except pywintypes.com_error: handle_com_error () except x_wmi_uninitialised_thread: raise x_wmi_uninitialised_thread ("WMI returned a syntax error: you're probably running inside a thread without first calling pythoncom.CoInitialize[Ex]") WMI = connect def construct_moniker ( computer=None, impersonation_level=None, authentication_level=None, authority=None, privileges=None, namespace=None, suffix=None ): security = [] if impersonation_level: security.append ("impersonationLevel=%s" % impersonation_level) if authentication_level: security.append ("authenticationLevel=%s" % authentication_level) # # Use of the authority descriptor is invalid on the local machine # if authority and computer: security.append ("authority=%s" % authority) if privileges: security.append ("(%s)" % ", ".join (privileges)) moniker = [PROTOCOL] if security: moniker.append ("{%s}!" % ",".join (security)) if computer: moniker.append ("//%s/" % computer) if namespace: parts = re.split (r"[/\\]", namespace) if parts[0] != 'root': parts.insert (0, "root") moniker.append ("/".join (parts)) if suffix: moniker.append (":%s" % suffix) return "".join (moniker) def get_wmi_type (obj): try: path = obj.Path_ except AttributeError: return "namespace" else: if path.IsClass: return "class" else: return "instance" def connect_server ( server, namespace = "", user = "", password = "", locale = "", authority = "", impersonation_level="", authentication_level="", security_flags = 0x80, named_value_set = None ): """Return a remote server running WMI :param server: name of the server :param namespace: namespace to connect to - defaults to whatever's defined as default :param user: username to connect as, either local or domain (dom\\name or user@domain for XP) :param password: leave blank to use current context :param locale: desired locale in form MS_XXXX (eg MS_409 for Am En) :param authority: either "Kerberos:" or an NT domain. Not needed if included in user :param impersonation_level: valid WMI impersonation level :param security_flags: if 0, connect will wait forever; if 0x80, connect will timeout at 2 mins :param named_value_set: typically empty, otherwise a context-specific `SWbemNamedValueSet` Example:: remote_connetion = wmi.connect_server ( server="remote_machine", user="myname", password="mypassword" ) c = wmi.WMI (wmi=remote_connection) """ # # Thanks to Matt Mercer for example code to set # impersonation & authentication on ConnectServer # if impersonation_level: try: impersonation = getattr (obj._constants, "wbemImpersonationLevel%s" % impersonation_level.title ()) except AttributeError: raise x_wmi_authentication ("No such impersonation level: %s" % impersonation_level) else: impersonation = None if authentication_level: try: authentication = getattr (obj._constants, "wbemAuthenticationLevel%s" % authentication_level.title ()) except AttributeError: raise x_wmi_authentication ("No such impersonation level: %s" % impersonation_level) else: authentication = None server = Dispatch ("WbemScripting.SWbemLocator").\ ConnectServer ( server, namespace, user, password, locale, authority, security_flags, named_value_set ) if impersonation: server.Security_.ImpersonationLevel = impersonation if authentication: server.Security_.AuthenticationLevel = authentication return server def Registry ( computer=None, impersonation_level="Impersonate", authentication_level="Default", authority=None, privileges=None, moniker=None ): warnings.warn ("This function can be implemented using wmi.WMI (namespace='DEFAULT').StdRegProv", DeprecationWarning) if not moniker: moniker = construct_moniker ( computer=computer, impersonation_level=impersonation_level, authentication_level=authentication_level, authority=authority, privileges=privileges, namespace="default", suffix="StdRegProv" ) try: return _wmi_object (GetObject (moniker)) except pywintypes.com_error: handle_com_error () # # Typical use test # if __name__ == '__main__': system = WMI () for my_computer in system.Win32_ComputerSystem (): print ("Disks on", my_computer.Name) for disk in system.Win32_LogicalDisk (): print (disk.Caption, disk.Description, disk.ProviderName or "") 070701000245f5000081b40000000000000000000000014faa950900002862000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/resVgRawLinux.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import resVgRaw import os import rcStatus import re import rcExceptions as ex from rcGlobalEnv import * class Vg(resVgRaw.Vg): def __init__(self, rid=None, devs=set([]), user="root", group="root", perm="660", type=None, optional=False, disabled=False, tags=set([]), always_on=set([]), monitor=False): resVgRaw.Vg.__init__(self, rid=rid, devs=devs, user=user, group=group, perm=perm, type=type, optional=optional, disabled=disabled, tags=tags, always_on=always_on, monitor=monitor) self.min_raw = 1 self.raws = {} def get_devs_t(self): self.devs_t = {} for dev in self.devs: d = os.stat(dev) self.devs_t[dev] = (os.major(d.st_rdev), os.minor(d.st_rdev)) def get_rdevnames(self): self.rdevs_t = {} for dirpath, dirnames, filenames in os.walk('/dev/raw'): for filename in filenames: f = os.path.join(dirpath, filename) d = os.stat(f) self.rdevs_t[(os.major(d.st_rdev), os.minor(d.st_rdev))] = filename def modprobe(self): cmd = ["raw", "-qa"] ret, out, err = self.call(cmd) if ret == 0: # no need to load (already loaded or compiled-in) return cmd = ["lsmod"] ret, out, err = self.call(cmd) if ret != 0: raise ex.excError if "raw" in out.split(): return cmd = ["modprobe", "raw"] ret, out, err = self.vcall(cmd) if ret != 0: self.log.error("failed to load raw device driver") raise ex.excError def get_raws(self): self.modprobe() self.sysfs_raw_path = os.path.join(os.sep, 'sys', 'class', 'raw') for dirpath, dirnames, filenames in os.walk(self.sysfs_raw_path): for dirname in dirnames: if dirname == 'rawctl': continue dev = os.path.join(dirpath, dirname, 'dev') if not os.path.exists(dev): continue with open(dev, 'r') as f: buff = f.read() try: major, minor = buff.strip().split(':') except: continue self.raws[dirname] = {'rdev': (int(major), int(minor))} cmd = ['raw', '-qa'] ret, out, err = self.call(cmd) if ret != 0: self.log.error('failed to fetch raw device bindings') raise ex.excError for line in out.split('\n'): l = line.split() if len(l) != 7: continue raw = l[0].strip(':').replace('/dev/raw/','') major = int(l[4].strip(',')) minor = int(l[6]) if raw in self.raws: self.raws[raw]['bdev'] = (major, minor) self.get_devs_t() for dev, dev_t in self.devs_t.items(): for raw, d in self.raws.items(): if dev_t == d['bdev']: self.raws[raw]['devname'] = dev self.get_rdevnames() for raw, d in self.raws.items(): if d['rdev'] in self.rdevs_t: self.raws[raw]['rdevname'] = self.rdevs_t[d['rdev']] def find_next_raw(self): allocated = set(map(lambda x: x['rdev'][1], self.raws.values())) candidates = set(range(1, 255)) candidates -= allocated if len(candidates) == 0: self.log.error("no more raw device can be allocated") raise ex.excError return '/dev/raw/raw%d'%sorted(list(candidates))[0] def devname_to_rdevname(self, devname): b = os.path.basename(devname) return '/dev/raw/'+self.svc.svcname+"."+b def find_raw(self, dev): for raw, d in self.raws.items(): if 'devname' in d and dev == d['devname']: return raw return None def lock(self, timeout=30, delay=1): import lock lockfile = os.path.join(rcEnv.pathlock, 'startvgraw') lockfd = None try: lockfd = lock.lock(timeout=timeout, delay=delay, lockfile=lockfile) except lock.lockTimeout: self.log.error("timed out waiting for lock") raise ex.excError except lock.lockNoLockFile: self.log.error("lock_nowait: set the 'lockfile' param") raise ex.excError except lock.lockCreateError: self.log.error("can not create lock file %s"%lockfile) raise ex.excError except lock.lockAcquire as e: self.log.warn("another action is currently running (pid=%s)"%e.pid) raise ex.excError except ex.excSignal: self.log.error("interrupted by signal") raise ex.excError except: self.log.error("unexpected locking error") import traceback traceback.print_exc() raise ex.excError self.lockfd = lockfd def unlock(self): import lock lock.unlock(self.lockfd) def has_it(self): """Returns True if all raw devices are present and correctly named """ r = False if len(self.devs_not_found) > 0: self.status_log("%s not found"%', '.join(self.devs_not_found)) r |= True self.get_raws() for dev in self.devs: raw = self.find_raw(dev) if raw is None: self.status_log("%s is not mapped to a raw device"%dev) r |= True elif '/dev/raw/'+self.raws[raw]['rdevname'] != self.devname_to_rdevname(dev): self.status_log("%s raw device is named %s, expected %s"%(dev, '/dev/raw/'+self.raws[raw]['rdevname'], self.devname_to_rdevname(dev))) r |= True elif not self.check_uid('/dev/raw/'+self.raws[raw]['rdevname'], verbose=True): r |= True elif not self.check_gid('/dev/raw/'+self.raws[raw]['rdevname'], verbose=True): r |= True elif not self.check_perm('/dev/raw/'+self.raws[raw]['rdevname'], verbose=True): r |= True return not r def _status(self, verbose=False): if rcEnv.nodename in self.always_on: if self.is_up(): return rcStatus.STDBY_UP else: return rcStatus.STDBY_DOWN else: if self.is_up(): return rcStatus.UP else: return rcStatus.DOWN def do_start(self): self.lock() self.get_raws() for dev in self.devs: raw = self.find_raw(dev) if raw is not None: self.log.info("%s is already mapped to a raw device"%dev) rdevname = '/dev/raw/'+self.raws[raw]['rdevname'] if rdevname != self.devname_to_rdevname(dev): cmd = ['mv', rdevname, self.devname_to_rdevname(dev)] ret, out, err = self.vcall(cmd) if ret != 0: self.unlock() raise ex.excError else: self.log.info("%s is correctly named"%rdevname) else: raw = self.find_next_raw() cmd = ['raw', raw, dev] ret, out, err = self.vcall(cmd) if ret != 0: self.unlock() raise ex.excError s = os.stat(raw) self.raws[raw] = {'rdevname': self.devname_to_rdevname(dev), 'rdev': (os.major(s.st_rdev), os.minor(s.st_rdev)), 'devname': dev, 'bdev': self.devs_t[dev]} cmd = ['mv', raw, self.devname_to_rdevname(dev)] ret, out, err = self.vcall(cmd) if ret != 0: self.unlock() raise ex.excError rdevname = self.raws[raw]['rdevname'] if not self.check_uid(rdevname) or not self.check_gid(rdevname): self.vcall(['chown', ':'.join((str(self.uid),str(self.gid))), rdevname]) else: self.log.info("%s has correct ownership"%rdevname) if not self.check_perm(rdevname): self.vcall(['chmod', self.perm, rdevname]) else: self.log.info("%s has correct permissions"%rdevname) self.unlock() def do_stop(self): self.get_raws() for dev in self.devs: raw = self.find_raw(dev) if raw is not None: cmd = ['raw', '/dev/raw/raw%d'%self.raws[raw]['rdev'][1], '0', '0'] ret, out, err = self.vcall(cmd) if ret != 0: raise ex.excError rdevname = self.devname_to_rdevname(dev) if os.path.exists(rdevname): if '*' in rdevname: self.log.error("no wildcard allow in raw device names") raise ex.excError cmd = ['rm', '-f', rdevname] ret, out, err = self.vcall(cmd) if ret != 0: raise ex.excError 07070100024595000081b40000000000000000000000014faa9509000012f3000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/rcStatsAIX.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import datetime from rcUtilities import call, which from rcGlobalEnv import rcEnv today = datetime.datetime.today() yesterday = today - datetime.timedelta(days=1) def sarfile(day): f = os.path.join(os.sep, 'var', 'adm', 'sa', 'sa'+day) if os.path.exists(f): return f return None def twodays(fn): if which('sar') is None: return [] lines = fn(yesterday) lines += fn(today) return lines def stats_cpu(): return twodays(stats_cpu_day) def stats_cpu_day(t): d = t.strftime("%Y-%m-%d") day = t.strftime("%d") f = sarfile(day) if f is None: return [] cmd = ['sar', '-u', '-P', 'ALL', '-f', f] (ret, buff, err) = call(cmd, errlog=False) lines = [] for line in buff.split('\n'): l = line.split() if len(l) != 6: continue if l[1] == '%usr': continue if l[0] == 'Average': continue # SunOS: date %usr %sys %wio %idle # xmlrpc: date cpu usr nice sys iowait steal irq soft guest idle nodename x = ['%s %s'%(d, l[0]), 'all', '0', '0', '0', '0', '0', '0', '0', '0', '0', rcEnv.nodename] x[1] = l[1].replace('-', 'all') x[2] = l[2] x[4] = l[3] x[5] = l[4] x[10] = l[5] lines.append(x) return lines def stats_mem_u(file, collect_date=None): return twodays(stats_mem_u_day) def stats_mem_u_day(t): return [] def stats_proc(file, collect_date=None): return twodays(stats_proc_day) def stats_proc_day(t): d = t.strftime("%Y-%m-%d") day = t.strftime("%d") f = sarfile(day) if f is None: return [] cmd = ['sar', '-q', '-f', f] (ret, buff, err) = call(cmd) lines = [] for line in buff.split('\n'): l = line.split() if len(l) < 3: continue if ':' not in l[0]: continue """ xmlrpc: date runq_sz plist_sz ldavg_1 ldavg_5 ldavg_15 nodename """ x = ['%s %s'%(d, l[0]), l[1], '0', '0', '0', '0', rcEnv.nodename] lines.append(x) return lines def stats_swap(file, collect_date=None): return twodays(stats_swap_day) def stats_swap_day(t): return [] def stats_block(file, collect_date=None): return twodays(stats_block_day) def stats_block_day(t): d = t.strftime("%Y-%m-%d") day = t.strftime("%d") f = sarfile(day) if f is None: return [] cmd = ['sar', '-b', '-f', f] (ret, buff, err) = call(cmd) lines = [] for line in buff.split('\n'): l = line.split() if len(l) != 9: continue if ':' not in l[1]: continue """ xmlrpc: date tps rtps wtps rbps wbps nodename """ x = ['%s %s'%(d, l[0]), '0', '0', '0', l[1], l[4], rcEnv.nodename] lines.append(x) return lines def stats_blockdev(file, collect_date=None): return twodays(stats_blockdev_day) def stats_blockdev_day(t): d = t.strftime("%Y-%m-%d") day = t.strftime("%d") f = sarfile(day) if f is None: return [] cmd = ['sar', '-d', '-f', f] (ret, buff, err) = call(cmd, errlog=False) lines = [] for line in buff.split('\n'): l = line.split() if len(l) == 8: date = l[0] if len(l) == 7: l = [date] + l if len(l) != 8: continue if l[1] == 'device': continue if l[0] == 'Average': continue """ xmlrpc: 22:05:01 DEV tps rd_sec/s wr_sec/s avgrq-sz avgqu-sz await svctm %util 00:00:00 device %busy avque r+w/s blks/s avwait avserv """ x = ['%s %s'%(d, l[0]), l[1], l[4], '0', '0', '0', l[3], l[6], l[7], l[2], rcEnv.nodename] lines.append(x) return lines def stats_netdev(file, collect_date=None): return twodays(stats_netdev_day) def stats_netdev_day(t): return [] def stats_netdev_err(file, collect_date=None): return twodays(stats_netdev_err_day) def stats_netdev_err_day(t): return [] 0707010002453c000081b40000000000000000000000014faa95090000076e000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/rcCommandWorker.py#!/opt/opensvc/bin/python import os from multiprocessing import Queue, Process from Queue import Empty from rcUtilities import justcall pathosvc = os.path.realpath(os.path.join(os.path.dirname(__file__), '..')) import logging import logging.handlers logfile = os.path.join(pathosvc, 'log', 'cmdworker.log') fileformatter = logging.Formatter("%(asctime)s - %(name)s - %(levelname)s - %(message)s") filehandler = logging.handlers.RotatingFileHandler(os.path.join(logfile), maxBytes=5242880, backupCount=5) filehandler.setFormatter(fileformatter) log = logging.getLogger("cmdworker") log.addHandler(filehandler) log.setLevel(logging.DEBUG) log.debug("logger setup") def worker(q): try: _worker(q) except ex.excSignal: log.info("interrupted by signal") def _worker(q): log.debug("worker started") cmd = "foo" while cmd is not None: cmd = q.get() if cmd is None: log.debug("shutdown (poison pill)") break log.info("call: %s", ' '.join(cmd)) out, err, ret = justcall(cmd) log.info("ret: %d", ret) continue log.debug("shutdown") class CommandWorker(object): def __init__(self, name=""): self.q = None self.p = None self.name = "cmdworker" if name: self.name += "_"+name def start_worker(self): self.q = Queue() self.p = Process(target=worker, name=self.name, args=(self.q,)) self.p.start() def enqueue(self, cmd): if self.p is None: self.start_worker() self.q.put(cmd, block=True) def stop_worker(self): if self.p is None or not self.p.is_alive(): return log.debug("give poison pill to worker") self.enqueue(None) self.p.join() 07070100024603000081b40000000000000000000000014faa9509000006d9000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/svcHosted.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc class SvcHosted(svc.Svc): """Define hosted services """ def __init__(self, svcname, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, "Hosted", optional=optional, disabled=disabled, tags=tags) if __name__ == "__main__": for c in (SvcHosted,) : help(c) import mountSunOS as mount import ipSunOS as ip print """ S=SvcHosted() S+=mount.Mount("/mnt1","/dev/sda") S+=mount.Mount("/mnt2","/dev/sdb") S+=ip.Ip("eth0","192.168.0.173") S+=ip.Ip("eth0","192.168.0.174") """ S=SvcSone() S+=mount.Mount("/mnt1","/dev/sda") S+=mount.Mount("/mnt2","/dev/sdb") S+=ip.Ip("eth0","192.168.0.173") S+=ip.Ip("eth0","192.168.0.174") print "Show S: ", S print "start S:" S.start() print "stop S:" S.stop() 0707010002452c000081b40000000000000000000000014faa95090000007d000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/provIp.pyfrom provisioning import Provisioning class ProvisioningIp(Provisioning): def provisioner(self): self.r.start() 070701000245d7000081b40000000000000000000000014faa9509000029e5000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/resMountLinux.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import os import rcMountsLinux as rcMounts import resMount as Res from rcUtilities import qcall, protected_mount, getmount from rcUtilitiesLinux import major, get_blockdev_sd_slaves, lv_exists from rcGlobalEnv import rcEnv from rcLoopLinux import file_to_loop import rcExceptions as ex from stat import * def try_umount(self): cmd = ['umount', self.mountPoint] (ret, out, err) = self.vcall(cmd, err_to_warn=True) if ret == 0: return 0 if "not mounted" in err: return 0 """ don't try to kill process using the source of a protected bind mount """ if protected_mount(self.mountPoint): return 1 """ best effort kill of all processes that might block the umount operation. The priority is given to mass action reliability, ie don't contest oprator's will """ cmd = ['sync'] (ret, out, err) = self.vcall(cmd) for i in range(4): cmd = ['fuser', '-kmv', self.mountPoint] (ret, out, err) = self.vcall(cmd, err_to_info=True) self.log.info('umount %s'%self.mountPoint) cmd = ['umount', self.mountPoint] ret = qcall(cmd) if ret == 0: break return ret class Mount(Res.Mount): """ define Linux mount/umount doAction """ def __init__(self, rid, mountPoint, device, fsType, mntOpt, always_on=set([]), snap_size=None, disabled=False, tags=set([]), optional=False, monitor=False): self.Mounts = None Res.Mount.__init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size, always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) """ 0 - No errors 1 - File system errors corrected 32 - E2fsck canceled by user request """ self.fsck_h = { 'ext2': {'bin': 'e2fsck', 'cmd': ['e2fsck', '-p', self.device], 'allowed_ret': [0, 1, 32, 33]}, 'ext3': {'bin': 'e2fsck', 'cmd': ['e2fsck', '-p', self.device], 'allowed_ret': [0, 1, 32, 33]}, 'ext4': {'bin': 'e2fsck', 'cmd': ['e2fsck', '-p', self.device], 'allowed_ret': [0, 1, 32, 33]}, } self.loopdevice = None def is_up(self): self.Mounts = rcMounts.Mounts() ret = self.Mounts.has_mount(self.device, self.mountPoint) if ret: return True # might be mount using a /dev/mapper/ name too l = self.device.split('/') if len(l) == 4 and l[2] != "mapper": dev = "/dev/mapper/%s-%s"%(l[2].replace('-','--'),l[3].replace('-','--')) ret = self.Mounts.has_mount(dev, self.mountPoint) if ret: return True if self.fsType not in self.netfs: # might be a loopback mount try: mode = os.stat(self.device)[ST_MODE] if S_ISREG(mode): devs = file_to_loop(self.device) for dev in devs: ret = self.Mounts.has_mount(dev, self.mountPoint) if ret: return True except: self.log.debug("can not stat %s" % self.device) return False return False def realdev(self): try: mode = os.stat(self.device)[ST_MODE] except: self.log.debug("can not stat %s" % self.device) return None if S_ISBLK(mode): dev = self.device else: mnt = getmount(self.device) if self.Mounts is None: self.Mounts = rcMounts.Mounts() m = self.Mounts.has_param("mnt", mnt) if m is None: self.log.debug("can't find dev %(dev)s mounted in %(mnt)s in mnttab"%dict(mnt=mnt, dev=self.device)) return None dev = m.dev return dev def mplist(self): dev = self.realdev() if dev is None: return set([]) try: self.dm_major = major('device-mapper') except: return set([]) return self._mplist([dev]) def devname_to_dev(self, x): if 'cciss!' in x: return '/dev/cciss/'+x.replace('cciss!', '') return '/dev/'+x def _mplist(self, devs): mps = set([]) for dev in devs: devmap = False if 'dm-' in dev: minor = int(dev.replace('/dev/dm-', '')) dm = dev.replace('/dev/', '') devmap = True else: try: statinfo = os.stat(dev) except: self.log.warning("can not stat %s" % dev) continue minor = os.minor(statinfo.st_rdev) dm = 'dm-%i'%minor devmap = self.is_devmap(statinfo) if self.is_multipath(minor): mps |= set([dev]) elif devmap: syspath = '/sys/block/' + dm + '/slaves' if not os.path.exists(syspath): continue slaves = os.listdir(syspath) mps |= self._mplist(map(self.devname_to_dev, slaves)) return mps def is_multipath(self, minor): cmd = ['dmsetup', '-j', str(self.dm_major), '-m', str(minor), 'table' ] (ret, buff, err) = self.call(cmd, errlog=False, cache=True) if ret != 0: return False l = buff.split() if len(l) < 3: return False if l[2] != 'multipath': return False if 'queue_if_no_path' not in l: return False cmd = ['dmsetup', '-j', str(self.dm_major), '-m', str(minor), 'status' ] (ret, buff, err) = self.call(cmd, errlog=False, cache=True) if ret != 0: return False l = buff.split() if l.count('A') > 1: return False return True def is_devmap(self, statinfo): if os.major(statinfo.st_rdev) == self.dm_major: return True return False def disklist(self): dev = self.realdev() if dev is None: return set([]) try: self.dm_major = major('device-mapper') except: return set([dev]) try: statinfo = os.stat(dev) except: self.log.error("can not stat %s" % dev) raise ex.excError if not self.is_devmap(statinfo): return set([dev]) if lv_exists(self, dev): """ if the fs is built on a lv of a private vg, its disks will be given by the vg resource. if the fs is built on a lv of a shared vg, we don't want to account its disks : don't reserve them, don't account their size multiple times. """ return set([]) dm = 'dm-' + str(os.minor(statinfo.st_rdev)) syspath = '/sys/block/' + dm + '/slaves' devs = get_blockdev_sd_slaves(syspath) return devs def can_check_writable(self): if len(self.mplist()) > 0: self.log.debug("a multipath under fs has queueing enabled and no active path") return False return True def start(self): if self.Mounts is None: self.Mounts = rcMounts.Mounts() Res.Mount.start(self) """ loopback mount if the file has already been binded to a loop re-use the loopdev to avoid allocating another one """ if self.fsType in self.netfs: # TODO showmount -e pass else: try: mode = os.stat(self.device)[ST_MODE] if S_ISREG(mode): devs = file_to_loop(self.device) if len(devs) > 0: self.loopdevice = devs[0] mntopt_l = self.mntOpt.split(',') mntopt_l.remove("loop") self.mntOpt = ','.join(mntopt_l) except: self.log.debug("can not stat %s" % self.device) return False if self.is_up() is True: self.log.info("fs(%s %s) is already mounted"% (self.device, self.mountPoint)) return 0 self.fsck() if not os.path.exists(self.mountPoint): os.makedirs(self.mountPoint, 0755) if self.fsType != "": fstype = ['-t', self.fsType] else: fstype = [] if self.mntOpt != "": mntopt = ['-o', self.mntOpt] else: mntopt = [] if self.loopdevice is None: device = self.device else: device = self.loopdevice cmd = ['mount']+fstype+mntopt+[device, self.mountPoint] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError self.Mounts = None def stop(self): if self.Mounts is None: self.Mounts = rcMounts.Mounts() if self.is_up() is False: self.log.info("fs(%s %s) is already umounted"% (self.device, self.mountPoint)) return for i in range(3): ret = try_umount(self) if ret == 0: break if ret != 0: self.log.error('failed to umount %s'%self.mountPoint) raise ex.excError self.Mounts = None if __name__ == "__main__": for c in (Mount,) : help(c) 07070100024524000081b40000000000000000000000014faa950900008798000000ae00010002ffffffffffffffff0000001d00000000root/opt/opensvc/lib/node.py# # Copyright (c) 2009 Christophe Varoqui # Copyright (c) 2009 Cyril Galibern # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. from svc import Svc from freezer import Freezer import svcBuilder import xmlrpcClient import os import ConfigParser import datetime import time import sys import json from rcGlobalEnv import rcEnv import rcCommandWorker import socket import rcLogger import rcUtilities class Options(object): def __init__(self): self.cron = False self.force = False self.debug = False self.stats_dir = None self.begin = None self.end = None self.moduleset = "" self.module = "" self.ruleset_date = "" os.environ['LANG'] = 'C' class Node(Svc, Freezer): """ Defines a cluster node. It contain list of Svc. Implements node-level actions and checks. """ def __str__(self): s = self.nodename return s def __init__(self): self.delay_done = False self.nodename = socket.gethostname() self.nodeconf = os.path.join(os.path.dirname(__file__), '..', 'etc', 'node.conf') self.dotnodeconf = os.path.join(os.path.dirname(__file__), '..', 'etc', '.node.conf') self.setup_sync_flag = os.path.join(rcEnv.pathvar, 'last_setup_sync') self.config_defaults = { 'host_mode': 'TST', 'push_interval': 121, 'push_days': '["monday", "tuesday", "wednesday", "thursday", "friday", "saturday", "sunday"]', 'push_period': '["04:00", "06:00"]', 'sync_interval': 121, 'sync_days': '["monday", "tuesday", "wednesday", "thursday", "friday", "saturday", "sunday"]', 'sync_period': '["04:00", "06:00"]', 'comp_check_interval': 241, 'comp_check_days': '["sunday"]', 'comp_check_period': '["02:00", "06:00"]', } self.load_config() self.options = Options() self.svcs = None Freezer.__init__(self, '') self.action_desc = { 'Node actions': { 'shutdown': 'shutdown the node to powered off state', 'reboot': 'reboot the node', }, 'Service actions': { 'syncservices': 'send var files, config files and configured replications to other nodes for each node service', 'updateservices': 'refresh var files associated with services', }, 'Node configuration edition': { 'register': 'obtain a registration number from the collector, used to authenticate the node', 'get': 'get the value of the node configuration parameter pointed by --param', 'set': 'set a node configuration parameter (pointed by --param) value (pointed by --value)', 'unset': 'unset a node configuration parameter (pointed by --param)', }, 'Push data to the collector': { 'pushasset': 'push asset information to collector', 'pushservices': 'push services configuration to collector', 'pushstats': 'push performance metrics to collector. By default pushed stats interval begins yesterday at the beginning of the allowed interval and ends now. This interval can be changed using --begin/--end parameters. The location where stats files are looked up can be changed using --stats-dir.', 'pushdisks': 'push disks usage information to collector', 'pushpkg': 'push package/version list to collector', 'pushpatch': 'push patch/version list to collector', 'pushsym': 'push symmetrix configuration to collector', 'pusheva': 'push HP EVA configuration to collector', 'pushnecism': 'push NEC ISM configuration to collector', 'pushdcs': 'push Datacore configuration to collector', 'pushibmsvc': 'push IBM SVC configuration to collector', 'pushvioserver': 'push IBM VIO server configuration to collector', 'push_appinfo': 'push services application launchers appinfo key/value pairs to database', 'checks': 'run node sanity checks, push results to collector', }, 'Misc': { 'prkey': 'show persistent reservation key of this node', }, 'Compliance': { 'compliance_check': 'run compliance checks. --ruleset instruct the collector to provide an historical ruleset.', 'compliance_fix': 'run compliance fixes. --ruleset instruct the collector to provide an historical ruleset.', 'compliance_fixable': 'verify compliance fixes prerequisites. --ruleset instruct the collector to provide an historical ruleset.', 'compliance_list_module': 'list compliance modules available on this node', 'compliance_show_moduleset': 'show compliance rules applying to this node', 'compliance_list_moduleset': 'list available compliance modulesets. --moduleset f% limit the scope to modulesets matching the f% pattern.', 'compliance_attach_moduleset': 'attach moduleset specified by --moduleset for this node', 'compliance_detach_moduleset': 'detach moduleset specified by --moduleset for this node', 'compliance_list_ruleset': 'list available compliance rulesets. --ruleset f% limit the scope to rulesets matching the f% pattern.', 'compliance_show_ruleset': 'show compliance rules applying to this node', 'compliance_show_status': 'show compliance modules status', 'compliance_attach_ruleset': 'attach ruleset specified by --ruleset for this node', 'compliance_detach_ruleset': 'detach ruleset specified by --ruleset for this node', }, 'Collector management': { 'collector_events': 'display node events during the period specified by --begin/--end. --end defaults to now. --begin defaults to 7 days ago', 'collector_alerts': 'display node alerts', 'collector_checks': 'display node checks', 'collector_status': 'display node services status according to the collector', 'collector_list_actions': 'list actions on the node, whatever the service, during the period specified by --begin/--end. --end defaults to now. --begin defaults to 7 days ago', 'collector_ack_action': 'acknowledge an action error on the node. an acknowlegment can be completed by --author (defaults to root@nodename) and --comment', 'collector_show_actions': 'show actions detailled log. a single action is specified by --id. a range is specified by --begin/--end dates. --end defaults to now. --begin defaults to 7 days ago', }, } self.collector = xmlrpcClient.Collector() self.cmdworker = rcCommandWorker.CommandWorker() try: rcos = __import__('rcOs'+rcEnv.sysname) except ImportError: rcos = __import__('rcOs') self.os = rcos.Os() rcEnv.logfile = os.path.join(rcEnv.pathlog, "node.log") self.log = rcLogger.initLogger(rcEnv.nodename) def call(self, cmd=['/bin/false'], cache=False, info=False, errlog=True, err_to_warn=False, err_to_info=False, outlog=False): """Use subprocess module functions to do a call """ return rcUtilities.call(cmd, log=self.log, cache=cache, info=info, errlog=errlog, err_to_warn=err_to_warn, err_to_info=err_to_info, outlog=outlog) def vcall(self, cmd, err_to_warn=False, err_to_info=False): """Use subprocess module functions to do a call and log the command line using the resource logger """ return rcUtilities.vcall(cmd, log=self.log, err_to_warn=err_to_warn, err_to_info=err_to_info) def supported_actions(self): a = [] for s in self.action_desc: a += self.action_desc[s].keys() return a def build_services(self, *args, **kwargs): if self.svcs is not None: return autopush = True if 'autopush' in kwargs: if not kwargs['autopush']: autopush = False del kwargs['autopush'] self.svcs = svcBuilder.build_services(*args, **kwargs) for svc in self.svcs: svc.node = self if autopush: for svc in self.svcs: if svc.collector_outdated(): svc.action('push') def close(self): self.collector.stop_worker() self.cmdworker.stop_worker() def _setup_sync_conf(self): h = {} self.build_services() for svc in self.svcs: for rs in [_rs for _rs in svc.resSets if _rs.type.startswith('sync')]: for r in rs.resources: s = '#'.join((svc.svcname, r.rid)) if not self.config.has_section(s): self.config.add_section(s) self.config.set(s, 'svcname', svc.svcname) self.config.set(s, 'rid', r.rid) self.config.set(s, 'interval', r.sync_interval) self.config.set(s, 'days', json.dumps(r.sync_days)) self.config.set(s, 'period', json.dumps(r.sync_period)) self.write_dotconfig() with open(self.setup_sync_flag, 'w') as f: f.write(str(time.time())) def write_dotconfig(self): for o in self.config_defaults: if self.config.has_option('DEFAULT', o): self.config.remove_option('DEFAULT', o) for s in self.config.sections(): if '#sync#' not in s: self.config.remove_section(s) try: fp = open(self.dotnodeconf, 'w') self.config.write(fp) fp.close() except: print >>sys.stderr, "failed to write new %s"%self.dotnodeconf raise Exception() self.load_config() def write_config(self): for o in self.config_defaults: if self.config.has_option('DEFAULT', o): self.config.remove_option('DEFAULT', o) for s in self.config.sections(): if '#sync#' in s: self.config.remove_section(s) try: fp = open(self.nodeconf, 'w') self.config.write(fp) fp.close() except: print >>sys.stderr, "failed to write new %s"%self.nodeconf raise Exception() self.load_config() def load_config(self): self.config = ConfigParser.RawConfigParser(self.config_defaults) self.config.read(self.nodeconf) self.config.read(self.dotnodeconf) def setup_sync_outdated(self): """ return True if one env file has changed in the last 10' else return False """ import datetime import glob envs = glob.glob(os.path.join(rcEnv.pathetc, '*.env')) if not os.path.exists(self.setup_sync_flag): return True for pathenv in envs: try: mtime = os.stat(pathenv).st_mtime f = open(self.setup_sync_flag) last = float(f.read()) f.close() except: return True if mtime > last: return True return False def setup_sync_conf(self): if self.setup_sync_outdated(): self._setup_sync_conf() return elif not self.config.has_section('sync'): self._setup_sync_conf() return elif not self.config.has_option('sync', 'interval') or \ not self.config.has_option('sync', 'days') or \ not self.config.has_option('sync', 'period'): self._setup_sync_conf() def format_desc(self): from textwrap import TextWrapper from compliance import Compliance from collector import Collector wrapper = TextWrapper(subsequent_indent="%19s"%"", width=78) desc = "" for s in sorted(self.action_desc): l = len(s) desc += s+'\n' for i in range(0, l): desc += '-' desc += "\n\n" for a in sorted(self.action_desc[s]): if a.startswith("compliance_"): o = Compliance(self.skip_action, self.options, self.collector) if not hasattr(o, a): continue elif a.startswith("collector_"): o = Collector(self.options, self.collector) if not hasattr(o, a): continue elif not hasattr(self, a): continue fancya = a.replace('_', ' ') if len(a) < 16: text = " %-16s %s\n"%(fancya, self.action_desc[s][a]) desc += wrapper.fill(text) else: text = " %-16s"%(fancya) desc += wrapper.fill(text) desc += '\n' text = "%19s%s"%(" ", self.action_desc[s][a]) desc += wrapper.fill(text) desc += '\n\n' return desc[0:-2] def __iadd__(self, s): if not isinstance(s, Svc): pass self.svcs.append(s) return self def action(self, a): if a.startswith("compliance_"): from compliance import Compliance o = Compliance(self.skip_action, self.options, self.collector) return getattr(o, a)() elif a.startswith("collector_"): from collector import Collector o = Collector(self.options, self.collector) return getattr(o, a)() else: return getattr(self, a)() def need_action_interval(self, timestamp_f, delay=10): """ Return False if timestamp is fresher than now-interval Return True otherwize. Zero is a infinite interval """ if delay == 0: return False if not os.path.exists(timestamp_f): return True try: with open(timestamp_f, 'r') as f: d = f.read() last = datetime.datetime.strptime(d,"%Y-%m-%d %H:%M:%S.%f\n") limit = last + datetime.timedelta(minutes=delay) if datetime.datetime.now() < limit: return False else: return True f.close() except: return True # never reach here return True def timestamp(self, timestamp_f, interval): timestamp_d = os.path.dirname(timestamp_f) if not os.path.isdir(timestamp_d): os.makedirs(timestamp_d ,0755) with open(timestamp_f, 'w') as f: f.write(str(datetime.datetime.now())+'\n') f.close() return True def skip_action_interval(self, timestamp_f, interval): return not self.need_action_interval(timestamp_f, interval) def skip_probabilistic(self, period, interval): if len(period) == 0: return False try: start, end, now = self.get_period_minutes(period) except: return False if start > end: end += 1440 if now < start: now += 1440 length = end - start if interval <= length: # don't skip if interval <= period length, because the user # expects the action to run multiple times in the period return False elapsed = now - start elapsed_pct = int(100.0 * elapsed / length) """ proba ^ 100% | 75% |X 50% |XX 25% |XXX 0% ----|----|-> elapsed 0% 50% 100% The idea is to skip 75% of actions in period's first run, skip none after half the interval is consumed, and decrease skip probabilty linearly in-between. This algo is meant to level collector's load which peaks when all daily cron trigger at the same minute. """ p = 75.0 * (100.0 - min(elapsed_pct * 2, 100)) / 100 import random r = random.random()*100.0 """ print "start:", start print "end:", end print "now:", now print "length:", length print "elapsed:", elapsed print "elapsed_pct:", elapsed_pct print "p:", p print "r:", r """ if r >= p: print "win probabilistic challenge: %d, over %d"%(r, p) return False return True def get_period_minutes(self, period): start_s, end_s = period try: start_t = time.strptime(start_s, "%H:%M") end_t = time.strptime(end_s, "%H:%M") start = start_t.tm_hour * 60 + start_t.tm_min end = end_t.tm_hour * 60 + end_t.tm_min except: print >>sys.stderr, "malformed time string: %s"%str(period) raise Exception("malformed time string: %s"%str(period)) now = datetime.datetime.now() now_m = now.hour * 60 + now.minute return start, end, now_m def in_period(self, period): if isinstance(period[0], list): r = False for p in period: if self.in_period(p): return True return False elif not isinstance(period[0], unicode) or len(period) != 2 or \ not isinstance(period[1], unicode): print >>sys.stderr, "malformed period: %s"%str(period) return False if len(period) == 0: return True try: start, end, now = self.get_period_minutes(period) except: return False if start <= end: if now >= start and now <= end: return True elif start > end: """ XXXXXXXXXXXXXXXXX 23h 0h 1h """ if (now >= start and now <= 1440) or \ (now >= 0 and now <= end): return True return False def in_days(self, days): now = datetime.datetime.now() today = now.strftime('%A').lower() if today in map(lambda x: x.lower(), days): return True return False def skip_action_probabilistic(self, section, option, interval): if option is None: return False if self.config.has_section(section) and \ self.config.has_option(section, 'period'): period_s = self.config.get(section, 'period') elif self.config.has_option('DEFAULT', option): period_s = self.config.get('DEFAULT', option) else: return False try: period = json.loads(period_s) except: print >>sys.stderr, "malformed parameter value: %s.period"%section return True if isinstance(period[0], list): matching_period = None for p in period: if self.in_period(p): matching_period = p break if matching_period is None: return True period = matching_period return self.skip_probabilistic(period, interval) def skip_action_period(self, section, option): if option is None: return False if self.config.has_section(section) and \ self.config.has_option(section, 'period'): period_s = self.config.get(section, 'period') elif self.config.has_option('DEFAULT', option): period_s = self.config.get('DEFAULT', option) else: return False try: period = json.loads(period_s) except: print >>sys.stderr, "malformed parameter value: %s.period"%section return True if self.in_period(period): return False return True def skip_action_days(self, section, option): if option is None: return False if self.config.has_section(section) and \ self.config.has_option(section, 'days'): days_s = self.config.get(section, 'days') elif self.config.has_option('DEFAULT', option): days_s = self.config.get('DEFAULT', option) else: return False try: days = json.loads(days_s) except: print >>sys.stderr, "malformed parameter value: %s.days"%section return True if self.in_days(days): return False return True def get_interval(self, section, option, cmdline_parm): # get interval from config file if self.config.has_section(section) and \ self.config.has_option(section, 'interval'): interval = self.config.getint(section, 'interval') else: interval = self.config.getint('DEFAULT', option) # override with command line if cmdline_parm is not None: v = getattr(self.options, cmdline_parm) if v is not None: interval = v return interval def skip_action(self, section, option, fname, cmdline_parm=None, period_option=None, days_option=None): def err(msg): print '%s: skip:'%section, msg, '(--force to bypass)' if not self.options.cron: return False if self.options.force: return False # check if we are in allowed period if self.skip_action_period(section, period_option): err('out of allowed periods') return True # check if we are in allowed days of week if self.skip_action_days(section, days_option): err('out of allowed days') return True interval = self.get_interval(section, option, cmdline_parm) timestamp_f = os.path.join(os.path.dirname(__file__), '..', 'var', fname) # check if we are in allowed days of week if self.skip_action_interval(timestamp_f, interval): err('last run < interval') return True # probabilistic skip if '#sync#' not in section and \ self.skip_action_probabilistic(section, period_option, interval): err('checks passed but skip to level collector load') return True # don't update the timestamp in force mode # to not perturb the schedule if not self.options.force: self.timestamp(timestamp_f, interval) # ok. we have some action to perform. # now wait for a random delay <5min to not overload the # collector listeners at 10 minutes intervals. # only delay for the first action of this Node() object # lifespan if not self.delay_done: import random import time delay = int(random.random()*300) print "delay action for %d secs to level database load"%delay time.sleep(delay) self.delay_done = True return False def pushstats(self): if self.skip_action('stats', 'push_interval', 'last_stats_push', period_option='push_period', days_option='push_days'): return if self.config.has_section('stats'): period = self.config.get('stats', 'push_period') else: period = self.config.get('DEFAULT', 'push_period') try: period = json.loads(period) except: return try: start, end, now = self.get_period_minutes(period) except: return # set interval to grab from the begining of the last allowed period # to now interval = 1440 + now - start self.collector.call('push_stats', force=self.options.force, stats_dir=self.options.stats_dir, stats_start=self.options.begin, stats_end=self.options.end, interval=interval) def pushpkg(self): if self.skip_action('packages', 'push_interval', 'last_pkg_push', period_option='push_period', days_option='push_days'): return self.collector.call('push_pkg') def pushpatch(self): if self.skip_action('patches', 'push_interval', 'last_patch_push', period_option='push_period', days_option='push_days'): return self.collector.call('push_patch') def pushasset(self): if self.skip_action('asset', 'push_interval', 'last_asset_push', period_option='push_period', days_option='push_days'): return self.collector.call('push_asset', self) def pushdcs(self): if self.skip_action('dcs', 'push_interval', 'last_dcs_push', period_option='push_period', days_option='push_days', force=self.options.force): return self.collector.call('push_dcs') def pushnecism(self): if self.skip_action('necism', 'push_interval', 'last_necism_push', period_option='push_period', days_option='push_days'): return self.collector.call('push_necism') def pusheva(self): if self.skip_action('eva', 'push_interval', 'last_eva_push', period_option='push_period', days_option='push_days'): return self.collector.call('push_eva') def pushibmsvc(self): if self.skip_action('ibmsvc', 'push_interval', 'last_ibmsvc_push', period_option='push_period', days_option='push_days'): return self.collector.call('push_ibmsvc') def pushvioserver(self): if self.skip_action('ibmsvc', 'push_interval', 'last_vioserver_push', period_option='push_period', days_option='push_days'): return self.collector.call('push_vioserver') def pushsym(self): if self.skip_action('sym', 'push_interval', 'last_sym_push', period_option='push_period', days_option='push_days'): return self.collector.call('push_sym') def pushdisks(self): if self.skip_action('sym', 'push_interval', 'last_disks_push', period_option='push_period', days_option='push_days'): return if self.svcs is None: self.build_services() self.collector.call('push_disks', self) def need_sync(self): l = [] for s in self.config.sections(): if '#sync#' not in s: continue ts = '_'.join(('last_sync', self.config.get(s, 'svcname'), self.config.get(s, 'rid'))) if self.skip_action(s, 'sync_interval', ts, period_option='sync_period', days_option='sync_days'): continue l.append(self.config.get(s, 'svcname')) return l def shutdown(self): print "TODO" def reboot(self): print "TODO" def syncservices(self): self.setup_sync_conf() svcnames = self.need_sync() if len(svcnames) == 0: return from multiprocessing import Process p = {} if self.svcs is None: self.build_services(svcnames=svcnames) for svc in self.svcs: p[svc.svcname] = rcCommandWorker.CommandWorker(name=svc.svcname) cmd = [os.path.join(rcEnv.pathetc, svc.svcname), 'syncall'] if self.options.force: cmd.append('--force') if self.options.cron: cmd.append('--cron') p[svc.svcname].enqueue(cmd) for svcname in p: p[svcname].stop_worker() def updateservices(self): if self.svcs is None: self.build_services() for svc in self.svcs: svc.cron = self.options.cron svc.action('presync') def pushservices(self): if self.skip_action('svcconf', 'push_interval', 'last_svcconf_push', period_option='push_period', days_option='push_days'): return if self.svcs is None: self.build_services() for svc in self.svcs: svc.cron = self.options.cron svc.action('push') def push_appinfo(self): if self.skip_action('appinfo', 'push_interval', 'last_appinfo_push', period_option='push_period', days_option='push_days'): return if self.svcs is None: self.build_services() for svc in self.svcs: svc.cron = self.options.cron svc.action('push_appinfo') def prkey(self): from rcGlobalEnv import rcEnv m = __import__('hostid'+rcEnv.sysname) print m.hostid() def checks(self): if self.skip_action('checks', 'push_interval', 'last_checks_push', period_option='push_period', days_option='push_days'): return import checks self.build_services() c = checks.checks(self.svcs) c.node = self c.do_checks() def unset(self): if self.options.param is None: print >>sys.stderr, "no parameter. set --param" return 1 l = self.options.param.split('.') if len(l) != 2: print >>sys.stderr, "malformed parameter. format as 'section.key'" return 1 section, option = l if not self.config.has_section(section): print >>sys.stderr, "section '%s' not found"%section return 1 if not self.config.has_option(section, option): print >>sys.stderr, "option '%s' not found in section '%s'"%(option, section) return 1 try: self.config.remove_option(section, option) self.write_config() except: return 1 return 0 def get(self): if self.options.param is None: print >>sys.stderr, "no parameter. set --param" return 1 l = self.options.param.split('.') if len(l) != 2: print >>sys.stderr, "malformed parameter. format as 'section.key'" return 1 section, option = l if not self.config.has_section(section): print >>sys.stderr, "section '%s' not found"%section return 1 if not self.config.has_option(section, option): print >>sys.stderr, "option '%s' not found in section '%s'"%(option, section) return 1 print self.config.get(section, option) return 0 def set(self): if self.options.param is None: print >>sys.stderr, "no parameter. set --param" return 1 if self.options.value is None: print >>sys.stderr, "no value. set --value" return 1 l = self.options.param.split('.') if len(l) != 2: print >>sys.stderr, "malformed parameter. format as 'section.key'" return 1 section, option = l if not self.config.has_section(section): self.config.add_section(section) if self.config.has_option(section, option) and \ self.config.get(section, option) == self.options.value: return self.config.set(section, option, self.options.value) try: self.write_config() except: return 1 return 0 def register(self): u = self.collector.call('register_node') if u is None: print >>sys.stderr, "failed to obtain a registration number" return 1 elif isinstance(u, list): print >>sys.stderr, u[0] return 1 try: if not self.config.has_section('node'): self.config.add_section('node') self.config.set('node', 'uuid', u) self.write_config() except: print >>sys.stderr, "failed to write registration number: %s"%u return 1 print "registered" return 0 def service_action_worker(self, s, **kwargs): r = s.action(**kwargs) self.close() sys.exit(r) def devlist(self): try: m = __import__("rcDevTree"+rcEnv.sysname) except ImportError: return tree = m.DevTree() tree.load() l = [] for dev in tree.get_top_devs(): if len(dev.devpath) > 0: l.append(dev.devpath[0]) return l if __name__ == "__main__" : for n in (Node,) : help(n) 07070100024526000081b40000000000000000000000014faa950900000434000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/nodeLinux.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import node class Node(node.Node): def shutdown(self): cmd = ["shutdown", "-h"] ret, out, err = self.vcall(cmd) def reboot(self): cmd = ["reboot"] ret, out, err = self.vcall(cmd) 07070100024561000081b40000000000000000000000014faa95090000078d000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/rcMounts.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # class Mount: def __init__(self, dev, mnt, type, mnt_opt): self.dev = dev self.mnt = mnt self.type = type self.mnt_opt = mnt_opt def __str__(self): return "Mount: dev[%s] mnt[%s] type[%s] options[%s]" % \ (self.dev,self.mnt,self.type,self.mnt_opt) class Mounts: def __init__(self): """ OS dependent """ self.mounts = [] def match_mount(self): """ OS dependent """ pass def mount(self, dev, mnt): for i in self.mounts: if self.match_mount(i, dev, mnt): return i return None def has_mount(self, dev, mnt): for i in self.mounts: if self.match_mount(i, dev, mnt): return True return False def has_param(self, param, value): for i in self.mounts: if getattr(i, param) == value: return i return None def __str__(self): output="%s" % (self.__class__.__name__) for m in self.mounts: output+="\n %s" % m.__str__() return output 0707010002458e000081b40000000000000000000000014faa9509000012f4000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcPkgWindows.py# # Copyright (c) 2012 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from collections import namedtuple from ctypes import byref, create_unicode_buffer, windll from ctypes.wintypes import DWORD from itertools import count # defined at http://msdn.microsoft.com/en-us/library/aa370101(v=VS.85).aspx UID_BUFFER_SIZE = 39 PROPERTY_BUFFER_SIZE = 256 ERROR_MORE_DATA = 234 ERROR_INVALID_PARAMETER = 87 ERROR_SUCCESS = 0 ERROR_NO_MORE_ITEMS = 259 ERROR_UNKNOWN_PRODUCT = 1605 # diff propoerties of a product, not all products have all properties PRODUCT_PROPERTIES = [u'Language', u'ProductName', u'PackageCode', u'Transforms', u'AssignmentType', u'PackageName', u'InstalledProductName', u'VersionString', u'RegCompany', u'RegOwner', u'ProductID', u'ProductIcon', u'InstallLocation', u'InstallSource', u'InstallDate', u'Publisher', u'LocalPackage', u'HelpLink', u'HelpTelephone', u'URLInfoAbout', u'URLUpdateInfo',] # class to be used for python users :) Product = namedtuple('Product', PRODUCT_PROPERTIES) def get_property_for_product(product, property, buf_size=PROPERTY_BUFFER_SIZE): """Retruns the value of a fiven property from a product.""" property_buffer = create_unicode_buffer(buf_size) size = DWORD(buf_size) result = windll.msi.MsiGetProductInfoW(product, property, property_buffer, byref(size)) if result == ERROR_MORE_DATA: return get_property_for_product(product, property, 2 * buf_size) elif result == ERROR_SUCCESS: return property_buffer.value else: return None def populate_product(uid): """Return a Product with the different present data.""" properties = [] for property in PRODUCT_PROPERTIES: properties.append(get_property_for_product(uid, property)) return Product(*properties) def get_installed_products_uids(): """Returns a list with all the different uid of the installed apps.""" # enum will return an error code according to the result of the app products = [] for i in count(0): uid_buffer = create_unicode_buffer(UID_BUFFER_SIZE) result = windll.msi.MsiEnumProductsW(i, uid_buffer) if result == ERROR_NO_MORE_ITEMS: # done interating over the collection break products.append(uid_buffer.value) return products def get_installed_products(): """Returns a collection of products that are installed in the system.""" products = [] for puid in get_installed_products_uids(): products.append(populate_product(puid)) return products def is_product_installed_uid(uid): """Return if a product with the given id is installed. uid Most be a unicode object with the uid of the product using the following format {uid} """ # we try to get the VersisonString for the uid, if we get an error it means # that the product is not installed in the system. buf_size = 256 uid_buffer = create_unicode_buffer(uid) property = u'VersionString' property_buffer = create_unicode_buffer(buf_size) size = DWORD(buf_size) result = windll.msi.MsiGetProductInfoW(uid_buffer, property, property_buffer, byref(size)) if result == ERROR_UNKNOWN_PRODUCT: return False else: return True from rcGlobalEnv import rcEnv def listpkg(): plist = get_installed_products() lines = [] for p in plist: x = [rcEnv.nodename, p.ProductName, p.VersionString, ""] lines.append(x) return lines def listpatch(): return [] if __name__ == "__main__": print get_installed_products() 070701000245ac000081b40000000000000000000000014faa950900000fb5000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resAppVm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * import os import glob from rcGlobalEnv import rcEnv from rcUtilities import qcall, justcall import resApp import rcStatus import rcExceptions as ex class Apps(resApp.Apps): app_d = os.path.join(os.sep, 'svc', 'etc', 'init.d') def set_perms(self, rc): (ret, out, err) = self.call(self.prefix+['/usr/bin/find', self.app_d, '-name', os.path.basename(rc), '-a', '-user', 'root', '-a', '-group', 'root']) if len(out) == 0 or rc != out.split()[0]: self.vcall(self.prefix+['chown', 'root:root', rc]) (ret, out, err) = self.call(self.prefix+['test', '-x', rc]) if ret != 0: self.vcall(self.prefix+['chmod', '+x', rc]) def check_reachable(self, container): cmd = self.prefix + ['/bin/pwd'] ret = qcall(cmd) if ret != 0: return False return True def checks(self, verbose=False): container = self.svc.resources_by_id["container"] if container.status(refresh=True) != rcStatus.UP: self.log.debug("abort resApp action because container status is %s"%rcStatus.status_str(container.status())) self.status_log("container is %s"%rcStatus.status_str(container.status())) raise ex.excNotAvailable if self.svc.guestos == 'Windows' or not self.check_reachable(container): self.log.debug("abort resApp action because container is unreachable") self.status_log("container is unreachable") return False cmd = self.prefix + ['test', '-d', self.app_d] ret = qcall(cmd) if ret == 0: return True cmd = self.prefix + ['/bin/mkdir', '-p', self.app_d] ret, out, err = self.vcall(cmd) if ret != 0: return False return True def stop_checks(self): return self.checks() def start_checks(self): return self.checks() def status_checks(self, verbose=False): return self.checks(verbose=verbose) def sorted_app_list(self, pattern): cmd = self.prefix + ['/usr/bin/find', self.app_d, '-name', pattern.replace('*', '\*')] p = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) buff = p.communicate() if p.returncode != 0: self.log.debug("failed to fetch container startup scripts list") return [] l = buff[0].split('\n') # most unix find commands don't support maxdepth. # discard manually the startup scripts found in subdirs of app_d n = self.app_d.count("/") if not self.app_d.endswith("/"): n += 1 l = [e for e in l if e.count("/") == n] return sorted(l) def app_exist(self, name): """ verify app_exists inside Vm """ (out, err, ret) = justcall (self.prefix + ['/bin/ls', '-Ld', name ]) if ret == 0: return True else: return False if __name__ == "__main__": for c in (Apps,) : help(c) 070701000245b8000081b40000000000000000000000014faa950900002df1000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/resContainerZone.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from datetime import datetime import rcStatus import resources as Res import time import os from rcUtilities import justcall, qcall from stat import * import resContainer from rcExceptions import excError ZONECFG="/usr/sbin/zonecfg" ZLOGIN="/usr/sbin/zlogin" PGREP="/usr/bin/pgrep" PWAIT="/usr/bin/pwait" INIT="/sbin/init" SVCS="/usr/bin/svcs" MULTI_USER_SMF="svc:/milestone/multi-user:default" class Zone(resContainer.Container): def __init__(self, name, optional=False, disabled=False, monitor=False, tags=set([])): """define Zone object attribute : name label state zonepath """ Res.Resource.__init__(self, rid="zone", type="container.zone", optional=optional, disabled=disabled, monitor=monitor, tags=tags) self.name = name self.label = name self.state = None self.zonepath = os.path.realpath(os.path.join(os.sep, 'zones', self.name)) self.zone_refresh() def zonecfg(self, zonecfg_args=None): cmd = [ZONECFG, '-z', self.name, zonecfg_args ] (ret, out, err) = self.vcall(cmd,err_to_info=True) if ret != 0: msg = '%s "%s" failed status: %i - logs in %s' % ( " ".join(cmd[0:3]), "".join([c for c in zonecfg_args if c != ";"]), ret, out) self.log.error(msg) raise excError(msg) else: self.log.info('%s "%s" done status: %i - logs in %s' % (" ".join(cmd[0:3]), "".join([c for c in zonecfg_args if c != ";"]), ret, out)) self.zone_refresh() return ret def zoneadm(self, action, option=None): if action in [ 'ready' , 'boot' ,'shutdown' , 'halt' ,'attach', 'detach', 'install', 'clone' ] : cmd = ['zoneadm', '-z', self.name, action ] else: self.log.error("unsupported zone action: %s" % action) return 1 if option is not None: cmd += option t = datetime.now() (ret, out, err) = self.vcall(cmd,err_to_info=True) len = datetime.now() - t if ret != 0: msg = '%s failed status: %i in %s logs in %s' % (' '.join(cmd), ret, len, out) self.log.error(msg) raise excError(msg) else: self.log.info('%s done in %s - ret %i - logs in %s' % (' '.join(cmd), len, ret, out)) self.zone_refresh() return ret def set_zonepath_perms(self): if not os.path.exists(self.zonepath): os.makedirs(self.zonepath) s = os.stat(self.zonepath) if s.st_uid != 0 or s.st_gid != 0: self.log.info("set %s ownership to uid 0 gid 0"%self.zonepath) os.chown(self.zonepath, 0, 0) mode = s[ST_MODE] if (S_IWOTH&mode) or (S_IXOTH&mode) or (S_IROTH&mode) or \ (S_IWGRP&mode) or (S_IXGRP&mode) or (S_IRGRP&mode): self.vcall(['chmod', '700', self.zonepath]) def attach(self): self.zone_refresh() if self.state in ('installed' , 'ready', 'running'): self.log.info("zone container %s already installed" % self.name) return 0 try: self.zoneadm('attach') except excError: self.zoneadm('attach', ['-F'] ) def detach(self): self.zone_refresh() if self.state == "configured" : self.log.info("zone container %s already detached/configured" % self.name) return 0 return self.zoneadm('detach') def ready(self): self.zone_refresh() if self.state == 'ready' or self.state == "running" : self.log.info("zone container %s already ready" % self.name) return 0 self.set_zonepath_perms() return self.zoneadm('ready') def install_drp_flag(self): rootfs = self.zonepath flag = os.path.join(rootfs, ".drp_flag") self.log.info("install drp flag in container : %s"%flag) with open(flag, 'w') as f: f.write(' ') f.close() def get_smf_state(self, smf=None): cmd = [ ZLOGIN, self.name, SVCS, '-H', '-o', 'state', smf] (out, err, status) = justcall(cmd) if status == 0: return out.split('\n')[0] else: return False def is_smf_state(self, smf=None, value=None): current_value = self.get_smf_state(smf) if current_value is False: return False elif current_value == value: return True else: return False def is_multi_user(self): return self.is_smf_state(MULTI_USER_SMF, "online") def wait_multi_user(self): self.log.info("wait for smf state on on %s", MULTI_USER_SMF) self.wait_for_fn(self.is_multi_user, self.startup_timeout, 2) def boot(self): "return 0 if zone is running else return self.zoneadm('boot')" self.zone_refresh() if self.state == "running" : self.log.info("zone container %s already running" % self.name) return 0 self.zoneadm('boot') if self.state == "running": return(0) else: raise(excError("zone should be running")) def stop(self): """ Need wait poststat after returning to installed state on ipkg example : /bin/ksh -p /usr/lib/brand/ipkg/poststate zonename zonepath 5 4 """ self.zone_refresh() if self.state in [ 'installed', 'configured'] : self.log.info("zone container %s already stopped" % self.name) return 0 if self.state == 'running': (ret, out, err) = self.vcall(['zlogin' , self.name , '/sbin/init' , '0']) for t in range(self.shutdown_timeout): self.zone_refresh() if self.state == 'installed': for t2 in range(self.shutdown_timeout): time.sleep(1) (out,err,st) = justcall([ 'pgrep', '-fl', 'ipkg/poststate.*'+ self.name]) if st == 0 : self.log.info("Waiting for ipkg poststate complete: %s" % out) else: break return 0 time.sleep(1) self.log.info("timeout out waiting for %s shutdown", self.name) return self.zoneadm('halt') def container_start(self): return self.boot() def _status(self, verbose=False): self.zone_refresh() if self.state == 'running' : return rcStatus.UP else: return rcStatus.DOWN def zone_refresh(self): """ refresh Zone object attributes: state zonepath brand from zoneadm -z zonename list -p zoneid:zonename:state:zonepath:uuid:brand:ip-type """ (out,err,st) = justcall([ 'zoneadm', '-z', self.name, 'list', '-p' ]) if st == 0 : (zoneid,zonename,state,zonepath,uuid,brand,iptype)=out.split(':') if zonename == self.name : self.state = state self.zonepath = zonepath self.brand = brand return True else: return False else: return False def is_running(self): "return True if zone is running else False" self.zone_refresh() if self.state == 'running' : return True else: return False def is_up(self): "return self.is_running status" return self.is_running() def operational(self): "return status of: zlogin zone pwd" cmd = [ ZLOGIN, self.name, 'pwd'] if qcall(cmd) == 0: return True else: return False def boot_and_wait_reboot(self): """boot zone, then wait for automatic zone reboot boot zone wait for zone init process end wait for zone running wait for zone operational """ self.log.info("wait for zone boot and reboot...") self.boot() if self.is_running is False: raise(excError("zone is not running")) cmd = [PGREP, "-z", self.name, "-f", INIT] (out, err, st) = justcall(cmd) if st != 0: raise(excError("fail to detect zone init process")) pids = " ".join(out.split("\n")).rstrip() cmd = [PWAIT, pids] self.log.info("wait for zone init process %s termination" % (pids)) if qcall(cmd) != 0: raise(excError("failed " + " ".join(cmd))) self.log.info("wait for zone running again") self.wait_for_fn(self.is_up, self.startup_timeout, 2) self.log.info("wait for zone operational") self.wait_for_fn(self.operational, self.startup_timeout, 2) def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def provision(self): m = __import__("provZone") m.ProvisioningZone(self).provisioner() def get_container_info(self): vcpus = "0" vmem = "0" cmd = [ZONECFG, "-z", self.name, "info", "rctl", "name=zone.cpu-cap"] (out, err, status) = justcall(cmd) if status == 0: lines = out.split('\n') for line in lines: if "value:" not in line: continue l = line.split("limit=") if len(l) == 2: vcpus = l[-1][:l[-1].index(',')] vcpus = str(float(vcpus)/100) break cmd = [ZONECFG, "-z", self.name, "info", "capped-memory"] (out, err, status) = justcall(cmd) if status == 0: lines = out.split('\n') for line in lines: if "physical:" not in line: continue l = line.split(": ") if len(l) == 2: vmem = l[-1].strip() if vmem.endswith('T'): vmem = str(float(vmem[:-1])*1024*1024) elif vmem.endswith('G'): vmem = str(float(vmem[:-1])*1024) elif vmem.endswith('M'): vmem = vmem[:-1] elif vmem.endswith('K'): vmem = str(float(vmem[:-1])/1024) break return {'vcpus': vcpus, 'vmem': vmem} if __name__ == "__main__": for c in (Zone,) : help(c) 07070100024596000081b40000000000000000000000014faa950900001557000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/rcStatsDarwin.py# # Copyright (c) 2011 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcUtilities import call, which from rcGlobalEnv import rcEnv import rcStats class StatsProvider(rcStats.StatsProvider): def customfile(self, metric, day): f = os.path.join(rcEnv.pathvar, 'stats', metric+day) if os.path.exists(f): return f return None def cpu(self, d, day, start, end): cols = ['date', 'cpu', 'usr', 'nice', 'sys', 'idle', 'nodename'] f = self.sarfile(day) lines = [] if f is None: return cols, lines cmd = ['sar', '-u', '-f', f, '-s', start, '-e', end] (ret, buff, err) = call(cmd, errlog=False) for line in buff.split('\n'): l = line.split() if len(l) != 5: continue if l[1] == '%usr': continue if l[0] == 'Average:': continue (time, usr, nice, sys, idle) = l l = ['%s %s'%(d, time), 'all', usr, nice, sys, idle, self.nodename] lines.append(l) return cols, lines def mem_u(self, d, day, start, end): cols = ['date', 'kbmemfree', 'kbmemused', 'kbbuffers', 'kbcached', 'kbmemsys', 'nodename'] fname = self.customfile('mem_u', day) lines = [] if fname is None: return cols, lines try: f = open(fname, 'r') buff = f.read() f.close() except: return cols, lines for line in buff.split('\n'): l = line.split() if len(l) != 6: continue (time, free, inactive, active, speculative, wired) = l l = ['%s %s'%(d, time), free, active, speculative, inactive, wired, self.nodename] lines.append(l) return cols, lines def blockdev(self, d, day, start, end): cols = ['date', 'dev', 'tps', 'rsecps', 'nodename'] f = self.sarfile(day) lines = [] if f is None: return cols, lines cmd = ['sar', '-d', '-f', f, '-s', start, '-e', end] (ret, buff, err) = call(cmd, errlog=False) for line in buff.split('\n'): l = line.split() if len(l) != 4: continue if l[1] == 'device': continue if l[1] == 'Disk:': continue if l[0] == 'Average:': continue l.append(self.nodename) l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines def netdev(self, d, day, start, end): cols = ['date', 'dev', 'rxpckps', 'rxkBps', 'txpckps', 'txkBps', 'nodename'] f = self.sarfile(day) lines = [] if f is None: return cols, lines cmd = ['sar', '-n', 'DEV', '-f', f, '-s', start, '-e', end] (ret, buff, err) = call(cmd, errlog=False) for line in buff.split('\n'): l = line.split() if len(l) != 6: continue if l[1] in ['IFACE', 'lo0'] : continue if 'dummy' in l[1] or 'vnet' in l[1] or 'veth' in l[1] or \ 'gif' in l[1] or 'stf' in l[1]: continue if l[0] == 'Average:': continue l.append(self.nodename) l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines def netdev_err(self, d, day, start, end): cols = ['date', 'dev', 'rxerrps', 'txerrps', 'collps', 'rxdropps', 'nodename'] f = self.sarfile(day) lines = [] if f is None: return cols, lines cmd = ['sar', '-n', 'EDEV', '-f', f, '-s', start, '-e', end] (ret, buff, err) = call(cmd, errlog=False) for line in buff.split('\n'): l = line.split() if len(l) != 6: continue if l[1] in ['IFACE', 'lo0'] : continue if 'dummy' in l[1] or 'vnet' in l[1] or 'veth' in l[1] or \ 'gif' in l[1] or 'stf' in l[1]: continue if l[0] == 'Average:': continue l.append(self.nodename) l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines 07070100024518000081b40000000000000000000000014faa9509000010f1000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/checks.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from rcGlobalEnv import rcEnv import os class check(object): undef = [{ 'check_svcname': '', 'chk_instance': 'undef', 'chk_value': '-1' }] def __init__(self, svcs=[]): self.svcs = svcs def do_check(self): return [] class checks(check): check_list = [] def __init__(self, svcs=[]): self.svcs = svcs self.register('checkFsUsage') self.register('checkFsInode') self.register('checkVgUsage') self.register('checkLag') self.register('checkMpath') self.register('checkMpathPowerpath') self.register('checkZfsUsage') self.register('checkRaidSmartArray') self.register('checkRaidMegaRaid') self.register('checkRaidSas2') self.register('checkFmFmadm') self.register_local_checkers() def __iadd__(self, c): if isinstance(c, check): self.check_list.append(c) elif isinstance(c, checks): self.check_list += c.check_list def register_local_checkers(self): import os import glob check_d = os.path.join(rcEnv.pathvar, 'check') if not os.path.exists(check_d): return import sys sys.path.append(check_d) for f in glob.glob(os.path.join(check_d, 'check*.py')): if rcEnv.sysname not in f: continue cname = os.path.basename(f).replace('.py', '') try: m = __import__(cname) self += m.check(svcs=self.svcs) except: print >>sys.stderr, 'Could not import check:', cname def register(self, chk_name): if not os.path.exists(os.path.join(rcEnv.pathlib, chk_name+rcEnv.sysname+'.py')): return m = __import__(chk_name+rcEnv.sysname) self += m.check(svcs=self.svcs) def do_checks(self): import datetime now = str(datetime.datetime.now()) vars = [\ "chk_nodename", "chk_svcname", "chk_type", "chk_instance", "chk_value", "chk_updated"] vals = [] for chk in self.check_list: # print header s = chk.chk_type if hasattr(chk, "chk_name"): s += ' (' + chk.chk_name + ')' print s d = chk.do_check() if len(d) == 0: continue for i in d: if not isinstance(i, dict): continue if 'chk_instance' not in i: continue if i['chk_instance'] == 'undef': continue if 'chk_value' not in i: continue if 'chk_svcname' in i: chk_svcname = i['chk_svcname'] else: chk_svcname = "" # print instance s = " " + i['chk_instance'] if len(chk_svcname) > 0: s += '@' + chk_svcname s += ': ' + i['chk_value'] print s vals.append([\ rcEnv.nodename, chk_svcname, chk.chk_type, i['chk_instance'], i['chk_value'].replace("%",""), now] ) self.node.collector.call('push_checks', vars, vals) 070701000245b9000081b40000000000000000000000014faa950900000aeb000000ae00010002ffffffffffffffff0000001e00000000root/opt/opensvc/lib/resDg.py# # Copyright (c) 2009 Christophe Varoqui # Copyright (c) 2009 Cyril Galibern # Copyright (c) 2010 Christophe Varoqui # Copyright (c) 2010 Cyril Galibern # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. """Module providing Generic device group resources """ import resources as Res import rcStatus import rcExceptions as exc from rcGlobalEnv import rcEnv class Dg(Res.Resource): """ basic Dg resource, must be extend for LVM / Veritas / ZFS """ def __init__(self, rid=None, name=None, type=None, always_on=set([]), optional=False, disabled=False, tags=set([]), monitor=False): Res.Resource.__init__(self, rid, type, optional=optional, disabled=disabled, tags=tags, monitor=monitor) self.name = name self.always_on = always_on self.disks = set() self.devs = set() def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def disklist(self): return self.disks def has_it(self): return False def is_up(self): return False def do_start(self): return False def do_stop(self): return False def stop(self): self.do_stop() def start(self): self.do_start() def startstandby(self): if rcEnv.nodename in self.always_on: self.start() def _status(self, verbose=False): if rcEnv.nodename in self.always_on: if self.is_up(): return rcStatus.STDBY_UP else: return rcStatus.STDBY_DOWN else: if self.is_up(): return rcStatus.UP else: return rcStatus.DOWN if __name__ == "__main__": for c in (Dg,) : help(c) print """d=Dg("aGenericDg")""" d=Dg("aGenericDg") print "show d", d print """d.do_action("start")""" d.do_action("start") print """d.do_action("stop")""" d.do_action("stop") 0707010002455e000081b40000000000000000000000014faa950900000891000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/rcLogger.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import sys import logging import logging.handlers from rcGlobalEnv import * def initLogger(name): log = logging.getLogger(name) name_width = len(name) + 8 """Common log formatter """ fileformatter = logging.Formatter("%(asctime)s - %(name)s - %(levelname)s - %(message)s") streamformatter = logging.Formatter("%(asctime)s %(levelname)-7s %(name)-"+str(name_width)+"s %(message)s", datefmt="%H:%M:%S") """Common logfile with rotation """ filehandler = logging.handlers.RotatingFileHandler(rcEnv.logfile, maxBytes=5242880, backupCount=5) filehandler.setFormatter(fileformatter) log.addHandler(filehandler) """Stdout logger """ streamhandler = logging.StreamHandler() streamhandler.setFormatter(streamformatter) log.addHandler(streamhandler) if '--debug' in sys.argv: rcEnv.loglevel = logging.DEBUG log.setLevel(logging.DEBUG) elif '--warn' in sys.argv: rcEnv.loglevel = logging.WARNING log.setLevel(logging.WARNING) elif '--error' in sys.argv: rcEnv.loglevel = logging.ERROR log.setLevel(logging.ERROR) else: rcEnv.loglevel = logging.INFO log.setLevel(logging.INFO) return log 07070100024504000081b40000000000000000000000014faa9509000007a1000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/checkFsInodeHP-UX.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import call class check(checks.check): chk_type = "fs_i" def find_svc(self, mountpt): for svc in self.svcs: for rs in svc.get_res_sets('fs'): for r in rs.resources: if r.mountPoint == mountpt: return svc.svcname return '' def do_check(self): """ # bdf -li Filesystem kbytes used avail %used iused ifree %iuse Mounted on /dev/vg00/lvol3 1048576 228160 814136 22% 2105 25607 8% / """ cmd = ['bdf', '-li'] (ret, out, err) = call(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef r = [] for line in lines[1:]: l = line.split() if len(l) != 9: continue r.append({'chk_instance': l[0], 'chk_value': l[7], 'chk_svcname': self.find_svc(l[8]), } ) return r 0707010002456e000081b40000000000000000000000014faa9509000000d8000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/rcOsLinux.pyimport shutil import rcOs class Os(rcOs.Os): def reboot(self): with open("/proc/sysrq-trigger", "w") as f: f.write("b") def crash(self): shutil.copyfile('/dev/zero', '/dev/mem') 07070100024570000081b40000000000000000000000014faa9509000004f7000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/rcPkgAIX.py# # Copyright (c) 2010 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcUtilities import justcall, which from rcGlobalEnv import rcEnv def listpkg(): cmd = ['lslpp', '-Lc'] out, err, ret = justcall(cmd) if ret != 0: return [] lines = [] for line in out.split('\n'): l = line.split(':') if len(l) < 5: continue pkgvers = l[2] pkgname = l[1].replace('-'+pkgvers, '') x = [rcEnv.nodename, pkgname, pkgvers, ''] lines.append(x) return lines def listpatch(): return [] 0707010002451f000081b40000000000000000000000014faa950900000378000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/hostidLinux.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from uuid import getnode def hostid(): return str(getnode()) 0707010002458f000081b40000000000000000000000014faa950900002040000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcPrintTable.pyimport cStringIO,operator def indent(rows, hasHeader=False, headerChar='-', delim=' | ', justify='left', separateRows=False, prefix='', postfix='', wrapfunc=lambda x:x): """Indents a table by column. - rows: A sequence of sequences of items, one sequence per row. - hasHeader: True if the first row consists of the columns' names. - headerChar: Character to be used for the row separator line (if hasHeader==True or separateRows==True). - delim: The column delimiter. - justify: Determines how are data justified in their column. Valid values are 'left','right' and 'center'. - separateRows: True if rows are to be separated by a line of 'headerChar's. - prefix: A string prepended to each printed row. - postfix: A string appended to each printed row. - wrapfunc: A function f(text) for wrapping text; each element in the table is first wrapped by this function.""" # closure for breaking logical rows to physical, using wrapfunc def rowWrapper(row): newRows = [wrapfunc(item).split('\n') for item in row] return [[substr or '' for substr in item] for item in map(None,*newRows)] # break each logical row into one or more physical ones logicalRows = [rowWrapper(row) for row in rows] # columns of physical rows columns = map(None,*reduce(operator.add,logicalRows)) # get the maximum of each column by the string length of its items maxWidths = [max([len(unicode(item)) for item in column]) for column in columns] rowSeparator = headerChar * (len(prefix) + len(postfix) + sum(maxWidths) + \ len(delim)*(len(maxWidths)-1)) # select the appropriate justify method justify = {'center':str.center, 'right':str.rjust, 'left':str.ljust}[justify.lower()] output=cStringIO.StringIO() if separateRows: print >> output, rowSeparator for physicalRows in logicalRows: for row in physicalRows: print >> output, \ prefix \ + delim.join([justify(str(unicode(item).encode('ascii', 'replace')),width) for (item,width) in zip(row,maxWidths)]) \ + postfix if separateRows or hasHeader: print >> output, rowSeparator; hasHeader=False return output.getvalue() # written by Mike Brown # http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/148061 def wrap_onspace(text, width): """ A word-wrap function that preserves existing line breaks and most spaces in the text. Expects that existing line breaks are posix newlines (\n). """ return reduce(lambda line, word, width=width: '%s%s%s' % (line, ' \n'[(len(line[line.rfind('\n')+1:]) + len(word.split('\n',1)[0] ) >= width)], word), text.split(' ') ) import re def wrap_onspace_strict(text, width): """Similar to wrap_onspace, but enforces the width constraint: words longer than width are split.""" wordRegex = re.compile(r'\S{'+str(width)+r',}') return wrap_onspace(wordRegex.sub(lambda m: wrap_always(m.group(),width),text),width) import math def wrap_always(text, width): """A simple word-wrap function that wraps text on exactly width characters. It doesn't split the text in words.""" return '\n'.join([ text[width*i:width*(i+1)] \ for i in xrange(int(math.ceil(1.*len(text)/width))) ]) def print_table(data, width=20): if isinstance(data, list): print indent(data, hasHeader=True, wrapfunc=lambda x: wrap_onspace_strict(x,width)) return lines = data.splitlines() if len(lines) < 2: print "no data" labels = map(lambda x: x.split('.')[-1], lines[0].split(',')) lines = lines[1:] rows = [] for line in lines: row = [] incell = False cell_begin = 0 l = len(line) for i, c in enumerate(line): if c != ',' and i < l-1: continue if incell and ((i>1 and line[i-1] == '"') or i == l-1): incell = False if not incell: if i > 0: if i < l-1: cell = line[cell_begin:i].replace('""', '"') else: cell = line[cell_begin:].replace('""', '"') else: cell = "" if len(cell) > 1 and cell[0] == '"' and cell[-1] == '"': if len(cell) > 2: cell = cell[1:-1] else: cell = "" row.append(cell) cell_begin = i+1 if i' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from uuid import getnode def hostid(): return str(getnode()) 070701000245d9000081b40000000000000000000000014faa950900001ad9000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/resScsiReserv.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import resources as Res import uuid import re import time import rcStatus import rcExceptions as ex from rcUtilities import which from subprocess import * from rcGlobalEnv import rcEnv hostId = __import__('hostid'+rcEnv.sysname) class ScsiReserv(Res.Resource): """Define method to acquire and release scsi SPC-3 persistent reservations on disks held by a service """ def __init__(self, rid=None, disks=set([]), no_preempt_abort=False, disabled=False, tags=set([]), optional=False): self.no_preempt_abort = no_preempt_abort self.hostid = '0x'+hostId.hostid() self.disks = disks if len(disks) == 0: self.label = 'preserv 0 scsi disk' elif len(', '.join(disks)) > 248: self.label = 'preserv '+', '.join(disks)[0:248] self.label += " ..." else: self.label = ', '.join(disks) self.preempt_timeout = 10 self.prtype = '5' Res.Resource.__init__(self, rid=rid+"pr", type="disk.scsireserv", disabled=disabled, tags=tags, optional=optional) def scsireserv_supported(self): return False def ack_unit_attention(self, d): raise ex.notImplemented def disk_registered(self, disk): raise ex.notImplemented def disk_register(self, disk): raise ex.notImplemented def disk_unregister(self, disk): raise ex.notImplemented def get_reservation_key(self, disk): raise ex.notImplemented def disk_reserved(self, disk): raise ex.notImplemented def disk_release(self, disk): raise ex.notImplemented def disk_reserve(self, disk): raise ex.notImplemented def disk_preempt_reservation(self, disk, oldkey): if not hasattr(self, '_disk_preempt_reservation'): raise ex.notImplemented if not self.svc.force and not self.svc.cluster: self.log.error("%s is already reserved. use --force to override this safety net"%disk) raise ex.excError return self._disk_preempt_reservation(disk, oldkey) def ack_all_unit_attention(self): for d in self.disks: try: if self.ack_unit_attention(d) != 0: return 1 except ex.excScsiPrNotsupported: continue return 0 def register(self): r = 0 for d in self.disks: try: r += self.ack_unit_attention(d) r += self.disk_register(d) except ex.excScsiPrNotsupported: continue return r def unregister(self): r = 0 for d in self.disks: try: r += self.ack_unit_attention(d) if not self.disk_registered(d): continue r += self.disk_unregister(d) except ex.excScsiPrNotsupported: continue return r def disk_wait_reservation(self, disk): for i in range(3, 0, -1): if self.disk_reserved(disk): self.log.info("reservation acquired for disk %s" % disk) return 0 if i > 0: time.sleep(1) self.log.error("timed out waiting for reservation for disk %s" % disk) return 1 def reserve(self): r = 0 for d in self.disks: try: r += self.ack_unit_attention(d) key = self.get_reservation_key(d) if key is None: r += self.disk_reserve(d) elif key == self.hostid: continue else: r += self.disk_preempt_reservation(d, key) r += self.disk_wait_reservation(d) except ex.excScsiPrNotsupported: continue return r def release(self): r = 0 for d in self.disks: try: r += self.ack_unit_attention(d) if not self.disk_reserved(d): continue r += self.disk_release(d) except ex.excScsiPrNotsupported: continue return r def checkreserv(self): if self.ack_all_unit_attention() != 0: return rcStatus.WARN r = rcStatus.Status() for d in self.disks: try: key = self.get_reservation_key(d) if key is None: self.log.debug("disk %s is not reserved" % d) r += rcStatus.DOWN elif key != self.hostid: self.log.debug("disk %s is reserved by another host whose key is %s" % (d, key)) r += rcStatus.DOWN else: self.log.debug("disk %s is correctly reserved" % d) r += rcStatus.UP except ex.excScsiPrNotsupported: continue return r.status def scsireserv(self): if not self.scsireserv_supported(): return r = 0 r += self.register() r += self.reserve() return r def scsirelease(self): if not self.scsireserv_supported(): return r = 0 r += self.release() r += self.unregister() return r def scsicheckreserv(self): if not self.scsireserv_supported(): return return self.checkreserv() def _status(self, verbose=False): if not self.scsireserv_supported(): return rcStatus.NA return self.scsicheckreserv() def start(self): if not self.scsireserv_supported(): return if self.scsireserv() != 0: raise ex.excError def stop(self): if not self.scsireserv_supported(): return if self.scsirelease() != 0: raise ex.excError 07070100024605000081b40000000000000000000000014faa95090000068b000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/svcJail.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc import resContainerJail as jail class SvcJail(svc.Svc): """ Define Jail services""" def __init__(self, svcname, vmname=None, guestos=None, jailroot=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmname = vmname self.guestos = guestos self.jailroot = jailroot self += jail.Jail(vmname, disabled=disabled) """ jail names cannot have dots """ self.basevmname = vmname.split('.')[0] self.runmethod = ['jexec', self.basevmname] if __name__ == "__main__": for c in (SvcJail,) : help(c) 0707010002459b000081b40000000000000000000000014faa950900001dd5000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcStatsHP-UX.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2011 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcUtilities import call from rcGlobalEnv import rcEnv import rcStats class StatsProvider(rcStats.StatsProvider): def glancefile(self, day): f = os.path.join(rcEnv.pathvar, 'glance'+day) if os.path.exists(f): return f return None def cpu(self, d, day, start, end): f = self.glancefile(day) if f is None: return [], [] cols = ['date', 'cpu', 'usr', 'nice', 'sys', 'iowait', 'steal', 'irq', 'soft', 'guest', 'idle', 'nodename'] lines = [] with open(f, 'r') as file: for line in file: l = line.split() if len(l) != 24: continue """ hpux: usr nice sys irq wait idle 1 2 3 4 5 6 xmlrpc: date cpu usr nice sys iowait steal irq soft guest idle nodename """ ts = '%s %s'%(d, l[0]) ts = ts.replace('\0','') x = [ts, 'all', l[1], l[2], l[3], l[5], '0', l[4], '0', '0', l[6], self.nodename] lines.append(x) return cols, lines def mem_u(self, d, day, start, end): f = self.glancefile(day) if f is None: return [], [] cols = ['date', 'kbmemfree', 'kbmemused', 'pct_memused', 'kbbuffers', 'kbcached', 'kbcommit', 'pct_commit', 'kbmemsys', 'nodename'] lines = [] with open(f, 'r') as file: for line in file: l = line.split() if len(l) != 24: continue """ hpux: phys kbmemfree kbcached kbfilecached kbsys kbuser kbswapused kbswap 7 8 9 10 11 12 13 14 xmlrpc: date kbmemfree kbmemused pct_memused kbbuffers kbcached kbcommit pct_commit kbmemsys nodename """ phys = int(l[7]) free = int(l[8]) swapused = int(l[13]) swap = int(l[14]) used = phys - free commit = used + swapused vm = phys + swap if vm == 0 or phys == 0: continue pct_commit = 100 * commit / vm pct_used = 100 * used / phys ts = '%s %s'%(d, l[0]) ts = ts.replace('\0','') x = [ts, l[8], str(used), str(pct_used), l[9], l[10], str(commit), str(pct_commit), l[11], self.nodename] lines.append(x) return cols, lines def proc(self, d, day, start, end): f = self.glancefile(day) if f is None: return [], [] cols = ['date', 'runq_sz', 'plist_sz', 'ldavg_1', 'ldavg_5', 'ldavg_15', 'nodename'] lines = [] with open(f, 'r') as file: for line in file.readlines(): l = line.split() if len(l) != 24: continue """ hpux: GBL_LOADAVG GBL_LOADAVG5 GBL_LOADAVG15 GBL_CPU_QUEUE TBL_PROC_TABLE_USED 15 16 17 18 19 xmlrpc: date runq_sz plist_sz ldavg_1 ldavg_5 ldavg_15 nodename """ ts = '%s %s'%(d, l[0]) ts = ts.replace('\0','') x = [ts, l[18], l[19], l[15], l[16], l[17], self.nodename] lines.append(x) return cols, lines def swap(self, d, day, start, end): f = self.glancefile(day) if f is None: return [], [] lines = [] cols = ['date', 'kbswpfree', 'kbswpused', 'pct_swpused', 'kbswpcad', 'pct_swpcad', 'nodename'] with open(f, 'r') as file: for line in file.readlines(): l = line.split() if len(l) != 24: continue """ hpux: kbswapused kbswap 13 14 xmlrpc: date kbswpfree kbswpused pct_swpused kbswpcad pct_swpcad nodename """ swapused = int(l[13]) swap = int(l[14]) swapfree = swap - swapused ts = '%s %s'%(d, l[0]) ts = ts.replace('\0','') x = [ts, str(swapfree), l[13], str(100 * swapused / swap), '0', '0', self.nodename] lines.append(x) return cols, lines def block(self, d, day, start, end): f = self.glancefile(day) if f is None: return [], [] cols = ['date', 'tps', 'rtps', 'wtps', 'rbps', 'wbps', 'nodename'] lines = [] with open(f, 'r') as file: for line in file.readlines(): l = line.split() if len(l) != 24: continue """ hpux: rio wio rkb wkb 20 21 22 23 xmlrpc: date tps rtps wtps rbps wbps nodename """ tps = float(l[20]) + float(l[21]) ts = '%s %s'%(d, l[0]) ts = ts.replace('\0','') x = [ts, str(tps), l[20], l[21], l[22], l[23], self.nodename] lines.append(x) return cols, lines 0707010002456f000081fd0000000000000000000000014faa950900001193000000ae00010002ffffffffffffffff0000001e00000000root/opt/opensvc/lib/rcOvm.py#!/opt/opensvc/bin/python # # Copyright (c) 2011 Christophe Varoqui # Copyright (c) 2011 Cyril Galibern # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import subprocess from rcUtilities import which, call import rcExceptions as ex from rcGlobalEnv import rcEnv class Ovm(object): def __init__(self, log=None): self.ovmcli = 'ovm' if log is not None: self.log = log else: import logging self.log = logging.getLogger('OVM') import ConfigParser cf = os.path.join(os.path.dirname(__file__), '..', 'etc', "auth.conf") self.conf = ConfigParser.RawConfigParser() self.conf.read(cf) if not self.conf.has_section("ovm"): raise ex.excError("no auth information for OVM manager") if not self.conf.has_option("ovm", "username"): raise ex.excError("no username information for OVM manager") if not self.conf.has_option("ovm", "password"): raise ex.excError("no password information for OVM manager") self.username = self.conf.get("ovm", "username") self.password = self.conf.get("ovm", "password") def test(self): if which(self.ovmcli): self.log.error("ovm CLI is not installed") return False if self.username is None: self.log.error("manager username is not set") return False if self.password is None: self.log.error("manager password is not set") return False return True def ovm(self, args, check=True, verbose=True): if not self.test: raise ex.excError cmd = [self.ovmcli, '-u', self.username, '-p', self.password, '-S";"'] + args if verbose: _cmd = [self.ovmcli, '-u', self.username, '-p', 'XXXXXX'] + args self.log.info(subprocess.list2cmdline(_cmd)) ret, out, err = call(cmd, log=self.log) if 'Error:' in out > 0: self.log.error(out) else: self.log.info(out) else: ret, out, err = call(cmd, log=self.log) if check and ret != 0: raise ex.excError("ovm command execution error") return ret, out, err def get_pool(self): cmd = ['svr', 'ls'] ret, out, err = self.ovm(cmd, verbose=False) for line in out.split('\n'): l = line.split(';') if len(l) != 4: continue if l[1].strip('"') == rcEnv.nodename: return l[3].strip('"') raise ex.excError("can't find node's pool name") def vm_enable_ha(self, vm): pool = self.get_pool() cmd = ['vm', 'conf', '-n', vm, '-s', pool, '-e'] self.ovm(cmd) def vm_disable_ha(self, vm): pool = self.get_pool() cmd = ['vm', 'conf', '-n', vm, '-s', pool, '-d'] self.ovm(cmd) def vm_info(self, vm): pool = self.get_pool() cmd = ['vm', 'info', '-n', vm, '-s', pool] ret, out, err = self.ovm(cmd, verbose=False) if ret != 0: raise ex.excError("failed to fetch VM information from manager") h = {} for line in out.split('\n'): l = line.split(':') if len(l) != 2: continue h[l[0].strip()] = l[1].strip() return h def vm_ha_enabled(self, vm): info = self.vm_info(vm) if 'Hign Availability' in info and info['Hign Availability'] == 'Enabled': return True if 'High Availability' in info and info['High Availability'] == 'Enabled': return True return False if __name__ == "__main__": o = Ovm() #o.vm_disable_ha("ovmguest1") #o.vm_enable_ha("ovmguest1") 070701000245e6000081b40000000000000000000000014faa950900002468000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/resSyncNexenta.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import logging from rcGlobalEnv import rcEnv import rcExceptions as ex import rcStatus import resSync import datetime from rcNexenta import Nexenta class syncNexenta(resSync.Sync): def can_sync(self, target=None): try: self.get_endpoints() except ex.excError, e: self.log.error(str(e)) raise ex.excError if self.ts is None: self.get_props() if self.skip_sync(self.ts): return False return True def syncswap(self): # only available from CLI ? pass def syncupdate(self): try: self.get_endpoints() except ex.excError, e: self.log.error(str(e)) raise ex.excError if not self.can_sync() and not self.svc.force: return s = self.master.autosync_get_state(self.autosync) if s == "disabled": self.log.error("update not applicable: disabled") return if s == "running": self.log.info("update not applicable: transfer in progress") return if s != "online": self.log.error("update not applicable: %s state"%s) return self.master.autosync_execute(self.autosync) self.log.info("autosync runner execution submitted") def bind(self): b = self.local.ssh_list_bindings() found = False for k in b: user, hostport = k.split('@') if hostport == self.remote.head: found = True break if found: self.log.info("%s head already bound"%self.remote.head) else: self.local.ssh_bind(self.remote.username, self.remote.head, self.remote.password) self.log.info("%s head bound"%self.remote.head) def unbind(self): b = self.local.ssh_list_bindings() done = False for k in b: user, hostport = k.split('@') if hostport != self.remote.head: continue self.local.ssh_unbind(user, hostport, '1') self.log.info("%s head unbound"%hostport) done = True if not done: self.log.info("%s head already unbound"%self.remote.head) def syncresync(self): try: self.get_endpoints() self.bind() self.master.autosync_enable(self.autosync) self.log.info("autosync enable submitted") except ex.excError, e: self.log.error(str(e)) raise ex.excError def syncbreak(self): try: self.get_endpoints() self.unbind() self.master.autosync_disable(self.autosync) self.log.info("autosync disable submitted") self.wait_break() except ex.excError, e: self.log.error(str(e)) raise ex.excError def wait_break(self): import time timeout = 5 for i in range(timeout, 0, -1): s = self.master.autosync_get_state(self.autosync) if s == "disabled": return if i > 1: time.sleep(2) self.log.error("timed out waiting for disable to finish") raise ex.excError def start(self): try: self.get_endpoints() self.local.set_can_mount(self.path) self.log.info("set 'canmount = on' on %s"%self.path) except ex.excError, e: self.log.error(str(e)) raise ex.excError def stop(self): pass def get_props(self): self.props = self.master.autosync_get_props(self.autosync) # timestamp format : 15:34:09,May27 now = datetime.datetime.now() try: self.ts = datetime.datetime.strptime(str(now.year)+' '+self.props['zfs/time_started'], "%Y %H:%M:%S,%b%d") if now < self.ts: self.ts = datetime.datetime.strptime(str(now.year-1)+' '+self.props['zfs/time_started'], "%Y %H:%M:%S,%b%d") except ValueError: raise ex.excError("can not parse last sync date: %s"%self.props['zfs/time_started']) self.age = now - self.ts def _status(self, verbose=False): ret = rcStatus.UP try: self.get_endpoints() self.status_log("master head is %s"%self.master.head) self.get_props() except ex.excError, e: if 'message' in e.value: msg = e.value['message'] else: msg = str(e) self.status_log(msg) return rcStatus.WARN except: self.status_log("unexpected error") self.save_exc() return rcStatus.UNDEF limit = datetime.timedelta(minutes=self.sync_max_delay) if self.age > limit: self.status_log("last sync too old: %s ago"%str(self.age)) ret = rcStatus.WARN s = self.master.autosync_get_state(self.autosync) if s not in ['online', 'running']: self.status_log("runner in '%s' state"%s) ret = rcStatus.WARN if ret == rcStatus.UP: self.status_log("last sync %s ago"%str(self.age)) return ret def get_endpoints(self): """ determine which head is the replication master and which is replication slave. """ if self.local is not None and self.remote is not None: return heads = list(set(self.filers.values()) - set([self.filer])) if len(heads) != 1: raise ex.excError("two heads need to be setup") self.local = Nexenta(self.filer, self.log) self.remote = Nexenta(heads[0], self.log) prop = 'zfs/to-host' try: localdown = False props = self.local.autosync_get_props(self.autosync) if prop in props and props[prop] == self.filer: self.slave = self.local self.master = self.remote else: self.slave = self.remote self.master = self.local return except ex.excError, e: if 'does not exist' in str(e): path_props = self.local.get_props(self.path) if path_props is None: raise ex.excError("path '%s' not found on local head '%s'"%(self.path, self.filer)) self.slave = self.local self.master = self.remote else: # local head is down localdown = True try: props = self.remote.autosync_get_props(self.autosync) if prop in props and props[prop] == self.filer: self.slave = self.local self.master = self.remote else: self.slave = self.remote self.master = self.local return except ex.excError, e: if 'does not exist' in str(e): path_props = self.remote.get_props(self.path) if path_props is None: raise ex.excError("path '%s' not found on remote head '%s'"%(self.path, self.filer)) self.slave = self.remote self.master = self.local elif localdown: raise ex.excError("both heads unreachable") def __init__(self, rid=None, name=None, path=None, filers={}, reversible=False, sync_max_delay=None, sync_interval=None, sync_days=None, sync_period=None, optional=False, disabled=False, tags=set([]), internal=False): resSync.Sync.__init__(self, rid=rid, type="sync.nexenta", sync_max_delay=sync_max_delay, sync_interval=sync_interval, sync_days=sync_days, sync_period=sync_period, optional=optional, disabled=disabled, tags=tags) self.label = "nexenta autosync %s"%name self.autosync = name self.filers = filers self.path = path self.reversible = reversible self.filer = filers[rcEnv.nodename] self.master = None self.slave = None self.ts = None self.age = None self.props = None self.local = None self.remote = None def __str__(self): return "%s autosync=%s" % (resSync.Sync.__str__(self),\ self.autosync) 070701000245bd000081b40000000000000000000000014faa950900001a3f000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/resHbOpenHA.py# # Copyright (c) 2010 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import resHb from rcGlobalEnv import rcEnv import os import rcStatus import rcExceptions as ex from rcUtilities import justcall class Hb(resHb.Hb): """ HeartBeat ressource """ def __init__(self, rid=None, name=None, always_on=set([]), optional=False, disabled=False, tags=set([])): resHb.Hb.__init__(self, rid, "hb.openha", optional=optional, disabled=disabled, tags=tags) self.basedir = os.path.join(os.sep, 'usr', 'local', 'cluster') self.bindir = os.path.join(self.basedir, 'bin') self.logdir = os.path.join(self.basedir, 'log') self.svcdir = os.path.join(self.basedir, 'services') self.cfsvc = os.path.join(self.basedir, 'conf', 'services') self.cfnod = os.path.join(self.basedir, 'conf', 'nodes') self.cfmon = os.path.join(self.basedir, 'conf', 'monitor') os.environ['EZ'] = self.basedir os.environ['EZ_BIN'] = self.bindir os.environ['EZ_SERVICES'] = self.cfsvc os.environ['EZ_NODES'] = self.cfnod os.environ['EZ_MONITOR'] = self.cfmon os.environ['EZ_LOG'] = self.logdir self.service_cmd = os.path.join(self.bindir, 'service') self.heartc = os.path.join(self.bindir, 'heartc') self.heartd = os.path.join(self.bindir, 'heartd') self.nmond = os.path.join(self.bindir, 'nmond') self.name = name self.state = {'0': 'stopped', '1': 'stopping', '2': 'started', '3': 'starting', '4': 'start_failed', '5': 'stop_failed', '6': 'frozen_stop', '7': 'start_ready', '8': 'unknown', '9': 'force_stop'} def cluster_name(self): if self.name is None: return self.svc.svcname else: return self.name def service_local_status(self): return self.service_status(rcEnv.nodename) def service_remote_status(self): if len(self.svc.nodes) != 2: self.log.error("HA cluster must have 2 nodes") raise ex.excError nodes = [n for n in self.svc.nodes if n != rcEnv.nodename] if len(nodes) != 1: self.log.error("local node is not in cluster") raise ex.excError peer = nodes[0] return self.service_status(peer) def service_status(self, nodename): service_state = os.path.join(self.svcdir, self.cluster_name(), 'STATE.'+nodename) try: f = open(service_state, 'r') buff = f.read().strip(' \n') f.close() except: import traceback traceback.print_exc() return 'unknown' if len(buff) < 1: self.log.error("%s is corrupted"%service_state) return 'unknown' if buff[0] in self.state: return self.state[buff[0]] else: return 'unknown' def service_action(self, command): cmd = [self.service_cmd, '-A', self.cluster_name(), command] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def freezestop(self): cmd = ['env'] vars = ('EZ', 'EZ_BIN', 'EZ_SERVICES', 'EZ_NODES', 'EZ_MONITOR', 'EZ_LOG') for var in vars: cmd.append(var+'='+os.environ[var]) cmd += [self.service_cmd, '-A', self.cluster_name(), 'freeze-stop'] self.svc.node.cmdworker.enqueue(cmd) def process_running(self): if not os.path.exists(self.cfmon): return True buff = "" with open(self.cfmon) as f: buff = f.read() daemons = [] for line in buff.split('\n'): l = line.split() if len(l) < 4: continue if '#' in l[0]: continue if l[1] == 'net': l[1] = '' else: l[1] = '_'+l[1] if rcEnv.nodename == l[0]: l[1] = self.heartd + l[1] daemons.append(' '.join(l[1:-1])) else: l[1] = self.heartc + l[1] daemons.append(' '.join(l[1:])) daemons.append(self.nmond) (out, err, ret) = justcall(['ps', '-ef']) if ret != 0: return False h = {} for d in daemons: h[d] = 1 for line in out.split('\n'): for d in daemons: if d in line: h[d] = 0 total = 0 for d in daemons: total += h[d] if total > 0: return False return True def need_stonith(self): status = self.service_remote_status() if status == 'unknown': return True return False def __status(self, verbose=False): if not os.path.exists(self.service_cmd): self.status_log("open-ha is not installed") return rcStatus.WARN if not self.process_running(): self.status_log("open-ha daemons are not running") return rcStatus.WARN status = self.service_local_status() if status == 'unknown': self.status_log("unable to determine cluster service state") return rcStatus.WARN elif status in ['frozen_stop', 'start_failed', 'stop_failed', 'starting', 'start_ready', 'stopping', 'force_stop']: self.status_log("cluster service status is %s"%status) return rcStatus.WARN elif status in ['stopped']: return rcStatus.DOWN elif status in ['started']: return rcStatus.UP else: self.status_log("unknown cluster service status: %s"%status) return rcStatus.WARN 07070100024556000081b40000000000000000000000014faa9509000006f3000000ae00010002ffffffffffffffff0000002c00000000root/opt/opensvc/lib/rcIfconfigHP-UXhpvm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcExceptions as ex from subprocess import * rcIfconfig = __import__("rcIfconfigHP-UX") from rcGlobalEnv import rcEnv class ifconfig(rcIfconfig.ifconfig): def __init__(self, hostname): self.intf = [] cmd = rcEnv.rsh.split(' ') + [hostname, 'netstat', '-win'] p = Popen(cmd, stdout=PIPE) buff = p.communicate()[0] if p.returncode != 0: raise ex.excError intf_list = buff for line in intf_list.split('\n'): if len(line) == 0: continue intf = line.split()[0].replace('*', '') cmd = rcEnv.rsh.split(' ') + [hostname, 'env', 'LANG=C', 'ifconfig', intf] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out = p.communicate() if "no such interface" in out[1]: continue elif p.returncode != 0: raise ex.excError self.parse(out[0]) 070701000245b7000081b40000000000000000000000014faa950900000f4c000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/resContainerXen.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import resources as Res import os import rcExceptions as ex import resContainer rcU = __import__("rcUtilities" + os.uname()[0]) class Xen(resContainer.Container): startup_timeout = 180 shutdown_timeout = 120 def __init__(self, name, optional=False, disabled=False, monitor=False, tags=set([])): resContainer.Container.__init__(self, rid="xen", name=name, type="container.xen", optional=optional, disabled=disabled, monitor=monitor, tags=tags) def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def list_conffiles(self): cf = os.path.join(os.sep, 'opt', 'opensvc', 'var', self.name+'.xml') if os.path.exists(cf): return [cf] return [] def files_to_sync(self): return self.list_conffiles() def check_capabilities(self): cmd = ['virsh', 'capabilities'] (ret, out, err) = self.call(cmd, errlog=False) if ret != 0: self.status_log("can not fetch capabilities") return False return True def ping(self): return rcU.check_ping(self.addr, timeout=1, count=1) def container_start(self): cf = os.path.join(os.sep, 'opt', 'opensvc', 'var', self.name+'.xml') if os.path.exists(cf): cmd = ['virsh', 'define', cf] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError cmd = ['virsh', 'start', self.name] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_stop(self): cmd = ['virsh', 'shutdown', self.name] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_forcestop(self): cmd = ['virsh', 'destroy', self.name] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def is_up(self): cmd = ['virsh', 'dominfo', self.name] (ret, out, err) = self.call(cmd, errlog=False) if ret != 0: return False if "running" in out.split() or "idle" in out.split() : return True return False def get_container_info(self): cmd = ['virsh', 'dominfo', self.name] (ret, out, err) = self.call(cmd, errlog=False, cache=True) self.info = {'vcpus': '0', 'vmem': '0'} if ret != 0: return self.info for line in out.split('\n'): if "CPU(s):" in line: self.info['vcpus'] = line.split(':')[1].strip() if "Max memory" in line: self.info['vmem'] = line.split(':')[1].strip() if "Autostart:" in line: self.info['autostart'] = line.split(':')[1].strip() return self.info def check_manual_boot(self): self.get_container_info() if self.info['autostart'] == 'disable' : return True else: return False 07070100024506000081b40000000000000000000000014faa9509000007a1000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/checkFsInodeSunOS.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "fs_i" def find_svc(self, mountpt): for svc in self.svcs: for rs in svc.get_res_sets('fs'): for r in rs.resources: if r.mountPoint == mountpt: return svc.svcname return '' def do_check(self): r = [] for t in ['ufs', 'vxfs']: r += self._do_check(t) return r def _do_check(self, t): cmd = ['df', '-F', t, '-o', 'i'] (out,err,ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef r = [] for line in lines[1:]: l = line.split() if len(l) == 5: l = [''] + l elif len(l) != 6: continue r.append({ 'chk_instance': l[5], 'chk_value': l[4], 'chk_svcname': self.find_svc(l[5]), }) return r 070701000245eb000081b40000000000000000000000014faa950900000b48000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resVdisk.py# # Copyright (c) 2010 Christophe Varoqui # Copyright (c) 2010 Cyril Galibern # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. """ Module providing device path remapping for libvirt VMs """ import resources as Res import rcStatus import rcExceptions as ex from rcGlobalEnv import rcEnv class Vdisk(Res.Resource): def __init__(self, rid=None, name=None, devpath={}, type=None, always_on=set([]), optional=False, disabled=False, tags=set([]), monitor=False): Res.Resource.__init__(self, rid, "disk.vdisk", optional=optional, disabled=disabled, tags=tags, monitor=monitor) self.name = name self.always_on = always_on self.disks = set() self.devpath = devpath def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def disklist(self): return self.disks def remap(self): path = self.devpath[rcEnv.nodename] paths = set(self.devpath.values()) - set(self.devpath[rcEnv.nodename]) from xml.etree.ElementTree import ElementTree, SubElement tree = ElementTree() try: tree.parse(self.svc.resources_by_id['container'].cf) except: self.log.error("failed to parse %s"%self.svc.resources_by_id['container'].cf) raise ex.excError for dev in tree.getiterator('disk'): s = dev.find('source') if s is None: continue il = s.items() if len(il) != 1: continue attr, devp = il[0] if devp in paths: self.log.info("remapping device path: %s -> %s"%(devp,path)) s.set('dev', path) #SubElement(dev, "source", {'dev': path}) tree.write(self.svc.resources_by_id['container'].cf) def stop(self): pass def start(self): self.remap() def startstandby(self): pass def _status(self, verbose=False): return rcStatus.NA 070701000245c6000081b40000000000000000000000014faa950900000624000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resIpKvm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. resIpHv = __import__("resIpLinux") import resIpVm class Ip(resIpVm.Ip, resIpHv.Ip): def __init__(self, rid=None, ipDev=None, ipName=None, mask=None, always_on=set([]), disabled=False, tags=set([]), optional=False, monitor=False): resIpVm.Ip.__init__(self, rid=rid, ipDev=ipDev, ipName=ipName, mask=mask, always_on=always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) def check_ping(self): return resIpHv.Ip.check_ping(self) if __name__ == "__main__": for c in (Ip,) : help(c) 0707010002459d000081b40000000000000000000000014faa950900002013000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcStatsSunOS.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2011 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcUtilities import call, which import rcStats import datetime class StatsProvider(rcStats.StatsProvider): def __init__(self, interval=2880, stats_dir=None, stats_start=None, stats_end=None): rcStats.StatsProvider.__init__(self, interval=interval, stats_dir=stats_dir, stats_start=stats_start, stats_end=stats_end) cmd = ['pagesize'] (ret, pagesize, err) = call(cmd) self.pagesize = int(pagesize) def zsfile(self, day): f = os.path.join(os.sep, 'var', 'adm', 'zonestat', 'zs'+day) if os.path.exists(f): return f return None def sarfile(self, day): f = os.path.join(os.sep, 'var', 'adm', 'sa', 'sa'+day) if os.path.exists(f): return f return None def svc(self, d, day, start, end): cols = ['date', 'svcname', 'swap', 'rss', 'cap', 'at', 'avgat', 'pg', 'avgpg', 'nproc', 'mem', 'cpu', 'nodename'] f = self.zsfile(day) lines = [] if f is None: return cols, lines try: with open(f, 'r') as f: buff = f.read() except: return cols, lines _start = datetime.datetime.strptime(start, "%H:%M:%S") _start = _start.hour * 3600 + _start.minute * 60 + _start.second _end = datetime.datetime.strptime(end, "%H:%M:%S") _end = _end.hour * 3600 + _end.minute * 60 + _end.second for line in buff.split('\n'): l = line.split() if len(l) != 17: continue _d = datetime.datetime.strptime(" ".join(l[0:2]), "%Y-%m-%d %H:%M:%S") _d = _d.hour * 3600 + _d.minute * 60 + _d.second if _d < _start or _d > _end: continue for i, e in enumerate(l): if e.endswith('T'): l[i] = str(int(e[0:-2]) * 1024 * 1024) elif e.endswith('G'): l[i] = str(int(e[0:-2]) * 1024) elif e.endswith('M'): l[i] = e.rstrip('M') elif e.endswith('K'): l[i] = str(1.0 * int(e[0:-2]) / 1024) l = [" ".join(l[0:2])] + l[2:-4] + [self.nodename] lines.append(l) return cols, lines def cpu(self, d, day, start, end): cols = ['date', 'usr', 'sys', 'iowait', 'idle', 'cpu', 'nodename'] f = self.sarfile(day) lines = [] if f is None: return cols, lines cmd = ['sar', '-u', '-f', f, '-s', start, '-e', end] (ret, buff, err) = call(cmd, errlog=False) for line in buff.split('\n'): l = line.split() if len(l) != 5: continue if l[1] == '%usr': continue if l[0] == 'Average': continue l += ['all', self.nodename] l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines def mem_u(self, d, day, start, end): cols = ['date', 'kbmemfree', 'nodename'] f = self.sarfile(day) lines = [] if f is None: return cols, lines cmd = ['sar', '-r', '-f', f, '-s', start, '-e', end] (ret, buff, err) = call(cmd) for line in buff.split('\n'): l = line.split() if len(l) != 3: continue if l[1] == 'freemem': continue if l[0] == 'Average': continue try: freemem = int(l[1])*self.pagesize/1024 except: continue x = ['%s %s'%(d, l[0]), str(freemem), self.nodename] lines.append(x) return cols, lines def proc(self, d, day, start, end): cols = ['date', 'runq_sz', 'nodename'] f = self.sarfile(day) lines = [] if f is None: return cols, lines cmd = ['sar', '-q', '-f', f, '-s', start, '-e', end] (ret, buff, err) = call(cmd) for line in buff.split('\n'): l = line.split() if len(l) != 5: continue if l[1] == 'runq-sz': continue if l[0] == 'Average': continue x = ['%s %s'%(d, l[0]), l[1], self.nodename] lines.append(x) return cols, lines def swap(self, d, day, start, end): cols = ['date', 'kbswpfree', 'nodename'] f = self.sarfile(day) lines = [] if f is None: return cols, lines cmd = ['sar', '-r', '-f', f, '-s', start, '-e', end] (ret, buff, err) = call(cmd) for line in buff.split('\n'): l = line.split() if len(l) != 3: continue if l[1] == 'freemem': continue if l[0] == 'Average': continue try: freeswap = int(l[2])/2 except: continue x = ['%s %s'%(d, l[0]), str(freeswap), self.nodename] lines.append(x) return cols, lines def block(self, d, day, start, end): cols = ['date', 'rbps', 'wbps', 'nodename'] f = self.sarfile(day) lines = [] if f is None: return [], [] cmd = ['sar', '-b', '-f', f, '-s', start, '-e', end] (ret, buff, err) = call(cmd) for line in buff.split('\n'): l = line.split() if len(l) != 9: continue if l[1] == 'bread/s': continue if l[0] == 'Average': continue x = ['%s %s'%(d, l[0]), l[1], l[4], self.nodename] lines.append(x) return cols, lines def blockdev(self, d, day, start, end): cols = ['date', 'dev', 'pct_util', 'avgqu_sz', 'rsecps', 'await', 'svctm', 'nodename'] f = self.sarfile(day) lines = [] if f is None: return cols, lines cmd = ['sar', '-d', '-f', f, '-s', start, '-e', end] (ret, buff, err) = call(cmd, errlog=False) for line in buff.split('\n'): l = line.split() if len(l) == 8: date = l[0] if len(l) == 7: l = [date] + l if len(l) != 8: continue if l[1] == 'device': continue if l[0] == 'Average': continue # 00:00:00 device %busy avque r+w/s [blks/s] avwait avserv x = ['%s %s'%(d, l[0]), l[1], l[2], l[3], l[4], l[6], l[7], self.nodename] lines.append(x) return cols, lines 07070100024532000081b40000000000000000000000014faa9509000000a8000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/provisioning.pyclass Provisioning(object): def __init__(self, r): self.r = r def validate(self): return True def provisioner(self): return True 070701000245de000081b40000000000000000000000014faa950900000261000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/resStonithIlo.pyimport resStonith import rcStatus from rcGlobalEnv import rcEnv class Stonith(resStonith.Stonith): def __init__(self, rid=None, name=None, always_on=set([]), optional=False, disabled=False, tags=set([])): resStonith.Stonith.__init__(self, rid, "stonith.ilo", optional=optional, disabled=disabled, tags=tags) self.name = name self.username, self.password, self.key = self.creds() def _start(self): cmd = rcEnv.rsh.split() + ['-l', self.username, '-i', self.key, self.name, 'power', 'reset'] self.vcall(cmd) 070701000245da000081b40000000000000000000000014faa9509000016e6000000ae00010002ffffffffffffffff0000002b00000000root/opt/opensvc/lib/resScsiReservHP-UX.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import resources as Res import uuid import re import os import time import rcStatus import rcExceptions as ex from rcUtilities import which from subprocess import * import resScsiReserv def mpath_to_path(disks): l = [] for disk in disks: if "/dev/dsk" in disk: l.append(disk.replace("/dev/dsk", "/dev/rdsk")) continue if "/dev/disk" not in disk and "/dev/rdisk" not in disk: continue if not os.path.exists(disk): continue cmd = ['ioscan', '-F', '-m', 'dsf', disk] p = Popen(cmd, stderr=None, stdout=PIPE, close_fds=True) buff = p.communicate() ret = p.returncode if ret != 0: continue a = buff[0].split(':') if len(a) != 2: continue b = a[1].split() for d in b: l.append(d.replace("/dev/dsk", "/dev/rdsk")) return l class ScsiReserv(resScsiReserv.ScsiReserv): def __init__(self, rid=None, disks=set([]), no_preempt_abort=False, disabled=False, tags=set([]), optional=False): resScsiReserv.ScsiReserv.__init__(self, rid=rid, disks=disks, no_preempt_abort=no_preempt_abort, disabled=disabled, tags=tags, optional=optional) self.prtype = 'wero' self.disks = mpath_to_path(disks) self.leg_mpath_disable() def scsireserv_supported(self): if which('scu') is None: return False return True def leg_mpath_disable(self): cmd = ['scsimgr', 'get_attr', '-p', '-a', 'leg_mpath_enable'] p = Popen(cmd, stderr=None, stdout=PIPE, close_fds=True) buff = p.communicate() ret = p.returncode if ret != 0: self.log.error("can not fetch 'leg_mpath_enable' value") raise ex.excError if 'false' in buff[0]: return cmd = ['scsimgr', 'save_attr', '-a', 'leg_mpath_enable=false'] self.log.info(' '.join(cmd)) p = Popen(cmd, stderr=None, stdout=PIPE, close_fds=True) buff = p.communicate() ret = p.returncode if ret != 0: self.log.error("can not set 'leg_mpath_enable' value") raise ex.excError def ack_unit_attention(self, d): return 0 def disk_registered(self, disk): cmd = [ 'scu', '-f', disk, 'show', 'keys' ] (ret, out, err) = self.call(cmd) if ret != 0: self.log.error("failed to read registrations for disk %s" % disk) if self.hostid in out: return True return False def disk_register(self, disk): cmd = [ 'scu', '-f', disk, 'preserve', 'register', 'skey', self.hostid ] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("failed to register key %s with disk %s" % (self.hostid, disk)) return ret def disk_unregister(self, disk): cmd = [ 'scu', '-f', disk, 'preserve', 'register', 'skey', '0', 'key', self.hostid ] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("failed to unregister key %s with disk %s" % (self.hostid, disk)) return ret def get_reservation_key(self, disk): cmd = [ 'scu', '-f', disk, 'show', 'reservation' ] (ret, out, err) = self.call(cmd) if ret != 0: self.log.error("failed to list reservation for disk %s" % disk) if 'Reservation Key' not in out: return None for line in out.split('\n'): if 'Reservation Key' in line: return line.split()[-1] raise Exception() def disk_reserved(self, disk): cmd = [ 'scu', '-f', disk, 'show', 'reservation' ] (ret, out, err) = self.call(cmd) if ret != 0: self.log.error("failed to read reservation for disk %s" % disk) if self.hostid in out: return True return False def disk_release(self, disk): cmd = [ 'scu', '-f', disk, 'preserve', 'release', 'key', self.hostid, 'type', self.prtype ] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("failed to release disk %s" % disk) return ret def disk_reserve(self, disk): cmd = [ 'scu', '-f', disk, 'preserve', 'reserve', 'key', self.hostid, 'type', self.prtype ] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("failed to reserve disk %s" % disk) return ret def _disk_preempt_reservation(self, disk, oldkey): cmd = [ 'scu', '-f', disk, 'preserve', 'preempt', 'key', self.hostid, 'skey', oldkey, 'type', self.prtype ] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("failed to preempt reservation for disk %s" % disk) return ret 0707010002456a000081b40000000000000000000000014faa9509000005da000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/rcNode.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import sys import re from rcGlobalEnv import * import logging import rcExceptions as ex import ConfigParser def node_get_hostmode(): nodeconf = os.path.join(os.path.dirname(__file__), '..', 'etc', 'node.conf') config = ConfigParser.RawConfigParser() config.read(nodeconf) if config.has_section('node'): if config.has_option('node', 'host_mode'): return config.get('node', 'host_mode') elif config.has_option('DEFAULT', 'host_mode'): return config.get('DEFAULT', 'host_mode') return 'TST' def discover_node(): """Fill rcEnv class with information from node discovery """ rcEnv.host_mode = node_get_hostmode() 07070100024550000081b40000000000000000000000014faa950900000afa000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/rcIfconfigAIX.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * import rcIfconfig class ifconfig(rcIfconfig.ifconfig): def hexmask_to_str(self, mask): mask = mask.replace('0x', '') s = [str(int(mask[i:i+2], 16)) for i in range(0, len(mask), 2)] return '.'.join(s) def parse(self, out): prev = '' prevprev = '' for w in out.split(): if 'flags=' in w: i = rcIfconfig.interface(prev.replace(':','')) self.intf.append(i) # defaults i.link_encap = '' i.scope = '' i.bcast = '' i.mtu = '' i.ipaddr = [] i.mask = [] i.ip6addr = [] i.ip6mask = [] i.hwaddr = '' i.flag_up = False i.flag_broadcast = False i.flag_running = False i.flag_multicast = False i.flag_loopback = False flags = w.split('<')[1].split('>')[0].split(',') if 'UP' in flags: i.flag_up = True if 'BROADCAST' in flags: i.flag_broadcast = True if 'RUNNING' in flags: i.flag_running = True if 'MULTICAST' in flags: i.flag_multicast = True if 'LOOPBACK' in flags: i.flag_loopback = True elif 'inet' == prev: i.ipaddr += [w] elif 'netmask' == prev: i.mask += [self.hexmask_to_str(w)] elif 'inet6' == prev: i.ip6addr += [w.split('/')[0]] i.ip6mask += [w.split('/')[1]] elif 'ether' == prev: i.hwaddr = w prevprev = prev prev = w def __init__(self): self.intf = [] out = Popen(['ifconfig', '-a'], stdout=PIPE).communicate()[0] self.parse(out) 0707010002460c000081b40000000000000000000000014faa9509000005b3000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/svcXen.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc import resContainerXen as xen from rcGlobalEnv import rcEnv class SvcXen(svc.Svc): """ Define Xen services""" def __init__(self, svcname, vmname=None, guestos=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmname = vmname self.guestos = guestos self += xen.Xen(vmname, disabled=disabled) self.runmethod = rcEnv.rsh.split() + [vmname] 070701000245bc000081b40000000000000000000000014faa950900000795000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/resHbLinuxHA.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import resHb from rcGlobalEnv import rcEnv import os import rcStatus import rcExceptions as ex from rcUtilities import justcall, which class Hb(resHb.Hb): """ HeartBeat ressource """ def __init__(self, rid=None, name=None, always_on=set([]), optional=False, disabled=False, tags=set([])): resHb.Hb.__init__(self, rid, "hb.linuxha", optional=optional, disabled=disabled, tags=tags) self.status_cmd = 'cl_status' self.name = name def process_running(self): cmd = [self.status_cmd, 'hbstatus'] (out, err, ret) = justcall(cmd) if ret != 0: return False if not 'is running' in out: return False return True def __status(self, verbose=False): if not which(self.status_cmd): self.status_log("heartbeat is not installed") return rcStatus.WARN if not self.process_running(): self.status_log("heartbeat daemons are not running") return rcStatus.WARN return rcStatus.NA 07070100024501000081b40000000000000000000000014faa9509000006ff000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/checkFmFmadm.py# # Copyright (c) 2012 Lucien Hercaud # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks import os from rcUtilities import justcall, which from rcGlobalEnv import rcEnv class check(checks.check): prefixes = [os.path.join(os.sep, "usr", "sbin")] fmadm = "fmadm" chk_type = "fm" chk_name = "Solaris fmadm" def find_fmadm(self): if which(self.fmadm): return self.fmadm for prefix in self.prefixes: fmadm = os.path.join(prefix, self.fmadm) if os.path.exists(fmadm): return fmadm return def do_check(self): r = self.do_check_ldpdinfo() return r def do_check_ldpdinfo(self): fmadm = self.find_fmadm() if fmadm is None: return self.undef os.chdir(rcEnv.pathtmp) cmd = [fmadm, 'faulty'] out, err, ret = justcall(cmd) if ret != 0: return self.undef r = [] r.append({ 'chk_instance': 'faults ', 'chk_value': str(len(out)), 'chk_svcname': '', }) return r 07070100024546000081b40000000000000000000000014faa950900000378000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/rcDiskInfoDarwin.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcDiskInfo class diskInfo(rcDiskInfo.diskInfo): pass 07070100024601000081b40000000000000000000000014faa95090000f226000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/svcDict.py#!/opt/opensvc/bin/python import sys from rcGlobalEnv import rcEnv from rcNode import node_get_hostmode class MissKeyNoDefault(Exception): pass class KeyInvalidValue(Exception): pass class Keyword(object): def __init__(self, section, keyword, rtype=None, order=100, required=False, at=False, default=None, validator=None, candidates=None, depends=[], text="", provisioning=False): self.section = section self.keyword = keyword self.rtype = rtype self.order = order self.at = at self.required = required self.default = default self.candidates = candidates self.depends = depends self.text = text self.provisioning = provisioning def __cmp__(self, o): if o.order > self.order: return -1 elif o.order == self.order: return 0 return 1 def __str__(self): from textwrap import TextWrapper wrapper = TextWrapper(subsequent_indent="%15s"%"", width=78) depends = "" for d in self.depends: depends += "%s in %s\n"%(d[0], d[1]) if depends == "": depends = None s = '' s += "------------------------------------------------------------------------------\n" s += "section: %s\n"%self.section s += "keyword: %s\n"%self.keyword s += "------------------------------------------------------------------------------\n" s += " required: %s\n"%str(self.required) s += " default: %s\n"%str(self.default) s += " candidates: %s\n"%str(self.candidates) s += " depends: %s\n"%depends s += " @node: %s\n"%str(self.at) if self.text: s += wrapper.fill(" help: "+self.text) if self.at: s += "\n\nPrefix the value with '@node ' to specify a node-specific value.\n" s += "You will be prompted for new values until you submit an empty value.\n" return s def form(self, d): # skip this form if dependencies are not met for d_keyword, d_value in self.depends: if d_keyword not in d: return d if d[d_keyword] not in d_value: return d # print the form print self # if we got a json seed, use its values as default # else use the Keyword object default if self.keyword in d: default = d[self.keyword] elif self.default is not None: default = self.default else: default = None if default is not None: default_prompt = " [%s] "%str(default) else: default_prompt = "" req_satisfied = False while True: try: val = raw_input(self.keyword+default_prompt+"> ") except EOFError: break if len(val) == 0: if req_satisfied: return d if default is None: if self.required: print "value required" continue # keyword is optional, leave dictionary untouched return d else: val = default if self.candidates is not None and \ val not in self.candidates: print "invalid value" continue d[self.keyword] = val elif self.at and val[0] == '@': l = val.split() if len(l) < 2: print "invalid value" continue val = ' '.join(l[1:]) d[self.keyword+l[0]] = val req_satisfied = True else: d[self.keyword] = val req_satisfied = True if self.at: # loop for more key@node = values print "More '%s' ? to step to the next parameter."%self.keyword continue else: return d class KeywordInteger(Keyword): def validator(self, val, d=None): try: val = int(val) except: return False return True class KeywordProvision(Keyword): def __init__(self): Keyword.__init__( self, section="provision", keyword="provision", default="no", candidates=('yes', 'no'), text="Say yes to provision this resource. Warning, provisioning implies destructive operations like formating." ) class KeywordMode(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="mode", required=True, order=10, default="hosted", candidates=["hosted"] + rcEnv.vt_supported, text="The mode decides upon disposition OpenSVC takes to bring a service up or down : virtualized services need special actions to prepare and boot the container for example, which is not needed for 'hosted' services." ) class KeywordVirtinst(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="virtinst", depends=[('mode', ["kvm", "xen", "ovm"])], text="The virt-install command to use to create the container.", required=True, provisioning=True ) class KeywordSnap(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="snap", depends=[('mode', ["kvm", "xen", "ovm", "zone", "esx"])], text="The target snapshot/clone full path containing the new container disk files.", required=True, provisioning=True ) class KeywordSnapof(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="snapof", depends=[('mode', ["kvm", "xen", "ovm", "zone", "esx"])], text="The snapshot origin full path containing the reference container disk files.", required=True, provisioning=True ) class KeywordContainerOrigin(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="container_origin", depends=[('mode', ["zone"])], text="The origin container having the reference container disk files.", required=True, provisioning=True ) class KeywordRootfs(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="rootfs", depends=[('mode', ["lxc", "vz", "zone"])], text="Sets the root fs directory of the container", required=True, provisioning=True ) class KeywordTemplate(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="template", depends=[('mode', ["lxc", "vz", "zone"])], text="Sets the url of the template unpacked into the container root fs.", required=True, provisioning=True ) class KeywordVmName(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="vm_name", order=11, depends=[('mode', rcEnv.vt_supported)], text="This need to be set if the virtual machine name is different from the service name." ) class KeywordVmUuid(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="vm_uuid", order=11, depends=[('mode', "ovm")], text="The virtual machine unique identifier used to pass commands on the VM." ) class KeywordClusterType(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="cluster_type", order=15, required=False, default="failover", candidates=["failover", "allactive", "flex", "autoflex"], text="failover: the service is allowed to be up on one node at a time. allactive: the service must be up on all nodes. flex: the service can be up on n out of m nodes (n <= m), n/m must be in the [flex_min_nodes, flex_max_nodes] range. autoflex: same as flex, but charge the collector to start the service on passive nodes when the average %cpu usage on active nodes > flex_cpu_high_threshold and stop the service on active nodes when the average %cpu usage on active nodes < flex_cpu_low_threshold." ) class KeywordFlexMinNodes(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="flex_min_nodes", order=16, required=False, default=1, depends=[('cluster_type', ['flex', 'autoflex'])], text="Minimum number of active nodes in the cluster. Below this number alerts are raised by the collector, and the collector won't stop any more service instances." ) class KeywordFlexMaxNodes(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="flex_max_nodes", order=16, required=False, default=0, depends=[('cluster_type', ['flex', 'autoflex'])], text="Maximum number of active nodes in the cluster. Above this number alerts are raised by the collector, and the collector won't start any more service instances. 0 means unlimited." ) class KeywordFlexCpuMinThreshold(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="flex_cpu_min_threshold", order=16, required=False, default=10, depends=[('cluster_type', ['flex', 'autoflex'])], text="Average CPU usage across the active cluster nodes below which the collector raises alerts and decides to stop service instances with autoflex cluster type." ) class KeywordFlexCpuMaxThreshold(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="flex_cpu_max_threshold", order=16, required=False, default=70, depends=[('cluster_type', ['flex', 'autoflex'])], text="Average CPU usage across the active cluster nodes above which the collector raises alerts and decides to start new service instances with autoflex cluster type." ) class KeywordServiceType(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="service_type", order=15, required=True, default=node_get_hostmode(), candidates=rcEnv.allowed_svctype, text="A non-PRD service can not be brought up on a PRD node, but a PRD service can be startup on a non-PRD node (in a DRP situation)." ) class KeywordNodes(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="nodes", order=20, required=True, default=rcEnv.nodename, text="List of cluster local nodes able to start the service. Whitespace separated." ) class KeywordAutostartNode(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="autostart_node", order=20, required=True, default=rcEnv.nodename, text="A whitespace-separated list subset of 'nodes'. Defines the nodes where the service will try to start on upon node reboot. On a failover cluster there should only be one autostart node and the start-up will fail if the service is already up on another node though. If not specified, the service will never be started at node boot-time, which is rarely the expected behaviour." ) class KeywordDrpnode(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="drpnode", order=21, text="The backup node where the service is activated in a DRP situation. This node is also a data synchronization target for 'sync' resources." ) class KeywordDrpnodes(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="drpnodes", order=21, text="Alternate backup nodes, where the service could be activated in a DRP situation if the 'drpnode' is not available. These nodes are also data synchronization targets for 'sync' resources." ) class KeywordApp(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="app", order=24, default="DEFAULT", text="Used to identify who is responsible for is service, who is billable and provides a most useful filtering key. Better keep it a short code." ) class KeywordComment(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="comment", order=25, text="Helps users understand the role of the service, which is nice to on-call support people having to operate on a service they are not usualy responsible for." ) class KeywordScsireserv(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="scsireserv", order=25, default=False, candidates=(True, False), text="If set to 'true', OpenSVC will try to acquire a type-5 (write exclusive, registrant only) scsi3 persistent reservation on every path to disks of every disk group attached to this service. Existing reservations are preempted to not block service start-up. If the start-up was not legitimate the data are still protected from being written over from both nodes. If set to 'false' or not set, 'scsireserv' can be activated on a per-resource basis." ) class KeywordBwlimit(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="DEFAULT", keyword="bwlimit", order=25, text="Bandwidth limit in KB applied to all rsync transfers. Leave empty to enforce no limit." ) class KeywordSyncInterval(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="DEFAULT", keyword="sync_interval", order=26, default=121, text="Set the minimum delay between syncs in minutes. If a sync is triggered through crond or manually, it is skipped if last sync occured less than 'sync_min_delay' ago. The mecanism is enforced by a timestamp created upon each sync completion in /opt/opensvc/var/sync/[service]![dst]" ) class KeywordSyncMaxDelay(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="DEFAULT", keyword="sync_max_delay", order=27, default=1440, text="Unit is minutes. This sets to delay above which the sync status of the resource is to be considered down. Should be set according to your application service level agreement. The cron job frequency should be set between 'sync_min_delay' and 'sync_max_delay'" ) class KeywordPresnapTrigger(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="presnap_trigger", order=28, text="Define a command to run before creating snapshots. This is most likely what you need to use plug a script to put you data in a coherent state (alter begin backup and the like)." ) class KeywordPostsnapTrigger(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="postsnap_trigger", order=29, text="Define a command to run after snapshots are created. This is most likely what you need to use plug a script to undo the actions of 'presnap_trigger'." ) class KeywordContainerize(Keyword): def __init__(self): Keyword.__init__( self, section="DEFAULT", keyword="containerize", order=30, default=True, candidates=(True, False), text="Use process containers when possible. Containers allow capping memory, swap and cpu usage per service. Lxc containers are naturally containerized, so skip containerization of their startapp." ) class KeywordContainerCpus(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="DEFAULT", keyword="container_cpus", order=31, depends=[('containerize', [True])], text="Allow service process to bind only the specified cpus. Cpus are specified as list or range : 0,1,2 or 0-2" ) class KeywordContainerMems(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="DEFAULT", keyword="container_mems", order=31, depends=[('containerize', [True])], text="Allow service process to bind only the specified memory nodes. Memory nodes are specified as list or range : 0,1,2 or 0-2" ) class KeywordContainerCpuShare(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="DEFAULT", keyword="container_cpu_share", order=31, depends=[('containerize', [True])], text="Kernel default value is used, which usually is 1024 shares. In a cpu-bound situation, ensure the service does not use more than its share of cpu ressource. The actual percentile depends on shares allowed to other services." ) class KeywordContainerMemLimit(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="DEFAULT", keyword="container_mem_limit", order=31, depends=[('containerize', [True])], text="Ensures the service does not use more than specified memory (in bytes). The Out-Of-Memory killer get triggered in case of tresspassing." ) class KeywordContainerVmemLimit(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="DEFAULT", keyword="container_vmem_limit", order=31, depends=[('containerize', [True])], text="Ensures the service does not use more than specified memory+swap (in bytes). The Out-Of-Memory killer get triggered in case of tresspassing. The specified value must be greater than container_mem_limit." ) class KeywordSyncType(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="type", order=10, required=True, candidates=("rsync", "dds", "netapp", "zfs", "symclone"), default="rsync", text="Point a sync driver to use." ) class KeywordSyncZfsSrc(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="src", rtype="zfs", order=10, at=True, required=True, text="Source dataset of the sync." ) class KeywordSyncZfsDst(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="dst", rtype="zfs", order=11, at=True, required=True, text="Destination dataset of the sync." ) class KeywordSyncZfsTarget(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="target", rtype="zfs", order=12, required=True, candidates=['nodes', 'drpnodes', 'nodes drpnodes'], text="Describes which nodes should receive this data sync from the PRD node where the service is up and running. SAN storage shared 'nodes' must not be sync to 'nodes'. SRDF-like paired storage must not be sync to 'drpnodes'." ) class KeywordSyncZfsRecursive(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="recursive", rtype="zfs", order=13, default=True, candidates=(True, False), text="Describes which nodes should receive this data sync from the PRD node where the service is up and running. SAN storage shared 'nodes' must not be sync to 'nodes'. SRDF-like paired storage must not be sync to 'drpnodes'." ) class KeywordSyncZfsTags(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="tags", rtype="zfs", text="The zfs sync resource supports the 'delay_snap' tag. This tag is used to delay the snapshot creation just before the sync, thus after 'postsnap_trigger' execution. The default behaviour (no tags) is to group all snapshots creation before copying data to remote nodes, thus between 'presnap_trigger' and 'postsnap_trigger'." ) class KeywordSyncRsyncSrc(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="src", rtype="rsync", order=10, at=True, required=True, text="Source of the sync. Can be a whitespace-separated list of files or dirs passed as-is to rsync. Beware of the meaningful ending '/'. Refer to the rsync man page for details." ) class KeywordSyncRsyncDst(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="dst", rtype="rsync", order=11, required=True, text="Destination of the sync. Beware of the meaningful ending '/'. Refer to the rsync man page for details." ) class KeywordSyncRsyncTags(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="tags", rtype="rsync", text="The sync resource supports the 'delay_snap' tag. This tag is used to delay the snapshot creation just before the rsync, thus after 'postsnap_trigger' execution. The default behaviour (no tags) is to group all snapshots creation before copying data to remote nodes, thus between 'presnap_trigger' and 'postsnap_trigger'." ) class KeywordSyncRsyncExclude(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="exclude", rtype="rsync", text="!deprecated!. A whitespace-separated list of --exclude params passed unchanged to rsync. The 'options' keyword is preferred now." ) class KeywordSyncRsyncOptions(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="options", rtype="rsync", text="A whitespace-separated list of params passed unchanged to rsync. Typical usage is ACL preservation activation." ) class KeywordSyncRsyncTarget(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="target", rtype="rsync", order=12, required=True, candidates=['nodes', 'drpnodes', 'nodes drpnodes'], text="Describes which nodes should receive this data sync from the PRD node where the service is up and running. SAN storage shared 'nodes' must not be sync to 'nodes'. SRDF-like paired storage must not be sync to 'drpnodes'." ) class KeywordSyncRsyncSnap(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="snap", rtype="rsync", order=14, candidates=(True, False), default=False, text="If set to true, OpenSVC will try to snapshot the first snapshottable parent of the source of the sync and try to sync from the snap." ) class KeywordSyncRsyncDstfs(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="dstfs", rtype="rsync", order=13, text="If set to a remote mount point, OpenSVC will verify that the specified mount point is really hosting a mounted FS. This can be used as a safety net to not overflow the parent FS (may be root)." ) class KeywordSyncRsyncBwlimit(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="sync", keyword="bwlimit", rtype="rsync", text="Bandwidth limit in KB applied to this rsync transfer. Leave empty to enforce no limit. Takes precedence over 'bwlimit' set in [DEFAULT]." ) class KeywordSyncSyncInterval(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="sync", keyword="sync_interval", default=30, text="Set the minimum delay between syncs in minutes. If a sync is triggered through crond or manually, it is skipped if last sync occured less than 'sync_min_delay' ago. If no set in a resource section, fallback to the value set in the 'default' section. The mecanism is enforced by a timestamp created upon each sync completion in /opt/opensvc/var/sync/[service]![dst]" ) class KeywordSyncSyncMaxDelay(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="sync", keyword="sync_max_delay", default=1440, text="Unit is minutes. This sets to delay above which the sync status of the resource is to be considered down. Should be set according to your application service level agreement. The cron job frequency should be set between 'sync_min_delay' and 'sync_max_delay'." ) class KeywordIpIpname(Keyword): def __init__(self): Keyword.__init__( self, section="ip", keyword="ipname", order=12, at=True, required=True, text="The DNS name of the ip resource. Can be different from one node to the other, in which case '@nodename' can be specified. This is most useful to specify a different ip when the service starts in DRP mode, where subnets are likely to be different than those of the production datacenter." ) class KeywordIpIpdev(Keyword): def __init__(self): Keyword.__init__( self, section="ip", keyword="ipdev", order=11, at=True, required=True, text="The interface name over which OpenSVC will try to stack the service ip. Can be different from one node to the other, in which case the '@nodename' can be specified." ) class KeywordIpNetmask(Keyword): def __init__(self): Keyword.__init__( self, section="ip", keyword="netmask", order=13, text="If an ip is already plumbed on the root interface (if which case the netmask is deduced from this ip). Mandatory if the interface is dedicated to the service (dummy interface are likely to be in this case). The format is decimal for IPv4, ex: 255.255.252.0, and octal for IPv6, ex: 64." ) class KeywordVgType(Keyword): def __init__(self): Keyword.__init__( self, section="vg", keyword="type", order=9, required=False, candidates=['veritas'], text="The volume group driver to use. Leave empty to activate the native volume group manager." ) class KeywordVgVgname(Keyword): def __init__(self): Keyword.__init__( self, section="vg", keyword="vgname", order=10, required=True, text="The name of the volume group" ) class KeywordVgDsf(Keyword): def __init__(self): Keyword.__init__( self, section="vg", keyword="dsf", candidates=(True, False), default=True, text="HP-UX only. 'dsf' must be set to false for LVM to use never-multipathed /dev/dsk/... devices. Otherwize, ad-hoc multipathed /dev/disk/... devices." ) class KeywordVgScsireserv(Keyword): def __init__(self): Keyword.__init__( self, section="vg", keyword="scsireserv", default=False, candidates=(True, False), text="If set to 'true', OpenSVC will try to acquire a type-5 (write exclusive, registrant only) scsi3 persistent reservation on every path to disks of every disk group attached to this service. Existing reservations are preempted to not block service start-up. If the start-up was not legitimate the data are still protected from being written over from both nodes. If set to 'false' or not set, 'scsireserv' can be activated on a per-resource basis." ) class KeywordVgPvs(Keyword): def __init__(self): Keyword.__init__( self, section="vg", keyword="pvs", required=True, text="The list of paths to the physical volumes of the volume group.", provisioning=True ) class KeywordPoolPoolname(Keyword): def __init__(self): Keyword.__init__( self, section="pool", keyword="poolname", order=10, at=True, text="The name of the zfs pool" ) class KeywordPoolTags(Keyword): def __init__(self): Keyword.__init__( self, section="pool", keyword="tags", text="tags = preboot may be used when zfs pool is required before container boot else postboot is presumed" ) class KeywordVmdgScsireserv(Keyword): def __init__(self): Keyword.__init__( self, section="vmdg", keyword="scsireserv", default=False, candidates=(True, False), text="If set to 'true', OpenSVC will try to acquire a type-5 (write exclusive, registrant only) scsi3 persistent reservation on every path to disks of every disk group attached to this service. Existing reservations are preempted to not block service start-up. If the start-up was not legitimate the data are still protected from being written over from both nodes. If set to 'false' or not set, 'scsireserv' can be activated on a per-resource basis." ) class KeywordDrbdScsireserv(Keyword): def __init__(self): Keyword.__init__( self, section="drbd", keyword="scsireserv", default=False, candidates=(True, False), text="If set to 'true', OpenSVC will try to acquire a type-5 (write exclusive, registrant only) scsi3 persistent reservation on every path to disks of every disk group attached to this service. Existing reservations are preempted to not block service start-up. If the start-up was not legitimate the data are still protected from being written over from both nodes. If set to 'false' or not set, 'scsireserv' can be activated on a per-resource basis." ) class KeywordDrbdRes(Keyword): def __init__(self): Keyword.__init__( self, section="drbd", keyword="res", order=11, text="The name of the drbd resource associated with this service resource. OpenSVC expect the resource configuration file to reside in '/etc/drbd.d/resname.res'. The 'sync#i0' resource will take care of replicating this file to remote nodes." ) class KeywordFsDev(Keyword): def __init__(self): Keyword.__init__( self, section="fs", keyword="dev", order=11, at=True, required=True, text="The block device file or filesystem image file hosting the filesystem to mount. Different device can be set up on different nodes using the dev@nodename syntax" ) class KeywordFsVg(Keyword): def __init__(self): Keyword.__init__( self, section="fs", keyword="vg", required=True, text="The name of the disk group the filesystem device should be provisioned from.", provisioning=True ) class KeywordFsSize(Keyword): def __init__(self): Keyword.__init__( self, section="fs", keyword="size", required=True, text="The size in MB of the logical volume to provision for this filesystem.", provisioning=True ) class KeywordFsMnt(Keyword): def __init__(self): Keyword.__init__( self, section="fs", keyword="mnt", order=12, required=True, text="The mount point where to mount the filesystem." ) class KeywordFsMntOpt(Keyword): def __init__(self): Keyword.__init__( self, section="fs", keyword="mnt_opt", order=13, text="The mount options." ) class KeywordFsType(Keyword): def __init__(self): Keyword.__init__( self, section="fs", keyword="type", order=14, required=True, text="The filesystem type. Used to determine the fsck command to use." ) class KeywordFsSnapSize(Keyword): def __init__(self): Keyword.__init__( self, section="fs", keyword="snap_size", order=14, text="If this filesystem is build on a snapable logical volume or is natively snapable (jfs, vxfs, ...) this setting overrides the default 10% of the filesystem size to compute the snapshot size. The snapshot is created by snap-enabled rsync-type sync resources. The unit is Megabytes." ) class KeywordFsTags(Keyword): def __init__(self): Keyword.__init__( self, section="fs", keyword="tags", text="tags = preboot may be used when zfs dataset is required before container boot else postboot is presumed", provisioning=True ) class KeywordLoopSize(Keyword): def __init__(self): Keyword.__init__( self, section="loop", keyword="size", required=True, default=10, text="The size of the loop file to provision.", provisioning=True ) class KeywordLoopFile(Keyword): def __init__(self): Keyword.__init__( self, section="loop", keyword="file", required=True, text="The file hosting the disk image to map." ) class KeywordSyncNetappFiler(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="filer", rtype="netapp", required=True, at=True, text="The Netapp filer resolvable host name used by the node. Different filers can be set up for each node using the filer@nodename syntax." ) class KeywordSyncNetappPath(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="path", rtype="netapp", required=True, text="Specifies the volume or qtree to drive snapmirror on." ) class KeywordSyncNetappUser(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="user", rtype="netapp", required=True, default="nasadm", text="Specifies the user used to ssh connect the filers. Nodes should be trusted by keys to access the filer with this user." ) class KeywordSyncSymcloneSymdg(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="symdg", rtype="symclone", required=True, text="Name of the symmetrix device group where the source and target devices are grouped." ) class KeywordSyncSymclonePrecopyTimeout(KeywordInteger): def __init__(self): KeywordInteger.__init__( self, section="sync", keyword="precopy_timeout", rtype="symclone", required=True, default=300, text="Seconds to wait for a precopy (syncresync) to finish before returning with an error. In this case, the precopy proceeds normally, but the opensvc leftover actions must be retried. The precopy time depends on the amount of changes logged at the source, which is context-dependent. Tune to your needs." ) class KeywordSyncSymcloneSymdevs(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="symdevs", rtype="symclone", required=True, at=True, default=300, text="Whitespace-separated list of devices to drive with this resource. Devices are specified as 'symmetrix identifier:symmetrix device identifier. Different symdevs can be setup on each node using the symdevs@nodename." ) class KeywordSyncDdsSrc(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="src", rtype="dds", required=True, text="Points the origin of the snapshots to replicate from." ) class KeywordSyncDdsDst(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="dst", rtype="dds", required=True, text="Target file or block device. Optional. Defaults to src. Points the media to replay the binary-delta received from source node to. This media must have a size superior or equal to source." ) class KeywordSyncDdsTarget(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="target", rtype="dds", required=True, candidates=['nodes', 'drpnodes', 'nodes drpnodes'], text="Accepted values are 'drpnodes', 'nodes' or both, whitespace-separated. Points the target nodes to replay the binary-deltas on. Be warned that starting the service on a target node without a 'stop-syncupdate-start cycle, will break the synchronization, so this mode is usually restricted to drpnodes sync, and should not be used to replicate data between nodes with automated services failover." ) class KeywordSyncDdsSnapSize(Keyword): def __init__(self): Keyword.__init__( self, section="sync", keyword="snap_size", rtype="dds", text="Default to 10% of origin. In MB, rounded to physical extent boundaries by lvm tools. Size of the snapshots created by OpenSVC to extract binary deltas from. Opensvc creates at most 2 snapshots : one short-lived to gather changed data from, and one long-lived to gather changed chunks list from. Volume groups should have the necessary space always available." ) class KeywordVdiskPath(Keyword): def __init__(self): Keyword.__init__( self, section="vdisk", keyword="path", required=True, at=True, text="Path of the device or file used as a virtual machine disk. The path@nodename can be used to to set up different path on each node." ) class KeywordHbType(Keyword): def __init__(self): Keyword.__init__( self, section="hb", keyword="type", required=True, candidates=('OpenHA', 'LinuxHA'), text="Specify the heartbeat driver to use." ) class KeywordHbName(Keyword): def __init__(self): Keyword.__init__( self, section="hb", keyword="name", rtype="OpenHA", text="Specify the service name used by the heartbeat. Defaults to the service name." ) class Section(object): def __init__(self, section): self.section = section self.keywords = [] def __iadd__(self, o): if not isinstance(o, Keyword): return self self.keywords.append(o) return self def __str__(self): s = '' for keyword in sorted(self.keywords): s += str(keyword) return s def getkeys(self, rtype=None): if rtype is None: return [k for k in self.keywords if k.rtype is None and not k.provisioning] else: return [k for k in self.keywords if k.rtype == rtype and not k.provisioning] def getprovkeys(self, rtype=None): if rtype is None: return [k for k in self.keywords if k.rtype is None and k.provisioning] else: return [k for k in self.keywords if k.rtype == rtype and k.provisioning] def getkey(self, keyword, rtype=None): if '@' in keyword: l = keyword.split('@') if len(l) != 2: return None keyword, node = l for k in self.keywords: if k.keyword == keyword and k.rtype == rtype: return k return None class KeywordStore(dict): def __init__(self, provision=False): self.sections = {} self.provision = provision def __iadd__(self, o): if not isinstance(o, Keyword): return self o.top = self if o.section not in self.sections: self.sections[o.section] = Section(o.section) self.sections[o.section] += o return self def __getattr__(self, key): return self.sections[str(key)] def __getitem__(self, key): return self.sections[str(key)] def __str__(self): s = '' for section in self.sections: s += str(self.sections[section]) return s def required_keys(self, section, rtype=None): if section not in self.sections: return [] return [k for k in sorted(self.sections[section].getkeys(rtype)) if k.required is True] def purge_keywords_from_dict(self, d, section): if 'type' in d: rtype = d['type'] else: rtype = None for keyword, value in d.items(): key = self.sections[section].getkey(keyword) if key is None and rtype is not None: key = self.sections[section].getkey(keyword, rtype) if key is None: if keyword != "rtype": print "Remove unknown keyword '%s' from section '%s'"%(keyword, section) del d[keyword] return d def update(self, rid, d): """ Given a resource dictionary, spot missing required keys and provide a new dictionary to merge populated by default values """ import copy completion = copy.copy(d) # decompose rid into section and rtype if rid == 'DEFAULT': section = rid rtype = None else: if '#' not in rid: return {} l = rid.split('#') if len(l) != 2: return {} section = l[0] if 'type' in d: rtype = d['type'] elif self[section].getkey('type') is not None and \ self[section].getkey('type').default is not None: rtype = self[section].getkey('type').default else: rtype = None # validate command line dictionary for keyword, value in d.items(): key = self.sections[section].getkey(keyword) if key is None and rtype is not None: key = self.sections[section].getkey(keyword, rtype) if key is None: continue if key.candidates is not None and value not in key.candidates: print "'%s' keyword has invalid value '%s' in section '%s'"%(keyword, str(value), rid) raise KeyInvalidValue() # add missing required keys if they have a known default value for key in self.required_keys(section, rtype): if key.keyword in d: continue if key.keyword in map(lambda x: x.split('@')[0], d.keys()): continue if key.default is None: sys.stderr.write("No default value for required key '%s' in section '%s'\n"%(key.keyword, rid)) raise MissKeyNoDefault() print "Implicitely add [%s]"%rid, key.keyword, "=", key.default completion[key.keyword] = key.default """ # do we have a provisioning for for this resource ? prov = self.get_provisioning_class(section, completion) if prov is not None: # is provisioning needed ? tmp = {rid: completion} if prov(rid, tmp).validate(): print rid, "resource is valid" elif prov(rid, tmp).provisioner(): print rid, "resource provisioned" else: print rid, "resource provisioning failed" """ # purge unknown keywords and provisioning keywords completion = self.purge_keywords_from_dict(completion, section) return completion def form_sections(self, sections): from textwrap import TextWrapper wrapper = TextWrapper(subsequent_indent="%18s"%"", width=78) candidates = set(self.sections.keys()) - set(['DEFAULT']) print "------------------------------------------------------------------------------" print "Choose a resource type to add or a resource to edit." print "Enter 'quit' to finish the creation." print "------------------------------------------------------------------------------" print wrapper.fill("resource types: "+', '.join(candidates)) print wrapper.fill("resource ids: "+', '.join(sections.keys())) print return raw_input("resource type or id> ") def free_resource_index(self, section, sections): indices = [] for s in sections: l = s.split('#') if len(l) != 2: continue sname, sindex = l if section != sname: continue try: indices.append(int(sindex)) except: continue i = 0 while True: if i not in indices: return i i += 1 def form(self, defaults, sections): for key in sorted(self.DEFAULT.getkeys()): defaults = key.form(defaults) while True: try: section = self.form_sections(sections) except EOFError: break if section == "quit": break if '#' in section: rid = section section = section.split('#')[0] else: index = self.free_resource_index(section, sections) rid = '#'.join((section, str(index))) if section not in self.sections: print "unsupported resource type" continue for key in sorted(self.sections[section].getkeys()): if rid not in sections: sections[rid] = {} sections[rid] = key.form(sections[rid]) if 'type' in sections[rid]: specific_keys = self.sections[section].getkeys(rtype=sections[rid]['type']) if len(specific_keys) > 0: print "\nKeywords specific to the '%s' driver\n"%sections[rid]['type'] for key in sorted(specific_keys): if rid not in sections: sections[rid] = {} sections[rid] = key.form(sections[rid]) """ # do we have a provisioning for for this resource ? prov = self.get_provisioning_class(section, sections[rid]) if prov is None: continue # is provisioning needed ? if prov(rid, sections).validate(): print rid, "resource is valid" continue # toggle provisioning keywords # either --provision or user said so on prompt if not self.provision: tmp = {} tmp = KeywordProvision().form(tmp) if tmp['provision'] == "no": continue provkeys = self.sections[section].getprovkeys() if len(provkeys) > 0: print "\nProvisioning keywords\n" for key in sorted(provkeys): if rid not in sections: sections[rid] = {} sections[rid] = key.form(sections[rid]) if 'type' in sections[rid]: specific_provkeys = self.sections[section].getprovkeys(rtype=sections[rid]['type']) if len(specific_provkeys) > 0: print "\nProvisioning keywords specific to the '%s' driver\n"%sections[rid]['type'] for key in sorted(specific_provkeys): if rid not in sections: sections[rid] = {} sections[rid] = key.form(sections[rid]) # now we have everything needed to provision. just do it. prov(rid, sections).provisioner() """ # purge the provisioning keywords sections[rid] = self.purge_keywords_from_dict(sections[rid], section) return defaults, sections """ def get_provisioning_class(self, section, d): mod_prefix = 'prov' class_prefix = 'Provisioning' rtype = "" if section == 'DEFAULT': section = "" if 'mode' in d: rtype = d['mode'] else: section = section[0].upper() + section[1:].lower() if 'type' in d: rtype = d['type'] if len(rtype) > 2: rtype = rtype[0].upper() + rtype[1:].lower() try: m = __import__(mod_prefix+section+rtype) return getattr(m, class_prefix+section+rtype) except ImportError: import traceback traceback.print_exc() pass try: m = __import__(mod_prefix+section) return getattr(m, class_prefix+section) except ImportError: print mod_prefix+section+rtype, "nor", mod_prefix+section, "provisioning modules not implemented" return None """ class KeyDict(KeywordStore): def __init__(self, provision=False): KeywordStore.__init__(self, provision) import os def kw_disable(resource): return Keyword( section=resource, keyword="disable", candidates=(True, False), default=False, text="A disabled resource will be ignored on service startup and shutdown." ) def kw_disable_on(resource): return Keyword( section=resource, keyword="disable_on", text="A list of nodenames where to consider the 'disable' value is True. Also supports the 'nodes' and 'drpnodes' special values." ) def kw_optional(resource): return Keyword( section=resource, keyword="optional", candidates=(True, False), default=False, text="Possible values are 'true' or 'false'. Actions on resource will be tried upon service startup and shutdown, but action failures will be logged and passed over. Useful for resources like dump filesystems for example." ) def kw_always_on(resource): return Keyword( section=resource, keyword="always_on", candidates=['nodes', 'drpnodes', 'nodes drpnodes'], text="Possible values are 'nodes', 'drpnodes' or 'nodes drpnodes', or a list of nodes. Sets the nodes on which the resource is always kept up. Primary usage is file synchronization receiving on non-shared disks. Don't set this on shared disk !! danger !!" ) for r in ["sync", "ip", "fs", "vg", "hb", "pool", "vmdg", "drbd", "loop", "vdisk"]: self += kw_disable(r) self += kw_disable_on(r) self += kw_optional(r) self += kw_always_on(r) self += KeywordMode() self += KeywordRootfs() self += KeywordTemplate() self += KeywordVmName() self += KeywordVmUuid() self += KeywordClusterType() self += KeywordFlexMinNodes() self += KeywordFlexMaxNodes() self += KeywordFlexCpuMinThreshold() self += KeywordFlexCpuMaxThreshold() self += KeywordServiceType() self += KeywordNodes() self += KeywordAutostartNode() self += KeywordDrpnode() self += KeywordDrpnodes() self += KeywordApp() self += KeywordComment() self += KeywordScsireserv() self += KeywordBwlimit() self += KeywordSyncInterval() self += KeywordSyncMaxDelay() self += KeywordPresnapTrigger() self += KeywordPostsnapTrigger() self += KeywordContainerize() self += KeywordContainerCpus() self += KeywordContainerMems() self += KeywordContainerCpuShare() self += KeywordContainerMemLimit() self += KeywordContainerVmemLimit() self += KeywordSyncType() self += KeywordSyncZfsSrc() self += KeywordSyncZfsDst() self += KeywordSyncZfsTarget() self += KeywordSyncZfsRecursive() self += KeywordSyncZfsTags() self += KeywordSyncRsyncSrc() self += KeywordSyncRsyncDst() self += KeywordSyncRsyncTags() self += KeywordSyncRsyncExclude() self += KeywordSyncRsyncOptions() self += KeywordSyncRsyncTarget() self += KeywordSyncRsyncSnap() self += KeywordSyncRsyncDstfs() self += KeywordSyncRsyncBwlimit() self += KeywordSyncSyncInterval() self += KeywordSyncSyncMaxDelay() self += KeywordIpIpname() self += KeywordIpIpdev() self += KeywordIpNetmask() self += KeywordVgType() self += KeywordVgVgname() self += KeywordVgDsf() self += KeywordVgScsireserv() self += KeywordVgPvs() self += KeywordPoolPoolname() self += KeywordPoolTags() self += KeywordVmdgScsireserv() self += KeywordDrbdScsireserv() self += KeywordDrbdRes() self += KeywordFsType() self += KeywordFsDev() self += KeywordFsMnt() self += KeywordFsMntOpt() self += KeywordFsSnapSize() self += KeywordFsVg() self += KeywordFsSize() self += KeywordFsTags() self += KeywordLoopFile() self += KeywordLoopSize() self += KeywordSyncNetappFiler() self += KeywordSyncNetappPath() self += KeywordSyncNetappUser() self += KeywordSyncSymcloneSymdg() self += KeywordSyncSymclonePrecopyTimeout() self += KeywordSyncSymcloneSymdevs() self += KeywordSyncDdsSrc() self += KeywordSyncDdsDst() self += KeywordSyncDdsTarget() self += KeywordSyncDdsSnapSize() self += KeywordVdiskPath() self += KeywordHbType() self += KeywordHbName() self += KeywordVirtinst() self += KeywordSnap() self += KeywordSnapof() self += KeywordContainerOrigin() if __name__ == "__main__": store = KeyDict() print store #print store.DEFAULT.app #print store['DEFAULT'] 070701000245c9000081b40000000000000000000000014faa950900000625000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/resIpLinuxLxc.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. resIpHv = __import__("resIpLinux") import resIpVm class Ip(resIpVm.Ip, resIpHv.Ip): def __init__(self, rid=None, ipDev=None, ipName=None, mask=None, always_on=set([]), monitor=False, disabled=False, tags=set([]), optional=False): resIpVm.Ip.__init__(self, rid=rid, ipDev=ipDev, ipName=ipName, mask=mask, always_on=always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) def check_ping(self): return resIpHv.Ip.check_ping(self) if __name__ == "__main__": for c in (Ip,) : help(c) 07070100024516000081b40000000000000000000000014faa9509000007a2000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/checkVgUsageLinux.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "vg_u" def find_svc(self, vgname): for svc in self.svcs: for rs in svc.get_res_sets('disk.vg'): for r in rs.resources: if r.name == vgname: return svc.svcname return '' def do_check(self): cmd = ['vgs', '--units', 'b', '--noheadings', '-o', 'vg_name,vg_size,vg_free'] (out,err,ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 1: return self.undef r = [] for line in lines: l = line.split() if len(l) != 3: continue size = int(l[1].replace('B','')) free = int(l[2].replace('B','')) val = int(100*(size-free)/size) r.append({'chk_instance': l[0], 'chk_value': str(val), 'chk_svcname': self.find_svc(l[0]), } ) return r 070701000245b6000081b40000000000000000000000014faa95090000115d000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/resContainerVz.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import rcStatus import resources as Res from rcUtilities import which, qcall import resContainer import rcExceptions as ex class Vz(resContainer.Container): def files_to_sync(self): return [self._cf] def get_cf_value(self, param): value = None try: cf = self.cf() except: return value with open(cf, 'r') as f: for line in f.readlines(): if param not in line: continue if line.strip()[0] == '#': continue l = line.replace('\n', '').split('=') if len(l) < 2: continue if l[0].strip() != param: continue value = ' '.join(l[1:]).strip() break return value def get_rootfs(self): with open(self.cf(), 'r') as f: for line in f: if 'VE_PRIVATE' in line: return line.strip('\n').split('=')[1].strip('"').replace('$VEID', self.name) self.log.error("could not determine lxc container rootfs") return ex.excError def install_drp_flag(self): rootfs = self.get_rootfs() flag = os.path.join(rootfs, ".drp_flag") self.log.info("install drp flag in container : %s"%flag) with open(flag, 'w') as f: f.write(' ') f.close() def vzctl(self, action, options=[]): cmd = ['vzctl', action, self.name] + options ret, out, err = self.vcall(cmd) if ret != 0: raise ex.excError return out def container_start(self): self.vzctl('start') def container_stop(self): self.vzctl('stop') def container_forcestop(self): raise ex.excError def operational(self): cmd = self.svc.runmethod + ['/sbin/ifconfig', '-a'] ret = qcall(cmd) if ret == 0: return True return False def is_up(self): """ CTID 101 exist mounted running """ cmd = ['vzctl', 'status', self.name] ret, out, err = self.call(cmd) if ret != 0: raise ex.excError l = out.split() if len(l) != 5: return False if l[2] != 'exist' or \ l[3] != 'mounted' or \ l[4] != 'running': return False return True def get_container_info(self): return {'vcpus': '0', 'vmem': '0'} def check_manual_boot(self): try: cf = self.cf() except: return True with open(self.cf(), 'r') as f: for line in f: if 'ONBOOT' in line and 'yes' in line: return False return True def check_capabilities(self): if not which('vzctl'): self.log.debug("vzctl is not in PATH") return False return True def cf(self): if not os.path.exists(self._cf): self.log.error("%s does not exist"%self._cf) raise ex.excError return self._cf def __init__(self, name, optional=False, disabled=False, monitor=False, tags=set([])): resContainer.Container.__init__(self, rid="vz", name=name, type="container.vz", optional=optional, disabled=disabled, monitor=monitor, tags=tags) self._cf = os.path.join(os.sep, 'etc', 'vz', 'conf', name+'.conf') def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) 070701000245cc000081b40000000000000000000000014faa950900000cb1000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/resIpVm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import rcExceptions as ex import rcStatus from subprocess import * from rcUtilities import qcall from rcGlobalEnv import rcEnv import resIp as Res class Ip(Res.Ip): def is_up(self): for vm in self.svc.get_res_sets("container."+self.svc.svcmode): pass if vm.status() == rcStatus.DOWN: self.log.debug("container is down") self.status_log("container is down") return False try: rcIfconfig = __import__("rcIfconfig"+self.svc.guestos+self.svc.svcmode) except: print "rcIfconfig"+self.svc.guestos+self.svc.svcmode raise ex.excNotSupported try: ifconfig = rcIfconfig.ifconfig(self.svc.vmname) except ex.excError, e: self.log.debug(str(e)) self.status_log(str(e)) return False except: self.log.debug("failed to fetch interface configuration") self.status_log("failed to fetch interface configuration") return False if ifconfig.has_param("ipaddr", self.addr) is not None or \ ifconfig.has_param("ip6addr", self.addr) is not None: self.log.debug("%s@%s is up" % (self.addr, self.ipDev)) return True self.log.debug("%s@%s is down" % (self.addr, self.ipDev)) return False def allow_start(self): for vm in self.svc.get_res_sets("container."+self.svc.svcmode): pass if self.check_ping() and vm.status() == rcStatus.DOWN: self.log.error("%s is already up on another host" % (self.addr)) raise ex.IpConflict(self.addr) return def start(self): self.getaddr() try: self.allow_start() except ex.IpConflict: raise ex.excError def stop(self): pass def __init__(self, rid=None, ipDev=None, ipName=None, mask=None, always_on=set([]), monitor=False, disabled=False, tags=set([]), optional=False): Res.Ip.__init__(self, rid=rid, ipDev=ipDev, ipName=ipName, mask=mask, always_on=always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) if __name__ == "__main__": for c in (Ip,) : help(c) 0707010002454f000081b40000000000000000000000014faa95090000101c000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/rcIfconfig.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * import logging from rcGlobalEnv import * class interface: def __str__(self): a = ['ifconfig %s:'%self.name] a += [' link_encap = ' + self.link_encap] a += [' scope = ' + self.scope] a += [' bcast = ' + self.bcast] a += [' mtu = ' + self.mtu] a += [' ipaddr = ' + str(self.ipaddr)] a += [' mask = ' + str(self.mask)] a += [' ip6addr = ' + str(self.ip6addr)] a += [' ip6mask = ' + str(self.ip6mask)] a += [' hwaddr = ' + self.hwaddr] a += [' flag_up = ' + str(self.flag_up)] a += [' flag_broadcast = ' + str(self.flag_broadcast)] a += [' flag_running = ' + str(self.flag_running)] a += [' flag_multicast = ' + str(self.flag_multicast)] a += [' flag_loopback = ' + str(self.flag_loopback)] return '\n'.join(a) def __init__(self, name): self.name = name # defaults self.link_encap = '' self.scope = '' self.bcast = '' self.mask = '' self.mtu = '' self.ipaddr = '' self.ip6addr = [] self.ip6mask = [] self.hwaddr = '' self.flag_up = False self.flag_broadcast = False self.flag_running = False self.flag_multicast = False self.flag_loopback = False class ifconfig(object): def add_interface(self, name): i = interface(name) self.intf.append(i) def interface(self, name): for i in self.intf: if i.name == name: return i return None def has_interface(self, name): for i in self.intf: if i.name == name: return 1 return 0 def has_param(self, param, value): for i in self.intf: if isinstance(getattr(i, param), list): if value in getattr(i, param): return i else: if getattr(i, param) == value: return i return None def __str__(self): for intf in self.intf: print intf def __init__(self): self.intf = [] def next_stacked_dev(self,dev): """Return the first available interfaceX:Y on interfaceX """ i = 1 while True: stacked_dev = dev+':'+str(i) if not self.has_interface(stacked_dev): return stacked_dev i = i + 1 def get_stacked_dev(self, dev, addr, log): """Upon start, a new interfaceX:Y will have to be assigned. Upon stop, the currently assigned interfaceX:Y will have to be found for ifconfig down """ if ':' in addr: stacked_intf = self.has_param("ip6addr", addr) else: stacked_intf = self.has_param("ipaddr", addr) if stacked_intf is not None: if dev not in stacked_intf.name: log.error("%s is plumbed but not on %s" % (addr, dev)) return stacked_dev = stacked_intf.name log.debug("found matching stacked device %s" % stacked_dev) else: stacked_dev = self.next_stacked_dev(dev) log.debug("allocate new stacked device %s" % stacked_dev) return stacked_dev 0707010002455a000081b40000000000000000000000014faa950900000463000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/rcIfconfigLinuxvz.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcIfconfigLinux from rcUtilities import call import os import rcExceptions as ex class ifconfig(rcIfconfigLinux.ifconfig): def __init__(self, vmname): self.intf = [] cmd = ['vzctl', 'exec', vmname, '/sbin/ifconfig', '-a'] ret, out, err = call(cmd) if ret != 0: raise ex.excError self.parse(out) 07070100024523000081b40000000000000000000000014faa95090000059f000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/loopSunOS.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import resources from rcGlobalEnv import * import rcStatus class Loop(resources.Resource): def is_up(self): """Returns True if the volume group is present and activated """ return True def start(self): pass def stop(self): pass def status(self, verbose=False): if self.is_up(): return rcStatus.UP else: return rcStatus.DOWN def __init__(self, file, disabled=False, tags=set([]), optional=False): self.file = file resources.Resource.__init__(self, disabled=disabled, tags=tags, optional=optional) 070701000245dc000081b40000000000000000000000014faa950900000923000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/resStonith.pyimport resources as Res import rcStatus import re import os from rcGlobalEnv import rcEnv import rcExceptions as ex class Stonith(Res.Resource): def __init__(self, rid=None, type=None, always_on=set([]), optional=False, disabled=False, monitor=False, tags=set([])): Res.Resource.__init__(self, rid, type, optional=optional, disabled=disabled, monitor=monitor, tags=tags) self.name = None self.re_login = re.compile("(login\s*: )|(Login Name: )|(username: )|(User Name :)", re.IGNORECASE) self.re_pass = re.compile("password", re.IGNORECASE) def creds(self): import ConfigParser c = ConfigParser.RawConfigParser() c.read(os.path.join(rcEnv.pathetc, 'auth.conf')) username = None password = None key = None if not c.has_section(self.name): raise ex.excError("No credentials in node.conf for %s"%self.name) if c.has_option(self.name, "username"): username = c.get(self.name, 'username') else: raise ex.excError("No username in node.conf for %s"%self.name) if c.has_option(self.name, "password"): password = c.get(self.name, 'password') if c.has_option(self.name, "key"): key = c.get(self.name, 'key') if not os.path.exists(key): raise ex.excError("key in node.conf for %s does not exist"%self.name) if password is None and key is None: raise ex.excError("No password nor key in node.conf for %s"%self.name) return username, password, key def start(self): if self.sanity(): self.log.info("sanity checks passed. trigger stonith method") else: self.log.info("stonith bypassed") return self._start() def _start(self): pass def _status(self, verbose=False): return rcStatus.NA def sanity(self): for rs in self.svc.get_res_sets(['hb.ovm', 'hb.openha', 'hb.linuxha']): for r in rs.resources: if not r.disabled and hasattr(r, 'need_stonith') and r.need_stonith(): self.log.info("heartbeat %s asks for stonith"%r.rid) return True self.log.debug("no heartbeat asks for stonith") return False 070701000245fa000081b40000000000000000000000014faa95090000141b000000ae00010002ffffffffffffffff0000001d00000000root/opt/opensvc/lib/snap.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import resources as Res import rcExceptions as ex def find_mount(rs, dir): """Sort mounts from deepest to shallowest and return the first mount whose 'mountPoint' is matching 'dir' """ for m in sorted(rs.resources, reverse=True): if m.is_disabled(): continue if m.mountPoint in dir: return m return None def find_mounts(self, mounts_h): rs = self.svc.get_res_sets("fs")[0] if rs is None: self.log.error("can not find fs resources encapsulating %s to snap (no fs resources)"%self.src) raise ex.syncNotSnapable for src in self.src: m = find_mount(rs, src) if m is None: self.log.error("can not find fs resources encapsulating %s to snap"%src) raise ex.syncNotSnapable mounts_h[src] = m return mounts_h class Snap(Res.Resource): """Defines a snap object """ def __init__(self, rid, optional=False, disabled=False, tags=set([])): self.snaps = {} Res.Resource.__init__(self, rid, "sync.snap", optional=optional,\ disabled=disabled, tags=tags) def try_snap(self, rset, action, rid=None): if action == "nodes": action = "syncnodes" if action == "drpnodes": action = "syncdrp" mounts_h = {} for r in rset.resources: """ if rid is set, snap only the specified resource. Used by resources tagged 'delay_snap' on sync() if rid is not set, don't snap resources tagged 'delay_snap' (pre_action() code path) """ if rid is None: if "delay_snap" in r.tags: continue elif rid != r.rid: continue if r.is_disabled(): continue if r.snap is not True and r.snap is not False: self.log.error("service configuration error: 'snap' must be 'true' or 'false'. default is 'false'") raise ex.syncConfigSyntaxError if not r.snap: continue if (action == "syncnodes" and not 'nodes' in r.target) or \ (action == "syncdrp" and not 'drpnodes' in r.target): self.log.debug("action %s but resource target is %s"%(action, r.target)) continue mounts_h = find_mounts(r, mounts_h) mounts = set(mounts_h.values()) for m in mounts: try: self.snapcreate(m) except ex.syncNotSnapable: self.log.error("Resource not snapable: "+m.__str__()) continue except (ex.syncNotSnapable, ex.syncSnapExists, ex.syncSnapMountError, ex.syncSnapCreateError, ex.syncSnapDestroyError): """Clean up the mess """ self.snap_cleanup(rset) raise ex.excError except: raise """Update src dirs of every sync resource to point to an existing snap """ for i, r in enumerate(rset.resources): r.alt_src = list(r.src) for j, src in enumerate(r.alt_src): if not mounts_h.has_key(src): continue mnt = mounts_h[src].mountPoint if not self.snaps.has_key(mnt): continue snap_mnt = self.snaps[mnt]['snap_mnt'] rset.resources[i].alt_src[j] = src.replace(os.path.join(mnt), os.path.join(snap_mnt), 1) def snap_cleanup(self, rset=None): if not hasattr(self, 'snaps'): return if len(self.snaps) == 0 : return for s in self.snaps.keys(): self.snapdestroykey(s) if rset is None: return for i, r in enumerate(rset.resources): if hasattr(rset.resources[i], 'alt_src'): delattr(rset.resources[i], 'alt_src') def snapcreate(self, m): """ create a snapshot for m add self.snaps[m] with dict(snapinfo key val) """ raise ex.MissImpl def snapdestroykey(self, snaps_key): """ destroy a snapshot for a snap key """ raise ex.MissImpl 070701000245c2000081b40000000000000000000000014faa950900000611000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resIpEsx.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. from rcGlobalEnv import rcEnv resIpHv = __import__("resIp"+rcEnv.sysname) import resIpVm class Ip(resIpVm.Ip, resIpHv.Ip): def __init__(self, rid=None, ipDev=None, ipName=None, mask=None, always_on=set([]), monitor=False, disabled=False, tags=set([]), optional=False): resIpVm.Ip.__init__(self, rid=rid, ipDev=ipDev, ipName=ipName, mask=mask, always_on=always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) def check_ping(self): return resIpHv.Ip.check_ping(self) if __name__ == "__main__": for c in (Ip,) : help(c) 07070100024600000081b40000000000000000000000014faa95090000fa8a000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/svcBuilder.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import sys import ConfigParser import logging import re import socket from rcGlobalEnv import * from rcNode import discover_node from rcUtilities import * import rcLogger import resSyncRsync import rcExceptions as ex import platform check_privs() # # file tree abstraction # rcEnv.pathsvc = os.path.realpath(os.path.join(os.path.dirname(__file__), '..')) rcEnv.pathbin = os.path.join(rcEnv.pathsvc, 'bin') rcEnv.pathetc = os.path.join(rcEnv.pathsvc, 'etc') rcEnv.pathlib = os.path.join(rcEnv.pathsvc, 'lib') rcEnv.pathlog = os.path.join(rcEnv.pathsvc, 'log') rcEnv.pathtmp = os.path.join(rcEnv.pathsvc, 'tmp') rcEnv.pathvar = os.path.join(rcEnv.pathsvc, 'var') rcEnv.pathlock = os.path.join(rcEnv.pathvar, 'lock') rcEnv.sysname, rcEnv.nodename, x, x, rcEnv.machine, x = platform.uname() rcEnv.nodename = socket.gethostname() os.environ['LANG'] = 'C' os.environ['PATH'] += ':/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin' def conf_get(svc, conf, s, o, t, scope=False): if t == 'string': f = conf.get elif t == 'boolean': f = conf.getboolean elif t == 'integer': f = conf.getint else: raise Exception() if not scope: if conf.has_option(s, o): return f(s, o) else: raise ex.OptNotFound if conf.has_option(s, o+"@"+rcEnv.nodename): return f(s, o+"@"+rcEnv.nodename) elif conf.has_option(s, o+"@nodes") and \ rcEnv.nodename in svc.nodes: return f(s, o+"@nodes") elif conf.has_option(s, o+"@drpnodes") and \ rcEnv.nodename in svc.drpnodes: return f(s, o+"@drpnodes") elif conf.has_option(s, o): return f(s, o) else: raise ex.OptNotFound def conf_get_string(svc, conf, s, o): return conf_get(svc, conf, s, o, 'string', scope=False) def conf_get_string_scope(svc, conf, s, o): return conf_get(svc, conf, s, o, 'string', scope=True) def conf_get_boolean(svc, conf, s, o): return conf_get(svc, conf, s, o, 'boolean', scope=False) def conf_get_boolean_scope(svc, conf, s, o): return conf_get(svc, conf, s, o, 'boolean', scope=True) def conf_get_int(svc, conf, s, o): return conf_get(svc, conf, s, o, 'integer', scope=False) def conf_get_int_scope(svc, conf, s, o): return conf_get(svc, conf, s, o, 'integer', scope=True) def svcmode_mod_name(svcmode=''): """Returns (moduleName, serviceClassName) implementing the class for a given service mode. For example: lxc => ('svcLxc', 'SvcLxc') zone => ('svcZone', 'SvcZone') hosted => ('svcHosted', 'SvcHosted') """ if svcmode == 'lxc': return ('svcLxc', 'SvcLxc') elif svcmode == 'vz': return ('svcVz', 'SvcVz') elif svcmode == 'zone': return ('svcZone', 'SvcZone') elif svcmode == 'jail': return ('svcJail', 'SvcJail') elif svcmode == 'hosted': return ('svcHosted', 'SvcHosted') elif svcmode == 'hpvm': return ('svcHpVm', 'SvcHpVm') elif svcmode == 'ldom': return ('svcLdom', 'SvcLdom') elif svcmode == 'kvm': return ('svcKvm', 'SvcKvm') elif svcmode == 'esx': return ('svcEsx', 'SvcEsx') elif svcmode == 'xen': return ('svcXen', 'SvcXen') elif svcmode == 'ovm': return ('svcOvm', 'SvcOvm') elif svcmode == 'vbox': return ('svcVbox', 'SvcVbox') raise ex.excError("unknown service mode: %s"%svcmode) def get_tags(conf, section): if conf.has_option(section, 'tags'): return set(conf.get(section, "tags").split()) return set([]) def get_optional(conf, section, svc): if not conf.has_section(section): if conf.has_option('DEFAULT', 'optional'): return conf.getboolean("DEFAULT", "optional") else: return False if conf.has_option(section, 'optional'): return conf.getboolean(section, "optional") nodes = set([]) if conf.has_option(section, 'optional_on'): l = conf.get(section, "optional_on").split() for i in l: if i == 'nodes': nodes |= svc.nodes elif i == 'drpnodes': nodes |= svc.drpnodes else: nodes |= set([i]) if rcEnv.nodename in nodes: return True return False def get_monitor(conf, section, svc): if not conf.has_section(section): if conf.has_option('DEFAULT', 'monitor'): return conf.getboolean("DEFAULT", "monitor") else: return False if conf.has_option(section, 'monitor'): return conf.getboolean(section, "monitor") nodes = set([]) if conf.has_option(section, 'monitor_on'): l = conf.get(section, "monitor_on").split() for i in l: if i == 'nodes': nodes |= svc.nodes elif i == 'drpnodes': nodes |= svc.drpnodes else: nodes |= set([i]) if rcEnv.nodename in nodes: return True return False def get_disabled(conf, section, svc): if not conf.has_section(section): if conf.has_option('DEFAULT', 'disable'): return conf.getboolean("DEFAULT", "disable") else: return False if conf.has_option(section, 'disable'): return conf.getboolean(section, "disable") nodes = set([]) if conf.has_option(section, 'disable_on'): l = conf.get(section, "disable_on").split() for i in l: if i == 'nodes': nodes |= svc.nodes elif i == 'drpnodes': nodes |= svc.drpnodes else: nodes |= set([i]) if rcEnv.nodename in nodes: return True return False def need_scsireserv(svc, conf, section): """scsireserv = true can be set globally or in a specific resource section """ r = False try: r = conf_get_boolean_scope(svc, conf, section, 'scsireserv') except ex.OptNotFound: defaults = conf.defaults() if 'scsireserv' in defaults: r = bool(defaults['scsireserv']) return r def add_scsireserv(svc, resource, conf, section): if not need_scsireserv(svc, conf, section): return try: sr = __import__('resScsiReserv'+rcEnv.sysname) except ImportError: sr = __import__('resScsiReserv') try: pa = conf_get_boolean_scope(svc, conf, resource.rid, 'no_preempt_abort') except ex.OptNotFound: defaults = conf.defaults() if 'no_preempt_abort' in defaults: pa = bool(defaults['no_preempt_abort']) else: pa = False kwargs = {} kwargs['rid'] = resource.rid kwargs['tags'] = resource.tags kwargs['disks'] = resource.disklist() kwargs['no_preempt_abort'] = pa kwargs['disabled'] = resource.is_disabled() kwargs['optional'] = resource.is_optional() r = sr.ScsiReserv(**kwargs) svc += r def add_triggers(svc, resource, conf, section): triggers = ['pre_stop', 'pre_start', 'pre_syncnodes', 'pre_syncdrp', 'post_stop', 'post_start', 'post_syncnodes', 'post_syncdrp', 'post_syncresync', 'pre_syncresync'] for trigger in triggers: try: s = conf_get_string_scope(svc, conf, resource.rid, trigger) except ex.OptNotFound: continue setattr(resource, trigger, s.split()) def always_on_nodes_set(svc, conf, section): try: always_on_opt = conf.get(section, "always_on").split() except: always_on_opt = [] always_on = set([]) if 'nodes' in always_on_opt: always_on |= svc.nodes if 'drpnodes' in always_on_opt: always_on |= svc.drpnodes always_on |= set(always_on_opt) - set(['nodes', 'drpnodes']) return always_on def get_sync_args(conf, s, svc): kwargs = {} defaults = conf.defaults() if conf.has_option(s, 'sync_max_delay'): kwargs['sync_max_delay'] = conf.getint(s, 'sync_max_delay') elif 'sync_max_delay' in defaults: kwargs['sync_max_delay'] = int(defaults['sync_max_delay']) if conf.has_option(s, 'sync_min_delay'): kwargs['sync_interval'] = conf.getint(s, 'sync_min_delay') svc.log.warn("sync_min_delay is deprecated. replace with sync_interval.") elif 'sync_min_delay' in defaults: kwargs['sync_interval'] = int(defaults['sync_min_delay']) svc.log.warn("sync_min_delay is deprecated. replace with sync_interval.") if conf.has_option(s, 'sync_interval'): kwargs['sync_interval'] = conf.getint(s, 'sync_interval') elif 'sync_interval' in defaults: kwargs['sync_interval'] = int(defaults['sync_interval']) elif 'sync_max_delay' in kwargs: kwargs['sync_interval'] = kwargs['sync_max_delay'] import json try: if conf.has_option(s, 'sync_period'): kwargs['sync_period'] = json.loads(conf.get(s, 'sync_period')) elif conf.has_option('DEFAULT', 'sync_period'): kwargs['sync_period'] = json.loads(conf.get('DEFAULT', 'sync_period')) except ValueError: svc.log.error("malformed parameter value: %s.%s"%(s, 'sync_period')) try: if conf.has_option(s, 'sync_days'): kwargs['sync_days'] = json.loads(conf.get(s, 'sync_days')) elif conf.has_option('DEFAULT', 'sync_days'): kwargs['sync_days'] = json.loads(conf.get('DEFAULT', 'sync_days')) except ValueError: svc.log.error("malformed parameter value: %s.%s"%(s, 'sync_days')) return kwargs def add_ips(svc, conf): """Parse the configuration file and add an ip object for each [ip#n] section. Ip objects are stored in a list in the service object. """ for s in conf.sections(): if re.match('ip#[0-9]', s, re.I) is None: continue kwargs = {} try: kwargs['ipName'] = conf_get_string_scope(svc, conf, s, 'ipname') except ex.OptNotFound: svc.log.error("nor ipname and ipname@%s defined in config file section %s"%(rcEnv.nodename, s)) continue try: kwargs['ipDev'] = conf_get_string_scope(svc, conf, s, 'ipdev') except ex.OptNotFound: svc.log.debug('add_ips ipdev not found in ip section %s'%s) continue if hasattr(svc, "vmname"): vmname = svc.vmname else: vmname = svc.svcname try: kwargs['mask'] = conf_get_string_scope(svc, conf, s, 'netmask') except ex.OptNotFound: pass if svc.svcmode == 'lxc': ip = __import__('resIp'+rcEnv.sysname+'Lxc') elif svc.svcmode == 'vz': ip = __import__('resIp'+rcEnv.sysname+'Lxc') elif svc.svcmode == 'kvm': ip = __import__('resIp'+'Kvm') elif svc.svcmode == 'hpvm': ip = __import__('resIp'+'HpVm') elif svc.svcmode == 'ldom': ip = __import__('resIp'+'Ldom') elif svc.svcmode == 'zone': ip = __import__('resIp'+'Zone') elif svc.svcmode == 'xen' or svc.svcmode == 'ovm': ip = __import__('resIp'+'Xen') elif svc.svcmode == 'esx': ip = __import__('resIp'+'Esx') elif svc.svcmode == 'vbox': ip = __import__('resIp'+'Vbox') else: ip = __import__('resIp'+rcEnv.sysname) kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['always_on'] = always_on_nodes_set(svc, conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs['monitor'] = get_monitor(conf, s, svc) r = ip.Ip(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_drbds(svc, conf): """Parse the configuration file and add a drbd object for each [drbd#n] section. Drbd objects are stored in a list in the service object. """ for s in conf.sections(): if re.match('drbd#[0-9]', s, re.I) is None: continue kwargs = {} try: kwargs['res'] = conf_get_string(svc, conf, s, 'res') except ex.OptNotFound: svc.log.error("res must be set in section %s"%s) return kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['always_on'] = always_on_nodes_set(svc, conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs['monitor'] = get_monitor(conf, s, svc) drbd = __import__('resDrbd') r = drbd.Drbd(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_vdisks(svc, conf): for s in conf.sections(): if re.match('vdisk#[0-9]', s, re.I) is None: continue kwargs = {} devpath = {} for attr, val in conf.items(s): if 'path@' in attr: devpath[attr.replace('path@','')] = val if len(devpath) == 0: svc.log.error("path@node must be set in section %s"%s) return kwargs['devpath'] = devpath kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['always_on'] = always_on_nodes_set(svc, conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs['monitor'] = get_monitor(conf, s, svc) vdisk = __import__('resVdisk') r = vdisk.Vdisk(**kwargs) add_triggers(svc, r, conf, s) svc += r add_scsireserv(svc, r, conf, s) def add_stoniths(svc, conf): for s in conf.sections(): if re.match('stonith#[0-9]', s, re.I) is None: continue if rcEnv.nodename in svc.drpnodes: # no stonith on DRP nodes return kwargs = {} try: _type = conf_get_string(svc, conf, s, 'type') if len(_type) > 1: _type = _type[0].upper()+_type[1:].lower() except ex.OptNotFound: svc.log.error("type must be set in section %s"%s) return if _type in ('Ilo'): try: kwargs['name'] = conf_get_string_scope(svc, conf, s, 'name') except ex.OptNotFound: pass try: kwargs['name'] = conf_get_string_scope(svc, conf, s, 'target') except ex.OptNotFound: pass if 'name' not in kwargs: svc.log.error("target must be set in section %s"%s) return elif _type in ('Callout'): try: kwargs['cmd'] = conf_get_string_scope(svc, conf, s, 'cmd') except ex.OptNotFound: pass if 'cmd' not in kwargs: svc.log.error("cmd must be set in section %s"%s) return kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['always_on'] = always_on_nodes_set(svc, conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) st = __import__('resStonith'+_type) try: st = __import__('resStonith'+_type) except ImportError: svc.log.error("resStonith%s is not implemented"%_type) continue r = st.Stonith(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_hbs(svc, conf): for s in conf.sections(): if re.match('hb#[0-9]', s, re.I) is None: continue if rcEnv.nodename in svc.drpnodes: # no heartbeat on DRP nodes return kwargs = {} try: hbtype = conf_get_string(svc, conf, s, 'type').lower() except ex.OptNotFound: svc.log.error("type must be set in section %s"%s) return try: kwargs['name'] = conf_get_string(svc, conf, s, 'name') except ex.OptNotFound: pass kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['always_on'] = always_on_nodes_set(svc, conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) if hbtype == 'openha': hbtype = 'OpenHA' elif hbtype == 'linuxha': hbtype = 'LinuxHA' try: hb = __import__('resHb'+hbtype) except ImportError: svc.log.error("resHb%s is not implemented"%hbtype) continue r = hb.Hb(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_loops(svc, conf): """Parse the configuration file and add a loop object for each [loop#n] section. Loop objects are stored in a list in the service object. """ for s in conf.sections(): if re.match('loop#[0-9]', s, re.I) is None: continue kwargs = {} try: kwargs['loopFile'] = conf_get_string_scope(svc, conf, s, 'file') except ex.OptNotFound: svc.log.error("file must be set in section %s"%s) return kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['always_on'] = always_on_nodes_set(svc, conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs['monitor'] = get_monitor(conf, s, svc) try: loop = __import__('resLoop'+rcEnv.sysname) except ImportError: svc.log.error("resLoop%s is not implemented"%rcEnv.sysname) continue r = loop.Loop(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_vgs(svc, conf): """Parse the configuration file and add a vg object for each [vg#n] section. Vg objects are stored in a list in the service object. """ for s in conf.sections(): if re.match('vg#[0-9]', s, re.I) is None: continue kwargs = {} try: vgtype = conf_get_string_scope(svc, conf, s, 'vgtype') if len(vgtype) > 2: vgtype = vgtype[0].upper() + vgtype[1:].lower() except ex.OptNotFound: vgtype = rcEnv.sysname try: vgtype = conf_get_string_scope(svc, conf, s, 'type') if len(vgtype) > 2: vgtype = vgtype[0].upper() + vgtype[1:].lower() except ex.OptNotFound: vgtype = rcEnv.sysname if vgtype == 'Raw': vgtype += rcEnv.sysname try: kwargs['user'] = conf_get_string_scope(svc, conf, s, 'user') except ex.OptNotFound: pass try: kwargs['group'] = conf_get_string_scope(svc, conf, s, 'user') except ex.OptNotFound: pass try: kwargs['perm'] = conf_get_string_scope(svc, conf, s, 'perm') except ex.OptNotFound: pass try: kwargs['name'] = conf_get_string_scope(svc, conf, s, 'vgname') except ex.OptNotFound: if not vgtype.startswith("Raw"): svc.log.error("vgname must be set in section %s"%s) return try: kwargs['dsf'] = conf_get_boolean_scope(svc, conf, s, 'dsf') except ex.OptNotFound: pass try: kwargs['devs'] = set(conf_get_string_scope(svc, conf, s, 'devs').split()) except ex.OptNotFound: if vgtype == "Raw": svc.log.error("devs must be set in section %s"%s) return kwargs['always_on'] = always_on_nodes_set(svc, conf, s) kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs['monitor'] = get_monitor(conf, s, svc) try: vg = __import__('resVg'+vgtype) except ImportError: svc.log.error("vg type %s is not implemented"%vgtype) continue r = vg.Vg(**kwargs) add_triggers(svc, r, conf, s) svc += r add_scsireserv(svc, r, conf, s) def add_vmdg(svc, conf): if not conf.has_section('vmdg'): return if svc.svcmode == 'hpvm': vg = __import__('resVgHpVm') elif svc.svcmode == 'ldom': vg = __import__('resVgLdom') elif svc.svcmode in rcEnv.vt_libvirt: vg = __import__('resVgLibvirtVm') elif svc.svcmode == 'ovm': vg = __import__('resVgOvm') else: return kwargs = {} kwargs['rid'] = 'vmdg' kwargs['tags'] = get_tags(conf, 'vmdg') kwargs['name'] = 'vmdg' kwargs['disabled'] = get_disabled(conf, 'vmdg', svc) kwargs['optional'] = get_optional(conf, 'vmdg', svc) kwargs['monitor'] = get_monitor(conf, 'vmdg', svc) r = vg.Vg(**kwargs) add_triggers(svc, r, conf, 'vmdg') svc += r add_scsireserv(svc, r, conf, 'vmdg') def add_pools(svc, conf): """Parse the configuration file and add a pool object for each [pool#n] section. Pools objects are stored in a list in the service object. """ for s in conf.sections(): if re.match('pool#[0-9]', s, re.I) is None: continue kwargs = {} try: kwargs['name'] = conf_get_string_scope(svc, conf, s, 'poolname') except ex.OptNotFound: svc.log.error("poolname must be set in section %s"%s) continue pool = __import__('resVgZfs') kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['always_on'] = always_on_nodes_set(svc, conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs['monitor'] = get_monitor(conf, s, svc) r = pool.Pool(**kwargs) add_triggers(svc, r, conf, s) svc += r add_scsireserv(svc, r, conf, s) def add_filesystems(svc, conf): """Parse the configuration file and add a fs object for each [fs#n] section. Fs objects are stored in a list in the service object. """ for s in conf.sections(): if re.match('fs#[0-9]', s, re.I) is None: continue kwargs = {} try: kwargs['device'] = conf_get_string_scope(svc, conf, s, 'dev') except ex.OptNotFound: svc.log.error("dev must be set in section %s"%s) continue try: kwargs['mountPoint'] = conf_get_string_scope(svc, conf, s, 'mnt') except ex.OptNotFound: svc.log.error("mnt must be set in section %s"%s) continue if kwargs['mountPoint'][-1] == '/': """ Remove trailing / to not risk losing rsync src trailing / upon snap mountpoint substitution. """ kwargs['mountPoint'] = kwargs['mountPoint'][0:-1] try: kwargs['fsType'] = conf_get_string_scope(svc, conf, s, 'type') except ex.OptNotFound: kwargs['fsType'] = "" try: kwargs['mntOpt'] = conf_get_string_scope(svc, conf, s, 'mnt_opt') except ex.OptNotFound: kwargs['mntOpt'] = "" try: kwargs['snap_size'] = conf_get_int_scope(svc, conf, s, 'snap_size') except ex.OptNotFound: pass if svc.svcmode == 'zone': try: globalfs = conf.getboolean(s, "globalfs") except: globalfs = False if globalfs is False: kwargs['mountPoint'] = os.path.realpath(svc.zone.zonepath+'/root/'+kwargs['mountPoint']) try: mount = __import__('resMount'+rcEnv.sysname) except ImportError: svc.log.error("resMount%s is not implemented"%rcEnv.sysname) continue kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['always_on'] = always_on_nodes_set(svc, conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs['monitor'] = get_monitor(conf, s, svc) r = mount.Mount(**kwargs) add_triggers(svc, r, conf, s) svc += r add_scsireserv(svc, r, conf, s) def add_mandatory_syncs(svc, conf): """Mandatory files to sync: 1/ to all nodes: service definition 2/ to drpnodes: system files to replace on the drpnode in case of startdrp """ """1 """ kwargs = {} src = [] src.append(os.path.join(rcEnv.pathetc, svc.svcname)) src.append(os.path.join(rcEnv.pathetc, svc.svcname+'.env')) src.append(os.path.join(rcEnv.pathetc, svc.svcname+'.d')) localrc = os.path.join(rcEnv.pathetc, svc.svcname+'.dir') cluster = os.path.join(rcEnv.pathetc, svc.svcname+'.cluster') if os.path.exists(cluster): src.append(cluster) if os.path.exists(localrc): src.append(localrc) for rs in svc.resSets: for r in rs.resources: src += r.files_to_sync() dst = os.path.join("/") exclude = ['--exclude=*.core'] targethash = {'nodes': svc.nodes, 'drpnodes': svc.drpnodes} kwargs['rid'] = "sync#i0" kwargs['src'] = src kwargs['dst'] = dst kwargs['options'] = ['-R']+exclude kwargs['target'] = targethash kwargs['internal'] = True kwargs['disabled'] = get_disabled(conf, kwargs['rid'], svc) kwargs['optional'] = get_optional(conf, kwargs['rid'], svc) kwargs.update(get_sync_args(conf, 'sync', svc)) r = resSyncRsync.Rsync(**kwargs) svc += r """2 """ targethash = {'drpnodes': svc.drpnodes} """ Reparent all PRD backed-up file in drp_path/node on the drpnode """ dst = os.path.join(rcEnv.drp_path, rcEnv.nodename) i = 0 for src, exclude in rcEnv.drp_sync_files: """'-R' triggers rsync relative mode """ kwargs = {} src = [ s for s in src if os.path.exists(s) ] if len(src) == 0: continue i += 1 kwargs['rid'] = "sync#i"+str(i) kwargs['src'] = src kwargs['dst'] = dst kwargs['options'] = ['-R']+exclude kwargs['target'] = targethash kwargs['internal'] = True kwargs['disabled'] = get_disabled(conf, kwargs['rid'], svc) kwargs['optional'] = get_optional(conf, kwargs['rid'], svc) kwargs.update(get_sync_args(conf, 'sync', svc)) r = resSyncRsync.Rsync(**kwargs) svc += r def add_syncs(svc, conf): add_syncs_rsync(svc, conf) add_syncs_netapp(svc, conf) add_syncs_nexenta(svc, conf) add_syncs_symclone(svc, conf) add_syncs_evasnap(svc, conf) add_syncs_dcssnap(svc, conf) add_syncs_dcsckpt(svc, conf) add_syncs_dds(svc, conf) add_syncs_zfs(svc, conf) def add_syncs_zfs(svc, conf): zfs = __import__('resSyncZfs') for s in conf.sections(): if re.match('sync#[0-9]', s, re.I) is None: continue if not conf.has_option(s, 'type'): continue elif conf.get(s, 'type') != 'zfs': continue kwargs = {} try: kwargs['src'] = conf_get_string_scope(svc, conf, s, 'src') except ex.OptNotFound: svc.log.error("config file section %s must have src set" % s) continue try: kwargs['dst'] = conf_get_string_scope(svc, conf, s, 'dst') except ex.OptNotFound: svc.log.error("config file section %s must have dst set" % s) continue try: kwargs['target'] = conf_get_string_scope(svc, conf, s, 'target').split() except ex.OptNotFound: svc.log.error("config file section %s must have target set" % s) continue try: kwargs['recursive'] = conf_get_boolean(svc, conf, s, 'recursive') except ex.OptNotFound: pass kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs.update(get_sync_args(conf, s, svc)) r = zfs.SyncZfs(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_syncs_dds(svc, conf): dds = __import__('resSyncDds') for s in conf.sections(): if re.match('sync#[0-9]', s, re.I) is None: continue if not conf.has_option(s, 'type'): continue elif conf.get(s, 'type') != 'dds': continue kwargs = {} try: kwargs['src'] = conf_get_string_scope(svc, conf, s, 'src') except ex.OptNotFound: svc.log.error("config file section %s must have src set" % s) continue try: kwargs['dst'] = conf_get_string_scope(svc, conf, s, 'dst') except ex.OptNotFound: kwargs['dst'] = conf.get(s, 'src') try: kwargs['target'] = conf_get_string_scope(svc, conf, s, 'target').split() except ex.OptNotFound: svc.log.error("config file section %s must have target set" % s) continue try: kwargs['sender'] = conf_get_string(svc, conf, s, 'sender') except ex.OptNotFound: pass try: kwargs['snap_size'] = conf_get_int_scope(svc, conf, s, 'snap_size') except ex.OptNotFound: pass try: kwargs['delta_store'] = conf_get_string_scope(svc, conf, s, 'delta_store') except ex.OptNotFound: pass kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs.update(get_sync_args(conf, s, svc)) r = dds.syncDds(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_syncs_dcsckpt(svc, conf): try: sc = __import__('resSyncDcsCkpt'+rcEnv.sysname) except: sc = __import__('resSyncDcsCkpt') for s in conf.sections(): if re.match('sync#[0-9]', s, re.I) is None: continue if not conf.has_option(s, 'type'): continue elif conf.get(s, 'type') != 'dcsckpt': continue kwargs = {} try: kwargs['dcs'] = set(conf_get_string_scope(svc, conf, s, 'dcs').split()) except ex.OptNotFound: svc.log.error("config file section %s must have 'dcs' set" % s) continue try: kwargs['manager'] = set(conf_get_string_scope(svc, conf, s, 'manager').split()) except ex.OptNotFound: svc.log.error("config file section %s must have 'manager' set" % s) continue import json pairs = [] if 'pairs' in conf.options(s): try: pairs = json.loads(conf.get(s, 'pairs')) if len(pairs) == 0: svc.log.error("config file section %s must have 'pairs' set" % s) continue except: svc.log.error("json error parsing 'pairs' in section %s" % s) kwargs['pairs'] = pairs kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs.update(get_sync_args(conf, s, svc)) r = sc.syncDcsCkpt(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_syncs_dcssnap(svc, conf): try: sc = __import__('resSyncDcsSnap'+rcEnv.sysname) except: sc = __import__('resSyncDcsSnap') for s in conf.sections(): if re.match('sync#[0-9]', s, re.I) is None: continue if not conf.has_option(s, 'type'): continue elif conf.get(s, 'type') != 'dcssnap': continue kwargs = {} try: kwargs['dcs'] = set(conf_get_string(svc, conf, s, 'dcs').split()) except ex.OptNotFound: svc.log.error("config file section %s must have 'dcs' set" % s) continue try: kwargs['manager'] = set(conf_get_string(svc, conf, s, 'manager').split()) except ex.OptNotFound: svc.log.error("config file section %s must have 'manager' set" % s) continue try: kwargs['snapname'] = set(conf_get_string(svc, conf, s, 'snapname').split()) except ex.OptNotFound: svc.log.error("config file section %s must have 'snapname' set" % s) continue kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs.update(get_sync_args(conf, s, svc)) r = sc.syncDcsSnap(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_syncs_evasnap(svc, conf): try: sc = __import__('resSyncEvasnap'+rcEnv.sysname) except: sc = __import__('resSyncEvasnap') for s in conf.sections(): if re.match('sync#[0-9]', s, re.I) is None: continue if not conf.has_option(s, 'type'): continue elif conf.get(s, 'type') != 'evasnap': continue kwargs = {} try: kwargs['eva_name'] = conf_get_string(svc, conf, s, 'eva_name') except ex.OptNotFound: svc.log.error("config file section %s must have eva_name set" % s) continue import json pairs = [] if 'pairs' in conf.options(s): pairs = json.loads(conf.get(s, 'pairs')) if len(pairs) == 0: svc.log.error("config file section %s must have pairs set" % s) continue else: kwargs['pairs'] = pairs kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs.update(get_sync_args(conf, s, svc)) r = sc.syncEvasnap(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_syncs_symclone(svc, conf): try: sc = __import__('resSyncSymclone'+rcEnv.sysname) except: sc = __import__('resSyncSymclone') for s in conf.sections(): if re.match('sync#[0-9]', s, re.I) is None: continue if not conf.has_option(s, 'type'): continue elif conf.get(s, 'type') != 'symclone': continue kwargs = {} try: kwargs['symdg'] = conf_get_string(svc, conf, s, 'symdg') except ex.OptNotFound: svc.log.error("config file section %s must have symdg set" % s) continue try: kwargs['symdevs'] = conf_get_string_scope(svc, conf, s, 'symdevs').split() except ex.OptNotFound: svc.log.error("config file section %s must have symdevs set" % s) continue try: kwargs['precopy_timeout'] = conf_get_int(svc, conf, s, 'precopy_timeout') except ex.OptNotFound: pass kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs.update(get_sync_args(conf, s, svc)) r = sc.syncSymclone(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_syncs_nexenta(svc, conf): for s in conf.sections(): if re.match('sync#[0-9]', s, re.I) is None: continue kwargs = {} if not conf.has_option(s, 'type'): continue elif conf.get(s, 'type') != 'nexenta': continue try: kwargs['name'] = conf_get_string(svc, conf, s, 'name') except ex.OptNotFound: svc.log.error("config file section %s must have 'name' set" % s) continue try: kwargs['path'] = conf_get_string_scope(svc, conf, s, 'path') except ex.OptNotFound: svc.log.error("config file section %s must have path set" % s) continue try: kwargs['reversible'] = conf.getboolean(s, "reversible") except: pass filers = {} if 'filer' in conf.options(s): for n in svc.nodes | svc.drpnodes: filers[n] = conf.get(s, 'filer') if 'filer@nodes' in conf.options(s): for n in svc.nodes: filers[n] = conf.get(s, 'filer@nodes') if 'filer@drpnodes' in conf.options(s): for n in svc.nodes: filers[n] = conf.get(s, 'filer@drpnodes') for o in conf.options(s): if 'filer@' not in o: continue (filer, node) = o.split('@') if node in ('nodes', 'drpnodes'): continue filers[node] = conf.get(s, o) if rcEnv.nodename not in filers: svc.log.error("config file section %s must have filer@%s set" %(s, rcEnv.nodename)) kwargs['filers'] = filers kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs.update(get_sync_args(conf, s, svc)) import resSyncNexenta r = resSyncNexenta.syncNexenta(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_syncs_netapp(svc, conf): for s in conf.sections(): if re.match('sync#[0-9]', s, re.I) is None: continue kwargs = {} if not conf.has_option(s, 'type'): continue elif conf.get(s, 'type') != 'netapp': continue try: kwargs['path'] = conf_get_string_scope(svc, conf, s, 'path') except ex.OptNotFound: svc.log.error("config file section %s must have path set" % s) continue try: kwargs['user'] = conf_get_string_scope(svc, conf, s, 'user') except ex.OptNotFound: svc.log.error("config file section %s must have user set" % s) continue filers = {} if 'filer' in conf.options(s): for n in svc.nodes | svc.drpnodes: filers[n] = conf.get(s, 'filer') if 'filer@nodes' in conf.options(s): for n in svc.nodes: filers[n] = conf.get(s, 'filer@nodes') if 'filer@drpnodes' in conf.options(s): for n in svc.nodes: filers[n] = conf.get(s, 'filer@drpnodes') for o in conf.options(s): if 'filer@' not in o: continue (filer, node) = o.split('@') if node in ('nodes', 'drpnodes'): continue filers[node] = conf.get(s, o) if rcEnv.nodename not in filers: svc.log.error("config file section %s must have filer@%s set" %(s, rcEnv.nodename)) kwargs['filers'] = filers kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs.update(get_sync_args(conf, s, svc)) import resSyncNetapp r = resSyncNetapp.syncNetapp(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_syncs_rsync(svc, conf): """Add mandatory node-to-nodes and node-to-drpnode synchronizations, plus the those described in the config file. """ import glob add_mandatory_syncs(svc, conf) for s in conf.sections(): if re.match('sync#[0-9]', s, re.I) is None: continue if conf.has_option(s, 'type') and \ conf.get(s, 'type') != 'rsync': continue if not conf.has_option(s, 'src') or \ not conf.has_option(s, 'dst'): svc.log.error("config file section %s must have src and dst set" % s) return options = [] kwargs = {} kwargs['src'] = [] for src in conf.get(s, "src").split(): kwargs['src'] += glob.glob(src) kwargs['dst'] = conf.get(s, "dst") if conf.has_option(s, 'dstfs'): kwargs['dstfs'] = conf.get(s, 'dstfs') if conf.has_option(s, 'options'): options += conf.get(s, 'options').split() if conf.has_option(s, 'exclude'): # for backward compat (use options keyword now) options += conf.get(s, 'exclude').split() kwargs['options'] = options if conf.has_option(s, 'snap'): kwargs['snap'] = conf.getboolean(s, 'snap') if conf.has_option(s, 'target'): target = conf.get(s, 'target').split() else: target = [] if conf.has_option(s, 'bwlimit'): kwargs['bwlimit'] = conf.get(s, 'bwlimit') targethash = {} if 'nodes' in target: targethash['nodes'] = svc.nodes if 'drpnodes' in target: targethash['drpnodes'] = svc.drpnodes kwargs['target'] = targethash kwargs['rid'] = s kwargs['tags'] = get_tags(conf, s) kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs.update(get_sync_args(conf, s, svc)) r = resSyncRsync.Rsync(**kwargs) add_triggers(svc, r, conf, s) svc += r def add_apps(svc, conf): if svc.svcmode in rcEnv.vt_supported: resApp = __import__('resAppVm') else: resApp = __import__('resApp') kwargs = {} kwargs['runmethod'] = svc.runmethod s = 'app' kwargs['disabled'] = get_disabled(conf, s, svc) kwargs['optional'] = get_optional(conf, s, svc) kwargs['monitor'] = get_monitor(conf, s, svc) r = resApp.Apps(**kwargs) add_triggers(svc, r, conf, s) svc += r def setup_logging(): """Setup logging to stream + logfile, and logfile rotation class Logger instance name: 'log' """ global log log = rcLogger.initLogger('INIT') def build(name): """build(name) is in charge of Svc creation it return None if service Name is not managed by local node else it return new Svc instance """ svcconf = os.path.join(rcEnv.pathetc, name) + '.env' svcinitd = os.path.join(rcEnv.pathetc, name) + '.d' logfile = os.path.join(rcEnv.pathlog, name) + '.log' rcEnv.logfile = logfile setup_logging() # # node discovery is hidden in a separate module to # keep it separate from the framework stuff # discover_node() # # parse service configuration file # class RawConfigParser instance name: 'conf' # svcmode = "hosted" conf = None kwargs = {'svcname': name} if os.path.isfile(svcconf): conf = ConfigParser.RawConfigParser() conf.read(svcconf) defaults = conf.defaults() if "mode" in defaults: svcmode = defaults["mode"] if "vm_name" in defaults: if svcmode not in rcEnv.vt_supported: log.error("can not set 'vm_name' with '%s' mode in %s env"%(svcmode, name)) return None vmname = defaults["vm_name"] kwargs['vmname'] = vmname if "vm_uuid" in defaults: if svcmode != "ovm": log.error("can not set 'vm_uuid' with '%s' mode in %s env"%(svcmode, name)) return None kwargs['vmuuid'] = defaults["vm_uuid"] if "guest_os" in defaults and \ len(defaults["guest_os"]) > 0: if svcmode not in rcEnv.vt_supported: log.error("can not set 'guest_os' with '%s' mode in %s env"%(svcmode, name)) return None guestos = defaults["guest_os"] kwargs['guestos'] = guestos elif svcmode in rcEnv.vt_supported: guestos = rcEnv.sysname kwargs['guestos'] = guestos if svcmode == 'jail': if not "jailroot" in defaults: log.error("jailroot parameter is mandatory for jail mode") return None jailroot = defaults["jailroot"] if not os.path.exists(jailroot): log.error("jailroot %s does not exist"%jailroot) return None kwargs['jailroot'] = jailroot kwargs['disabled'] = get_disabled(conf, "", "") # # dynamically import the module matching the service mode # and instanciate a service # log.debug('service mode = ' + svcmode) mod , svc_class_name = svcmode_mod_name(svcmode) svcMod = __import__(mod) svc = getattr(svcMod, svc_class_name)(**kwargs) svc.svcmode = svcmode if "presnap_trigger" in defaults: svc.presnap_trigger = defaults["presnap_trigger"].split() if "postsnap_trigger" in defaults: svc.postsnap_trigger = defaults["postsnap_trigger"].split() # # containerization options # if "containerize" in defaults: svc.containerize = bool(defaults["containerize"]) if "container_cpus" in defaults: svc.container_cpus = defaults["container_cpus"] if "container_cpu_shares" in defaults: svc.container_cpu_shares = defaults["container_cpu_shares"] if "container_mems" in defaults: svc.container_mems = defaults["container_mems"] if "container_mem_limit" in defaults: svc.container_mem_limit = defaults["container_mem_limit"] if "container_vmem_limit" in defaults: svc.container_vmem_limit = defaults["container_vmem_limit"] # # Store useful properties # svc.logfile = logfile svc.conf = svcconf svc.initd = svcinitd svc.config = conf # # Setup service properties from config file content # if "nodes" in defaults: svc.nodes = set(defaults["nodes"].split()) svc.nodes -= set(['']) else: svc.nodes = set([]) if "drpnodes" in defaults: svc.drpnodes = set(defaults["drpnodes"].split()) svc.drpnodes -= set(['']) else: svc.drpnodes = set([]) if "drpnode" in defaults: svc.drpnode = defaults["drpnode"] svc.drpnodes |= set([svc.drpnode]) svc.drpnodes -= set(['']) else: svc.drpnode = '' """ prune not managed service """ if rcEnv.nodename not in svc.nodes | svc.drpnodes: svc.log.error('service %s not managed here' % name) del(svc) return None if "cluster_type" in defaults: svc.clustertype = defaults["cluster_type"] else: svc.clustertype = 'failover' if 'flex' in svc.clustertype: svc.ha = True allowed_clustertype = ['failover', 'allactive', 'flex', 'autoflex'] if svc.clustertype not in allowed_clustertype: svc.log.error("invalid cluster type '%s'. allowed: %s"%(svc.svcname, svc.clustertype, ', '.join(allowed_clustertype))) del(svc) return None if "flex_primary" in defaults: svc.flex_primary = defaults["flex_primary"] else: svc.flex_primary = '' if "flex_min_nodes" in defaults: svc.flex_min_nodes = int(defaults["flex_min_nodes"]) else: svc.flex_min_nodes = 1 if svc.flex_min_nodes < 1: svc.log.error("invalid flex_min_nodes '%d' (<1)."%svc.flex_min_nodes) del(svc) return None nb_nodes = len(svc.nodes) if nb_nodes > 0 and svc.flex_min_nodes > nb_nodes: svc.log.error("invalid flex_min_nodes '%d' (>%d nb of nodes)."%(svc.flex_min_nodes, nb_nodes)) del(svc) return None if "flex_max_nodes" in defaults: svc.flex_max_nodes = int(defaults["flex_max_nodes"]) else: svc.flex_max_nodes = 0 if svc.flex_max_nodes < 0: svc.log.error("invalid flex_max_nodes '%d' (<0)."%svc.flex_max_nodes) del(svc) return None if "flex_cpu_low_threshold" in defaults: svc.flex_cpu_low_threshold = int(defaults["flex_cpu_low_threshold"]) else: svc.flex_cpu_low_threshold = 10 if svc.flex_cpu_low_threshold < 0: svc.log.error("invalid flex_cpu_low_threshold '%d' (<0)."%svc.flex_cpu_low_threshold) del(svc) return None if svc.flex_cpu_low_threshold > 100: svc.log.error("invalid flex_cpu_low_threshold '%d' (>100)."%svc.flex_cpu_low_threshold) del(svc) return None if "flex_cpu_high_threshold" in defaults: svc.flex_cpu_high_threshold = int(defaults["flex_cpu_high_threshold"]) else: svc.flex_cpu_high_threshold = 90 if svc.flex_cpu_high_threshold < 0: svc.log.error("invalid flex_cpu_high_threshold '%d' (<0)."%svc.flex_cpu_high_threshold) del(svc) return None if svc.flex_cpu_high_threshold > 100: svc.log.error("invalid flex_cpu_high_threshold '%d' (>100)."%svc.flex_cpu_high_threshold) del(svc) return None if "service_type" in defaults: svc.svctype = defaults["service_type"] else: svc.svctype = '' if svc.svctype not in rcEnv.allowed_svctype: svc.log.error('service %s type %s is not a known service type (%s)'%(svc.svcname, svc.svctype, ', '.join(allowed_svctype))) del(svc) return None """ prune service whose service type does not match host mode """ if svc.svctype != 'PRD' and rcEnv.host_mode == 'PRD': svc.log.error('service %s type %s is not allowed to run on this node (host mode %s)' % (svc.svcname, svc.svctype, rcEnv.host_mode)) del(svc) return None if "autostart_node" in defaults: svc.autostart_node = defaults["autostart_node"].split() else: svc.autostart_node = [] if "drp_type" in defaults: svc.drp_type = defaults["drp_type"] else: svc.drp_type = '' if "comment" in defaults: svc.comment = defaults["comment"] else: svc.comment = '' if "monitor_action" in defaults: svc.monitor_action = defaults["monitor_action"] if "app" in defaults: svc.app = defaults["app"] else: svc.app = '' if "drnoaction" in defaults: svc.drnoaction = defaults["drnoaction"] else: svc.drnoaction = False if "bwlimit" in defaults: svc.bwlimit = defaults["bwlimit"] else: svc.bwlimit = None # # instanciate resources # try: add_hbs(svc, conf) add_stoniths(svc, conf) add_ips(svc, conf) add_drbds(svc, conf) add_loops(svc, conf) add_vdisks(svc, conf) add_vgs(svc, conf) add_vmdg(svc, conf) add_pools(svc, conf) add_filesystems(svc, conf) add_apps(svc, conf) add_syncs(svc, conf) except (ex.excInitError, ex.excError), e: log.error(str(e)) return None return svc def is_service(f): svcmgr = os.path.join(rcEnv.pathsvc, 'bin', 'svcmgr') if os.path.realpath(f) != os.path.realpath(svcmgr): return False if not os.path.exists(f + '.env'): return False return True def list_services(): if not os.path.exists(rcEnv.pathetc): print "create dir %s"%rcEnv.pathetc os.makedirs(rcEnv.pathetc) if os.name == 'nt': import glob s = glob.glob(os.path.join(rcEnv.pathetc, '*.env')) s = map(lambda x: os.path.basename(x).replace('.env',''), s) return s # posix s = [] for name in os.listdir(rcEnv.pathetc): if not is_service(os.path.join(rcEnv.pathetc, name)): continue s.append(name) return s def build_services(status=None, svcnames=[], onlyprimary=False, onlysecondary=False): """returns a list of all services of status matching the specified status. If no status is specified, returns all services """ services = {} if type(svcnames) == str: svcnames = [svcnames] for name in list_services(): if len(svcnames) > 0 and name not in svcnames: continue fix_default_section([name]) try: svc = build(name) except (ex.excError, ex.excInitError, ex.excAbortAction): continue except: import traceback traceback.print_exc() continue if svc is None : continue if status is not None and svc.status() != status: continue if onlyprimary and rcEnv.nodename not in svc.autostart_node: continue if onlysecondary and rcEnv.nodename in svc.autostart_node: continue services[svc.svcname] = svc return [ s for n ,s in sorted(services.items()) ] def toggle_one(svcname, rids=[], disable=True): if len(svcname) == 0: print >>sys.stderr, "service name must not be empty" return 1 if svcname not in list_services(): print >>sys.stderr, "service", svcname, "does not exist" return 1 if len(rids) == 0: rids = ['DEFAULT'] envfile = os.path.join(rcEnv.pathetc, svcname+'.env') conf = ConfigParser.RawConfigParser() conf.read(envfile) for rid in rids: if rid != 'DEFAULT' and not conf.has_section(rid): print >>sys.stderr, "service", svcname, "has not resource", rid continue conf.set(rid, "disable", disable) try: f = open(envfile, 'w') except: print >>sys.stderr, "failed to open", envfile, "for writing" return 1 # # if we set DEFAULT.disable = True, # we don't want res#n.disable = False # if len(rids) == 0 and disable: for s in conf.sections(): if conf.has_option(s, "disable") and \ conf.getboolean(s, "disable") == False: conf.remove_option(s, "disable") conf.write(f) return 0 def disable_one(svcname, rids=[]): return toggle_one(svcname, rids, disable=True) def disable(svcnames, rid=[]): fix_default_section(svcnames) r = 0 for svcname in svcnames: r |= disable_one(svcname, rid) return r def enable_one(svcname, rids=[]): return toggle_one(svcname, rids, disable=False) def enable(svcnames, rid=[]): fix_default_section(svcnames) r = 0 for svcname in svcnames: r |= enable_one(svcname, rid) return r def delete_one(svcname, rids=[]): if len(svcname) == 0: print >>sys.stderr, "service name must not be empty" return 1 if svcname not in list_services(): print >>sys.stderr, "service", svcname, "does not exist" return 0 envfile = os.path.join(rcEnv.pathetc, svcname+'.env') conf = ConfigParser.RawConfigParser() conf.read(envfile) for rid in rids: if not conf.has_section(rid): print >>sys.stderr, "service", svcname, "has not resource", rid continue conf.remove_section(rid) try: f = open(envfile, 'w') except: print >>sys.stderr, "failed to open", envfile, "for writing" return 1 conf.write(f) return 0 def delete(svcnames, rid=[]): fix_default_section(svcnames) if len(rid) == 0: print "no resource flagged for deletion" return 0 r = 0 for svcname in svcnames: r |= delete_one(svcname, rid) return r def create(svcname, resources=[], interactive=False, provision=False): if not isinstance(svcname, list): print >>sys.stderr, "ouch, svcname should be a list object" return 1 if len(svcname) != 1: print >>sys.stderr, "you must specify a single service name with the 'create' action" return 1 svcname = svcname[0] if len(svcname) == 0: print >>sys.stderr, "service name must not be empty" return 1 if svcname in list_services(): print >>sys.stderr, "service", svcname, "already exists" return 1 envfile = os.path.join(rcEnv.pathetc, svcname+'.env') if os.path.exists(envfile): print >>sys.stderr, envfile, "already exists" return 1 try: f = open(envfile, 'w') except: print >>sys.stderr, "failed to open", envfile, "for writing" return 1 defaults = {} sections = {} rtypes = {} import json for r in resources: try: d = json.loads(r) except: print >>sys.stderr, "can not parse resource:", r return 1 if 'rid' in d: section = d['rid'] if '#' not in section: print >>sys.stderr, section, "must be formatted as 'rtype#n'" return 1 l = section.split('#') if len(l) != 2: print >>sys.stderr, section, "must be formatted as 'rtype#n'" return 1 rtype = l[1] if rtype in rtypes: rtypes[rtype] += 1 else: rtypes[rtype] = 0 del(d['rid']) if section in sections: sections[section].update(d) else: sections[section] = d elif 'rtype' in d: if 'rid' in d: del(d['rid']) rtype = d['rtype'] if rtype in rtypes: section = '%s#%d'%(rtype, rtypes[rtype]) rtypes[rtype] += 1 else: section = '%s#0'%rtype rtypes[rtype] = 1 if section in sections: sections[section].update(d) else: sections[section] = d else: defaults.update(d) from svcDict import KeyDict, MissKeyNoDefault, KeyInvalidValue try: keys = KeyDict(provision=provision) defaults.update(keys.update('DEFAULT', defaults)) for section, d in sections.items(): sections[section].update(keys.update(section, d)) except (MissKeyNoDefault, KeyInvalidValue): if not interactive: return 1 try: if interactive: defaults, sections = keys.form(defaults, sections) except KeyboardInterrupt: sys.stderr.write("Abort\n") return 1 conf = ConfigParser.RawConfigParser(defaults) for section, d in sections.items(): conf.add_section(section) for key, val in d.items(): if key == 'rtype': continue conf.set(section, key, val) conf.write(f) initdir = svcname+'.dir' if not os.path.exists(initdir): os.makedirs(initdir) fix_app_link(svcname) fix_exe_link(os.path.join('..', 'bin', 'svcmgr'), svcname) def update(svcname, resources=[], interactive=False, provision=False): fix_default_section(svcname) if not isinstance(svcname, list): print >>sys.stderr, "ouch, svcname should be a list object" return 1 if len(svcname) != 1: print >>sys.stderr, "you must specify a single service name with the 'create' action" return 1 svcname = svcname[0] if len(svcname) == 0: print >>sys.stderr, "service name must not be empty" return 1 if svcname not in list_services(): print >>sys.stderr, "service", svcname, "does not exist" return 1 envfile = os.path.join(rcEnv.pathetc, svcname+'.env') sections = {} rtypes = {} conf = ConfigParser.RawConfigParser() conf.read(envfile) defaults = conf.defaults() for section in conf.sections(): sections[section] = {} l = section.split('#') if len(l) == 2: rtype = l[0] ridx = l[1] if rtype not in rtypes: rtypes[rtype] = set([]) rtypes[rtype].add(ridx) for o, v in conf.items(section): if o in defaults.keys() + ['rtype']: continue sections[section][o] = v import json for r in resources: try: d = json.loads(r) except: print >>sys.stderr, "can not parse resource:", r return 1 if 'rid' in d: section = d['rid'] if '#' not in section: print >>sys.stderr, section, "must be formatted as 'rtype#n'" return 1 l = section.split('#') if len(l) != 2: print >>sys.stderr, section, "must be formatted as 'rtype#n'" return 1 del(d['rid']) if section in sections: sections[section].update(d) else: sections[section] = d elif 'rtype' in d: # new resource allocation, auto-allocated rid index if d['rtype'] in rtypes: ridx = 1 while str(ridx) in rtypes[d['rtype']]: ridx += 1 ridx = str(ridx) rtypes[d['rtype']].add(ridx) else: ridx = '1' rtypes[d['rtype']] = set([ridx]) section = '#'.join((d['rtype'], ridx)) del(d['rtype']) sections[section] = d else: defaults.update(d) conf = ConfigParser.RawConfigParser(defaults) for section, d in sections.items(): conf.add_section(section) for key, val in d.items(): conf.set(section, key, val) try: f = open(envfile, 'w') except: print >>sys.stderr, "failed to open", envfile, "for writing" return 1 conf.write(f) fix_app_link(svcname) fix_exe_link(os.path.join('..', 'bin', 'svcmgr'), svcname) def fix_app_link(svcname): os.chdir(rcEnv.pathetc) src = svcname+'.d' dst = svcname+'.dir' if os.name != 'posix': return try: p = os.readlink(src) except: if not os.path.exists(dst): os.makedirs(dst) os.symlink(dst, src) def fix_exe_link(dst, src): if os.name != 'posix': return os.chdir(rcEnv.pathetc) try: p = os.readlink(src) except: os.symlink(dst, src) p = dst if p != dst: os.unlink(src) os.symlink(dst, src) def _fix_default_section(svcname): """ [default] section is not returned by ConfigParser.defaults() [DEFAULT] is. Just replace when this occurs. """ envfile = os.path.join(rcEnv.pathetc, svcname+'.env') if not os.path.exists(envfile): # nothing to fix return try: f = open(envfile, 'r') except: print >>sys.stderr, "failed to open", envfile, "for reading" return 1 found = False lines = [] for line in f.readlines(): if line.startswith('[default]'): line = '[DEFAULT]\n' found = True lines.append(line) f.close() if found: try: f = open(envfile, 'w') except: print >>sys.stderr, "failed to open", envfile, "for writing" return 1 f.write(''.join(lines)) f.close() def fix_default_section(svcnames): for svcname in svcnames: _fix_default_section(svcname) 07070100024537000081b40000000000000000000000014faa950900000b28000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/rcAssetFreeBSD.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import datetime from rcUtilities import justcall, which from rcGlobalEnv import rcEnv import rcAssetLinux class Asset(rcAssetLinux.Asset): def _get_mem_bytes(self): cmd = ['sysctl', 'hw.realmem'] (out, err, ret) = justcall(cmd) if ret != 0: return '0' lines = out.split('\n') if len(lines) < 1: return '0' line = lines[0].split() if len(line) < 2: return '0' mb = int(line[-1]) return str(mb/1024/1024) def _get_os_vendor(self): return 'FreeBSD' def _get_os_release(self): return self._get_os_kernel() def _get_os_arch(self): cmd = ['sysctl', 'hw.machine_arch'] (out, err, ret) = justcall(cmd) if ret != 0: return 'Unknown' lines = out.split('\n') if len(lines) < 1: return 'Unknown' line = lines[0].split() if len(line) < 2: return 'Unknown' return line[-1] def _get_cpu_model(self): cmd = ['sysctl', 'hw.model'] (out, err, ret) = justcall(cmd) if ret != 0: return 'Unknown' lines = out.split('\n') if len(lines) < 1: return 'Unknown' line = lines[0].split() if len(line) < 2: return 'Unknown' return " ".join(line[1:]) def _get_cpu_cores(self): cmd = ['sysctl', 'hw.ncpu'] (out, err, ret) = justcall(cmd) if ret != 0: return 'Unknown' lines = out.split('\n') if len(lines) < 1: return 'Unknown' line = lines[0].split() if len(line) < 2: return 'Unknown' return line[-1] def _get_cpu_freq(self): cmd = ['sysctl', 'hw.clockrate'] (out, err, ret) = justcall(cmd) if ret != 0: return 'Unknown' lines = out.split('\n') if len(lines) < 1: return 'Unknown' line = lines[0].split() if len(line) < 2: return 'Unknown' return line[-1] 07070100024510000081b40000000000000000000000014faa95090000090e000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/checkMpathSunOS.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): """ # mpathadm list LU /dev/rdsk/c6t600507680280809AB0000000000000E7d0s2 Total Path Count: 4 Operational Path Count: 4 """ chk_type = "mpath" def find_svc(self, dev): for svc in self.svcs: if dev in svc.disklist(): return svc.svcname return '' def do_check(self): cmd = ['mpathadm', 'list', 'LU'] out, err, ret = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 4: return self.undef r = [] dev = None wwid = "" for line in lines: if "/dev/" in line: # new mpath # - store previous # - reset path counter if dev is not None: r.append({'chk_instance': wwid, 'chk_value': str(n), 'chk_svcname': self.find_svc(dev), }) n = 0 dev = line.strip() wwid = line[line.index('t')+1:line.rindex('d')] if "Operational Path Count:" in line: n = int(line.split(':')[-1].strip()) if dev is not None: r.append({'chk_instance': wwid, 'chk_value': str(n), 'chk_svcname': self.find_svc(dev), }) return r 0707010002454e000081b40000000000000000000000014faa950900000bc2000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/rcIbmSvc.pyfrom rcUtilities import justcall, which import rcExceptions as ex import os import ConfigParser pathlib = os.path.dirname(__file__) pathbin = os.path.realpath(os.path.join(pathlib, '..', 'bin')) pathetc = os.path.realpath(os.path.join(pathlib, '..', 'etc')) pathtmp = os.path.realpath(os.path.join(pathlib, '..', 'tmp')) if pathbin not in os.environ['PATH']: os.environ['PATH'] += ":"+pathbin def rcmd(cmd, manager, username, key): _cmd = ['ssh', '-i', key, '@'.join((username, manager))] _cmd += [cmd] out, err, ret = justcall(_cmd) if ret != 0: print _cmd print out raise ex.excError("ssh command execution error") return out, err class IbmSvcs(object): def __init__(self): self.arrays = [] self.index = 0 cf = os.path.join(pathetc, "auth.conf") if not os.path.exists(cf): return conf = ConfigParser.RawConfigParser() conf.read(cf) m = {} for s in conf.sections(): if not conf.has_option(s, "type") or \ conf.get(s, "type") != "ibmsvc": continue try: username = conf.get(s, 'username') key = conf.get(s, 'key') m[s] = [username, key] except: print "error parsing section", s pass del(conf) for name, creds in m.items(): username, key = creds self.arrays.append(IbmSvc(name, username, key)) def __iter__(self): return self def next(self): if self.index == len(self.arrays): raise StopIteration self.index += 1 return self.arrays[self.index-1] class IbmSvc(object): def __init__(self, name, username, key): self.name = name self.username = username self.key = key #self.keys = ['lsvdisk'] self.keys = ['lsvdisk', 'lsmdiskgrp', 'lsnode', 'lscluster', 'svc_product_id', 'lsfabric'] def rcmd(self, cmd): return rcmd(cmd, self.name, self.username, self.key) def get_lsvdisk(self): cmd = 'lsvdisk -delim :' print "%s: %s"%(self.name, cmd) return self.rcmd(cmd)[0] def get_lsmdiskgrp(self): cmd = 'lsmdiskgrp -delim :' print "%s: %s"%(self.name, cmd) return self.rcmd(cmd)[0] def get_lsnode(self): cmd = 'lsnode -delim !' print "%s: %s"%(self.name, cmd) return self.rcmd(cmd)[0] def get_lscluster(self): cmd = 'lscluster -delim :' print "%s: %s"%(self.name, cmd) return self.rcmd(cmd)[0] def get_lsfabric(self): cmd = 'lsfabric -delim :' print "%s: %s"%(self.name, cmd) return self.rcmd(cmd)[0] def get_svc_product_id(self): cmd = 'echo $SVC_PRODUCT_ID' print "%s: %s"%(self.name, cmd) return self.rcmd(cmd)[0] if __name__ == "__main__": o = IbmSvcs() for ibmsvc in o: print ibmsvc.lsmdiskgrp() 07070100024554000081b40000000000000000000000014faa9509000004f2000000ae00010002ffffffffffffffff0000002d00000000root/opt/opensvc/lib/rcIfconfigFreeBSDkvm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcExceptions as ex from subprocess import * rcIfconfig = __import__("rcIfconfigFreeBSD") from rcGlobalEnv import rcEnv class ifconfig(rcIfconfig.ifconfig): def __init__(self, hostname): self.intf = [] cmd = rcEnv.rsh.split(' ') + [hostname, 'ifconfig', '-a'] p = Popen(cmd, stdout=PIPE) buff = p.communicate()[0] if p.returncode != 0: raise ex.excError self.parse(buff) 07070100024604000081b40000000000000000000000014faa9509000005e2000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/svcHpVm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc import resContainerHpVm as hpvm import rcStatus import rcExceptions as ex from rcGlobalEnv import rcEnv class SvcHpVm(svc.Svc): """ Define hpvm services""" def __init__(self, svcname, vmname=None, guestos=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmname = vmname self.guestos = guestos self += hpvm.HpVm(vmname, disabled=disabled) self.runmethod = rcEnv.rsh.split() + [vmname] 070701000245c0000081b40000000000000000000000014faa9509000007ba000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resIpAIX.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. "Module implement Linux specific ip management" import resIp as Res import rcExceptions as ex from rcUtilitiesAIX import check_ping class Ip(Res.Ip): def check_ping(self): self.log.info("checking %s availability"%self.addr) return check_ping(self.addr) def arp_announce(self): return def startip_cmd(self): if ':' in self.addr: if '.' in self.mask: self.log.error("netmask parameter is mandatory for ipv6 adresses") raise ex.excError cmd = ['ifconfig', self.ipDev, 'inet6', 'alias', '/'.join([self.addr, self.mask])] else: cmd = ['ifconfig', self.ipDev, self.addr, 'netmask', self.mask, 'alias'] return self.vcall(cmd) def stopip_cmd(self): if ':' in self.addr: cmd = ['ifconfig', self.ipDev, 'inet6', self.addr, 'delete'] else: cmd = ['ifconfig', self.ipDev, self.addr, 'delete'] return self.vcall(cmd) if __name__ == "__main__": for c in (Ip,) : help(c) 07070100024569000081fd0000000000000000000000014faa950900002dc8000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/rcNexenta.py#!/opt/opensvc/bin/python # # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import json import urllib2 import base64 import os import rcExceptions as ex class logger(object): def __init__(self): pass def info(self, msg): print msg def warning(self, msg): print msg def error(self, msg): print msg class Nexenta(object): def __init__(self, head, log=None): self.object_type_cache = {} self.head = head self.auto_prefix = "svc:/system/filesystem/zfs/auto-sync:" self.username = None self.password = None self.port = 2000 if log is not None: self.log = log else: self.log = logger() def init(self): if self.username is not None and self.password is not None: return import ConfigParser cf = os.path.join(os.path.dirname(__file__), '..', 'etc', "auth.conf") self.conf = ConfigParser.RawConfigParser() self.conf.read(cf) if not self.conf.has_section(self.head): raise ex.excError("no auth information for head %s"%self.head) if not self.conf.has_option(self.head, "username"): raise ex.excError("no username information for head %s"%self.head) if not self.conf.has_option(self.head, "password"): raise ex.excError("no password information for head %s"%self.head) self.username = self.conf.get(self.head, "username") self.password = self.conf.get(self.head, "password") if self.conf.has_option(self.head, "port"): self.port = self.conf.get(self.head, "port") self.url = 'https://%(head)s:%(port)d/rest/nms/ '%dict(head=self.head, port=self.port) def rest(self, obj, method, params): self.init() data = {"method": method, "params": params, "object": obj} data = json.dumps(data) request = urllib2.Request(self.url, data) base64string = base64.encodestring('%s:%s' % (self.username, self.password))[:-1] request.add_header('Authorization', 'Basic %s' % base64string) request.add_header('Content-Type' , 'application/json') try: response = urllib2.urlopen(request) except urllib2.URLError: raise ex.excError("unreachable head %s"%self.head) response = json.loads(response.read()) return response def dbus_auth_keys_list(self): data = self.rest("appliance", "dbus_auth_keys_list", []) if data['error'] is not None: raise ex.excError(data['error']) return data['result'] def ssh_list_bindings(self): data = self.rest("appliance", "ssh_list_bindings", []) if data['error'] is not None: raise ex.excError(data['error']) return data['result'] def ssh_unbind(self, user, hostport, force="0"): data = self.rest("appliance", "ssh_unbind", [user, hostport, force]) if data['error'] is not None: raise ex.excError(data['error']) return data['result'] def ssh_bind(self, user, hostport, password): data = self.rest("appliance", "ssh_bind", [user, hostport, password]) if data['error'] is not None: raise ex.excError(data['error']) return data['result'] def autosync_get_names(self): data = self.rest("autosync", "get_names", ['']) if data['error'] is not None: raise ex.excError(data['error']) return data['result'] def autosync_disable(self, name): if not name.startswith(self.auto_prefix): name = self.auto_prefix+name data = self.rest("autosync", "disable", [name]) if data['error'] is not None: raise ex.excError(data['error']) return data['result'] def autosync_enable(self, name): if not name.startswith(self.auto_prefix): name = self.auto_prefix+name data = self.rest("autosync", "enable", [name]) if data['error'] is not None: raise ex.excError(data['error']) return data['result'] def autosync_execute(self, name): if not name.startswith(self.auto_prefix): name = self.auto_prefix+name data = self.rest("autosync", "execute", [name]) if data['error'] is not None: raise ex.excError(data['error']) return data['result'] def autosync_get_state(self, name): if not name.startswith(self.auto_prefix): name = self.auto_prefix+name data = self.rest("autosync", "get_state", [name]) if data['error'] is not None: raise ex.excError(data['error']) return data['result'] def autosync_set_prop(self, name, prop, value): if not name.startswith(self.auto_prefix): name = self.auto_prefix+name data = self.rest("autosync", "set_child_prop", [name, prop, value]) if data['error'] is not None: raise ex.excError(data["error"]) return data['result'] def autosync_get_props(self, name): if not name.startswith(self.auto_prefix): name = self.auto_prefix+name data = self.rest("autosync", "get_child_props", [name, '']) if data['error'] is not None: raise ex.excError(data["error"]) return data['result'] def autosync_register(self, name): if not name.startswith(self.auto_prefix): name = self.auto_prefix+name data = self.rest("runner", "register", [name, {}, {}]) if data['error'] is not None: raise ex.excError(data["error"]) return data['result'] def zvol_clone(self, src, dst): data = self.rest("zvol", "clone", [src, dst]) if data['error'] is not None: raise ex.excError(data["error"]) def folder_clone(self, src, dst): data = self.rest("folder", "clone", [src, dst]) if data['error'] is not None: raise ex.excError(data["error"]) def clone(self, src, dst): snap = "@".join([src, dst.replace('/','_')]) object_type = self.object_type(src) if object_type == "folder": self.folder_clone(snap, dst) elif object_type == "zvol": self.zvol_clone(snap, dst) else: raise ex.excError("object type %s is not cloneable"%str(object_type)) def snapshot_create(self, src, dst, recursive=0): dst = dst.replace('/','_') object_type = self.object_type(src) if object_type == "folder": self.folder_snapshot(src, dst, recursive) elif object_type == "zvol": self.zvol_snapshot(src, dst, recursive) else: raise ex.excError("object type %s is not snapable"%str(object_type)) def zvol_snapshot(self, src, dst, recursive=0): data = self.rest("zvol", "create_snapshot", [src, dst, recursive]) if data['error'] is not None: raise ex.excError(data["error"]) def folder_snapshot(self, src, dst, recursive=0): snap = "@".join([src, dst]) data = self.rest("snapshot", "create", [snap, recursive]) if data['error'] is not None: raise ex.excError(data["error"]) def snapshot_destroy(self, src, dst, recursive=''): snap = "@".join([src, dst]) data = self.rest("snapshot", "destroy", [snap, recursive]) if data['error'] is not None: raise ex.excError(data["error"]) def snapshot_get_names(self): data = self.rest("snapshot", "get_names", ['']) if data['error'] is not None: raise ex.excError(data["error"]) return data['result'] def folder_get_names(self): data = self.rest("folder", "get_names", ['']) if data['error'] is not None: raise ex.excError(data["error"]) for folder in data['result']: self.object_type_cache[folder] = "folder" return data['result'] def zvol_get_names(self): data = self.rest("zvol", "get_names", ['']) if data['error'] is not None: raise ex.excError(data["error"]) for zvol in data['result']: self.object_type_cache[folder] = "zvol" return data['result'] def object_type(self, o): if o in self.object_type_cache: return self.object_type_cache[o] if o in self.folder_get_names(): self.object_type_cache[o] = "folder" return "folder" elif o in self.zvol_get_names(): self.object_type_cache[o] = "zvol" return "zvol" else: raise ex.excError("can not determine type of object %s"%o) def set_prop(self, name, prop, val): otype = self.object_type(name) return self._set_prop(otype, name, prop, val) def _set_prop(self, otype, name, prop, val): data = self.rest(otype, "set_child_prop", [name, prop, val]) if data['error'] is not None: raise ex.excError(data["error"]) return data['result'] def get_props(self, name): otype = self.object_type(name) return self._get_props(otype, name) def _get_props(self, otype, name): data = self.rest(otype, "get_child_props", [name, '']) if data['error'] is not None: raise ex.excError(data["error"]) return data['result'] def set_can_mount(self, name): p = self.get_props(name) if not 'canmount' in p: return self.set_prop(name, "canmount", "on") def autosync_set_can_mount(self, name): folders = self.folder_get_names() props = self.autosync_get_props(name) if props['zfs/from-host'] == 'localhost': synchead = props['zfs/from-fs'] else: synchead = props['zfs/to-fs'] synchead = synchead.lstrip('/') for folder in folders: if not folder.startswith(synchead): continue self.set_can_mount(folder) self.log.info("set 'canmount = on' on folder %s"%folder) def snapclone(self, src, dst): self.snapshot_create(src, dst) self.clone(src, dst) if __name__ == "__main__": o = Nexenta("nexenta1") #names = o.autosync_register("test") #print o.set_prop("vol1/folder1", "canmount", "on") #print o.get_props("vol1/folder1") print Nexenta("nexenta1").dbus_auth_keys_list() print Nexenta("nexenta2").dbus_auth_keys_list() #print o.autosync_set_can_mount("vol1-folder1-000") #names = o.autosync_get_names() #print o.autosync_set_prop(names[0], "zfs/reverse_capable", "1") #print o.autosync_get_state(names[0]) #print o.autosync_get_props(names[0]) #print o.snapshot_create("vol1/zvol1", "test") #print o.snapshot_get_names() #print o.snapshot_destroy("vol1/zvol1", "test") #print o.snapclone("vol1/folder1", "vol1/folder2") 070701000245a4000081b40000000000000000000000014faa950900000106000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/rcUtilitiesHP-UX.pyfrom rcUtilities import call def check_ping(addr, timeout=5, count=1): cmd = ['ping', addr, '-n', repr(count), '-m', repr(timeout)] (ret, out, err) = call(cmd) if ret == 0: return True return False 07070100024567000081b40000000000000000000000014faa950900000792000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/rcMountsSunOS.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcMounts from rcUtilities import * class Mounts(rcMounts.Mounts): def match_mount(self, i, dev, mnt): """Given a line of 'mount' output, returns True if (dev, mnt) matches this line. Returns False otherwize. Also care about weirdos like loops and binds, ... """ if i.mnt != mnt: return False if i.dev == dev: return True return False def __init__(self): self.mounts = [] (ret, out, err) = call(['mount','-p'], outdebug=False) for line in out.split('\n'): words=line.split() if len(words) < 6 : continue elif words[1]+words[4] != '--' : # ignore mount line with space in mountpoint or dev continue elif len(words) == 6 : words.append('-') dev, null, mnt, type, null, null, mnt_opt = words m = rcMounts.Mount(dev, mnt, type, mnt_opt.strip('()')) self.mounts.append(m) if __name__ == "__main__" : help(Mounts) M=Mounts() print M 0707010002460a000081b40000000000000000000000014faa950900000587000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/svcVbox.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc import resContainerVbox as vbox from rcGlobalEnv import rcEnv class SvcVbox(svc.Svc): def __init__(self, svcname, vmname=None, guestos=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmname = vmname self.guestos = guestos self += vbox.Vbox(vmname, disabled=disabled) self.runmethod = rcEnv.rsh.split() + [vmname] 070701000245f9000081b40000000000000000000000014faa950900002e4e000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/resources.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import rcExceptions as exc import rcStatus import logging import rcUtilities from rcGlobalEnv import rcEnv class Resource(object): """Define basic resource properties: type, optional=optional, disabled=disabled, tags=tags a Resource should provide do_action(action): with action into (start/stop/status) """ label = None def __init__(self, rid=None, type=None, optional=False, disabled=False, monitor=False, tags=set([])): self.rid = rid self.tags = tags self.type = type self.optional = optional self.disabled = disabled self.monitor = monitor self.log = logging.getLogger(str(rid).upper()) self.rstatus = None self.always_on = set([]) if self.label is None: self.label = type self.status_log_str = "" def __str__(self): output="object=%s rid=%s type=%s" % (self.__class__.__name__, self.rid, self.type) if self.optional : output+=" opt="+str(self.optional) if self.disabled : output+=" disa="+str(self.disabled) return output def __cmp__(self, other): """resources needed to be started or stopped in a specific order should redefine that. For now consider all resources of a set equals """ return 0 def print_exc(self): import traceback try: self.log.error(traceback.format_exc()) except: self.log.error("unexpected error") traceback.print_exc() def save_exc(self): import traceback try: import tempfile import datetime now = str(datetime.datetime.now()).replace(' ', '-') f = tempfile.NamedTemporaryFile(dir=rcEnv.pathtmp, prefix='exc-'+now+'-') f.close() f = open(f.name, 'w') traceback.print_exc(file=f) self.log.error("unexpected error. stack saved in %s"%f.name) f.close() except: self.log.error("unexpected error") traceback.print_exc() def setup_environ(self): """ setup environement variables for use by triggers and startup scripts. This method needs defining in each class with their class variable. Env vars names should, by convention, be prefixed by OPENSVC_ """ pass def is_optional(self): return self.optional def is_disabled(self): return self.disabled def set_optional(self): self.optional=True def unset_optional(self): self.optional=False def disable(self): self.disabled=True def enable(self): self.disabled=False def action_triggers(self, type, action): attr = type+"_"+action if hasattr(self, attr): self.vcall(getattr(self, attr)) def do_action(self, action): self.log.debug('do_action: action=%s res=%s'%(action, self.rid)) if hasattr(self, action): if "stop" in action and rcEnv.nodename in self.always_on and not self.svc.force: if hasattr(self, action+'standby'): getattr(self, action+'standby')() return else: self.log.info("skip '%s' on standby resource (--force to override)"%action) return self.setup_environ() self.action_triggers("pre", action) getattr(self, action)() self.action_triggers("post", action) if "start" in action or "stop" in action or "sync" in action or action == "provision": """ refresh resource status cache after changing actions """ self.status(refresh=True) return """Every class inheriting resource should define start() stop() status() Alert on these minimal implementation requirements """ if action in ("start","stop","status") : raise exc.excUndefined(action,self.__class__.__name__,\ "Resource.do_action") def action(self, action=None): """ action() try to call do_action() on self return if action is not None or if self is disabled return status depends on optional property value: if self is optional then return True else return do_action() return value """ self.log.debug('action: action=%s res=%s'%(action, self.rid)) if action == None: self.log.debug('action: action cannot be None') return True if self.disabled: self.log.debug('action: skip action on disabled resource') return True try : self.do_action(action) except exc.excUndefined , ex: print ex return False except exc.excError: if self.optional: pass else: raise def status_stdby(self, s): """ This function modifies the passed status according to this node inclusion in the always_on nodeset """ if rcEnv.nodename not in self.always_on: return s if s == rcStatus.UP: return rcStatus.STDBY_UP elif s == rcStatus.DOWN: return rcStatus.STDBY_DOWN return s def _status(self, verbose=False): return rcStatus.UNDEF def status(self, verbose=False, refresh=False): if self.disabled: self.status_log("disabled") return rcStatus.NA if self.rstatus is None or refresh: self.status_log_str = "" self.rstatus = self._status(verbose) return self.rstatus def status_log(self, text): self.status_log_str += "# " + text + "\n" def status_quad(self): r = self.status(verbose=True) return (self.rid, rcStatus.status_str(r), self.label, self.status_log_str, self.monitor, self.disabled, self.optional) def call(self, cmd=['/bin/false'], cache=False, info=False, errlog=True, err_to_warn=False, err_to_info=False, outlog=False): """Use subprocess module functions to do a call """ return rcUtilities.call(cmd, log=self.log, cache=cache, info=info, errlog=errlog, err_to_warn=err_to_warn, err_to_info=err_to_info, outlog=outlog) def vcall(self, cmd, err_to_warn=False, err_to_info=False): """Use subprocess module functions to do a call and log the command line using the resource logger """ return rcUtilities.vcall(cmd, log=self.log, err_to_warn=err_to_warn, err_to_info=err_to_info) def devlist(self): return self.disklist() def disklist(self): """List disks the resource holds. Some resource have none, and can leave this function as is. """ return set() def presync(self): pass def postsync(self): pass def provision(self): pass def files_to_sync(self): return [] class ResourceSet(Resource): """ Define Set of same type resources Example 1: ResourceSet("fs",[m1,m2]) Example 2: r=ResourceSet("fs",[ip1]) It define the resource type """ def __init__(self, type=None, resources=[], optional=False, disabled=False, tags=set([])): self.resources = [] Resource.__init__(self, type=type, optional=optional, disabled=disabled, tags=tags) for r in resources: self += r def __iadd__(self,r): """Example 1 iadd another ResourceSet: R+=ResSet ... R+=[m1,m2] Example 2 : iadd a single Resource : R+=ip1 """ if isinstance(r,ResourceSet) : self.resources.extend(r.resources) elif isinstance(r,Resource) : """ Setup a back pointer to the resource set """ r.rset = self self.resources.append(r) if hasattr(r, 'pre_action'): r.log.debug("install pre_action") self.pre_action = r.pre_action if hasattr(r, 'post_action'): r.log.debug("install post_action") self.post_action = r.post_action return (self) def __str__(self): output="resSet %s [" % ( Resource.__str__(self) ) for r in self.resources: output+= " (%s)" % (r.__str__()) return "%s]" % (output) def pre_action(self, rset=None, action=None): pass def post_action(self, rset=None, action=None): pass def status(self, verbose=False): """aggregate status a ResourceSet """ s = rcStatus.Status() for r in self.resources: if r.is_disabled(): continue try: status = r.status() except: import sys import traceback e = sys.exc_info() print e[0], e[1], traceback.print_tb(e[2]) status = rcStatus.NA s += status return s.status def tag_match(self, rtags, keeptags): if len(keeptags) == 0: return True for tag in rtags: if tag in keeptags: return True return False def action(self, action=None, tags=set([])): """Call action on each resource of the ResourceSet """ resources = [r for r in self.resources if self.tag_match(r.tags, tags)] self.log.debug("resources after tags[%s] filter: %s"%(str(tags), str(resources))) if action in ["fs", "start", "startstandby", "provision"]: resources.sort() else: resources.sort(reverse=True) for r in resources: try: r.action(action) except exc.excAbortAction: break if __name__ == "__main__": for c in (Resource,ResourceSet) : help(c) print """m1=Resource("Type1")""" m1=Resource("Type1") print "m1=",m1 print """m2=Resource("Type1")""" m2=Resource("Type1") print "m1=",m1 print "m2=",m2 print """sets=ResourceSet("TypeRes2")""" sets=ResourceSet("TypeRes2") print "sets=", sets print """sets+=m1""" sets+=m1 print "sets=", sets print """sets+=m2""" sets+=m2 print "sets=", sets 070701000245ca000081b40000000000000000000000014faa95090000076e000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/resIpSunOS.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. "Module implement SunOS specific ip management" import resIp as Res from subprocess import * from rcUtilitiesSunOS import check_ping import rcExceptions as ex class Ip(Res.Ip): """ define ip SunOS start/stop doAction """ def arp_announce(self): """ arp_announce job is done by SunOS ifconfig... """ return def check_ping(self): self.log.info("checking %s availability"%self.addr) return check_ping(self.addr, timeout=2) def check_not_ping_raise(self): self.log.info("checking %s availability"%self.addr) if check_ping(self.addr, timeout=2): raise ex.excError def startip_cmd(self): cmd=['ifconfig', self.stacked_dev, 'plumb', self.addr, \ 'netmask', '+', 'broadcast', '+', 'up'] return self.vcall(cmd) def stopip_cmd(self): cmd = ['ifconfig', self.stacked_dev, 'unplumb'] return self.vcall(cmd) if __name__ == "__main__": for c in (Ip,) : help(c) 07070100024514000081b40000000000000000000000014faa950900000846000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/checkVgUsageAIX.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "vg_u" def find_svc(self, vgname): for svc in self.svcs: for rs in svc.get_res_sets('disk.vg'): for r in rs.resources: if r.name == vgname: return svc.svcname return '' def do_check(self): r = [] cmd = ['lsvg'] out, err, ret = justcall(cmd) if ret != 0: return self.undef vgs = out.split('\n') for vg in vgs: r += self._do_check(vg) return r def _do_check(self, vg): cmd = ['lsvg', '-p', vg] out, err, ret = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 3: return self.undef r = [] for line in lines[2:]: l = line.split() if len(l) != 5: continue size = int(l[2]) free = int(l[3]) val = int(100*(size-free)/size) r.append({'chk_instance': vg, 'chk_value': str(val), 'chk_svcname': self.find_svc(l[0]), } ) return r 070701000245fe000081b40000000000000000000000014faa95090000088d000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/snapZfsSunOS.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from rcUtilities import justcall import rcExceptions as ex import snap from rcZfs import dataset_exists class Snap(snap.Snap): """Defines a snap object with ZFS """ def snapcreate(self, m): """ create a snapshot for m add self.snaps[m] with dict(snapinfo key val) """ dataset = m.device if not dataset_exists(dataset, 'filesystem'): raise ex.syncNotSnapable snapdev = dataset +'@osvc_sync' mountPoint = m.mountPoint snapMountPoint= mountPoint + '/.zfs/snapshot/osvc_sync/' if dataset_exists(snapdev, 'snapshot'): (ret, buff, err) = self.vcall(['zfs', 'destroy', snapdev ]) if ret != 0: raise ex.syncSnapDestroyError (ret, buff, err) = self.vcall(['zfs', 'snapshot', snapdev ]) if ret != 0: raise ex.syncSnapCreateError self.snaps[mountPoint]={'snap_mnt' : snapMountPoint, \ 'snapdev' : snapdev } def snapdestroykey(self, snap_key): """ destroy a snapshot for a mountPoint """ snapdev = self.snaps[snap_key]['snapdev'] if not dataset_exists(snapdev, 'snapshot'): return (ret, buff, err) = self.vcall(['zfs', 'destroy', snapdev ]) if ret != 0: raise ex.syncSnapDestroyError 070701000245a1000081b40000000000000000000000014faa950900000146000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/rcUtilitiesAIX.pyimport os import re from rcUtilities import call def check_ping(addr, timeout=5, count=1): cmd = ['ping', '-c', repr(count), '-w', repr(timeout)] if ':' in addr: cmd += ['-a', 'inet6'] cmd += [addr] (ret, out, err) = call(cmd) if ret == 0: return True return False 07070100024574000081b40000000000000000000000014faa95090000071e000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/rcPkgLinux.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcUtilities import call, which from rcGlobalEnv import rcEnv def listpkg_dummy(): print "pushpkg supported on this system" return [] def listpkg_rpm(): (ret, out, err) = call(cmd, errlog=False, cache=True) lines = [] for line in out.split('\n'): l = line.split() if len(l) != 3: continue x = [rcEnv.nodename] + l lines.append(x) return lines def listpkg_deb(): (ret, out, err) = call(cmd, errlog=False, cache=True) lines = [] arch = "" for line in out.split('\n'): l = line.split() if len(l) < 4: continue if l[0] != "ii": continue x = [rcEnv.nodename] + l[1:3] + [arch] lines.append(x) return lines if which('dpkg') is not None: cmd = ['dpkg', '-l'] listpkg = listpkg_deb elif which('rpm') is not None: cmd = ['rpm', '-qa', '--queryformat=%{n} %{v}-%{r} %{arch}\n'] listpkg = listpkg_rpm else: cmd = ['true'] listpkg = listpkg_dummy def listpatch(): return [] 0707010002459a000081b40000000000000000000000014faa950900001494000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/rcStatsFreeBSD.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2011 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcUtilities import call, which import rcStats class StatsProvider(rcStats.StatsProvider): def cpu(self, d, day, start, end): cols = ['date', 'usr', 'sys', 'nice', 'irq', 'idle', 'cpu', 'nodename'] cmd = ['bsdsar', '-u', '-n', day] (ret, buff, err) = call(cmd, errlog=False) lines = [] if ret != 0: return cols, lines for line in buff.split('\n'): l = line.split() if len(l) != 6: continue if l[0] == 'Time': continue l += ['ALL', self.nodename] l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines def kb(self, s): n = int(s[0:-1]) unit = s[-1] if unit == 'k' or unit =='K': return n elif unit == 'M': return n*1024 elif unit == 'G': return n*1024*1024 elif unit == 'T': return n*1024*1024*1204 elif unit == 'P': return n*1024*1024*1204*1024 def mem_u(self, d, day, start, end): cols = ['date', 'kbmemfree', 'kbmemused', 'pct_memused', 'kbmemsys', 'nodename'] cmd = ['sysctl', 'hw.physmem'] (ret, out, err) = call(cmd) physmem = int(out.split(': ')[1])/1024 cmd = ['sysctl', 'hw.usermem'] (ret, out, err) = call(cmd) usermem = int(out.split(': ')[1])/1024 cmd = ['bsdsar', '-r', '-n', day] (ret, buff, err) = call(cmd) lines = [] for line in buff.split('\n'): l = line.split() if len(l) != 7: continue if l[0] == 'Time': continue free = self.kb(l[1]) used = self.kb(l[2])+self.kb(l[3]) x = [l[0], str(free), str(used), str(used/(used+free)), str(physmem-usermem), self.nodename] x[0] = '%s %s'%(d, x[0]) lines.append(x) return cols, lines def swap(self, d, day, start, end): cols = ['date', 'kbswpfree', 'kbswpused', 'pct_swpused', 'kbswpcad', 'pct_swpcad', 'nodename'] cmd = ['bsdsar', '-r', '-n', day] (ret, buff, err) = call(cmd, errlog=False) lines = [] if ret != 0: return cols, lines for line in buff.split('\n'): l = line.split() if len(l) != 7: continue if l[0] == 'Time': continue free = self.kb(l[6]) used = self.kb(l[5]) x = [l[0], str(free), str(used), str(used/(free+used)), '0', '0'] x.append(self.nodename) x[0] = '%s %s'%(d, x[0]) lines.append(x) return cols, lines def netdev(self, d, day, start, end): cols = ['date', 'rxpckps', 'rxkBps', 'txpckps', 'txkBps', 'dev', 'nodename'] cmd = ['bsdsar', '-I', '-n', day] (ret, buff, err) = call(cmd, errlog=False) lines = [] if ret != 0: return cols, lines for line in buff.split('\n'): l = line.split() if len(l) != 9: continue if l[0] == 'Time': continue x = [l[0], l[1], l[3], l[4], l[6], l[8], self.nodename] x[0] = '%s %s'%(d, x[0]) lines.append(x) return cols, lines def netdev_err(self, d, day, start, end): cols = ['date', 'rxerrps', 'txerrps', 'collps', 'dev', 'nodename'] cmd = ['bsdsar', '-I', '-n', day] (ret, buff, err) = call(cmd, errlog=False) lines = [] if ret != 0: return cols, lines for line in buff.split('\n'): l = line.split() if len(l) != 9: continue if l[0] == 'Time': continue x = [l[0], l[2], l[5], l[7], l[8], self.nodename] x[0] = '%s %s'%(d, l[0]) lines.append(x) return cols, lines 070701000245b2000081b40000000000000000000000014faa950900001392000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/resContainerLdom.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import resources as Res import rcExceptions as ex from rcUtilities import qcall from rcUtilitiesSunOS import check_ping import resContainer from rcGlobalEnv import rcEnv import os class Ldom(resContainer.Container): def __init__(self, name, optional=False, disabled=False, monitor=False, tags=set([])): resContainer.Container.__init__(self, rid="ldom", name=name, type="container.ldom", optional=optional, disabled=disabled, monitor=monitor, tags=tags) self.shutdown_timeout = 240 self.sshbin = '/usr/local/bin/ssh' def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def files_to_sync(self): import glob a = [] ldomf = os.path.join(rcEnv.pathvar, 'ldom_'+self.name+'.*') files = glob.glob(ldomf) if len(files) > 0: a += files return a def check_capabilities(self): cmd = ['/usr/sbin/ldm', 'list' ] (ret, out, err) = self.call(cmd) if ret != 0: return False return True def state(self): """ ldm state : None/inactive/bound/active ldm list -p domainname outputs: VERSION DOMAIN|[varname=varvalue]* """ cmd = ['/usr/sbin/ldm', 'list', '-p', self.name] (ret, out, err) = self.call(cmd) if ret != 0: return None for word in out.split("|"): a=word.split('=') if len(a) == 2: if a[0] == 'state': return a[1] return None def ping(self): return check_ping(self.addr) def container_action(self,action): cmd = ['/usr/sbin/ldm', action, self.name] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError return None def container_start(self): """ ldm bind domain ldm start domain """ state = self.state() if state == 'None': raise ex.excError if state == 'inactive': self.container_action('bind') self.container_action('start') if state == 'bound' : self.container_action('start') def container_forcestop(self): """ ldm unbind domain ldm stop domain """ if self.state == 'active': try: self.container_action('stop') except ex.excError: pass self.container_action('unbind') def container_stop(self): """ launch init 5 into container wait_for_shutdown ldm stop domain ldm unbind domain """ state = self.state() if state == 'None': raise ex.excError if state == 'inactive': return None if state == 'bound' : self.container_action('unbind') if state == 'active' : cmd = rcEnv.rsh.split() + [ self.name, '/usr/sbin/init', '5' ] (ret, buff, err) = self.vcall(cmd) if ret == 0: try: self.log.info("wait for container shutdown") self.wait_for_fn(self.is_shutdown, self.shutdown_timeout, 2) except ex.excError: pass self.container_forcestop() def check_manual_boot(self): cmd = ['/usr/sbin/ldm', 'list-variable', 'auto-boot?', self.name] (ret, out, err) = self.call(cmd) if ret != 0: return False if out != 'auto-boot?=False' : return True self.log.info("Auto boot should be turned off") return False def is_shutdown(self): state = self.state() if state == 'inactive' or state == 'bound': return True return False def is_down(self): if self.state() == 'inactive': return True return False def is_up(self): if self.state() == 'active': return True return False 070701000245a7000081b40000000000000000000000014faa9509000002f6000000ae00010002ffffffffffffffff0000002b00000000root/opt/opensvc/lib/rcUtilitiesWindows.pyimport os import re from rcUtilities import justcall import string from ctypes import windll def check_ping(addr, timeout=5, count=1): ping = 'ping.exe' cmd = [ping, '-n', repr(count), '-w', repr(timeout), addr] out, err, ret = justcall(cmd) if ret == 0: return True return False def get_registry_value(key, subkey, value): import _winreg key = getattr(_winreg, key) handle = _winreg.OpenKey(key, subkey) (value, type) = _winreg.QueryValueEx(handle, value) return value def get_drives(): drives = [] bitmask = windll.kernel32.GetLogicalDrives() for letter in string.uppercase: if bitmask & 1: drives.append(letter) bitmask >>= 1 return drives 070701000245c4000081b40000000000000000000000014faa9509000007d2000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/resIpHP-UX.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. "Module implement Linux specific ip management" import resIp as Res u = __import__('rcUtilitiesHP-UX') class Ip(Res.Ip): def check_ping(self): self.log.info("checking %s availability"%self.addr) return u.check_ping(self.addr) def arp_announce(self): """ arp_announce job is done by HP-UX ifconfig... """ return def startip_cmd(self): if ':' in self.addr: cmd = ['ifconfig', self.ipDev, 'inet6', 'up'] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError cmd = ['ifconfig', self.stacked_dev, 'inet6', self.addr+'/'+self.mask, 'up'] else: cmd = ['ifconfig', self.stacked_dev, self.addr, 'netmask', self.mask, 'up'] return self.vcall(cmd) def stopip_cmd(self): if ':' in self.addr: cmd = ['ifconfig', self.stacked_dev, "inet6", "::"] else: cmd = ['ifconfig', self.stacked_dev, "0.0.0.0"] return self.vcall(cmd) if __name__ == "__main__": for c in (Ip,) : help(c) 070701000245cb000081b40000000000000000000000014faa950900000611000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/resIpVbox.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. from rcGlobalEnv import rcEnv resIpHv = __import__("resIp"+rcEnv.sysname) import resIpVm class Ip(resIpVm.Ip, resIpHv.Ip): def __init__(self, rid=None, ipDev=None, ipName=None, mask=None, always_on=set([]), disabled=False, tags=set([]), optional=False, monitor=False): resIpVm.Ip.__init__(self, rid=rid, ipDev=ipDev, ipName=ipName, mask=mask, always_on=always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) def check_ping(self): return resIpHv.Ip.check_ping(self) if __name__ == "__main__": for c in (Ip,) : help(c) 070701000245ab000081b40000000000000000000000014faa9509000025a3000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/resApp.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * from datetime import datetime import os import glob import sys from rcUtilities import justcall from rcGlobalEnv import rcEnv import resources as Res import rcStatus import rcExceptions as ex class Apps(Res.Resource): prefix = [] def __init__(self, runmethod=[], optional=False, disabled=False, tags=set([]), monitor=False): Res.Resource.__init__(self, rid="app", type="app", optional=optional, disabled=disabled, tags=tags, monitor=monitor) self.prefix = runmethod self.label = "app" def set_perms(self, rc): s = os.stat(rc) if s.st_uid != 0 or s.st_gid != 0: self.log.info("set %s ownership to uid 0 gid 0"%rc) os.chown(rc, 0, 0) (ret, out, err) = self.call(self.prefix+['test', '-x', rc]) if ret != 0: self.vcall(self.prefix+['chmod', '+x', rc]) def stop_checks(self): if not os.path.exists(self.svc.initd): self.log.info("%s is not present, perhaps already stopped" %self.svc.initd) return True elif not os.path.islink(self.svc.initd): self.log.error("%s is not a link"%self.svc.initd) return False return True def info_checks(self): if not os.path.exists(self.svc.initd): return False return True def start_checks(self): if not os.path.exists(self.svc.initd): self.log.error("%s is not present"%self.svc.initd) return False elif not os.path.islink(self.svc.initd): self.log.error("%s is not a link"%self.svc.initd) return False return True def startstandby_checks(self): if not os.path.exists(self.svc.initd): self.log.info("%s is not present, no apps to start for standby"%self.svc.initd) return False elif not os.path.islink(self.svc.initd): self.log.error("%s is not a link"%self.svc.initd) return False return True def status_checks(self, verbose=False): if not os.path.exists(self.svc.initd): if verbose: self.status_log("%s does not exist"%self.svc.initd) return False status = self.svc.group_status(excluded_groups=set(["sync", "app", "disk", "hb"])) if str(status["overall"]) != "up": self.log.debug("abort resApp status because ip+fs status is %s"%status["overall"]) if verbose: self.status_log("ip+fs status is %s, skip check"%status["overall"]) return False return True def app_exist(self, name): if os.path.exists(name): return True else: return False def app(self, name, action, dedicated_log=True, return_out=False): if len(name) == 0: return 0 if not self.app_exist(name): return 0 self.set_perms(name) cmd = self.prefix+[name, action] try: if dedicated_log: self.log.info('spawn: %s' % ' '.join(cmd)) outf = os.path.join(rcEnv.pathtmp, 'svc_'+self.svc.svcname+'_'+os.path.basename(name)+'.log') f = open(outf, 'w') t = datetime.now() p = Popen(cmd, stdin=None, stdout=f.fileno(), stderr=f.fileno()) p.communicate() _len = datetime.now() - t self.log.info('%s done in %s - ret %d - logs in %s' % (action, _len, p.returncode, outf)) f.close() return p.returncode elif return_out: (out, err, ret) = justcall(cmd) if ret != 0: return "Error: info not implemented in launcher" return out else: (out, err, ret) = justcall(cmd) self.log.debug("%s returned out=[%s], err=[%s], ret=[%d]"%(cmd, out, err, ret)) return ret except OSError, e: if e.errno == 8: self.log.error("%s execution error (Exec format error)"%name) return 1 else: self.svc.save_exc() return 1 except: self.svc.save_exc() return 1 def sorted_app_list(self, pattern): return sorted(glob.glob(os.path.join(self.svc.initd, pattern))) def _status(self, verbose=False): """Execute each startup script (C* files). Log the return code but don't stop on error. Count errors. """ rets = {} errs = 0 nb = 0 try: if not self.status_checks(verbose=verbose): return rcStatus.NA except ex.excNotAvailable: return rcStatus.NA for name in self.sorted_app_list('C*'): if len(name) == 0: continue ret = self.app(name, 'status', dedicated_log=False) nb += 1 errs += ret rets[name] = ret if nb == 0: self.status_log("no checkup scripts") return rcStatus.NA elif errs == 0: return rcStatus.UP elif errs > 0: names = ', '.join([n for n in rets if rets[n] != 0 ]) self.status_log("%s returned errors"%(names)) return rcStatus.WARN else: return rcStatus.DOWN def startstandby(self): """Execute each startup script (SS* files). Log the return code but don't stop on error. """ try: if not self.startstandby_checks(): raise ex.excError except ex.excNotAvailable: return if rcEnv.nodename in self.svc.drpnodes: pool = 'drpnodes' else: pool = 'nodes' l = self.sorted_app_list('S*.standby@'+rcEnv.nodename) l += self.sorted_app_list('S*.standby@'+pool) l = sorted(l) for name in l: self.app(name, 'start') def containerize(self): if self.svc.containerize: return try: container = __import__('rcContainer'+rcEnv.sysname) except ImportError: self.log.info("containerization not supported") return container.containerize(self) def start(self): from multiprocessing import Process, Queue p = Process(target=self.start_job, args=()) p.start() p.join() if p.exitcode != 0: raise ex.excError def start_job(self): """Execute each startup script (S* files). Log the return code but don't stop on error. """ # # this bug should have be fixed, but it is not the case with python # 2.6.2 we ship for el5. # it manifests as apache failing to spawn workers because they can't # acquire stdin, closed upon thread startup. # sys.stdin = open(os.devnull) try: if not self.start_checks(): sys.exit(1) except ex.excNotAvailable: return if self.svc.containerize: self.containerize() for name in self.sorted_app_list('S*'): self.app(name, 'start') def stop(self): """Execute each shutdown script (K* files). Log the return code but don't stop on error. """ try: if not self.stop_checks(): raise ex.excError except ex.excNotAvailable: return for name in self.sorted_app_list('K*'): self.app(name, 'stop') def info(self): """Execute each startup script (S* files) info method. """ try: if not self.info_checks(): return [] except ex.excNotAvailable: return [] l = [] for name in self.sorted_app_list('S*'): s = self.app(name, 'info', dedicated_log=False, return_out=True) name = os.path.basename(os.path.realpath(name)) if type(s) != str or len(s) == 0: l.append([self.svc.svcname, name, "Error", "info not implemented in launcher"]) continue for line in s.split('\n'): if len(line) == 0: continue v = line.split(":") if len(v) < 2: l.append([self.svc.svcname, name, "Error", "parsing: %s"%line]) continue l.append([self.svc.svcname, rcEnv.nodename, self.svc.clustertype, name, v[0], ":".join(v[1:]).strip()]) return l if __name__ == "__main__": for c in (Apps,) : help(c) 07070100024508000081b40000000000000000000000014faa95090000085b000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/checkFsUsageLinux.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "fs_u" def find_svc(self, mountpt): for svc in self.svcs: for rs in svc.get_res_sets('fs'): for r in rs.resources: if r.mountPoint == mountpt: return svc.svcname return '' def do_check(self): cmd = ['df', '-lP'] (out,err,ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef r = [] for line in lines[1:]: l = line.split() if len(l) != 6: continue # discard bind mounts: we get metric from the source anyway if l[0].startswith('/') and not l[0].startswith('/dev') and not l[0].startswith('//'): continue if l[5].startswith('/Volumes'): continue if "osvc_sync_" in l[0]: # do not report osvc sync snapshots fs usage continue r.append({ 'chk_instance': l[5], 'chk_value': l[4], 'chk_svcname': self.find_svc(l[5]), }) return r 0707010002453e000081b40000000000000000000000014faa950900000dde000000ae00010002ffffffffffffffff0000001e00000000root/opt/opensvc/lib/rcDcs.pyfrom rcUtilities import justcall, which from xml.etree.ElementTree import XML, fromstring import rcExceptions as ex import os import ConfigParser pathlib = os.path.dirname(__file__) pathbin = os.path.realpath(os.path.join(pathlib, '..', 'bin')) pathetc = os.path.realpath(os.path.join(pathlib, '..', 'etc')) pathtmp = os.path.realpath(os.path.join(pathlib, '..', 'tmp')) if pathbin not in os.environ['PATH']: os.environ['PATH'] += ":"+pathbin def dcscmd(cmd, manager, username, password, dcs=None): _cmd = ['ssh', manager] if dcs is not None: _cmd += ["connect-dcsserver -server %s -username %s -password %s ; "%(dcs, username, password)+\ cmd+ " ; disconnect-dcsserver"] else: _cmd += [cmd] out, err, ret = justcall(_cmd) if "ErrorId" in err: print _cmd print out raise ex.excError("sssu command execution error") return out, err, ret class Dcss(object): arrays = [] def __init__(self): self.index = 0 cf = os.path.join(pathetc, "auth.conf") if not os.path.exists(cf): return conf = ConfigParser.RawConfigParser() conf.read(cf) m = {} for s in conf.sections(): try: stype = conf.get(s, 'type') except: continue if stype != "datacore": continue try: manager = s dcs = conf.get(s, 'dcs').split() username = conf.get(s, 'username') password = conf.get(s, 'password') m[manager] = [dcs, username, password] except: print "error parsing section", s pass del(conf) done = [] for manager, v in m.items(): dcs, username, password = v for name in dcs: self.arrays.append(Dcs(name, manager, username, password)) done.append(name) def __iter__(self): return self def next(self): if self.index == len(self.arrays): raise StopIteration self.index += 1 return self.arrays[self.index-1] class Dcs(object): def __init__(self, name, manager, username, password): self.name = name self.manager = manager self.username = username self.password = password #self.keys = ['disk_group'] self.keys = ['dcsserver', 'dcspool', 'dcslogicaldisk', 'dcsvirtualdisk'] def dcscmd(self, cmd): return dcscmd(cmd, self.manager, self.username, self.password, dcs=self.name) def stripxml(self, buff): return buff def get_dcsserver(self): cmd = 'get-dcsserver -server %s'%self.name print "%s: %s"%(self.name, cmd) buff = self.dcscmd(cmd)[0] return self.stripxml(buff) def get_dcspool(self): cmd = 'get-dcspool -server %s'%self.name print "%s: %s"%(self.name, cmd) buff = self.dcscmd(cmd)[0] return self.stripxml(buff) def get_dcslogicaldisk(self): cmd = 'get-dcslogicaldisk -server %s'%self.name print "%s: %s"%(self.name, cmd) buff = self.dcscmd(cmd)[0] return self.stripxml(buff) def get_dcsvirtualdisk(self): cmd = 'get-dcsvirtualdisk -server %s'%self.name print "%s: %s"%(self.name, cmd) buff = self.dcscmd(cmd)[0] return self.stripxml(buff) if __name__ == "__main__": o = Dcss() for dcs in o: print dcs.get_dcsserver() 070701000245f1000081b40000000000000000000000014faa950900001717000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/resVgLinux.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import re import os import rcExceptions as ex import resDg from rcGlobalEnv import rcEnv from rcUtilitiesLinux import major, get_blockdev_sd_slaves, \ devs_to_disks from rcUtilities import which class Vg(resDg.Dg): def __init__(self, rid=None, name=None, type=None, optional=False, disabled=False, tags=set([]), always_on=set([]), monitor=False): self.label = name self.tag = '@'+rcEnv.nodename resDg.Dg.__init__(self, rid=rid, name=name, type='disk.vg', always_on=always_on, optional=optional, disabled=disabled, tags=tags, monitor=monitor) def has_it(self): """Returns True if the volume is present """ cmd = ['vgdisplay', self.name] (ret, out, err) = self.call(cmd, cache=True, errlog=False) if ret == 0: return True return False def is_up(self): """Returns True if the volume group is present and activated """ if not self.has_it(): return False cmd = [ 'lvs', '--noheadings', '-o', 'lv_attr', self.name ] (ret, out, err) = self.call(cmd) if len(out) == 0 and ret == 0: # no lv ... happens in provisioning, where lv are not created yet return True if re.search(' ....a.', out, re.MULTILINE) is not None: return True return False def remove_tag(self, tag): cmd = [ 'vgchange', '--deltag', '@'+tag, self.name ] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def remove_tags(self, tags=[]): cmd = ['vgs', '-o', 'tags', '--noheadings', self.name] (ret, out, err) = self.call(cmd) if ret != 0: raise ex.excError out = out.strip(' \n') curtags = out.split(',') if len(tags) > 0: """ remove only specified tags """ for tag in tags: tag = tag.lstrip('@') if tag in curtags: self.remove_tag(tag) else: """ remove all tags """ for tag in curtags: if len(tag) == 0: continue self.remove_tag(tag) def add_tags(self): cmd = [ 'vgchange', '--addtag', self.tag, self.name ] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def do_start(self): if self.is_up(): self.log.info("%s is already up" % self.name) return 0 self.remove_tags() self.add_tags() cmd = [ 'vgchange', '-a', 'y', self.name ] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def remove_parts(self): if not which('partx'): return cmd = ['lvs', '-o', 'name', '--noheadings', self.name] (ret, out, err) = self.call(cmd) if ret != 0: self.log.error("can not fetch logical volume list from %s"%self.name) return base_cmd = ['kpartx', '-d'] for lv in out.split(): self.vcall(base_cmd+[os.path.join(os.sep, 'dev', self.name, lv)]) def do_stop(self): if not self.is_up(): self.log.info("%s is already down" % self.name) return self.remove_tags([self.tag]) self.remove_parts() cmd = [ 'vgchange', '-a', 'n', self.name ] (ret, out, err) = self.vcall(cmd, err_to_info=True) if ret == 0: return import time for i in range(3, 0, -1): if self.is_up() and i > 0: time.sleep(1) (ret, out, err) = self.vcall(cmd, err_to_info=True) if ret == 0: return continue break if i == 0: self.log.error("deactivation failed to release all logical volumes") raise ex.excError def devlist(self): if not self.has_it(): return set() if self.devs != set(): return self.devs self.devs = set() cmd = ['vgs', '--noheadings', '-o', 'pv_name', self.name] (ret, out, err) = self.call(cmd, cache=True) if ret != 0: return self.devs self.devs = set(out.split()) self.log.debug("found devs %s held by vg %s" % (self.devs, self.name)) return self.devs def disklist(self): if not self.has_it(): return set() if self.disks != set(): return self.disks self.disks = set() pvs = self.devlist() self.disks = devs_to_disks(self, pvs) self.log.debug("found disks %s held by vg %s" % (self.disks, self.name)) return self.disks def provision(self): m = __import__("provVgLinux") prov = getattr(m, "ProvisioningVg")(self) prov.provisioner() 07070100024517000081b40000000000000000000000014faa950900000c91000000ae00010002ffffffffffffffff0000002b00000000root/opt/opensvc/lib/checkZfsUsageSunOS.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall import svcZone class check(checks.check): def __init__(self, svcs=[]): checks.check.__init__(self, svcs) self.zpcache = {} chk_type = "fs_u" def convert(self, s): s = s.replace(',', '.') if len(s) < 2: raise if s.endswith('T'): s = float(s[:-1])*1024*1024*1024 elif s.endswith('G'): s = float(s[:-1])*1024*1024 elif s.endswith('M'): s = float(s[:-1])*1024 elif s.endswith('K'): s = float(s[:-1]) else: raise return s def get_zonepath(self, name): if name in self.zpcache: return self.zpcache[name] cmd = ['zonecfg', '-z', name, 'info', 'zonepath'] (out,err,ret) = justcall(cmd) if ret != 0: return None self.zpcache[name] = out.split()[-1].strip() return self.zpcache[name] def find_svc(self, name, mnt): for svc in self.svcs: if type(svc) == svcZone.SvcZone: zp = self.get_zonepath(svc.vmname) if zp is not None and zp == mnt: return svc.svcname for rs in svc.get_res_sets('fs'): for r in rs.resources: if r.device == name: return svc.svcname return '' def do_check(self): cmd = ['zfs', 'list', '-o', 'name,used,avail,mountpoint', '-H'] (out,err,ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) == 0: return self.undef r = [] for line in lines: l = line.split() if len(l) != 4: continue if "@" in l[0]: # do not report clone usage continue if "osvc_sync_" in l[0]: # do not report osvc sync snapshots fs usage continue used = self.convert(l[1]) avail = self.convert(l[2]) total = used + avail pct = used / total * 100 r.append({ 'chk_instance': l[0], 'chk_value': str(pct), 'chk_svcname': self.find_svc(l[0], l[3]), }) return r 0707010002454b000081b40000000000000000000000014faa950900000eae000000ae00010002ffffffffffffffff0000001e00000000root/opt/opensvc/lib/rcEva.pyfrom rcUtilities import justcall, which from xml.etree.ElementTree import XML, fromstring import rcExceptions as ex import os import ConfigParser pathlib = os.path.dirname(__file__) pathbin = os.path.realpath(os.path.join(pathlib, '..', 'bin')) pathetc = os.path.realpath(os.path.join(pathlib, '..', 'etc')) pathtmp = os.path.realpath(os.path.join(pathlib, '..', 'tmp')) if pathbin not in os.environ['PATH']: os.environ['PATH'] += ":"+pathbin def sssu(cmd, manager, username, password, array=None): os.chdir(pathtmp) _cmd = ['sssu', "select manager %s username=%s password=%s"%(manager, username, password)] if array is not None: _cmd += ["select system %s"%array] _cmd += [cmd] out, err, ret = justcall(_cmd) if "Error" in out: print _cmd print out raise ex.excError("sssu command execution error") return out, err class Evas(object): arrays = [] def __init__(self): self.index = 0 cf = os.path.join(pathetc, "sssu.conf") if not os.path.exists(cf): return conf = ConfigParser.RawConfigParser() conf.read(cf) m = {} for s in conf.sections(): try: manager = conf.get(s, 'manager') username = conf.get(s, 'username') password = conf.get(s, 'password') m[manager] = [username, password] except: print "error parsing section", s pass del(conf) done = [] for manager, creds in m.items(): username, password = creds out, err = sssu('ls system', manager, username, password) _in = False for line in out.split('\n'): if 'Systems avail' in line: _in = True continue if not _in: continue name = line.strip() self.arrays.append(Eva(name, manager, username, password)) done.append(name) def __iter__(self): return self def next(self): if self.index == len(self.arrays): raise StopIteration self.index += 1 return self.arrays[self.index-1] class Eva(object): def __init__(self, name, manager, username, password): self.name = name self.manager = manager self.username = username self.password = password #self.keys = ['disk_group'] self.keys = ['controller', 'disk_group', 'vdisk'] def sssu(self, cmd): return sssu(cmd, self.manager, self.username, self.password, array=self.name) def stripxml(self, buff): buff = buff[buff.index(""):] lines = buff.split('\n') for i, line in enumerate(lines): if line.startswith("\\"): del lines[i] lines = ['
'] + lines + ['
'] return '\n'.join(lines) def get_controller(self): cmd = 'ls controller full xml' print "%s: %s"%(self.name, cmd) buff = self.sssu(cmd)[0] return self.stripxml(buff) def get_disk_group(self): cmd = 'ls disk_group full xml' print "%s: %s"%(self.name, cmd) buff = self.sssu(cmd)[0] return self.stripxml(buff) def get_vdisk(self): cmd = 'ls vdisk full xml' print "%s: %s"%(self.name, cmd) buff = self.sssu(cmd)[0] return self.stripxml(buff) def get_lun(self): cmd = 'ls lun full xml' print "%s: %s"%(self.name, cmd) buff = self.sssu(cmd)[0] return self.stripxml(buff) if __name__ == "__main__": o = Evas() for eva in o: print eva.get_controller() 070701000245ea000081b40000000000000000000000014faa9509000035ea000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/resSyncZfs.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcGlobalEnv import rcEnv import datetime from subprocess import * import rcExceptions as ex import rcStatus import resSync from rcZfs import a2pool_dataset, Dataset class SyncZfs(resSync.Sync): """define zfs sync resource to be zfs send/zfs receive between nodes """ def __init__(self, rid=None, target=None, src=None, dst=None, delta_store=None, sender=None, recursive = True, snap_size=0, sync_max_delay=None, sync_interval=None, sync_days=None, sync_period=None, optional=False, disabled=False, tags=set([])): resSync.Sync.__init__(self, rid=rid, type="sync.zfs", sync_max_delay=sync_max_delay, sync_interval=sync_interval, sync_days=sync_days, sync_period=sync_period, optional=optional, disabled=disabled, tags=tags) self.label = "zfs of %s to %s"%(src, target) self.target = target self.sender = sender self.recursive = recursive (self.src_pool, self.src_ds) = a2pool_dataset(src) (self.dst_pool, self.dst_ds) = a2pool_dataset(dst) if delta_store is None: self.delta_store = rcEnv.pathvar else: self.delta_store = delta_store def pre_action(self, rset, action): """Prepare dataset snapshots Don't sync PRD services when running on !PRD node skip snapshot creation if delay_snap in tags delay_snap should be used for oracle archive datasets """ if self.svc.svctype == 'PRD' and rcEnv.host_mode != 'PRD': self.log.debug("won't sync a PRD service running on a !PRD node") raise ex.excAbortAction for i, r in enumerate(rset.resources): if r.is_disabled(): continue if 'delay_snap' in r.tags: continue r.get_info() if action in ['syncupdate', 'syncresync', 'syncdrp', 'syncnodes']: if action == 'syncnodes' and self.target != ['nodes']: return if action == 'syncdrp' and self.target != ['drpnodes']: return nb = 0 tgts = r.targets.copy() if len(tgts) == 0 : continue r.get_info() if not r.snap_exists(r.src_snap_tosend): r.create_snap(r.src_snap_tosend) def __str__(self): return "%s target=%s src=%s" % (resSync.Sync.__str__(self),\ self.target, self.src) def snap_exists(self, snapname, node=None): cmd = ['env', 'PATH=/usr/sbin:/sbin', 'zfs', 'list', '-t', 'snapshot', snapname] if node is not None: cmd = rcEnv.rsh.split() + [node] + cmd (ret, out, err) = self.call(cmd, errlog=False) if ret == 0: return True else: return False def create_snap(self, snap): snapds=Dataset(snap) if snapds.exists(): self.log.error('%s should not exist'%snap) raise ex.excError if self.recursive : cmd = ['zfs', 'snapshot' , '-r' , snap ] else: cmd = ['zfs', 'snapshot' , snap ] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def get_src_info(self): self.src_snap_sent = self.src_ds + '@sent' self.src_snap_tosend = self.src_ds + '@tosend' self.tosend = "tosend" def get_dst_info(self): self.dst_snap_sent = self.dst_ds + '@sent' self.dst_snap_tosend = self.dst_ds + '@tosend' def get_peersenders(self): self.peersenders = set([]) if 'nodes' == self.sender: self.peersenders |= self.svc.nodes self.peersenders -= set([rcEnv.nodename]) def get_targets(self): self.targets = set() if 'nodes' in self.target: self.targets |= self.svc.nodes if 'drpnodes' in self.target: self.targets |= self.svc.drpnodes self.targets -= set([rcEnv.nodename]) def get_info(self): self.get_targets() self.get_src_info() self.get_dst_info() def syncnodes(self): """alias to syncupdate""" self.syncupdate() def syncfullsync(self): """alias to syncupdate""" self.syncupdate() def zfs_send_incremental(self, node): if self.recursive : send_cmd = ['zfs', 'send', '-R', '-i', self.src_snap_sent, self.src_snap_tosend] else: send_cmd = ['zfs', 'send', '-i', self.src_snap_sent, self.src_snap_tosend] receive_cmd = ['env', 'PATH=/usr/sbin:/sbin', 'zfs', 'receive', '-dF', self.dst_pool] if node is not None: receive_cmd = rcEnv.rsh.strip(' -n').split() + [node] + receive_cmd self.log.info(' '.join(send_cmd + ["|"] + receive_cmd)) p1 = Popen(send_cmd, stdout=PIPE) p2 = Popen(receive_cmd, stdin=p1.stdout, stdout=PIPE) buff = p2.communicate() if p2.returncode != 0: if buff[1] is not None and len(buff[1]) > 0: self.log.error(buff[1]) self.log.error("sync update failed") raise ex.excError if buff[0] is not None and len(buff[0]) > 0: self.log.info(buff[0]) def zfs_send_initial(self, node=None): if self.recursive : send_cmd = ['zfs', 'send', '-R', self.src_snap_tosend] else: send_cmd = ['zfs', 'send', self.src_snap_tosend] receive_cmd = ['env', 'PATH=/usr/sbin:/sbin', 'zfs', 'receive', '-dF', self.dst_pool ] if node is not None: receive_cmd = rcEnv.rsh.strip(' -n').split() + [node] + receive_cmd self.log.info(' '.join(send_cmd + ["|"] + receive_cmd)) p1 = Popen(send_cmd, stdout=PIPE) p2 = Popen(receive_cmd, stdin=p1.stdout, stdout=PIPE) buff = p2.communicate() if p2.returncode != 0: if buff[1] is not None and len(buff[1]) > 0: self.log.error(buff[1]) self.log.error("full sync failed") raise ex.excError if buff[0] is not None and len(buff[0]) > 0: self.log.info(buff[0]) def remove_snap(self, snap, node=None): if not self.snap_exists(snap, node=node): return if self.recursive : cmd = ['zfs', 'destroy', '-r', snap] else: cmd = ['zfs', 'destroy', snap] if node is not None: cmd = rcEnv.rsh.split() + [node, 'env', 'PATH=/usr/sbin:/sbin'] + cmd (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def rename_snap(self, src, dst, node=None): if self.snap_exists(dst, node): self.log.error("%s should not exist"%dst) raise ex.excError if self.recursive : cmd = ['zfs', 'rename', '-r', src, dst] else: cmd = ['zfs', 'rename', src, dst] if node is not None: cmd = rcEnv.rsh.split() + [node, 'env', 'PATH=/usr/sbin:/sbin'] + cmd (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def rotate_snaps(self, src, dst, node=None): self.remove_snap(dst, node) self.rename_snap(src, dst, node) def syncupdate(self): """ test if service status is UP else return create the snap_tosend if not already created (during pre_action) if a snap has already been sent then for all targets zfs_send_incremental rotate snap else for all targets zfs_send_initial rotate snap rotate snap on local node """ s = self.svc.group_status(excluded_groups=set(["sync", "hb"])) if s['overall'].status != rcStatus.UP: self.log.debug("won't sync this resource for a service not up") return """ Refuse to sync from a flex non-primary node """ if self.svc.clustertype in ["flex", "autoflex"] and \ self.svc.flex_primary != rcEnv.nodename: self.log.debug("won't sync this resource from a flex non-primary node") return set([]) self.get_info() if not self.snap_exists(self.src_snap_tosend): self.create_snap(self.src_snap_tosend) if self.snap_exists(self.src_snap_sent): for n in self.targets: self.zfs_send_incremental(n) self.rotate_snaps(self.dst_snap_tosend, self.dst_snap_sent, n) else: for n in self.targets: self.zfs_send_initial(n) self.rotate_snaps(self.dst_snap_tosend, self.dst_snap_sent, n) self.rotate_snaps(self.src_snap_tosend, self.src_snap_sent) self.write_statefile() for n in self.targets: self.push_statefile(n) def start(self): pass def stop(self): pass def can_sync(self, target=None): try: ls = self.get_local_state() ts = datetime.datetime.strptime(ls['date'], "%Y-%m-%d %H:%M:%S.%f") except IOError: self.log.error("zfs state file not found") return True except: import sys import traceback e = sys.exc_info() print e[0], e[1], traceback.print_tb(e[2]) return False if self.skip_sync(ts): self.status_log("Last sync on %s older than %i minutes"%(ts, self.sync_max_delay)) return False return True def _status(self, verbose=False): try: ls = self.get_local_state() now = datetime.datetime.now() last = datetime.datetime.strptime(ls['date'], "%Y-%m-%d %H:%M:%S.%f") delay = datetime.timedelta(minutes=self.sync_max_delay) except IOError: self.status_log("zfs state file not found") return rcStatus.WARN except: import sys import traceback e = sys.exc_info() print e[0], e[1], traceback.print_tb(e[2]) return rcStatus.WARN if last < now - delay: self.status_log("Last sync on %s older than %i minutes"%(last, self.sync_max_delay)) return rcStatus.WARN return rcStatus.UP def check_remote(self, node): rs = self.get_remote_state(node) if self.snap1_uuid != rs['uuid']: self.log.error("%s last update uuid doesn't match snap1 uuid"%(node)) raise ex.excError def get_remote_state(self, node): self.set_statefile() cmd1 = ['env', 'LANG=C', 'cat', self.statefile] cmd = rcEnv.rsh.split() + [node] + cmd1 (ret, out, err) = self.call(cmd) if ret != 0: self.log.error("could not fetch %s last update uuid"%node) raise ex.excError return self.parse_statefile(out, node=node) def get_local_state(self): self.set_statefile() with open(self.statefile, 'r') as f: out = f.read() return self.parse_statefile(out) def get_snap_uuid(self, snap): cmd = ['zfs', 'list', '-H', '-o', 'creation', '-t', 'snapshot', snap] (ret, out, err) = self.call(cmd) if ret != 0: raise ex.excError self.snap_uuid = out.strip() def set_statefile(self): self.statefile = os.path.join(rcEnv.pathvar, self.svc.svcname+'_'+self.rid+'_zfs_state') def write_statefile(self): self.set_statefile() self.get_snap_uuid(self.src_snap_sent) self.log.info("update state file with snap uuid %s"%self.snap_uuid) with open(self.statefile, 'w') as f: f.write(str(datetime.datetime.now())+';'+self.snap_uuid+'\n') def _push_statefile(self, node): cmd = rcEnv.rcp.split() + [self.statefile, node+':'+self.statefile.replace('#', '\#')] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def push_statefile(self, node): self.set_statefile() self._push_statefile(node) self.get_peersenders() for s in self.peersenders: self._push_statefile(s) def parse_statefile(self, out, node=None): self.set_statefile() if node is None: node = rcEnv.nodename lines = out.strip().split('\n') if len(lines) != 1: self.log.error("%s:%s is corrupted"%(node, self.statefile)) raise ex.excError fields = lines[0].split(';') if len(fields) != 2: self.log.error("%s:%s is corrupted"%(node, self.statefile)) raise ex.excError return dict(date=fields[0], uuid=fields[1]) 070701000245c5000081b40000000000000000000000014faa950900000608000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/resIpHpVm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. resIpHv = __import__("resIpHP-UX") import resIpVm class Ip(resIpVm.Ip, resIpHv.Ip): def __init__(self, rid=None, ipDev=None, ipName=None, mask=None, always_on=set([]), monitor=False, disabled=False, tags=set([]), optional=False): resIpVm.Ip.__init__(self, rid=rid, ipDev=ipDev, ipName=ipName, mask=mask, always_on=always_on, monitor=monitor, disabled=disabled, tags=tags, optional=optional) def check_ping(self): return resIpHv.Ip.check_ping(self) if __name__ == "__main__": for c in (Ip,) : help(c) 07070100024557000081b40000000000000000000000014faa950900000b3e000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/rcIfconfigLinux.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * import rcIfconfig class ifconfig(rcIfconfig.ifconfig): def parse(self, out): prev = '' prevprev = '' for w in out.split(): if w == 'Link': i = rcIfconfig.interface(prev) self.intf.append(i) # defaults i.link_encap = '' i.scope = '' i.bcast = '' i.mask = '' i.mtu = '' i.ipaddr = '' i.ip6addr = [] i.ip6mask = [] i.hwaddr = '' i.flag_up = False i.flag_broadcast = False i.flag_running = False i.flag_multicast = False i.flag_loopback = False elif 'encap:' in w: (null, i.link_encap) = w.split(':') elif 'Scope:' in w: (null, i.scope) = w.split(':') elif 'Bcast:' in w: (null, i.bcast) = w.split(':') elif 'Mask:' in w: (null, i.mask) = w.split(':') elif 'MTU:' in w: (null, i.mtu) = w.split(':') if 'inet' == prev and 'addr:' in w: (null, i.ipaddr) = w.split(':') if 'inet6' == prevprev and 'addr:' == prev: (ip6addr, ip6mask) = w.split('/') i.ip6addr += [ip6addr] i.ip6mask += [ip6mask] if 'HWaddr' == prev: i.hwaddr = w if 'UP' == w: i.flag_up = True if 'BROADCAST' == w: i.flag_broadcast = True if 'RUNNING' == w: i.flag_running = True if 'MULTICAST' == w: i.flag_multicast = True if 'LOOPBACK' == w: i.flag_loopback = True prevprev = prev prev = w def __init__(self): self.intf = [] out = Popen(['ifconfig', '-a'], stdout=PIPE).communicate()[0] self.parse(out) 07070100024552000081b40000000000000000000000014faa950900000a47000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/rcIfconfigDarwin.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * import rcIfconfig class ifconfig(rcIfconfig.ifconfig): def parse(self, out): prev = '' prevprev = '' for w in out.split(): if 'flags=' in w: i = rcIfconfig.interface(prev.replace(':','')) self.intf.append(i) # defaults i.link_encap = '' i.scope = '' i.bcast = '' i.mtu = '' i.ipaddr = [] i.mask = [] i.ip6addr = [] i.ip6mask = [] i.hwaddr = '' i.flag_up = False i.flag_broadcast = False i.flag_running = False i.flag_multicast = False i.flag_loopback = False flags = w.split('<')[1].split('>')[0].split(',') if 'UP' in flags: i.flag_up = True if 'BROADCAST' in flags: i.flag_broadcast = True if 'RUNNING' in flags: i.flag_running = True if 'MULTICAST' in flags: i.flag_multicast = True if 'LOOPBACK' in flags: i.flag_loopback = True elif 'inet' == prev: i.ipaddr += [w] elif 'inet6' == prev: i.ip6addr += [w.split('%')[0]] elif 'netmask' == prev: i.mask += [w] elif 'prefixlen' == prev: i.ip6mask += [w] elif 'ether' == prev: i.hwaddr = w prevprev = prev prev = w def __init__(self): self.intf = [] out = Popen(['ifconfig', '-a'], stdout=PIPE).communicate()[0] self.parse(out) 07070100024549000081b40000000000000000000000014faa950900001347000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/rcDiskInfoLinux.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import sys import os import re from rcUtilities import call, which import rcDiskInfo import math from rcGlobalEnv import rcEnv class diskInfo(rcDiskInfo.diskInfo): disk_ids = {} def prefix_local(self, id): return '.'.join((rcEnv.nodename, id)) def disk_id(self, dev): regex = re.compile(r'/dev/mapper/[0-9a-f]{17}') if 'cciss' in dev: id = self.cciss_id(dev) elif dev.startswith('/dev/mapper/3'): id = dev.replace('/dev/mapper/3', '') elif dev.startswith('/dev/mapper/') and regex.match(dev) is not None: id = dev.replace('/dev/mapper/', '') else: id = self.scsi_id(dev) if len(id) == 0: return self.prefix_local(dev.replace('/dev/','').replace('/','!')) return id def cciss_id(self, dev): if dev in self.disk_ids: return self.disk_ids[dev] if which('cciss_id'): cciss_id = 'cciss_id' else: return "" cmd = [cciss_id, dev] (ret, out, err) = call(cmd) if ret == 0: id = out.split('\n')[0] if id.startswith('3'): id = id[1:] else: id = self.prefix_local(id) self.disk_ids[dev] = id return id return "" def scsi_id(self, dev): if dev in self.disk_ids: return self.disk_ids[dev] if which('scsi_id'): scsi_id = 'scsi_id' elif which('/lib/udev/scsi_id'): scsi_id = '/lib/udev/scsi_id' else: return "" regex = re.compile(r'[0-9a-f]{17}') cmd = [scsi_id, '-g', '-u', '-d', dev] (ret, out, err) = call(cmd) if ret == 0: id = out.split('\n')[0] if id.startswith('3'): id = id[1:] elif regex.match(id) is not None: pass else: id = self.prefix_local(id) self.disk_ids[dev] = id return id sdev = dev.replace("/dev/", "/block/") cmd = [scsi_id, '-g', '-u', '-s', sdev] (ret, out, err) = call(cmd, errlog=False) if ret == 0: id = out.split('\n')[0] if id.startswith('3'): id = id[1:] elif regex.match(id) is not None: pass else: id = self.prefix_local(id) self.disk_ids[dev] = id return id return "" def disk_vendor(self, dev): if 'cciss' in dev: return 'HP' s = '' dev = re.sub("[0-9]+$", "", dev) path = dev.replace('/dev/', '/sys/block/')+'/device/vendor' if not os.path.exists(path): return "" with open(path, 'r') as f: s = f.read() f.close() return s.strip() def disk_model(self, dev): if 'cciss' in dev: return 'VOLUME' s = '' dev = re.sub("[0-9]+$", "", dev) path = dev.replace('/dev/', '/sys/block/')+'/device/model' if not os.path.exists(path): return "" with open(path, 'r') as f: s = f.read() f.close() return s.strip() def disk_size(self, dev): size = 0 if '/dev/mapper/' in dev: try: statinfo = os.stat(dev) except: raise Exception("can not stat %s" % dev) dm = 'dm-' + str(os.minor(statinfo.st_rdev)) path = '/sys/block/' + dm + '/size' if not os.path.exists(path): return 0 else: path = dev.replace('/dev/', '/sys/block/')+'/size' if not os.path.exists(path): cmd = ['blockdev', '--getsize', dev] (ret, out, err) = call(cmd) if ret != 0: return 0 return int(math.ceil(1.*int(out)/2048)) with open(path, 'r') as f: size = f.read() f.close() return int(math.ceil(1.*int(size)/2048)) 07070100024542000081b40000000000000000000000014faa95090000288b000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/rcDevTreeLinux.pyimport rcDevTree import glob import os import re from subprocess import * from rcUtilities import which from rcGlobalEnv import rcEnv class DevTree(rcDevTree.DevTree): dev_h = {} def get_size(self, devpath): size = 0 with open(devpath+'/size', 'r') as f: try: size = int(f.read().strip()) * 512 / 1024 / 1024 except: pass return size def get_dm(self): if hasattr(self, 'dm_h'): return self.dm_h self.dm_h = {} if not os.path.exists("/dev/mapper"): return self.dm_h devpaths = glob.glob("/dev/mapper/*") devpaths.remove('/dev/mapper/control') for devpath in devpaths: s = os.stat(devpath) minor = os.minor(s.st_rdev) self.dm_h[devpath.replace("/dev/mapper/", "")] = "dm-%d"%minor # reverse hash self._dm_h = {} for mapname, devname in self.dm_h.items(): self._dm_h[devname] = mapname return self.dm_h def get_wwid(self): if hasattr(self, 'wwid_h'): return self.wwid_h self.wwid_h = {} if not which("multipath"): return self.wwid_h cmd = ['multipath', '-l'] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return self.mp_h for line in out.split('\n'): if 'dm-' not in line: continue devname = line[line.index('dm-'):].split()[0] try: wwid = line[line.index('(')+2:line.index(')')] except ValueError: wwid = line.split()[0] self.wwid_h[devname] = wwid return self.wwid_h def get_mp(self): if hasattr(self, 'mp_h'): return self.mp_h self.mp_h = {} if not which('dmsetup'): return self.mp_h cmd = ['dmsetup', 'ls', '--target', 'multipath'] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return self.mp_h for line in out.split('\n'): l = line.split() if len(l) == 0: continue mapname = l[0] major = l[1].strip('(,') minor = l[2].strip(' )') self.mp_h['dm-'+minor] = mapname return self.mp_h def get_md(self): if hasattr(self, 'md_h'): return self.md_h fpath = "/proc/mdstat" self.md_h = {} try: with open(fpath, 'r') as f: buff = f.read() except: return self.md_h for line in buff.split('\n'): if line.startswith("Personalities"): continue if len(line) == 0 or line[0] == " ": continue l = line.split() if len(l) < 4: continue self.md_h[l[0]] = l[3] return self.md_h def get_lv_linear(self): if hasattr(self, 'lv_linear'): return self.lv_linear self.lv_linear = {} if not which('dmsetup'): return self.lv_linear cmd = ['dmsetup', 'table', '--target', 'linear'] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return self.lv_linear for line in out.split('\n'): l = line.split(':') if len(l) < 2: continue mapname = l[0] line = line[line.index(':')+1:] l = line.split() if len(l) < 3: continue length = int(l[1])*512/1024/1024 devt = l[3] if mapname in self.lv_linear: self.lv_linear[mapname].append((devt, length)) else: self.lv_linear[mapname] = [(devt, length)] return self.lv_linear def is_cdrom(self, devname): p = '/sys/block/%s/device/media'%devname if not os.path.exists(p): return False with open(p, 'r') as f: buff = f.read() if buff.strip() == "cdrom": return True return False def dev_type(self, devname): t = "linear" md_h = self.get_md() mp_h = self.get_mp() if devname in md_h: return md_h[devname] if devname in mp_h: return "multipath" return t def add_drbd_relations(self): if not which("drbdadm") or not os.path.exists('/proc/drbd'): return cmd = ["drbdadm", "dump-xml"] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return from xml.etree import ElementTree as etree tree = etree.fromstring(out) for res in tree.getiterator('resource'): for host in res.findall('host'): if host.attrib['name'] != rcEnv.nodename: continue edisk = host.find('disk') edev = host.find('device') if edisk is None or edev is None: continue devname = 'drbd'+edev.attrib['minor'] parentpath = edisk.text d = self.get_dev_by_devpath(parentpath) if d is None: continue d.add_child(devname) c = self.get_dev(devname) c.add_parent(d.devname) def load_dev(self, devname, devpath): if self.is_cdrom(devname): return mp_h = self.get_mp() wwid_h = self.get_wwid() size = self.get_size(devpath) # exclude 0-sized md, Symmetrix gatekeeper and vcmdb if size in [0, 2, 30, 45]: return devtype = self.dev_type(devname) d = self.add_dev(devname, size, devtype) if d is None: return if 'cciss' in devname: d.set_devpath('/dev/'+devname.replace('!', '/')) else: d.set_devpath('/dev/'+devname) # store devt with open("%s/dev"%devpath, 'r') as f: devt = f.read().strip() self.dev_h[devt] = devname # add holders holderpaths = glob.glob("%s/holders/*"%devpath) holdernames = map(lambda x: os.path.basename(x), holderpaths) for holdername, holderpath in zip(holdernames, holderpaths): size = self.get_size(holderpath) devtype = self.dev_type(holdername) d.add_child(holdername, size, devtype) # add lv aliases self.get_dm() if devname in self._dm_h: d.set_alias(self._dm_h[devname]) d.set_devpath('/dev/mapper/'+self._dm_h[devname]) s = self._dm_h[devname].replace('--', ':').replace('-', '/').replace(':','-') d.set_devpath('/dev/'+s) # add slaves slavepaths = glob.glob("%s/slaves/*"%devpath) slavenames = map(lambda x: os.path.basename(x), slavepaths) for slavename, slavepath in zip(slavenames, slavepaths): size = self.get_size(slavepath) devtype = self.dev_type(slavename) d.add_parent(slavename, size, devtype) if devname in mp_h: d.set_alias(wwid_h[devname]) return d def load_fdisk(self): p = Popen(["fdisk", "-l"], stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return for line in out.split("\n"): if line.startswith("Disk "): # disk devpath = line.split()[1].strip(':') size = int(line.split()[-2]) / 1024 / 1024 devname = devpath.replace('/dev/','').replace("/","!") devtype = self.dev_type(devname) d = self.add_dev(devname, size, devtype) if d is None: continue d.set_devpath(devpath) elif line.startswith('/dev/'): # partition line = line.replace('*', '') partpath = line.split()[0] partsize = int(line.split()[3]) * 512 / 1024 / 1024 partname = partpath.replace('/dev/','').replace("/","!") p = self.add_dev(partname, partsize, "linear") if p is None: continue p.set_devpath(partpath) d.add_child(partname) p.add_parent(devname) def load_sysfs(self): devpaths = glob.glob("/sys/block/*") devnames = map(lambda x: os.path.basename(x), devpaths) for devname, devpath in zip(devnames, devpaths): d = self.load_dev(devname, devpath) if d is None: continue # add parts partpaths = glob.glob("%s/%s*"%(devpath, devname)) partnames = map(lambda x: os.path.basename(x), partpaths) for partname, partpath in zip(partnames, partpaths): p = self.load_dev(partname, partpath) if p is None: continue d.add_child(partname) p.add_parent(devname) def load(self): if not os.path.exists("/sys/block"): self.load_fdisk() else: self.load_sysfs() # tune relations dm_h = self.get_dm() for lv, segments in self.get_lv_linear().items(): for devt, length in segments: child = dm_h[lv] parent = self.dev_h[devt] r = self.get_relation(parent, child) if r is None: print "no %s-%s relation found"%(parent, child) continue else: r.set_used(length) self.add_drbd_relations() def blacklist(self, devname): bl = [r'^loop[0-9]*.*', r'^ram[0-9]*.*', r'^scd[0-9]*', r'^sr[0-9]*'] for b in bl: if re.match(b, devname): return True return False if __name__ == "__main__": tree = DevTree() tree.load() #print tree tree.print_tree_bottom_up() #print map(lambda x: x.alias, tree.get_top_devs()) 070701000245e5000081b40000000000000000000000014faa950900002aaf000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/resSyncNetapp.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import logging from rcGlobalEnv import rcEnv from rcUtilities import which import rcExceptions as ex import rcStatus import time import resSync import datetime class syncNetapp(resSync.Sync): def master(self): s = self.local_snapmirror_status() return s['master'] def slave(self): s = self.local_snapmirror_status() return s['slave'] def local(self): if rcEnv.nodename in self.filers: return self.filers[rcEnv.nodename] return None def _cmd(self, cmd, target, info=False): if target == "local": filer = self.local() elif target == "master": filer = self.master() elif target == "slave": filer = self.slave() elif target in self.filers.values(): filer = target else: self.log.error("unable to find the %s filer"%target) raise ex.excError return self.call(rcEnv.rsh.split() + [self.user+'@'+filer] + cmd, info=info) def cmd_master(self, cmd, info=False): return self._cmd(cmd, "master", info=info) def cmd_slave(self, cmd, info=False): return self._cmd(cmd, "slave", info=info) def cmd_local(self, cmd, info=False): return self._cmd(cmd, "local", info=info) def lag_to_ts(self, lag): now = datetime.datetime.now() l = lag.split(":") if len(l) != 3: self.log.error("unexpected lag format") raise ex.excError delta = datetime.timedelta(hours=int(l[0]), minutes=int(l[1]), seconds=int(l[2])) return now - delta def can_sync(self, target=None, s=None): if s is None: s = self.snapmirror_status(self.slave()) ts = self.lag_to_ts(s['lag']) if self.skip_sync(ts): return False return True def lagged(self, lag, max=None): if max is None: max = self.sync_max_delay l = lag.split(":") if len(l) != 3: self.log.error("unexpected lag format") raise ex.excError if int(l[0]) * 60 + int(l[1]) > max: return True return False def syncresync(self): (ret, buff, err) = self.cmd_slave(['snapmirror', 'resync', '-f', self.slave()+':'+self.path_short], info=True) if ret != 0: raise ex.excError def syncswap(self): master = self.master() slave = self.slave() s = self.snapmirror_status(self.local()) if s['state'] != "Broken-off": self.log.error("can not swap: snapmirror is not in state Broken-off") raise ex.excError src = slave+':'+self.path_short dst = master+':'+self.path_short (ret, buff, err) = self._cmd(['snapmirror', 'resync', '-f', '-S', src, dst], master, info=True) if ret != 0: raise ex.excError (ret, buff, err) = self._cmd(['snapmirror', 'release', self.path_short, src], master, info=True) if ret != 0: raise ex.excError (ret, buff, err) = self._cmd(['snapmirror', 'status', '-l', dst], slave, info=False) if ret != 0: raise ex.excError snap = "" state = "" for line in buff.split('\n'): l = line.split() if len(l) < 2: continue if l[0] == "State:": state = l[1] if state != "Broken-off": continue if l[0] == "Base" and l[1] == "Snapshot:": snap = l[-1] break if len(snap) == 0: self.log.error("can not determine base snapshot name to remove on %s"%slave) raise ex.excError import time time.sleep(5) (ret, buff, err) = self._cmd(['snap', 'delete', self.path_short, snap], slave, info=True) if ret != 0: raise ex.excError def syncupdate(self): s = self.snapmirror_status(self.slave()) if not self.can_sync(s=s): return if s['state'] == "Quiesced": self.log.error("update not applicable: quiesced") return if s['state'] == "Snapmirrored" and s['status'] == "Transferring": self.log.info("update not applicable: transfer in progress") return if s['state'] != "Snapmirrored" or s['status'] != "Idle": self.log.error("update not applicable: not in snapmirror idle status") return (ret, buff, err) = self.cmd_slave(['snapmirror', 'update', self.slave()+':'+self.path_short], info=True) if ret != 0: raise ex.excError def syncresume(self): s = self.snapmirror_status(self.slave()) if s['state'] != "Quiesced": self.log.info("resume not applicable: not quiesced") return (ret, buff, err) = self.cmd_slave(['snapmirror', 'resume', self.slave()+':'+self.path_short], info=True) if ret != 0: raise ex.excError def syncquiesce(self): s = self.snapmirror_status(self.slave()) if s['state'] == "Quiesced": self.log.info("already quiesced") return elif s['state'] != "Snapmirrored": self.log.error("Can not quiesce: volume not in Snapmirrored state") raise ex.excError if s['status'] == "Pending": self.log.error("Can not quiesce: volume in snapmirror Pending status") raise ex.excError (ret, buff, err) = self.cmd_slave(['snapmirror', 'quiesce', self.slave()+':'+self.path_short], info=True) if ret != 0: raise ex.excError self.wait_quiesce() def syncbreak(self): (ret, buff, err) = self.cmd_slave(['snapmirror', 'break', self.slave()+':'+self.path_short], info=True) if ret != 0: raise ex.excError self.wait_break() def wait_quiesce(self): timeout = 60 self.log.info("start waiting quiesce to finish (max %s seconds)"%(timeout*5)) for i in range(timeout): s = self.snapmirror_status(self.slave()) if s['state'] == "Quiesced" and s['status'] == "Idle": return time.sleep(5) self.log.error("timed out waiting for quiesce to finish") raise ex.excError def wait_break(self): timeout = 20 for i in range(timeout): s = self.snapmirror_status(self.slave()) if s['state'] == "Broken-off" and s['status'] == "Idle": return time.sleep(5) self.log.error("timed out waiting for break to finish") raise ex.excError def snapmirror_status(self, filer): (ret, buff, err) = self._cmd(['snapmirror', 'status'], filer) if ret != 0: self.log.error("can get snapmirror status from %s"%filer) raise ex.excError key = ':'.join([filer, self.path_short]) list = [] for line in buff.split('\n'): l = line.split() if len(l) < 5: continue if l[2] == "Uninitialized": continue if l[0] == key or l[1] == key: list.append(l) if len(list) == 0: self.log.error("%s not found in snapmirror status"%self.path_short) raise ex.excError elif len(list) == 1: l = list[0] master = l[0].split(':')[0] slave = l[1].split(':')[0] return dict(master=master, slave=slave, state=l[2], lag=l[3], status=l[4]) else: self.log.error("%s is in an unsupported state. Please repair manually."%filer) raise ex.excError def local_snapmirror_status(self): return self.snapmirror_status(self.local()) def start(self): if self.local() == self.master(): self.log.info("%s is already replication master"%self.local()) return s = self.snapmirror_status(self.slave()) if s['state'] != "Broken-off": try: self.syncquiesce() except: if self.svc.force: self.log.warning("force mode is on. bypass failed quiesce.") pass else: self.log.error("set force mode to bypass") raise ex.excError self.syncbreak() if rcEnv.host_mode == "PRD": self.syncswap() def stop(self): pass def _status(self, verbose=False): try: s = self.snapmirror_status(self.slave()) except: return rcStatus.UNDEF if s['state'] == "Snapmirrored": if "Transferring" in s['status']: self.log.debug("snapmirror transfer in progress") return rcStatus.WARN elif self.lagged(s['lag']): self.log.debug("snapmirror lag beyond sync_max_delay") return rcStatus.WARN else: return rcStatus.UP return rcStatus.DOWN def __init__(self, rid=None, filers={}, path=None, user=None, sync_max_delay=None, sync_interval=None, sync_days=None, sync_period=None, optional=False, disabled=False, tags=set([]), internal=False): resSync.Sync.__init__(self, rid=rid, type="sync.netapp", sync_max_delay=sync_max_delay, sync_interval=sync_interval, sync_days=sync_days, sync_period=sync_period, optional=optional, disabled=disabled, tags=tags) self.label = "netapp %s on %s"%(path, ', '.join(filers.values())) self.filers = filers self.path = path self.user = user self.path_short = self.path.replace('/vol/','') def __str__(self): return "%s filers=%s user=%s path=%s" % (resSync.Sync.__str__(self),\ self.filers, self.user, self.path) 0707010002453d000081b40000000000000000000000014faa950900001392000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/rcContainerLinux.pyimport os import rcExceptions as ex from rcUtilities import justcall default_cgroup_mntpt = '/cgroup' def get_cgroup_mntpt(): (out,err,ret) = justcall(['mount']) if ret != 0: return None for line in out.split('\n'): l = line.split() if len(l) < 6: continue if l[4] == 'cgroup': return l[2] return None def cgroup_capable(res): kconf = os.path.join(os.sep, 'lib', 'modules', os.uname()[2], 'build', '.config') if not os.path.exists(kconf): kconf = os.path.join(os.sep, 'boot', 'config-'+os.uname()[2]) if not os.path.exists(kconf): res.log.info("can not detect if system supports containerization") return False with open(kconf, 'r') as f: for line in f.readlines(): l = line.split('=') if len(l) != 2: continue if l[0] == 'CONFIG_CGROUPS' and l[1] == 'y\n': return True res.log.info("system does not support containerization") return False def set_cgroup(res, name, value): if value is None: return path = os.path.join(res.cgroup, name) if not os.path.exists(path): res.log.error("can not find %s"%path) raise ex.excError res.log.info('/bin/echo %s > %s'%(value, path)) with open(path, 'w') as f: f.write(str(value)) def get_cgroup(res, name): path = os.path.join(res.cgroup, name) if not os.path.exists(path): res.log.error("can not find %s"%path) raise ex.excError with open(path, 'r') as f: buff = f.read() return buff def set_mem_cgroup(res): if hasattr(res.svc, 'container_mem_limit'): mem_limit = int(res.svc.container_mem_limit) else: mem_limit = None if hasattr(res.svc, 'container_vmem_limit'): vmem_limit = int(res.svc.container_vmem_limit) else: vmem_limit = None # # validate memory limits sanity and order adequately the resize # depending on increase/decrease of limits # if mem_limit is not None and vmem_limit is not None: if mem_limit > vmem_limit: res.log.error("container_vmem_limit must be greater than container_mem_limit") raise ex.excError cur_vmem_limit = int(get_cgroup(res, 'memory.memsw.limit_in_bytes')) if mem_limit > cur_vmem_limit: set_cgroup(res, 'memory.memsw.limit_in_bytes', vmem_limit) set_cgroup(res, 'memory.limit_in_bytes', mem_limit) else: set_cgroup(res, 'memory.limit_in_bytes', mem_limit) set_cgroup(res, 'memory.memsw.limit_in_bytes', vmem_limit) elif mem_limit is not None: cur_vmem_limit = int(get_cgroup(res, 'memory.memsw.limit_in_bytes')) if mem_limit > cur_vmem_limit: res.log.error("container_mem_limit must not be greater than current container_vmem_limit (%d)"%cur_vmem_limit) raise ex.excError set_cgroup(res, 'memory.limit_in_bytes', mem_limit) elif vmem_limit is not None: cur_mem_limit = int(get_cgroup(res, 'memory.limit_in_bytes')) if vmem_limit < cur_mem_limit: res.log.error("container_vmem_limit must not be lesser than current container_mem_limit (%d)"%cur_mem_limit) raise ex.excError set_cgroup(res, 'memory.memsw.limit_in_bytes', vmem_limit) def containerize(res): if res.svc.svcmode == 'lxc': return if not cgroup_capable(res): return cgroup_mntpt = get_cgroup_mntpt() if cgroup_mntpt is None: cgroup_mntpt = default_cgroup_mntpt if not os.path.exists(cgroup_mntpt): res.log.info('mkdir %s'%cgroup_mntpt) os.makedirs(cgroup_mntpt) (ret, out, err) = res.vcall(['mount', '-t', 'cgroup', 'none', cgroup_mntpt]) if ret != 0: raise ex.excError res.cgroup = os.path.join(cgroup_mntpt, res.svc.svcname) if not os.path.exists(res.cgroup): os.makedirs(res.cgroup) if hasattr(res.svc, 'container_cpus'): v_cpus = str(res.svc.container_cpus) else: # default to all cpus import multiprocessing v_cpus = '0-%d'%(multiprocessing.cpu_count()-1) if hasattr(res.svc, 'container_mems'): v_mems = str(res.svc.container_mems) else: # default to all mems v_mems = '0' if hasattr(res.svc, 'container_cpu_share'): cpu_share = res.svc.container_cpu_share else: cpu_share = None pid = os.getpid() try: set_cgroup(res, 'cpuset.cpus', v_cpus) set_cgroup(res, 'cpu.shares', cpu_share) set_cgroup(res, 'cpuset.mems', v_mems) set_mem_cgroup(res) set_cgroup(res, 'tasks', pid) except: res.log.error("containerization in '%s' cgroup failed"%res.svc.svcname) raise ex.excError res.log.info("containerized in '%s' cgroup, with limits cpu[%s], mem[%s]:"%(res.svc.svcname, v_cpus, v_mems)) 070701000245d3000081b40000000000000000000000014faa9509000014bb000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/resMountAIX.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import os import rcMountsAIX as rcMounts import resMount as Res from rcUtilities import qcall, protected_mount, getmount from rcGlobalEnv import rcEnv import rcExceptions as ex from stat import * def try_umount(self): cmd = ['umount', self.mountPoint] (ret, out, err) = self.vcall(cmd, err_to_info=True) if ret == 0: return 0 """ don't try to kill process using the source of a protected bind mount """ if protected_mount(self.mountPoint): return 1 """ best effort kill of all processes that might block the umount operation. The priority is given to mass action reliability, ie don't contest oprator's will """ cmd = ['sync'] (ret, out, err) = self.vcall(cmd, err_to_info=True) for i in range(4): cmd = ['fuser', '-k', '-x', '-c', self.mountPoint] (ret, out, err) = self.vcall(cmd, err_to_info=True) self.log.info('umount %s'%self.mountPoint) cmd = ['umount', self.mountPoint] ret = qcall(cmd) if ret == 0: break return ret class Mount(Res.Mount): """ define Linux mount/umount doAction """ def __init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size=None, always_on=set([]), disabled=False, tags=set([]), optional=False, monitor=False): self.Mounts = None Res.Mount.__init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size, always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) self.fsck_h = { 'jfs': {'bin': 'fsck', 'cmd': ['fsck', '-p', '-V', 'jfs', self.device]}, 'jfs2': {'bin': 'fsck', 'cmd': ['fsck', '-p', '-V', 'jfs2', self.device]}, } def is_up(self): self.Mounts = rcMounts.Mounts() return self.Mounts.has_mount(self.device, self.mountPoint) def realdev(self): try: mode = os.stat(self.device)[ST_MODE] except: self.log.debug("can not stat %s" % self.device) return None if S_ISBLK(mode): dev = self.device else: mnt = getmount(self.device) if self.Mounts is None: self.Mounts = rcMounts.Mounts() m = self.Mounts.has_param("mnt", mnt) if m is None: self.log.debug("can't find dev %(dev)s mounted in %(mnt)s in mnttab"%dict(mnt=mnt, dev=self.device)) return None dev = m.dev return dev def mplist(self): dev = self.realdev() if dev is None: return set([]) return self._mplist([dev]) def _mplist(self, devs): mps = set([]) return mps def disklist(self): dev = self.realdev() if dev is None: return set([]) return set([]) def can_check_writable(self): return True def start(self): if self.Mounts is None: self.Mounts = rcMounts.Mounts() Res.Mount.start(self) if self.is_up() is True: self.log.info("fs(%s %s) is already mounted"% (self.device, self.mountPoint)) return 0 self.fsck() if not os.path.exists(self.mountPoint): os.makedirs(self.mountPoint, 0755) if self.fsType != "": fstype = ['-v', self.fsType] else: fstype = [] if self.mntOpt != "": mntopt = ['-o', self.mntOpt] else: mntopt = [] cmd = ['mount']+fstype+mntopt+[self.device, self.mountPoint] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError self.Mounts = None def stop(self): if self.Mounts is None: self.Mounts = rcMounts.Mounts() if self.is_up() is False: self.log.info("fs(%s %s) is already umounted"% (self.device, self.mountPoint)) return for i in range(3): ret = try_umount(self) if ret == 0: break if ret != 0: self.log.error('failed to umount %s'%self.mountPoint) raise ex.excError self.Mounts = None if __name__ == "__main__": for c in (Mount,) : help(c) 070701000245ef000081b40000000000000000000000014faa95090000101f000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/resVgLdom.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import rcExceptions as ex import rcStatus resVg = __import__("resDg") from subprocess import * import re class Vg(resVg.Dg): def __init__(self, rid=None, name=None, type=None, optional=False, disabled=False, tags=set([]), monitor=False): self.label = name resVg.Dg.__init__(self, rid=rid, name=name, type='disk.vg', optional=optional, disabled=disabled, tags=tags, monitor=monitor) def has_it(self): return True def is_up(self): return True def _status(self, verbose=False): return rcStatus.NA def do_start(self): pass def do_stop(self): pass def disklist(self): """ VCC|name=vccname|... VDS|name=vdsname|... |vol=volname|..|dev=/dev/...|.... |vol=volname1|..|dev=/dev/...|.... VDS|name=vdsname1|.. |vol=volname2|..|dev=/dev/...|.... ldm list -o disk -p domname VERSION DOMAIN|.. VDISK|name=...|vol=volname@vds|... VDISK|name=...|vol=volname2@vds2|... """ vdevname2dev = {} cmd = [ '/usr/sbin/ldm', 'list-services' , '-p' ] p = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) buff = p.communicate() if p.returncode != 0: raise ex.excError vds = '' for line in buff[0].split('\n'): keys = line.split('|') if keys[0] == 'VDS' and len(keys) > 1 : for k in keys : name_value = k.split('=') if name_value[0] == 'name' and len(name_value) == 2 : vds = name_value[1] elif vds != '' and keys[0] == '': volname = '' dev = '' for k in keys : name_value = k.split('=') if name_value[0] == 'vol' and len(name_value) == 2 : volname = name_value[1] elif name_value[0] == 'dev' and len(name_value) == 2 : dev = name_value[1] if re.match('^/dev/dsk/', dev) is None: continue dev = dev.replace('/dev/dsk/','/dev/rdsk/',1) if re.match('^.*s[0-9]$',dev) is None: dev = dev + 's2' vdevname2dev[volname + '@' + vds ] = dev else: vds = '' cmd = ['/usr/sbin/ldm', 'list', '-o', 'disk', '-p', self.svc.vmname] p = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) buff = p.communicate() if p.returncode != 0: raise ex.excError for line in buff[0].split('\n'): keys = line.split('|') if keys[0] == 'VDISK' and len(keys) > 1 : for k in keys : name_value = k.split('=') if name_value[0] == 'vol' and len(name_value) == 2 : vol = name_value[1] if vdevname2dev.has_key(vol): self.disks |= set([ vdevname2dev[vol] ]) return self.disks 0707010002450d000081b40000000000000000000000014faa950900000863000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/checkMpathHP-UX.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "mpath" def find_svc(self, dev): for svc in self.svcs: if dev in svc.disklist(): return svc.svcname return '' def do_check(self): cmd = ['scsimgr', 'lun_map'] out, err, ret = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 1: return self.undef r = [] dev = None wwid = None for line in lines: if "LUN PATH INFORMATION FOR LUN" in line: # new mpath # - store previous # - reset path counter if dev is not None and not dev.startswith('/dev/pt/pt'): r.append({'chk_instance': wwid, 'chk_value': str(n), 'chk_svcname': self.find_svc(dev), }) n = 0 l = line.split() if len(l) < 2: continue dev = l[-1] if "World Wide Identifier" in line: wwid = line.split()[-1].replace("0x","") if "State" in line and ("ACTIVE" in line or "UNOPEN" in line or 'STANDBY' in line): n += 1 return r 07070100024560000081b40000000000000000000000014faa950900001f46000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/rcLvmAIX.pyfrom subprocess import * """ lsvg format =========== VOLUME GROUP: rootvg VG IDENTIFIER: 00082a6a0000d400000001321aa20bf2 VG STATE: active PP SIZE: 64 megabyte(s) VG PERMISSION: read/write TOTAL PPs: 959 (61376 megabytes) MAX LVs: 256 FREE PPs: 717 (45888 megabytes) LVs: 11 USED PPs: 242 (15488 megabytes) OPEN LVs: 10 QUORUM: 2 (Enabled) TOTAL PVs: 1 VG DESCRIPTORS: 2 STALE PVs: 0 STALE PPs: 0 ACTIVE PVs: 1 AUTO ON: yes MAX PPs per VG: 32512 MAX PPs per PV: 1016 MAX PVs: 32 LTG size (Dynamic): 256 kilobyte(s) AUTO SYNC: no HOT SPARE: no BB POLICY: relocatable lsvg -l vgname format ===================== rootvg: LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT hd5 boot 1 1 1 closed/syncd N/A hd6 paging 32 32 1 open/syncd N/A hd8 jfs2log 1 1 1 open/syncd N/A hd4 jfs2 16 16 1 open/syncd / hd2 jfs2 40 40 1 open/syncd /usr hd9var jfs2 16 16 1 open/syncd /var hd3 jfs2 16 16 1 open/syncd /tmp hd1 jfs2 16 16 1 open/syncd /home hd10opt jfs2 16 16 1 open/syncd /opt lv_logs jfs2 32 32 1 open/syncd /logs lv_moteurs jfs2 56 56 1 open/syncd /moteurs lspv format =========== hdisk0 00082a6a1aa20b3c rootvg active hdisk1 00082a6ae73c7bb6 datavg active lspv -l pvname format ===================== hdisk0: LV NAME LPs PPs DISTRIBUTION MOUNT POINT hd10opt 16 16 00..00..16..00..00 /opt hd2 40 40 00..00..40..00..00 /usr hd9var 16 16 00..00..16..00..00 /var hd3 16 16 00..00..16..00..00 /tmp hd1 16 16 00..00..16..00..00 /home hd5 1 1 01..00..00..00..00 N/A hd6 32 32 00..00..32..00..00 N/A hd8 1 1 00..00..01..00..00 N/A hd4 16 16 00..00..16..00..00 / lv_logs 32 32 00..32..00..00..00 /logs lv_moteurs 56 56 00..56..00..00..00 /moteurs """ class InitVgError(Exception): pass class Container(dict): def __call__(self,key): return self.__getitem__(key) def __getitem__(self, key): dict.__getitem__(self, key) def __setitem__(self, key, value): dict.__setitem__(self, key, value) def __getattr__(self, key): return self[key] def __setattr__(self, key, value): self[key] = value def __iadd__(self, o): dict.__setitem__(self, o.name, o) return self class Vg(object): props = [{"prop": "ppsize", "key": "PP SIZE:", "consume": 2}] def __init__(self, name): self.name = name self.lv = Container() self.pv = Container() self.load_vg(name) self.load_lv(name) def __str__(self): l = [] l.append("type: vg") l.append("name: %s"%self.name) l.append("pp size: %d MB"%self.ppsize) s = '\n'.join(l) for lv in self.lv.values(): s += str(lv) + '\n' return s def parse_ppsize(self, l): self.ppsize = int(l[0]) if 'megabyte' in l[1]: pass elif 'kilobyte' in l[1]: self.ppsize /= 1024 elif 'gigabyte' in l[1]: self.ppsize *= 1024 def load_vg(self, name): cmd = ['lsvg', name] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: raise InitVgError() for line in out.split('\n'): for p in self.props: if p['key'] not in line: continue _line = line[line.index(p['key'])+len(p['key']):] l = _line.split() getattr(self, 'parse_'+p['prop'])(l[0:p['consume']]) def load_lv(self, name): cmd = ['lsvg', '-l', name] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: raise InitVgError() for line in out.split('\n'): if 'LV NAME' in line: continue l = line.split() if len(l) < 6: continue _name, _type, _lps, _pps, _pvs, _state = l[0:6] _mntpt = ' '.join(l[6:]) lv = Lv(_name) lv.type = _type lv.lps = int(_lps) lv.pps = int(_pps) lv.pvs = int(_pvs) lv.state = _state lv.mntpt = _mntpt lv.size = lv.pps * self.ppsize self.lv += lv class Pv(object): def __init__(self, name): self.name = name self.lv_pps = {} self.load_lv_pps(name) def load_lv_pps(self, name): cmd = ['lspv', '-l', name] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: raise InitVgError() for line in out.split('\n'): if 'LV NAME' in line: continue l = line.split() if len(l) < 4: continue _name, _lps, _pps, _distrib = l[0:4] _mntpt = ' '.join(l[4:]) if name in self.lv_pps: self.lv_pps[_name] += int(_pps) else: self.lv_pps[_name] = int(_pps) class Lv(object): def __init__(self, name): self.name = name self.pv_size = {} def __str__(self): l = [] l.append("type: lv") l.append("name: %s"%self.name) l.append("lv size: %d MB"%self.size) l.append("pv usage: %s"%self.pv_size.items()) return '\n'.join(l) class Lvm(object): def __init__(self): self.vg = Container() self.pv = Container() self.load_vg() self.load_pv() def __str__(self): s = "" for vgname, vg in self.vg.items(): s += str(vg) + '\n\n' return s def load_vg(self): cmd = ['lsvg'] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: raise InitVgError() for vg in out.split(): self.vg += Vg(vg) def load_pv(self): cmd = ['lspv'] p = Popen(cmd, stdout=PIPE) out, err = p.communicate() if p.returncode != 0: raise InitVgError() for line in out.split('\n'): l = line.split() if len(l) != 4: continue _name, _id, _vgname, _state = l pv = Pv(_name) pv.id = _id pv.vgname = _vgname pv.state = _state self.pv += pv for lvname, lvpps in pv.lv_pps.items(): vg, lv = self.find_lv(lvname) if lv is None: continue lv.pv_size[pv.name] = vg.ppsize * lvpps def find_lv(self, lvname): for vg in self.vg.values(): for lv in vg.lv.values(): if lv.name == lvname: return vg, lv return None, None if __name__ == "__main__" : lvm = Lvm() print lvm 070701000245a9000081b40000000000000000000000014faa950900001e03000000ae00010002ffffffffffffffff0000001e00000000root/opt/opensvc/lib/rcZfs.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from rcUtilities import justcall, call, vcall import logging import sys """ """ def dataset_exists(device, type): """return Dataset(device).exists(type)""" return Dataset(device).exists(type) def zfs_getprop(dataset='undef_ds', propname='undef_prop'): "return zfs dataset property propname value" cmd = [ 'zfs', 'get', '-Hp', '-o', 'value', propname, dataset ] (stdout, stderr, retcode) = justcall(cmd) if retcode == 0 : return stdout.split("\n")[0] else: return "" def zfs_setprop(dataset='undef_ds', propname='undef_prop', propval='undef_val'): "set zfs dataset property propname to value propval" if zfs_getprop(dataset, propname) == propval : return True cmd = [ 'zfs', 'set', propname + '='+ propval, dataset ] print ' '.join(cmd) (retcode, stdout, stderr) = vcall(cmd) if retcode == 0 : return True else: return False def a2pool_dataset(s): """return (pool,dataset) from mount point example: a2pool_dataset('/') => ('rpool','rpool/ROOT/opensolaris-b134') same with a2pool_dataset('rpool/ROOT/opensolaris-b134') """ if len(s) == 0: return ("", "") ss = s if s[0] == '/': cmd = ['zfs', 'list', '-H', '-o', 'name', s] (ret, out, err) = call(cmd) if ret != 0: return ("", "") ss = out.split('\n')[0] x = ss.split('/') if len(x) < 2: return (ss, ss) return (x[0], ss) class Dataset(object): """Define Dataset Class""" log = None def __init__(self, name, log=None): self.name = name if log is None: if Dataset.log is None: Dataset.log = logging.getLogger("DATASET".upper()) Dataset.log.addHandler(logging.StreamHandler(sys.stdout)) Dataset.log.setLevel(logging.INFO) self.log = Dataset.log else: self.log = log def __str__(self, option=None): if option is None: cmd = ['zfs', 'list', self.name ] else: cmd = ['zfs', 'list'] + option + [ self.name ] (retcode, stdout, stderr) = call(cmd, log=self.log) if retcode == 0: return stdout else: return "Failed to list info for dataset: %s" % (self.name) def destroy(self): "destroy dataset" cmd = ['zfs', 'destroy', self.name ] (retcode, stdout, stderr) = vcall(cmd, log=self.log) if retcode == 0: return True else: return False def exists(self, type="all"): """return True if dataset exists else return False if type is provided, also verify dataset type""" (out, err, ret) = justcall('zfs get -H -o value type'.split()+[self.name]) if ret == 0 and type == "all": return True elif ret == 0 and out.split('\n')[0] == type: return True else: return False def create(self, option = None): "create dataset with options" if option is None: cmd = ['zfs', 'create', self.name ] else: cmd = ['zfs', 'create'] + option + [ self.name ] (retcode, stdout, stderr) = vcall(cmd, log=self.log) if retcode == 0: return True else: return False def getprop(self, propname): """get a dataset propertie value of dataset If success return propperty value else return '' """ cmd = [ 'zfs', 'get', '-Hp', '-o', 'value', propname, self.name ] (stdout, stderr, retcode) = justcall(cmd) if retcode == 0 : return stdout.rstrip('\n') else: return "" def setprop(self, propname, propval, err_to_warn=False, err_to_info=False): """set Dataset property value Return True is sucess else return False """ cmd = [ 'zfs', 'set', propname + '='+ propval, self.name ] (retcode, stdout, stderr) = vcall(cmd, log=self.log, err_to_warn=err_to_warn, err_to_info=err_to_info) if retcode == 0 : return True else: return False def verify_prop(self, nv_pairs={}, err_to_warn=False, err_to_info=False): """for name, val from nv_pairs dict, if zfs name property value of dataset differ from val then zfs set name=value on dataset object""" for name in nv_pairs.keys(): if self.getprop(name) != nv_pairs[name]: self.setprop(propname=name, propval=nv_pairs[name], err_to_warn=err_to_warn, err_to_info=err_to_info) def snapshot(self, snapname=None): """snapshot dataset return snapshot dataset object Return False if failure """ if snapname is None: raise(rcExceptions.excBug("snapname should be defined")) snapdataset = self.name + "@" + snapname cmd = ['zfs', 'snapshot', snapdataset ] (retcode, stdout, stderr) = vcall(cmd, log=self.log) if retcode == 0: return Dataset(snapdataset) else: return False def clone(self, name, option=None): """clone dataset with options return clone object return False if failure """ if option is None: cmd = ['zfs', 'clone', self.name, name] else: cmd = ['zfs', 'clone'] + option + [ self.name, name ] (retcode, stdout, stderr) = vcall(cmd, log=self.log) if retcode == 0: return Dataset(name) else: return False if __name__ == "__main__": dsname="rpool/toto" ds = Dataset(dsname) if ds.create(option=[ "-o", "mountpoint=none"]) is False: print "========== Failed" else: print ds ds.verify_prop({'mountpoint':'/tmp/mnt', 'refquota':(10*1024*1024).__str__(),}) print "show type,refquota,mountpoint" for p in ('type', 'refquota', 'mountpoint'): print '%s value: %s'%(p, ds.getprop(p)) print ds val = ds.setprop('opensvc:name', 'Example') print ds.__str__(["-Ho", "opensvc:name"]) val = ds.getprop('opensvc:name') print "val Value=",val for sname in ["foo" , "bar"]: s = ds.snapshot(sname) if s is False: print "========== Failed" else: print s c=s.clone(dsname + "/clone_"+ sname) if c is False: print "========== Failed" else: print c c.destroy() if s.destroy() is False: print "========== Failed" if ds.exists: print "Destroy dataset", ds.name if ds.destroy() is False: print "Failed to create snapshot" 07070100024521000081b40000000000000000000000014faa950900000378000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/hostidWindows.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from uuid import getnode def hostid(): return str(getnode()) 070701000245a6000081b40000000000000000000000014faa9509000000c8000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/rcUtilitiesSunOS.pyfrom rcUtilities import call def check_ping(addr, timeout=5, count=1): cmd = ['ping', addr, "%s" % timeout] (ret, out, err) = call(cmd) if ret == 0: return True return False 070701000245e3000081b40000000000000000000000014faa950900003acd000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/resSyncDds.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import logging from rcGlobalEnv import rcEnv from rcUtilities import which from rcUtilitiesLinux import lv_info from subprocess import * import rcExceptions as ex import rcStatus import datetime import resSync class syncDds(resSync.Sync): def pre_action(self, rset, action): """Don't sync PRD services when running on !PRD node """ if self.svc.svctype == 'PRD' and rcEnv.host_mode != 'PRD': self.log.debug("won't sync a PRD service running on a !PRD node") raise ex.excAbortAction for i, r in enumerate(rset.resources): if r.is_disabled(): continue if not r.svc_syncable(): return r.get_info() if action == 'syncfullsync': r.create_snap1() elif action in ['syncupdate', 'syncresync', 'syncdrp', 'syncnodes']: if action == 'syncnodes' and self.target != ['nodes']: return if action == 'syncdrp' and self.target != ['drpnodes']: return r.get_info() r.get_snap1_uuid() nb = 0 tgts = r.targets.copy() for n in tgts: try: r.check_remote(n) nb += 1 except: self.targets -= set([n]) if nb != len(tgts): self.log.error('all destination nodes must be present for dds-based synchronization to proceed') raise ex.excError r.create_snap2() def snap_exists(self, dev): if not os.path.exists(dev): self.log.debug('dev path does not exist') return False cmd = ['lvs', '--noheadings', '-o', 'snap_percent', dev] (ret, out, err) = self.call(cmd, errlog=False) if ret != 0: return False if len(out.strip()) == 0: self.log.debug('dev is not a snapshot') return False return True def create_snap(self, dev, lv): if self.snap_exists(dev): self.log.error('%s should not exist'%dev) raise ex.excError cmd = ['lvcreate', '-s', '-n', lv, '-L', str(self.snap_size)+'M', os.path.join(os.sep, 'dev', self.src_vg, self.src_lv) ] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def set_statefile(self): self.statefile = os.path.join(rcEnv.pathvar, self.svc.svcname+'_'+self.rid+'_dds_state') def create_snap1(self): if self.snap_exists(self.snap2): self.log.error('%s should not exist'%self.snap2) raise ex.excError self.create_snap(self.snap1, self.snap1_lv) self.write_statefile() def create_snap2(self): self.create_snap(self.snap2, self.snap2_lv) def snap_name(self, snap): return os.path.basename(self.src_lv).replace('-', '_')+'_osvc_'+snap def get_src_info(self): (self.src_vg, self.src_lv, self.src_size) = lv_info(self, self.src) if self.src_lv is None: self.log.error("unable to fetch source logical volume information") raise ex.excError if self.snap_size == 0: self.snap_size = self.src_size//10 self.snap1_lv = self.snap_name('snap1') self.snap2_lv = self.snap_name('snap2') self.snap1 = os.path.join(os.sep, 'dev', self.src_vg, self.snap1_lv) self.snap2 = os.path.join(os.sep, 'dev', self.src_vg, self.snap2_lv) self.snap1_cow = os.path.join(os.sep, 'dev', 'mapper', '-'.join([self.src_vg.replace('-', '--'), self.snap1_lv, 'cow']) ) def get_peersenders(self): self.peersenders = set([]) if 'nodes' not in self.target: self.peersenders |= self.svc.nodes self.peersenders -= set([rcEnv.nodename]) def get_targets(self): self.targets = set() if 'nodes' in self.target: self.targets |= self.svc.nodes if 'drpnodes' in self.target: self.targets |= self.svc.drpnodes self.targets -= set([rcEnv.nodename]) def get_info(self): self.get_targets() self.get_src_info() def svc_syncable(self): s = self.svc.group_status(excluded_groups=set(["sync", "hb"])) if s['overall'].status != rcStatus.UP: self.log.debug("won't sync this resource for a service not up") return False if self.svc.clustertype in ["flex", "autoflex"] and \ self.svc.flex_primary != rcEnv.nodename: self.log.debug("won't sync this resource from a flex non-primary node") return set([]) return True def syncfullsync(self): if not self.svc_syncable(): return for n in self.targets: self.do_fullsync(n) def do_fullsync(self, node): cmd1 = ['dd', 'if='+self.snap1, 'bs=1M'] cmd2 = rcEnv.rsh.split() + [node, 'dd', 'bs=1M', 'of='+self.dst] self.log.info(' '.join(cmd1 + ["|"] + cmd2)) p1 = Popen(cmd1, stdout=PIPE) p2 = Popen(cmd2, stdin=p1.stdout, stdout=PIPE) p2.communicate()[0] if p2.returncode != 0: self.log.error("full sync failed") raise ex.excError self.push_statefile(node) def get_snap1_uuid(self): cmd = ['lvs', '--noheadings', '-o', 'uuid', self.snap1] (ret, out, err) = self.call(cmd) if ret != 0: raise ex.excError self.snap1_uuid = out.strip() def write_statefile(self): self.set_statefile() self.get_snap1_uuid() self.log.info("update state file with snap uuid %s"%self.snap1_uuid) with open(self.statefile, 'w') as f: f.write(str(datetime.datetime.now())+';'+self.snap1_uuid+'\n') def _push_statefile(self, node): cmd = rcEnv.rcp.split() + [self.statefile, node+':'+self.statefile] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def push_statefile(self, node): self.set_statefile() self._push_statefile(node) self.get_peersenders() for s in self.peersenders: self._push_statefile(s) def apply_delta(self, node): extract_cmd = ['dds', '--extract', '--cow', self.snap1_cow, '--source', self.snap2] merge_cmd = ['dds', '--merge', '--dest', self.dst, '-v'] merge_cmd = rcEnv.rsh.split() + [node] + merge_cmd self.log.info(' '.join(extract_cmd + ["|"] + merge_cmd)) p1 = Popen(extract_cmd, stdout=PIPE) p2 = Popen(merge_cmd, stdin=p1.stdout, stdout=PIPE) buff = p2.communicate() if p2.returncode != 0: if buff[1] is not None and len(buff[1]) > 0: self.log.error(buff[1]) self.log.error("sync update failed") raise ex.excError if buff[0] is not None and len(buff[0]) > 0: self.log.info(buff[0]) def do_update(self, node): self.apply_delta(node) def remove_snap1(self): if not self.snap_exists(self.snap1): return cmd = ['lvremove', '-f', self.snap1] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def rename_snap2(self): if not self.snap_exists(self.snap2): self.log.error("%s should exist"%self.snap2) raise ex.excError if self.snap_exists(self.snap1): self.log.error("%s should not exist"%self.snap1) raise ex.excError cmd = ['lvrename', self.src_vg, self.snap2_lv, self.snap1_lv] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def rotate_snaps(self): self.remove_snap1() self.rename_snap2() def check_remote(self, node): rs = self.get_remote_state(node) if self.snap1_uuid != rs['uuid']: self.log.error("%s last update uuid doesn't match snap1 uuid"%(node)) raise ex.excError def get_remote_state(self, node): self.set_statefile() cmd1 = ['env', 'LANG=C', 'cat', self.statefile] cmd = rcEnv.rsh.split() + [node] + cmd1 (ret, out, err) = self.call(cmd) if ret != 0: self.log.error("could not fetch %s last update uuid"%node) raise ex.excError return self.parse_statefile(out, node=node) def get_local_state(self): self.set_statefile() with open(self.statefile, 'r') as f: out = f.read() return self.parse_statefile(out) def parse_statefile(self, out, node=None): self.set_statefile() if node is None: node = rcEnv.nodename lines = out.strip().split('\n') if len(lines) != 1: self.log.error("%s:%s is corrupted"%(node, self.statefile)) raise ex.excError fields = lines[0].split(';') if len(fields) != 2: self.log.error("%s:%s is corrupted"%(node, self.statefile)) raise ex.excError return dict(date=fields[0], uuid=fields[1]) def syncnodes(self): if self.target != ['nodes']: return self.syncupdate() def syncdrp(self): if self.target != ['drpnodes']: return self.syncupdate() def syncupdate(self): if not self.svc_syncable(): return for n in self.targets: self.do_update(n) self.rotate_snaps() self.write_statefile() for n in self.targets: self.push_statefile(n) def checksum(self, node, bdev, q=None): cmd = ['md5sum', bdev] if node != rcEnv.nodename: cmd = rcEnv.rsh.split() + [node] + cmd (ret, out, err) = self.call(cmd) if ret != 0: return "" o = out.split() if q is not None: q.put(o[0]) else: self.checksums[node] = o[0] def syncverify(self): s = self.svc.group_status(excluded_groups=set(["sync", "hb"])) if s['overall'].status != rcStatus.UP: self.log.debug("won't verify this resource for a service not up") return if self.svc.clustertype in ["flex", "autoflex"] and \ self.svc.flex_primary != rcEnv.nodename: self.log.debug("won't verify this resource from a flex non-primary node") return set([]) self.get_info() from multiprocessing import Process, Queue self.checksums = {} queues = {} ps = [] self.log.info("start checksum threads. please be patient.") for n in self.targets: queues[n] = Queue() p = Process(target=self.checksum, args=(n, self.dst, queues[n])) p.start() ps.append(p) self.checksum(rcEnv.nodename, self.snap1) self.log.info("md5 %s: %s"%(rcEnv.nodename, self.checksums[rcEnv.nodename])) for p in ps: p.join() for n in self.targets: self.checksums[n] = queues[n].get() self.log.info("md5 %s: %s"%(n, self.checksums[n])) if len(self.checksums) < 2: self.log.error("not enough checksums collected") raise ex.excError err = False for n in self.targets: if self.checksums[rcEnv.nodename] != self.checksums[n]: self.log.error("src/dst checksums differ for %s/%s"%(rcEnv.nodename, n)) err = True if not err: self.log.info("src/dst checksums verified") def start(self): pass def stop(self): pass def can_sync(self, target=None): try: ls = self.get_local_state() last = datetime.datetime.strptime(ls['date'], "%Y-%m-%d %H:%M:%S.%f") except IOError: return True return not self.skip_sync(last) def _status(self, verbose=False): try: ls = self.get_local_state() now = datetime.datetime.now() last = datetime.datetime.strptime(ls['date'], "%Y-%m-%d %H:%M:%S.%f") delay = datetime.timedelta(minutes=self.sync_max_delay) except ex.excError: self.status_log("failed to get status") return rcStatus.WARN except IOError: self.status_log("dds state file not found") return rcStatus.WARN except: import sys import traceback e = sys.exc_info() print e[0], e[1], traceback.print_tb(e[2]) return rcStatus.WARN if last < now - delay: self.status_log("Last sync on %s older than %i minutes"%(last, self.sync_max_delay)) return rcStatus.WARN return rcStatus.UP def __init__(self, rid=None, target=None, src=None, dst=None, delta_store=None, sender=None, snap_size=0, sync_max_delay=None, sync_interval=None, sync_days=None, sync_period=None, optional=False, disabled=False, tags=set([])): resSync.Sync.__init__(self, rid=rid, type="sync.dds", sync_max_delay=sync_max_delay, sync_interval=sync_interval, sync_days=sync_days, sync_period=sync_period, optional=optional, disabled=disabled, tags=tags) self.label = "dds of %s to %s"%(src, target) self.target = target self.src = src self.dst = dst self.snap_size = snap_size if delta_store is None: self.delta_store = rcEnv.pathvar else: self.delta_store = delta_store def __str__(self): return "%s target=%s src=%s" % (resSync.Sync.__str__(self),\ self.target, self.src) 070701000245e0000081b40000000000000000000000014faa95090000140a000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/resSyncDcs.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import rcExceptions as ex import subprocess import resSync from rcGlobalEnv import rcEnv from rcUtilities import justcall class SyncDcs(resSync.Sync): def wait_for_devs_ready(self): pass def get_active_dcs(self): if self.active_dcs is not None: return for d in self.dcs: try: self.log.debug("try dcs", d) self.dcscmd("get-dcsserver", dcs=d) self.active_dcs = d self.log.debug("set active dcs", self.active_dcs) return except: pass if self.active_dcs is None: self.log.error("no usable dcs server") raise ex.excError def get_auth(self): if self.username is not None and \ self.password is not None: return self.get_active_manager() if self.active_manager is None: raise ex.excError("no active manager") import ConfigParser if not os.path.exists(self.conf): raise ex.excError("missing %s"%self.conf) self.config = ConfigParser.RawConfigParser() self.config.read(self.conf) if not self.config.has_section(self.active_manager): raise ex.excError("no credentials for manager %s in %s"%(self.active_manager, self.conf)) if not self.config.has_option(self.active_manager, "username"): raise ex.excError("no username set for manager %s in %s"%(self.active_manager, self.conf)) if not self.config.has_option(self.active_manager, "password"): raise ex.excError("no password set for manager %s in %s"%(self.active_manager, self.conf)) self.username = self.config.get(self.active_manager, "username") self.password = self.config.get(self.active_manager, "password") def dcscmd(self, cmd="", verbose=False, check=True, dcs=None): self.get_active_manager() if dcs is None: self.get_active_dcs() dcs = self.active_dcs self.get_auth() cmd = ['ssh', self.active_manager, "connect-dcsserver -server %s -username %s -password %s ; "%(dcs, self.username, self.password)+\ cmd+\ " ; disconnect-dcsserver"] if verbose: import re from copy import copy _cmd = copy(cmd) _cmd[2] = re.sub(r'password \S+', 'password xxxxx', _cmd[2]) self.log.info(subprocess.list2cmdline(_cmd)) ret, out, err = self.call(cmd) else: ret, out, err = self.call(cmd, errlog=False) if check and "ErrorId" in err: raise ex.excError("dcscmd command execution error") return ret, out, err def get_active_manager(self): if self.active_manager is not None: return for manager in self.manager: cmd = ['ssh', manager, 'id'] out, err, ret = justcall(cmd) if ret != 0: continue self.active_manager = manager self.log.debug("set active manager", self.active_manager) return if self.active_manager is None: self.log.error("no usable manager") raise ex.excError def __init__(self, rid=None, manager=set([]), dcs=set([]), type="sync.dcsunknown", sync_max_delay=None, sync_interval=None, sync_days=None, sync_period=None, optional=False, disabled=False, tags=set([]), internal=False): resSync.Sync.__init__(self, rid=rid, type=type, sync_max_delay=sync_max_delay, sync_interval=sync_interval, sync_days=sync_days, sync_period=sync_period, optional=optional, disabled=disabled, tags=tags) self.active_dcs = None self.active_manager = None self.username = None self.password = None self.dcs = dcs self.manager = manager self.conf = os.path.join(rcEnv.pathetc, 'auth.conf') def __str__(self): return "%s dcs=%s manager=%s" % ( resSync.Sync.__str__(self), ' '.join(self.dcs), ' '.join(self.manager)) 07070100024536000081b40000000000000000000000014faa950900000be0000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/rcAssetDarwin.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import datetime from rcUtilities import justcall, which from rcGlobalEnv import rcEnv import rcAsset class Asset(rcAsset.Asset): def __init__(self, node): rcAsset.Asset.__init__(self, node) self.sphw = {} (out, err, ret) = justcall(['system_profiler', 'SPHardwareDataType']) if ret == 0: for line in out.split('\n'): l = line.split(':') if len(l) != 2: continue self.sphw[l[0].strip()] = l[1].strip() def _get_mem_bytes(self): if 'Memory' not in self.sphw: return '0' m = self.sphw['Memory'].split() size = int(m[0]) unit = m[1] if unit == 'GB': size = size * 1024 elif unit == 'MB': pass else: raise return str(size) def _get_mem_banks(self): return '0' def _get_mem_slots(self): return '0' def _get_os_vendor(self): return 'Apple' def _get_os_release(self): (out, err, ret) = justcall(['uname', '-r']) if ret != 0: return 'Unknown' return out.split()[0] def _get_os_kernel(self): return self._get_os_release() def _get_os_arch(self): cmd = ['uname', '-m'] (out, err, ret) = justcall(cmd) if ret != 0: return 'Unknown' return out.split('\n')[0] def _get_cpu_freq(self): if 'Processor Speed' not in self.sphw: return '0' return self.sphw['Processor Speed'] def _get_cpu_cores(self): if 'Total Number of Cores' not in self.sphw: return '0' return self.sphw['Total Number of Cores'] def _get_cpu_dies(self): if 'Number of Processors' not in self.sphw: return '0' return self.sphw['Number of Processors'] def _get_cpu_model(self): if 'Processor Name' not in self.sphw: return '0' return self.sphw['Processor Name'] def _get_serial(self): if 'Hardware UUID' not in self.sphw: return '0' return self.sphw['Hardware UUID'] def _get_model(self): if 'Model Name' not in self.sphw: return '0' return self.sphw['Model Name'] 07070100024533000081b40000000000000000000000014faa95090000038f000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcAddService.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import logging def addservice(): log = logging.getLogger('CREATE') log.info('enter') 07070100024527000081b40000000000000000000000014faa950900000cc3000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/provFs.pyfrom provisioning import Provisioning from rcUtilities import justcall, which from rcGlobalEnv import rcEnv import os import rcExceptions as ex class ProvisioningFs(Provisioning): # required from children: # mkfs = ['mkfs.ext4', '-F'] # info = ['tune2fs', '-l'] def __init__(self, r): Provisioning.__init__(self, r) self.section = dict(r.svc.config.items(r.rid)) self.dev = self.section['dev'] self.mnt = self.section['mnt'] def check_fs(self): cmd = self.info + [self.dev] out, err, ret = justcall(cmd) if ret == 0: return True self.r.log.info("%s is not formatted"%self.dev) return False def provision_dev_linux(self): if not which('vgdisplay'): self.r.log.error("vgdisplay command not found") raise ex.excError cmd = ['vgdisplay', self.section['vg']] out, err, ret = justcall(cmd) if ret != 0: self.r.log.error("volume group %s does not exist"%self.section['vg']) raise ex.excError if self.dev.startswith('/dev/mapper/'): dev = self.dev.replace('/dev/mapper/').replace(self.section['vg'].replace('-', '--')+'-', '') dev = dev.replace('--', '-') elif self.section['vg'] in self.dev: dev = os.path.basename(self.dev) else: self.r.log.error("malformat dev %s"%self.dev) raise ex.excError if which('lvcreate'): # create the logical volume cmd = ['lvcreate', '-n', dev, '-L', str(self.section['size'])+'M', self.section['vg']] ret, out, err = self.r.vcall(cmd) if ret != 0: raise ex.excError else: self.r.log.error("lvcreate command not found") raise ex.excError # /dev/mapper/$vg-$lv and /dev/$vg/$lv creation is delayed ... refresh self.r.vcall(["dmsetup", "mknodes"]) mapname = "%s-%s"%(self.section['vg'].replace('-','--'), dev.replace('-','--')) self.dev = '/dev/mapper/'+mapname import time for i in range(3, 0, -1): if os.path.exists(self.dev): break if i != 0: time.sleep(1) if i == 0: self.r.log.error("timed out waiting for %s to appear"%self.dev) raise ex.excError def provision_dev(self): if 'vg' not in self.section: return if 'size' not in self.section: return vg = self.section['vg'] if rcEnv.sysname == 'Linux': self.provision_dev_linux() def provisioner(self): if not os.path.exists(self.mnt): os.makedirs(self.mnt) self.r.log.info("%s mount point created"%self.mnt) if not os.path.exists(self.dev): self.provision_dev() if not self.check_fs(): cmd = self.mkfs + [self.dev] (ret, out, err) = self.r.vcall(cmd) if ret != 0: self.r.log.error('Failed to format %s'%self.dev) raise ex.excError self.r.log.info("provisioned") self.r.start() return True 07070100024565000081b40000000000000000000000014faa9509000008ca000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/rcMountsHP-UX.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcMounts from rcUtilities import * from subprocess import Popen def get_src_dir_dev(dev): """Given a directory path, return its hosting device """ process = Popen(['df', '-l', dev], stdout=PIPE, stderr=STDOUT, close_fds=True) buff = process.communicate() out = buff[0] i = out.index('/') return out[i:].split()[0] class Mounts(rcMounts.Mounts): def match_mount(self, i, dev, mnt): """Given a line of 'mount' output, returns True if (dev, mnt) matches this line. Returns False otherwize. Also care about weirdos like loops and binds, ... """ if os.path.isdir(dev): is_bind = True src_dir_dev = get_src_dir_dev(dev) else: is_bind = False if i.mnt != mnt: return False if i.dev == dev: return True if is_bind and i.dev == src_dir_dev: return True return False def __init__(self): self.mounts = [] (ret, out, err) = call(['mount', '-v']) for l in out.split('\n'): if len(l.split()) != 12: return dev, null, mnt, null, type, mnt_opt, null, null, null, null, null, null = l.split() m = rcMounts.Mount(dev, mnt, type, mnt_opt.strip('()')) self.mounts.append(m) if __name__ == "__main__" : help(Mounts) for m in Mounts(): print m 07070100024566000081b40000000000000000000000014faa9509000008fd000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/rcMountsLinux.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcMounts import resLoopLinux as Res from rcUtilities import * from subprocess import Popen def get_src_dir_dev(dev): """Given a directory path, return its hosting device """ process = Popen(['df', '-l', dev], stdout=PIPE, stderr=STDOUT, close_fds=True) buff = process.communicate() out = buff[0] i = out.index('/') return out[i:].split()[0] class Mounts(rcMounts.Mounts): def match_mount(self, i, dev, mnt): """Given a line of 'mount' output, returns True if (dev, mnt) matches this line. Returns False otherwize. Also care about weirdos like loops and binds, ... """ if os.path.isdir(dev): is_bind = True src_dir_dev = get_src_dir_dev(dev) else: is_bind = False if i.mnt != mnt: return False if i.dev == dev: return True if i.dev in Res.file_to_loop(dev): return True if is_bind and i.dev == src_dir_dev: return True return False def __init__(self): self.mounts = [] (ret, out, err) = call(['mount']) for l in out.split('\n'): if len(l.split()) != 6: return dev, null, mnt, null, type, mnt_opt = l.split() m = rcMounts.Mount(dev, mnt, type, mnt_opt.strip('()')) self.mounts.append(m) if __name__ == "__main__" : help(Mounts) for m in Mounts(): print m 07070100024590000081b40000000000000000000000014faa950900000f85000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/rcStats.py# # Copyright (c) 2011 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import datetime class StatsProvider(object): def __init__(self, interval=2880, stats_dir=None, stats_start=None, stats_end=None): self.stats_dir = stats_dir self.interval = interval if stats_end is None: self.stats_end = datetime.datetime.now() else: self.stats_end = datetime.datetime.strptime(stats_end,"%Y-%m-%d %H:%M") if stats_start is None: self.stats_start = self.stats_end - datetime.timedelta(minutes=interval) else: self.stats_start = datetime.datetime.strptime(stats_start,"%Y-%m-%d %H:%M") delta = self.stats_end - self.stats_start interval = delta.days * 1440 + delta.seconds // 60 x, self.nodename, x, x, x = os.uname() self.minutes_first_day = 60*self.stats_end.hour + self.stats_end.minute + 1 one_minute = datetime.timedelta(minutes=1) one_day = datetime.timedelta(days=1) self.ranges = [] i = 0 end = self.stats_end while end > self.stats_start: start = end - one_day if start < self.stats_start: start = self.stats_start if start.day != end.day: start = end - datetime.timedelta(hours=end.hour, minutes=end.minute) if start != end: self.ranges.append((start, end)) end = start - one_minute #print self.stats_end, interval, map(lambda x: map(lambda y: y.strftime("%d-%m-%y %H:%M"), x), self.ranges) def get(self, fname): lines = [] cols = [] if not hasattr(self, fname): print fname, 'is not implemented' return cols, lines for start, end in self.ranges: date = start.strftime("%Y-%m-%d") day = start.strftime("%d") start = start.strftime("%H:%M:%S") end = end.strftime("%H:%M:%S") _cols, _lines = getattr(self, fname)(date, day, start, end) if len(_cols) == 0 or len(_lines) == 0: continue cols = _cols lines += _lines return cols, lines def sarfile(self, day): if self.stats_dir is None: stats_dir = os.path.join(os.sep, 'var', 'log', 'sysstat') if not os.path.exists(stats_dir): stats_dir = os.path.join(os.sep, 'var', 'log', 'sa') else: stats_dir = self.stats_dir f = os.path.join(stats_dir, 'sa'+day) if os.path.exists(f): return f return None def cpu(self, d, day, start, end): return [], [] def mem_u(self, d, day, start, end): return [], [] def proc(self, d, day, start, end): return [], [] def swap(self, d, day, start, end): return [], [] def block(self, d, day, start, end): return [], [] def blockdev(self, d, day, start, end): return [], [] def netdev(self, d, day, start, end): return [], [] def netdev_err(self, d, day, start, end): return [], [] if __name__ == "__main__": sp = StatsProvider(interval=20) print sp.get('cpu') print sp.get('swap') 0707010002455c000081b40000000000000000000000014faa950900000501000000ae00010002ffffffffffffffff0000002c00000000root/opt/opensvc/lib/rcIfconfigSunOSldom.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcExceptions as ex from subprocess import * rcIfconfig = __import__("rcIfconfigSunOS") from rcGlobalEnv import rcEnv class ifconfig(rcIfconfig.ifconfig): def __init__(self, hostname): self.intf = [] cmd = rcEnv.rsh.split(' ') + [hostname, 'env', 'LANG=C', 'ifconfig', '-a'] p = Popen(cmd, stdout=PIPE) buff = p.communicate()[0] if p.returncode != 0: raise ex.excError self.parse(buff) 0707010002459f000081b40000000000000000000000014faa950900001677000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/rcSymmetrix.pyfrom rcUtilities import justcall, which from xml.etree.ElementTree import XML, fromstring import rcExceptions as ex import os class Syms(object): syms = [] def __init__(self): self.index = 0 if which('symcfg') is None: print 'Can not find symcli programs in PATH' raise ex.excError out, err, ret = justcall(['symcfg', 'list', '-output', 'xml_element']) if ret != 0: print err raise ex.excError tree = fromstring(out) for symm in tree.getiterator('Symm_Info'): model = symm.find('model').text sid = symm.find('symid').text if model in ['VMAX-1']: self.syms.append(Vmax(sid)) if 'DMX' in model or '3000-M' in model: self.syms.append(Dmx(sid)) else: print "unsupported sym model: %s"%model def __iter__(self): return self def next(self): if self.index == len(self.syms): raise StopIteration self.index += 1 return self.syms[self.index-1] class Sym(object): def __init__(self, sid): self.keys = ['sym_info', 'sym_dir_info', 'sym_dev_info', 'sym_dev_wwn_info', 'sym_devrdfa_info', 'sym_ficondev_info', 'sym_meta_info', 'sym_disk_info', 'sym_diskgroup_info'] self.sid = sid def symcmd(self, cmd): cmd += ['-sid', self.sid, '-output', 'xml_element'] return justcall(cmd) def symaccesscmd(self, cmd): if self.aclx is None: cmd += ['-output', 'xml_element'] else: cmd += ['-file', self.aclx, '-output', 'xml_element'] return justcall(cmd) def get_sym_info(self): cmd = ['symcfg', 'list'] out, err, ret = self.symcmd(cmd) return out def get_sym_dir_info(self): cmd = ['symcfg', '-dir', 'all', '-v', 'list'] out, err, ret = self.symcmd(cmd) return out def get_sym_dev_info(self): cmd = ['symdev', 'list'] out, err, ret = self.symcmd(cmd) return out def get_sym_dev_wwn_info(self): cmd = ['symdev', 'list', '-wwn'] out, err, ret = self.symcmd(cmd) return out def get_sym_devrdfa_info(self): cmd = ['symdev', 'list', '-v', '-rdfa'] out, err, ret = self.symcmd(cmd) return out def get_sym_ficondev_info(self): cmd = ['symdev', 'list', '-ficon'] out, err, ret = self.symcmd(cmd) return out def get_sym_meta_info(self): cmd = ['symdev', 'list', '-meta', '-v'] out, err, ret = self.symcmd(cmd) return out def get_sym_disk_info(self): cmd = ['symdisk', 'list', '-v'] out, err, ret = self.symcmd(cmd) return out def get_sym_diskgroup_info(self): cmd = ['symdisk', 'list', '-dskgrp_summary'] out, err, ret = self.symcmd(cmd) return out class Vmax(Sym): def __init__(self, sid): Sym.__init__(self, sid) self.keys += ['sym_ig_aclx', 'sym_pg_aclx', 'sym_sg_aclx', 'sym_view_aclx'] if 'SYMCLI_DB_FILE' in os.environ: dir = os.path.dirname(os.environ['SYMCLI_DB_FILE']) # flat format self.aclx = os.path.join(dir, sid+'.aclx') if not os.path.exists(self.aclx): # emc grab format import glob files = glob.glob(os.path.join(dir, sid, sid+'*.aclx')) if len(files) == 1: self.aclx = files[0] if not os.path.exists(self.aclx): print "missing file %s"%self.aclx else: self.aclx = None def symaccesscmd(self, cmd): if self.aclx is None: cmd += ['-output', 'xml_element'] else: cmd += ['-file', self.aclx, '-output', 'xml_element'] return justcall(cmd) def get_sym_pg_aclx(self): cmd = ['symaccess', 'list', '-type', 'port'] out, err, ret = self.symaccesscmd(cmd) return out def get_sym_sg_aclx(self): cmd = ['symaccess', 'list', '-type', 'storage'] out, err, ret = self.symaccesscmd(cmd) return out def get_sym_ig_aclx(self): cmd = ['symaccess', 'list', '-type', 'initiator'] out, err, ret = self.symaccesscmd(cmd) return out def get_sym_view_aclx(self): cmd = ['symaccess', 'list', 'view', '-details'] out, err, ret = self.symaccesscmd(cmd) return out class Dmx(Sym): def __init__(self, sid): Sym.__init__(self, sid) self.keys += ['sym_maskdb'] if 'SYMCLI_DB_FILE' in os.environ: dir = os.path.dirname(os.environ['SYMCLI_DB_FILE']) # flat format self.maskdb = os.path.join(dir, sid+'.bin') if not os.path.exists(self.maskdb): # emc grab format self.maskdb = os.path.join(dir, sid, 'symmaskdb_backup.bin') if not os.path.exists(self.maskdb): print "missing file %s"%self.maskdb else: self.maskdb = None def symaccesscmd(self, cmd): if self.maskdb is None: cmd += ['-sid', self.sid, '-output', 'xml_element'] else: cmd += ['-f', self.maskdb, '-output', 'xml_element'] return justcall(cmd) def get_sym_maskdb(self): cmd = ['symmaskdb', 'list', 'database'] out, err, ret = self.symaccesscmd(cmd) return out 0707010002450e000081b40000000000000000000000014faa9509000009fd000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/checkMpathLinux.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "mpath" def find_svc(self, dev): for svc in self.svcs: if dev in svc.disklist(): return svc.svcname return '' def do_check(self): cmd = ['multipathd', '-kshow topo'] (out, err, ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 1: return self.undef r = [] wwid = None dev = None for line in lines: if ' dm-' in line: # new mpath # - store previous # - reset path counter if wwid is not None: r.append({'chk_instance': wwid, 'chk_value': str(n), 'chk_svcname': self.find_svc(dev), }) n = 0 if line.startswith(": "): line = line.replace(": ", "") l = line.split() if l[0].endswith(":"): # skip prefix: create, swithpg, reload, ... l = l[1:] if len(l) < 2: continue if l[1].startswith('('): wwid = l[1][2:-1] else: wwid = l[0][1:] if "[active][ready]" in line or \ "active ready" in line: n += 1 dev = "/dev/"+line.split()[2] if wwid is not None: r.append({'chk_instance': wwid, 'chk_value': str(n), 'chk_svcname': self.find_svc(dev), }) return r 0707010002460d000081b40000000000000000000000014faa9509000011d6000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/svcZone.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. __author__="cgaliber" __date__ ="$11 oct. 2009 21:56:59$" import svc import resContainerZone as Zone class SvcZone(svc.Svc): """ Define Zone services""" def __init__(self, svcname, vmname=None, guestos=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, type="container.zone", optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmname = vmname self.guestos = guestos self.zone = Zone.Zone(vmname, disabled=disabled) self += self.zone self.runmethod = [ '/usr/sbin/zlogin', '-S', vmname ] def start(self): """start a zone check ping zone ready start ips start zone start VGs start fs start apps """ self.sub_set_action("ip", "check_not_ping_raise") self.sub_set_action("disk.scsireserv", "start", tags=set(['preboot'])) self.sub_set_action("disk.vg", "start", tags=set(['preboot'])) self.sub_set_action("disk.zpool", "start", tags=set(['preboot'])) self.sub_set_action("fs", "start", tags=set(['preboot'])) self.sub_set_action("container.zone", "attach") self.sub_set_action("container.zone", "ready") self.sub_set_action("ip", "start") self.sub_set_action("container.zone", "boot") self.sub_set_action("sync.netapp", "start", tags=set(['postboot'])) self.sub_set_action("disk.scsireserv", "start", tags=set(['postboot'])) self.sub_set_action("disk.vg", "start", tags=set(['postboot'])) self.sub_set_action("disk.zpool", "start", tags=set(['postboot'])) self.sub_set_action("fs", "start") self.sub_set_action("app", "start") def stop(self): """stop a zone: stop apps stop fs stop VGs stop zone stop ips """ self.sub_set_action("app", "stop") self.sub_set_action("fs", "stop", tags=set(['postboot'])) self.sub_set_action("disk.vg", "stop", tags=set(['postboot'])) self.sub_set_action("disk.zpool", "stop", tags=set(['postboot'])) self.sub_set_action("disk.scsireserv", "stop", tags=set(['postboot'])) self.sub_set_action("container.zone", "stop") self.sub_set_action("container.zone", "detach") self.sub_set_action("fs", "stop", tags=set(['preboot'])) self.sub_set_action("disk.vg", "stop", tags=set(['preboot'])) self.sub_set_action("disk.zpool", "stop", tags=set(['preboot'])) self.sub_set_action("disk.scsireserv", "stop", tags=set(['preboot'])) self.sub_set_action("ip", "stop") def startip(self): self.sub_set_action("ip", "check_ping") self.sub_set_action("container.zone", "attach") self.sub_set_action("container.zone", "ready") self.sub_set_action("ip", "start") if __name__ == "__main__": for c in (SvcZone,) : help(c) import mountSunOS as mount import ipSunOS as ip print """ Z=SvcZone() Z+=mount.Mount("/mnt1","/dev/sda") Z+=mount.Mount("/mnt2","/dev/sdb") Z+=ip.Ip("eth0","192.168.0.173") Z+=ip.Ip("eth0","192.168.0.174") """ Z=SvcZone() Z+=mount.Mount("/mnt1","/dev/sda") Z+=mount.Mount("/mnt2","/dev/sdb") Z+=ip.Ip("eth0","192.168.0.173") Z+=ip.Ip("eth0","192.168.0.174") print "Show Z: ", Z print "start Z:" Z.start() print "stop Z:" Z.stop() 0707010002452b000081b40000000000000000000000014faa950900000616000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/provFsZfs.py# # Copyright (c) 2011 Christophe Varoqui # Copyright (c) 2011 Cyril Galibern # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from provFs import ProvisioningFs from rcUtilities import which from rcZfs import Dataset class ProvisioningFsZfs(ProvisioningFs): def provision_dev(self): if not which('zfs'): self.r.log.error("zfs command not found") raise ex.excError ds = Dataset(self.dev, log=self.r.log) if ds.exists() is False: ds.create(['-p']) nv_list = dict() #nv_list['mountpoint'] = self.mnt if 'size' in self.section: nv_list['refquota'] = self.section['size'] ds.verify_prop(nv_list) def provisioner(self): self.provision_dev() self.r.log.info("provisioned") # self.r.start(), return True 07070100024541000081b40000000000000000000000014faa9509000017b8000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/rcDevTreeHP-UX.pyimport rcDevTree import glob import os import re from subprocess import * from rcUtilities import which from rcGlobalEnv import rcEnv class DevTree(rcDevTree.DevTree): pe_size = {} def disk_size(self, devpath): """ return devpath size in megabytes """ if not which("diskinfo"): return 0 cmd = ["diskinfo", "-b", devpath] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode: return 0 return int(out.strip())/1024 def add_part(self, parent_devpath, child_devpath): child_dev = self.add_disk(child_devpath) if child_dev is None: return parent_dev = self.get_dev_by_devpath(parent_devpath) if parent_dev is None: return child_dev.add_parent(parent_dev.devname) parent_dev.add_child(child_dev.devname) def add_disk(self, devpath): devname = devpath.split('/')[-1] if devpath in self.lunmap: devtype = "multipath" else: devtype = "linear" size = self.disk_size(devpath.replace('/disk/', '/rdisk/')) # exclude 0-sized md, Symmetrix gatekeeper and vcmdb if size in [0, 2, 30, 45]: return d = self.add_dev(devname, size, devtype) d.set_devpath(devpath) d.set_devpath(devpath.replace('/disk/', '/rdisk/')) if devpath in self.lunmap: d.set_alias(self.lunmap[devpath]['wwid']) return d def load_ioscan(self): if not which("/usr/sbin/ioscan"): return cmd = ["/usr/sbin/ioscan", "-FunNC", "disk"] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode: return """ scsi:wsio:T:T:F:31:188:0:disk:sdisk:0/2/1/0.0.0.0.0:0 0 5 18 0 0 0 0 195 124 63 185 173 253 214 203 :0:root.sba.lba.sasd.sasd_vbus.tgt.sdisk:sdisk:CLAIMED:DEVICE:HP DG146BB976:0: /dev/disk/disk11 /dev/disk/disk11_p2 /dev/rdisk/disk11 /dev/rdisk/disk11_p2 /dev/disk/disk11_p1 /dev/disk/disk11_p3 /dev/rdisk/disk11_p1 /dev/rdisk/disk11_p3 """ for w in out.split(): if not w.startswith('/dev/'): new = True continue if new: disk = w new = False d = self.add_disk(disk) continue if '/pt/' in w: d.set_devpath(w) continue if '/rdisk/' in w: continue if '_p' in w: self.add_part(disk, w) else: d.set_devpath(w) def get_lunmap(self): if hasattr(self, "lunmap"): return self.lunmap = {} if not which("scsimgr"): return cmd = ["scsimgr", "lun_map"] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode: return """ LUN PATH INFORMATION FOR LUN : /dev/rdisk/disk10 Total number of LUN paths = 1 World Wide Identifier(WWID) = 0x5000c5000aba6793 LUN path : lunpath0 Class = lunpath Instance = 0 Hardware path = 0/2/1/0.0x5000c5000aba6791.0x0 SCSI transport protocol = sas State = UNOPEN Last Open or Close state = ACTIVE """ for line in out.split('\n'): if "INFORMATION" in line: disk = line.split()[-1] self.lunmap[disk] = {} if "WWID" in line: wwid = line.split()[-1].replace('0x', '') if wwid != "=": self.lunmap[disk]['wwid'] = line.split()[-1].replace('0x', '') else: del(self.lunmap[disk]) def load_lv(self, lv): if not which("lvdisplay"): return cmd = ["lvdisplay", "-v", lv] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode: return vgname = lv.split('/')[2] # parser h = {} for line in out.split('\n'): line = line.strip() if 'LV Size' in line: size = int(line.split()[-1]) if not line.startswith('/dev'): continue pv, le, pe = line.split() h[pv] = int(pe) * self.pe_size[vgname] # use the linux lvm naming convention devname = lv.replace('/dev/','').replace('-','--').replace('/','-') d = self.add_dev(devname, size, "linear") for pv in h: d.add_parent(pv.replace('/dev/disk/', ''), size=h[pv]) d.set_devpath(lv) parent_dev = self.get_dev_by_devpath(pv) if parent_dev is None: continue parent_dev.add_child(d.devname) def load_lvm(self): if not which("vgdisplay"): return cmd = ["vgdisplay", "-v"] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode: return for line in out.split('\n'): if 'VG Name' in line: vgname = line.split()[-1].replace('/dev/','') if 'PE Size' in line: self.pe_size[vgname] = int(line.split()[-1]) if 'LV Name' not in line: continue self.load_lv(line.split()[-1]) def load(self): self.get_lunmap() self.load_ioscan() self.load_lvm() def blacklist(self, devname): bl = [r'^loop[0-9]*.*', r'^ram[0-9]*.*', r'^scd[0-9]*', r'^sr[0-9]*'] for b in bl: if re.match(b, devname): return True return False if __name__ == "__main__": tree = DevTree() tree.load() #print tree tree.print_tree_bottom_up() #print map(lambda x: x.alias, tree.get_top_devs()) 07070100024548000081b40000000000000000000000014faa950900000b89000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/rcDiskInfoHP-UX.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from rcUtilities import call import rcDiskInfo class diskInfo(rcDiskInfo.diskInfo): def __init__(self): self.h = {} cmd = ["scsimgr", "-p", "get_attr", "all_lun", "-a", "wwid", "-a", "device_file", "-a", "vid", "-a", "pid", "-a", "capacity"] (ret, out, err) = call(cmd) for e in out.split('\n'): if len(e) == 0: continue (wwid, dev, vid, pid, size) = e.split(':') dev = self.devkey(dev) wwid = wwid.replace('0x', '') if len(size) != 0: size = int(size)/2097152 vid = vid.strip('" ') pid = pid.strip('" ') self.h[dev] = dict(wwid=wwid, vid=vid, pid=pid, size=size) def devkey(self, dev): dev = dev.replace("/dev/rdisk/", "") dev = dev.replace("/dev/disk/", "") dev = dev.replace("/dev/dsk/", "") return dev def dev2char(self, dev): dev = dev.replace("/dev/disk/", "/dev/rdisk/") dev = dev.replace("/dev/dsk/", "/dev/rdsk/") return dev def scan(self, dev): cmd = ["scsimgr", "-p", "get_attr", "-D", self.dev2char(dev), "-a", "wwid", "-a", "device_file", "-a", "vid", "-a", "pid", "-a", "capacity"] (ret, out, err) = call(cmd, errlog=False) dev = self.devkey(dev) if ret != 0: self.h[dev] = dict(wwid="", vid="", pid="", size="") return (wwid, foo, vid, pid, size) = out.split(':') wwid = wwid.replace('0x', '') if len(size) != 0: size = int(size)/2048 vid = vid.strip('" ') pid = pid.strip('" ') self.h[dev] = dict(wwid=wwid, vid=vid, pid=pid, size=size) def get(self, dev, type): if dev not in self.h: self.scan(dev) dev = self.devkey(dev) return self.h[dev][type] def disk_id(self, dev): return self.get(dev, 'wwid') def disk_vendor(self, dev): return self.get(dev, 'vid') def disk_model(self, dev): return self.get(dev, 'pid') def disk_size(self, dev): return self.get(dev, 'size') 07070100024555000081b40000000000000000000000014faa950900000d4b000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/rcIfconfigHP-UX.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * import rcIfconfig import rcExceptions as ex class ifconfig(rcIfconfig.ifconfig): def parse(self, out): if len(out) == 0: return intf = out.split()[0] if intf[len(intf)-1] == ':': intf = intf[0:len(intf)-1] i = rcIfconfig.interface(intf) self.intf.append(i) # defaults i.link_encap = '' i.scope = '' i.bcast = '' i.mask = '' i.mtu = '' i.ipaddr = '' i.ip6addr = [] i.ip6mask = [] i.hwaddr = '' i.flag_up = False i.flag_broadcast = False i.flag_running = False i.flag_multicast = False i.flag_loopback = False prev = '' for w in out.split(): if 'broadcast' in prev: i.bcast = w elif 'netmask' in prev: if w == '0': i.mask = "0.0.0.0" elif len(w) == 8: i.mask = "%d.%d.%d.%d"%( int(w[0:2], 16), int(w[2:4], 16), int(w[4:6], 16), int(w[6:8], 16) ) else: raise ex.excError("malformed ifconfig %s netmask: %s"%(intf, w)) elif 'inet' == prev: i.ipaddr = w elif 'inet6' == prev: i.ip6addr += [w] elif 'prefix' == prev: i.ip6mask += [w] if 'UP' in w: i.flag_up = True if 'BROADCAST' in w: i.flag_broadcast = True if 'RUNNING' in w: i.flag_running = True if 'MULTICAST' in w: i.flag_multicast = True if 'LOOPBACK' in w: i.flag_loopback = True prev = w def __init__(self): self.intf = [] intf_list = [] out = Popen(['netstat', '-win'], stdout=PIPE).communicate()[0] for line in out.split('\n'): if len(line) == 0: continue if 'IPv4:' in line or 'IPv6' in line: continue intf = line.split()[0] intf_list.append(intf.replace('*', '')) for intf in intf_list: p = Popen(['ifconfig', intf], stdout=PIPE, stderr=PIPE) out = p.communicate() if "no such interface" in out[1]: continue elif p.returncode != 0: raise ex.excError self.parse(out[0]) 070701000245e2000081b40000000000000000000000014faa9509000013c7000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/resSyncDcsSnap.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import rcExceptions as ex import rcStatus import datetime import resSyncDcs from rcGlobalEnv import rcEnv from rcUtilities import justcall class syncDcsSnap(resSyncDcs.SyncDcs): def can_sync(self, target=None): ts = None """ get oldest snap """ for snap in self.snapname: info = self.get_snap(snap) if info is None: self.log.debug("snap %s missing"%snap) return True _ts = info['TimeStamp'] if ts is None or _ts < ts: ts = _ts return not self.skip_sync(ts) def update_snap(self): cmd = "" vars = "" for i, snap in enumerate(self.snapname): cmd += '$v%d=get-dcssnapshot -snapshot %s;'%(i, snap) vars += '$v%d '%i cmd += "echo %s|update-dcssnapshot -Y"%vars self.dcscmd(cmd, verbose=True) def get_snap(self, snap): if snap in self._info: return self._info[snap] cmd = 'get-dcssnapshot -snapshot %s;'%snap try: ret, out, err = self.dcscmd(cmd) except: return None info = {} lines = out.split('\n') for line in lines: l = line.split(': ') if len(l) != 2: continue var = l[0].strip() val = l[1].strip() if var == 'TimeStamp': info['TimeStamp'] = datetime.datetime.strptime(val, "%d/%m/%Y %H:%M:%S") elif var in ['Type', 'State', 'ActiveOperation', 'Failure']: info[var] = val if len(info) > 0: self._info[snap] = info return info def _status(self, verbose=False, skip_prereq=False): err = False errlog = [] log = [] try: self.get_auth() except ex.excError as e: self.status_log(str(e)) return rcStatus.WARN for snap in self.snapname: info = self.get_snap(snap) if info is None: errlog.append("snapshot %s does not exists"%snap) err |= True continue if info['State'] not in ['Healthy']: errlog.append("snapshot %s state is %s"%(snap, info['State'])) err |= True if info['Failure'] not in ['NoFailure']: errlog.append("snapshot %s failure state is %s"%(snap, info['Failure'])) err |= True if info['TimeStamp'] < datetime.datetime.now() - datetime.timedelta(minutes=self.sync_max_delay): errlog.append("snapshot %s too old"%snap) err |= True log.append("last update on %s"%info['TimeStamp']) if err: self.status_log('\n'.join(errlog)) return rcStatus.WARN self.status_log('\n'.join(log)) return rcStatus.UP def syncresync(self): self.update_snap() def refresh_svcstatus(self): self.svcstatus = self.svc.group_status(excluded_groups=set(["sync", 'hb', 'app'])) def get_svcstatus(self): if len(self.svcstatus) == 0: self.refresh_svcstatus() def __init__(self, rid=None, snapname=set([]), manager=set([]), dcs=set([]), sync_max_delay=None, sync_interval=None, sync_days=None, sync_period=None, optional=False, disabled=False, tags=set([]), internal=False): resSyncDcs.SyncDcs.__init__(self, rid=rid, type="sync.dcssnap", manager=manager, dcs=dcs, sync_max_delay=sync_max_delay, sync_interval=sync_interval, sync_days=sync_days, sync_period=sync_period, optional=optional, disabled=disabled, tags=tags) self.label = "DCS snapshot %s"%', '.join(snapname) self.snapname = snapname self._info = {} def __str__(self): return "%s dcs=%s manager=%s snapname=%s" % ( resSync.Sync.__str__(self), ' '.join(self.dcs), ' '.join(self.manager), ' '.join(self.snapname)) 07070100024559000081b40000000000000000000000014faa95090000061f000000ae00010002ffffffffffffffff0000002b00000000root/opt/opensvc/lib/rcIfconfigLinuxlxc.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * import rcIfconfigLinux from rcGlobalEnv import rcEnv from rcUtilities import which import os class ifconfig(rcIfconfigLinux.ifconfig): def __init__(self, hostname): self.intf = [] if which('lxc-attach') and os.path.exists('/proc/1/ns/pid'): self.rsh = ['lxc-attach', '-n', hostname] cmd = ['echo', '/sbin/ifconfig', '-a'] p1 = Popen(cmd, stdout=PIPE) out = Popen(self.rsh, stdout=PIPE, stdin=p1.stdout).communicate()[0] else: self.rsh = rcEnv.rsh.split() + [hostname, '--', 'env', 'LANG=C'] cmd = self.rsh + ['/sbin/ifconfig', '-a'] out = Popen(cmd, stdout=PIPE).communicate()[0] self.parse(out) 07070100024547000081b40000000000000000000000014faa950900000517000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/rcDiskInfoFreeBSD.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from rcUtilities import call, which import rcDiskInfo class diskInfo(rcDiskInfo.diskInfo): disk_ids = {} def disk_id(self, dev): print "%s:disk_id TODO"%__file__ return "" def disk_vendor(self, dev): print "%s:disk_vendor TODO"%__file__ return "" def disk_model(self, dev): print "%s:disk_model TODO"%__file__ return "" def disk_size(self, dev): print "%s:disk_size TODO"%__file__ return 0 070701000245be000081b40000000000000000000000014faa950900000b33000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resHbovm.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import resHb from rcGlobalEnv import rcEnv import os import rcStatus import rcExceptions as ex from rcUtilities import justcall, which import rcOvm class Hb(resHb.Hb): """ HeartBeat ressource """ def __init__(self, rid=None, name=None, always_on=set([]), optional=False, disabled=False, tags=set([])): resHb.Hb.__init__(self, rid, "hb.ovm", optional=optional, disabled=disabled, tags=tags) self.ovsinit = os.path.join(os.sep, 'etc', 'init.d', 'ovs-agent') def process_running(self): cmd = [self.ovsinit, 'status'] (out, err, ret) = justcall(cmd) if ret != 0: return False for line in out.split('\n'): if len(line) == 0: continue if not line.startswith('ok!'): return False return True def stop(self): try: self.manager = rcOvm.Ovm(log=self.log) self.manager.vm_disable_ha(self.svc.vmname) except ex.excError, e: self.log.error(str(e)) raise def start(self): try: self.manager = rcOvm.Ovm(log=self.log) self.manager.vm_enable_ha(self.svc.vmname) except ex.excError, e: self.log.error(str(e)) raise def __status(self, verbose=False): if not os.path.exists(self.ovsinit): self.status_log("OVM agent is not installed") return rcStatus.WARN if not self.process_running(): self.status_log("OVM agent daemons are not running") return rcStatus.WARN try: self.manager = rcOvm.Ovm(log=self.log) ha_enabled = self.manager.vm_ha_enabled(self.svc.vmname) except ex.excError, e: self.status_log(str(e)) return rcStatus.WARN if not ha_enabled: self.status_log("HA not enabled for this VM") return rcStatus.WARN return rcStatus.UP 0707010002455d000081b40000000000000000000000014faa950900000448000000ae00010002ffffffffffffffff0000002d00000000root/opt/opensvc/lib/rcIfconfigWindowskvm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcExceptions as ex from subprocess import * rcIfconfig = __import__("rcIfconfig") from rcGlobalEnv import rcEnv class ifconfig(rcIfconfig.ifconfig): def __init__(self, hostname): self.intf = [] def has_param(self, param, value): return 0 0707010002458c000081b40000000000000000000000014faa950900000937000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/rcPkgSunOS.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcUtilities import call, which from rcGlobalEnv import rcEnv """ format: PKGINST: SUNWzoneu NAME: Solaris Zones (Usr) CATEGORY: system ARCH: i386 VERSION: 11.11,REV=2009.04.08.17.26 VENDOR: Sun Microsystems, Inc. DESC: Solaris Zones Configuration and Administration HOTLINE: Please contact your local service provider STATUS: completely installed """ def listpkg(): if which('pkginfo') is None: return [] cmd = ['pkginfo', '-l'] (ret, out, err) = call(cmd, errlog=False, cache=True) lines = [] for line in out.split('\n'): l = line.split(':') if len(l) != 2: continue l = map(lambda x: x.strip(), l) f = l[0] if f == "PKGINST": x = [rcEnv.nodename, l[1], "", ""] elif f == "VERSION": x[2] = l[1] elif f == "ARCH": x[3] = l[1] lines.append(x) return lines def listpatch(): """ Patch: patchnum-rev Obsoletes: num-rev[,patch-rev]... Requires: .... Incompatibles: ... Packages: ... """ if which('showrev') is None: return [] cmd = ['showrev', '-p'] (ret, out, err) = call(cmd, errlog=False, cache=True) lines = [] nodename = rcEnv.nodename for line in out.split('\n'): l = line.split(' ') if len(l) > 3: p = l[1].split('-') if len(p) != 2: continue else: lines.append( [ nodename , p[0], p[1] ] ) return lines if __name__ == "__main__" : print listpatch() 070701000245ed000081b40000000000000000000000014faa950900002b82000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/resVgHP-UX.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import re import os import rcExceptions as ex import resDg from subprocess import * from rcUtilities import qcall from rcGlobalEnv import rcEnv class Vg(resDg.Dg): def __init__(self, rid=None, name=None, type=None, always_on=set([]), dsf=True, disabled=False, tags=set([]), optional=False, monitor=False): self.label = name self.dsf = dsf resDg.Dg.__init__(self, rid=rid, name=name, type='disk.vg', always_on=always_on, optional=optional, disabled=disabled, tags=tags, monitor=monitor) def files_to_sync(self): return [self.mapfile_name(), self.mkfsfile_name()] def mapfile_name(self): return os.path.join(rcEnv.pathvar, 'vg_' + self.svc.svcname + '_' + self.name + '.map') def mkfsfile_name(self): return os.path.join(rcEnv.pathvar, 'vg_' + self.svc.svcname + '_' + self.name + '.mksf') def has_it(self): """ returns True if the volume is present """ if self.is_active(): return True if not os.path.exists(self.mapfile_name()): return False if self.is_imported(): return True return False def dev2char(self, dev): dev = dev.replace("/dev/disk", "/dev/rdisk") dev = dev.replace("/dev/dsk", "/dev/rdsk") return dev def dsf_name(self, dev): cmd = ['scsimgr', 'get_attr', '-D', self.dev2char(dev), '-a', 'device_file', '-p'] (ret, out, err) = self.call(cmd) if ret != 0: raise ex.excError return out.split()[0] def write_mksf(self): cmd = ['ioscan', '-F', '-m', 'dsf'] (ret, buff, err) = self.call(cmd) if ret != 0: raise ex.excError if len(buff) == 0: return mksf = {} if len(self.disks) == 0: self.disks = self.disklist() dsf_names = map(self.dsf_name, self.disks) with open(self.mkfsfile_name(), 'w') as f: for line in buff.split('\n'): if len(line) == 0: return a = line.split(':')[0] if '/dev/pt/pt' not in a and '/dev/rdisk/disk' not in a and self.dsf_name(a) in dsf_names: cmd = ['scsimgr', 'get_attr', '-D', self.dev2char(a), '-a', 'wwid', '-p'] (ret, out, err) = self.call(cmd) if ret != 0: raise ex.excError f.write(":".join([a, out.split()[0].replace('0x', '')])+'\n') def do_mksf(self): if not os.path.exists(self.mkfsfile_name()): return instance = {} cmd = ['scsimgr', 'get_attr', 'all_lun', '-a', 'wwid', '-a', 'instance', '-p'] (ret, buff, err) = self.call(cmd) for line in buff.split('\n'): l = line.split(':') if len(l) != 2: continue instance[l[0].replace('0x', '')] = l[1] r = 0 with open(self.mkfsfile_name(), 'r') as f: for line in f.readlines(): a = line.replace('\n', '').split(':') if len(a) == 0: continue if os.path.exists(a[0]): continue if a[1] not in instance.keys(): self.log.error("expected lun %s not present on node %s"%(a[1], rcEnv.nodename)) r += 1 continue cmd = ['mksf', '-r', '-C', 'disk', '-I', instance[a[1]], a[0]] (ret, buff, err) = self.vcall(cmd) if ret != 0: r += 1 continue if r > 0: raise ex.excError def presync(self): """ this one is exported as a service command line arg """ cmd = [ 'vgexport', '-m', self.mapfile_name(), '-p', '-s', self.name ] ret = qcall(cmd) if ret != 0: raise ex.excError self.write_mksf() def is_active(self): cmd = [ 'vgdisplay', self.name ] process = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) buff = process.communicate() if not "available" in buff[0]: return False return True def is_imported(self): if not os.path.exists(self.mapfile_name()): return False if self.dsf: dsfflag = '-N' else: dsfflag = '' cmd = [ 'vgimport', '-m', self.mapfile_name(), '-s', '-p', dsfflag, self.name ] process = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) buff = process.communicate() if not "already exists" in buff[1]: return False return True def is_up(self): """Returns True if the volume group is present and activated """ if not os.path.exists(self.mapfile_name()): self.do_export() if not self.is_imported(): return False if not self.is_active(): return False return True def do_import(self): if self.is_imported(): self.log.info("%s is already imported" % self.name) return if self.dsf: dsfflag = '-N' else: dsfflag = '' cmd = [ 'vgimport', '-m', self.mapfile_name(), '-s', dsfflag, self.name ] self.log.info(' '.join(cmd)) self.lock() process = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) buff = process.communicate() self.unlock() # we will modify buff[1], so convert from tuple to list buff = list(buff) # test string for warnings #buff[1] = """Warning: Cannot determine block size of Physical Volume "/dev/rdisk/disk394". #Assuming a default value of 1024 bytes. Continuing. #Warning: Cannot determine block size of Physical Volume "/dev/rdisk/disk395". #Assuming a default value of 1024 bytes. Continuing. #vgimport:""" if len(buff[1]) > 0: import re regex = re.compile("Warning:.*\n.*Continuing.\n", re.MULTILINE) w = regex.findall(buff[1]) if len(w) > 0: warnings = '\n'.join(w) self.log.warning(warnings) buff[1] = regex.sub('', buff[1]) if buff[1] != "vgimport: " and buff[1] != "vgimport:": self.log.error('error:\n' + buff[1]) if len(buff[0]) > 0: self.log.debug('output:\n' + buff[0]) if process.returncode != 0: raise ex.excError def do_export(self): preview = False if os.path.exists(self.mapfile_name()): if not self.is_imported(): self.log.info("%s is already exported" % self.name) return elif self.is_active(): preview = True if preview: cmd = [ 'vgexport', '-p', '-m', self.mapfile_name(), '-s', self.name ] else: cmd = [ 'vgexport', '-m', self.mapfile_name(), '-s', self.name ] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def do_activate(self): if self.is_active(): self.log.info("%s is already available" % self.name) return cmd = ['vgchange', '-c', 'n', self.name] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError cmd = ['vgchange', '-a', 'y', self.name] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def do_deactivate(self): if not self.is_active(): self.log.info("%s is already unavailable" % self.name) return cmd = ['vgchange', '-a', 'n', self.name] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def do_start(self): self.do_import() self.do_activate() def do_stop(self): self.do_deactivate() self.do_export() def start(self): self.do_mksf() self.do_start() def disklist(self): need_export = False if not self.is_active() and not self.is_imported(): self.do_import() need_export = True cmd = ['strings', '/etc/lvmtab'] (ret, out, err) = self.call(cmd) if ret != 0: raise ex.excError tab = out.split('\n') insection = False self.disks = set([]) for e in tab: """ move to the first disk of the vg """ if e == '/dev/'+self.name: insection = True continue if not insection: continue if e == "_KDI": continue if "/dev/dsk" not in e and "/dev/disk" not in e: break self.disks |= set([e]) if need_export: self.do_export() return self.disks def lock(self, timeout=30, delay=1): import lock lockfile = os.path.join(rcEnv.pathlock, 'vgimport') lockfd = None try: lockfd = lock.lock(timeout=timeout, delay=delay, lockfile=lockfile) except lock.lockTimeout: self.log.error("timed out waiting for lock (%s)"%lockfile) raise ex.excError except lock.lockNoLockFile: self.log.error("lock_nowait: set the 'lockfile' param") raise ex.excError except lock.lockCreateError: self.log.error("can not create lock file %s"%lockfile) raise ex.excError except lock.lockAcquire as e: self.log.warn("another action is currently running (pid=%s)"%e.pid) raise ex.excError except ex.excSignal: self.log.error("interrupted by signal") raise ex.excError except: self.log.error("unexpected locking error") import traceback traceback.print_exc() raise ex.excError self.lockfd = lockfd def unlock(self): import lock lock.unlock(self.lockfd) 07070100024558000081b40000000000000000000000014faa950900000501000000ae00010002ffffffffffffffff0000002b00000000root/opt/opensvc/lib/rcIfconfigLinuxkvm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcExceptions as ex from subprocess import * rcIfconfig = __import__("rcIfconfigLinux") from rcGlobalEnv import rcEnv class ifconfig(rcIfconfig.ifconfig): def __init__(self, hostname): self.intf = [] cmd = rcEnv.rsh.split(' ') + [hostname, 'env', 'LANG=C', 'ifconfig', '-a'] p = Popen(cmd, stdout=PIPE) buff = p.communicate()[0] if p.returncode != 0: raise ex.excError self.parse(buff) 0707010002460e000081a40000000000000000000000014faab5bf0000001c000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/version.pyversion = "1.3-120509.1802" 070701000245e9000081b40000000000000000000000014faa950900000aef000000ae00010002ffffffffffffffff0000002d00000000root/opt/opensvc/lib/resSyncSymcloneLinux.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import logging from rcGlobalEnv import rcEnv from rcUtilities import which import rcExceptions as ex import rcStatus import resources as Res import time import datetime import resSyncSymclone as symclone class syncSymclone(symclone.syncSymclone): def dev_rescan(self, dev): dev = dev.replace('/dev/', '') sysdev = "/sys/block/%s/device/rescan"%dev self.log.info("echo 1>%s"%sysdev) with open(sysdev, 'w') as s: s.write("1") def refresh_multipath(self, dev): cmd = ['multipath', '-v0', '-r', dev] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def dev_ready(self, dev): cmd = ['sg_turs', dev] (ret, out, err) = self.vcall(cmd) if ret != 0: return False return True def wait_for_dev_ready(self, dev): delay = 1 timeout = 5 for i in range(timeout/delay): if self.dev_ready(dev): return if i == 0: self.log.info("waiting for device %s to become ready (max %i secs)"%(dev,timeout)) time.sleep(delay) self.log.error("timed out waiting for device %s to become ready (max %i secs)"%(dev,timeout)) raise ex.excError def wait_for_devs_ready(self): for (symid, devid) in self.symld: dev = self.symld[symid, devid]['pdev'] self.dev_rescan(dev) self.wait_for_dev_ready(dev) self.refresh_multipath(dev) def __init__(self, rid=None, symdg=None, symdevs=[], precopy_timeout=300, sync_max_delay=1440, sync_min_delay=30, optional=False, disabled=False, tags=set([]), internal=False): symclone.syncSymclone.__init__(self, rid, symdg, symdevs, precopy_timeout, sync_max_delay, sync_min_delay, optional=optional, disabled=disabled, tags=tags, internal) 070701000245c8000081b40000000000000000000000014faa950900000922000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/resIpLinux.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. "Module implement Linux specific ip management" import resIp as Res import rcExceptions as ex from rcUtilitiesLinux import check_ping class Ip(Res.Ip): def check_ping(self): self.log.info("checking %s availability"%self.addr) return check_ping(self.addr) def startip_cmd(self): if ':' in self.addr: if '.' in self.mask: self.log.error("netmask parameter is mandatory for ipv6 adresses") raise ex.excError cmd = ['ifconfig', self.ipDev, 'inet6', 'add', '/'.join([self.addr, self.mask])] else: cmd = ['ifconfig', self.stacked_dev, self.addr, 'netmask', self.mask, 'up'] ret, out, err = self.vcall(cmd) if ret != 0: return ret, out, err # ip activation may still be incomplete # wait for activation, to avoid startapp scripts to fail binding their listeners for i in range(5, 0, -1): if check_ping(self.addr, timeout=1, count=1): return ret, out, err self.log.error("timed out waiting for ip activation") raise ex.excError def stopip_cmd(self): if ':' in self.addr: cmd = ['ifconfig', self.ipDev, 'inet6', 'del', self.addr] else: cmd = ['ifconfig', self.stacked_dev, 'down'] return self.vcall(cmd) if __name__ == "__main__": for c in (Ip,) : help(c) 0707010002454c000081b40000000000000000000000014faa950900000dfc000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcExceptions.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. class excError(Exception): """ Failed action """ def __init__(self, value=""): self.value = value def __str__(self): return str(self.value) class OptNotFound(Exception): """ Service config file option not found """ class excSignal(Exception): """ Termination signal received """ class excUndefined(Exception): """ Mandatory Undefined action exception """ def __init__(self,action=None,className=None,func=None): self.action=action self.className=className self.func=func def __str__(self): return "Undefined mandatory Action %s for className %s in function %s" % \ (self.action,self.className,self.func) class syncNoNodesToSync(Exception): """ No nodes to sync => abort stacked syncs resource actions """ class syncNoFilesToSync(Exception): """ No files to sync => move on to the next stacked syncs resource actions """ class syncConfigSyntaxError(Exception): """ Bogus configuration syntax => abort all """ class syncNotSnapable(Exception): """ A dir/file specified as source of a sync with snap is not included in a snapable resource mount => abort all """ class syncSnapExists(Exception): """ The snapshot already exists """ class syncSnapCreateError(Exception): """ Error in snapshot creation => clean up """ class syncSnapDestroyError(Exception): """ Error in snapshot destroy => clean up """ class syncSnapMountError(Exception): """ Error mounting fs => clean up """ class excAbortAction(Exception): """ Abort multi-resource action """ class excInitError(Exception): """ Resource initialisation error """ class excScsiPrNotsupported(Exception): """ Scsi persistent reservation is not supported """ class excNotAvailable(Exception): """ Not available """ class excNotSupported(Exception): """ Not supported """ class excBug(Exception): def __init__(self, value): self.value = value def __str__(self): return repr(self.value) class MissImpl(Exception): def __init__(self, value): self.value = value def __str__(self): return repr(self.value) class IpDevDown(Exception): def __init__(self, value): self.value = value def __str__(self): return repr(self.value) class IpConflict(Exception): def __init__(self, value): self.value = value def __str__(self): return repr(self.value) class IpAlreadyUp(Exception): def __init__(self, value): self.value = value def __str__(self): return repr(self.value) 07070100024545000081b40000000000000000000000014faa950900000b79000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/rcDiskInfoAIX.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from rcUtilities import call, justcall import rcDiskInfo import re class diskInfo(rcDiskInfo.diskInfo): def __init__(self): self.h = {} def scan(self, lname): vid = 'unknown' pid = 'unknown' wwid = 'unknown' size = 'unknown' cmd = ['lscfg', '-vpl', lname] (ret, out, err) = call(cmd) for f in out.split('\n'): if "Manufacturer" in f: vid = f.split('.')[-1] if "Machine Type and Model" in f: pid = f.split('.')[-1] cmd = ['bootinfo', '-s', lname] out, err, ret = justcall(cmd) if ret == 0: size = int(out.strip()) else: size = 0 wwid = self.odmget(lname, 'ww_name').replace('0x', '') if wwid == 'unknown': wwid = self.get_vscsi_id(lname) self.h[lname] = dict(vid=vid, pid=pid, wwid=wwid, size=size) def get_vscsi_id(self, lname): cmd = ['lscfg', '-l', lname] (ret, out, err) = call(cmd) if ret != 0: return 'unknown' l = out.split() if len(l) < 2: return 'unknown' d = l[1] regex = re.compile(r'-C[0-9]+-T[0-9]+') d = regex.sub('', d) return d def odmget(self, lname, attr): cmd = ['odmget', '-q', 'name='+lname+' AND attribute='+attr, 'CuAt'] (ret, out, err) = call(cmd) for f in out.split('\n'): if "value" not in f: continue return f.split(" = ")[-1].strip('"') return 'unknown' def devkey(self, dev): dev = dev.replace("/dev/", "") return dev def get(self, dev, type): dev = self.devkey(dev) if dev not in self.h: self.scan(dev) return self.h[dev][type] def disk_id(self, dev): return self.get(dev, 'wwid') def disk_vendor(self, dev): return self.get(dev, 'vid') def disk_model(self, dev): return self.get(dev, 'pid') def disk_size(self, dev): return self.get(dev, 'size') 07070100024610000081b40000000000000000000000014faa95090000a7e9000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/xmlrpcClient.py#!/usr/bin/python # # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from datetime import datetime, timedelta import xmlrpclib import os import sys from rcGlobalEnv import rcEnv import rcStatus import socket import httplib import rcExceptions as ex hostId = __import__('hostid'+rcEnv.sysname) hostid = hostId.hostid() rcEnv.warned = False pathosvc = os.path.realpath(os.path.join(os.path.dirname(__file__), '..')) import logging import logging.handlers logfile = os.path.join(pathosvc, 'log', 'xmlrpc.log') fileformatter = logging.Formatter("%(asctime)s - %(name)s - %(levelname)s - %(message)s") filehandler = logging.handlers.RotatingFileHandler(os.path.join(logfile), maxBytes=5242880, backupCount=5) filehandler.setFormatter(fileformatter) log = logging.getLogger("xmlrpc") log.addHandler(filehandler) log.setLevel(logging.DEBUG) log.debug("logger setup") from multiprocessing import Queue, Process from Queue import Empty def call_worker(q): e = "foo" o = Collector(worker=True) o.init() try: while e is not None: e = q.get() if e is None: break fn, args, kwargs = e o.log.debug("xmlrpc async %s"%fn) try: getattr(o.proxy, fn)(*args, **kwargs) o.log.debug("xmlrpc async %s done"%fn) continue except (socket.error, xmlrpclib.ProtocolError): """ normal for collector communications disabled through 127.0.0.1 == dbopensvc """ pass except socket.timeout: o.log.error("connection to collector timed out") except: import traceback e = sys.exc_info() o.log.error(str((e[0], e[1], traceback.print_tb(e[2])))) o.log.error("xmlrpc async %s error"%fn) o.log.info("shutdown") except ex.excSignal: o.log.info("interrupted on signal") class Collector(object): def split_url(self, url): if url == 'None': return 'https', '127.0.0.1', '443', '/' if url.startswith('https'): transport = 'https' url = url.replace('https://', '') elif url.startswith('http'): transport = 'http' url = url.replace('http://', '') l = url.split('/') if len(l) < 2: raise app = l[1] l = l[0].split(':') if len(l) == 1: host = l[0] if transport == 'http': port = '80' else: port = '443' elif len(l) == 2: host = l[0] port = l[1] else: raise return transport, host, port, app def setNodeEnv(self): import ConfigParser pathetc = os.path.join(os.path.dirname(__file__), '..', 'etc') nodeconf = os.path.join(pathetc, 'node.conf') config = ConfigParser.RawConfigParser() config.read(nodeconf) if config.has_option('node', 'dbopensvc'): rcEnv.dbopensvc = config.get('node', 'dbopensvc') try: rcEnv.dbopensvc_transport, rcEnv.dbopensvc_host, rcEnv.dbopensvc_port, rcEnv.dbopensvc_app = self.split_url(rcEnv.dbopensvc) except: self.log.error("malformed dbopensvc url: %s"%rcEnv.dbopensvc) if config.has_option('node', 'dbcompliance'): rcEnv.dbcompliance = config.get('node', 'dbcompliance') try: rcEnv.dbcompliance_transport, rcEnv.dbcompliance_host, rcEnv.dbcompliance_port, rcEnv.dbcompliance_app = self.split_url(rcEnv.dbcompliance) except: self.log.error("malformed dbcompliance url: %s"%rcEnv.dbcompliance) if config.has_option('node', 'uuid'): rcEnv.uuid = config.get('node', 'uuid') else: rcEnv.uuid = "" del(config) def submit(self, fn, *args, **kwargs): self.init_worker() self.log.debug("enqueue %s"%fn) self.queue.put((fn, args, kwargs), block=True) def call(self, *args, **kwargs): fn = args[0] self.init(fn) if len(self.proxy_methods) == 0: return self.log.debug("call %s"%fn) if len(args) > 1: args = args[1:] else: args = [] if fn == "register_node" and \ 'register_node' not in self.proxy_methods: print >>sys.stderr, "collector does not support node registration" return if rcEnv.uuid == "" and \ rcEnv.dbopensvc is not None and \ not rcEnv.warned and \ self.auth_node and \ fn != "register_node": print >>sys.stderr, "this node is not registered. try 'nodemgr register'" print >>sys.stderr, "to disable this warning, set 'dbopensvc = None' in node.conf" rcEnv.warned = True return try: buff = getattr(self, fn)(*args, **kwargs) self.log.debug("call %s done"%fn) return buff except (socket.error, xmlrpclib.ProtocolError): """ normal for collector communications disabled through 127.0.0.1 == dbopensvc """ pass #except AttributeError: # print fn, "function does not exist in Collector() object" except socket.timeout: print "connection to collector timed out" except: import traceback e = sys.exc_info() print e[0], e[1], traceback.print_tb(e[2]) self.log.error("call %s error"%fn) def __init__(self, worker=False): self.proxy = None self.proxy_method = None self.comp_proxy = None self.comp_proxy_method = None self._worker = worker self.worker = None self.queue = None self.comp_fns = ['comp_get_moduleset_modules', 'comp_get_moduleset', 'comp_get_svc_moduleset', 'comp_attach_moduleset', 'comp_attach_svc_moduleset', 'comp_detach_moduleset', 'comp_detach_svc_moduleset', 'comp_get_ruleset', 'comp_get_svc_ruleset', 'comp_get_ruleset_md5', 'comp_attach_ruleset', 'comp_attach_svc_ruleset', 'comp_detach_ruleset', 'comp_detach_svc_ruleset', 'comp_list_ruleset', 'comp_list_moduleset', 'comp_show_status', 'comp_log_action'] self.method_cache = os.path.join(pathosvc, "var", "collector") self.auth_node = True self.log = logging.getLogger("xmlrpc%s"%('.worker' if worker else '')) def load_method_cache(self): if not os.path.exists(self.method_cache): self.log.error("missing %s"%self.method_cache) raise ex.excError import ConfigParser conf = ConfigParser.RawConfigParser() conf.read(self.method_cache) if not conf.has_section("methods"): self.log.error("missing 'methods' section of %s"%self.method_cache) raise ex.excError if not conf.has_option("methods", "feed"): self.log.error("missing 'feed' option in 'methods' section of %s"%self.method_cache) raise ex.excError if not conf.has_option("methods", "compliance"): self.log.error("missing 'compliance' option in 'methods' section of %s"%self.method_cache) raise ex.excError self.proxy_methods = conf.get("methods", "feed").split(',') self.comp_proxy_methods = conf.get("methods", "compliance").split(',') self.log.debug("%s loaded"%self.method_cache) self.log.debug("%d feed methods"%len(self.proxy_methods)) self.log.debug("%d compliance methods"%len(self.comp_proxy_methods)) def write_method_cache(self): import ConfigParser conf = ConfigParser.RawConfigParser() conf.add_section('methods') if len(self.proxy_methods) > 0: conf.set('methods', 'feed', ','.join(self.proxy_methods)) if len(self.comp_proxy_methods) > 0: conf.set('methods', 'compliance', ','.join(self.comp_proxy_methods)) f = open(self.method_cache, 'w') conf.write(f) self.log.debug("%s refreshed"%self.method_cache) def get_methods(self): self.log.debug("get method lists") try: if self.proxy is None: self.proxy = xmlrpclib.ServerProxy(rcEnv.dbopensvc) self.proxy_methods = self.proxy.system.listMethods() except: self.proxy = xmlrpclib.ServerProxy("https://127.0.0.1/") self.proxy_methods = [] self.log.debug("%d feed methods"%len(self.proxy_methods)) try: if self.comp_proxy is None: self.comp_proxy = xmlrpclib.ServerProxy(rcEnv.dbcompliance) self.comp_proxy_methods = self.comp_proxy.system.listMethods() except: self.comp_proxy = xmlrpclib.ServerProxy("https://127.0.0.1/") self.comp_proxy_methods = [] self.log.debug("%d compliance methods"%len(self.comp_proxy_methods)) def init(self, fn=None): if fn is not None: if fn in self.comp_fns: if self.comp_proxy is not None: return elif self.proxy is not None: return self.setNodeEnv() try: a = socket.getaddrinfo(rcEnv.dbopensvc_host, None) if len(a) == 0: raise Exception dbopensvc_ip = a[0][-1][0] except: self.log.error("could not resolve %s to an ip address. disable collector updates."%rcEnv.dbopensvc_host) try: a = socket.getaddrinfo(rcEnv.dbcompliance_host, None) if len(a) == 0: raise Exception dbcompliance_ip = a[0][-1][0] except: self.log.error("could not resolve %s to an ip address. disable collector updates."%rcEnv.dbcompliance_host) socket.setdefaulttimeout(120) utils = __import__('rcUtilities'+rcEnv.sysname) if fn is None: try: if not utils.check_ping(dbopensvc_ip): self.log.error("could not ping %s. disable collector updates."%dbopensvc_ip) raise self.proxy = xmlrpclib.ServerProxy(rcEnv.dbopensvc) except: self.proxy = xmlrpclib.ServerProxy("https://127.0.0.1/") try: if not utils.check_ping(dbcompliance_ip): self.log.error("could not ping %s. disable collector updates."%dbcompliance_ip) raise self.comp_proxy = xmlrpclib.ServerProxy(rcEnv.dbcompliance) except: self.comp_proxy = xmlrpclib.ServerProxy("https://127.0.0.1/") elif fn not in self.comp_fns: try: if not utils.check_ping(dbopensvc_ip): self.log.error("could not ping %s. disable collector updates."%dbopensvc_ip) raise self.proxy = xmlrpclib.ServerProxy(rcEnv.dbopensvc) except: self.proxy = xmlrpclib.ServerProxy("https://127.0.0.1/") else: try: if not utils.check_ping(dbcompliance_ip): self.log.error("could not ping %s. disable collector updates."%dbopensvc_ip) raise self.comp_proxy = xmlrpclib.ServerProxy(rcEnv.dbcompliance) except: self.comp_proxy = xmlrpclib.ServerProxy("https://127.0.0.1/") self.log.debug("feed proxy %s"%str(self.proxy)) self.log.debug("compliance proxy %s"%str(self.comp_proxy)) try: self.load_method_cache() except ex.excError: self.get_methods() self.write_method_cache() if "register_node" not in self.proxy_methods: self.auth_node = False def stop_worker(self): if self.queue is None: self.log.debug("worker already stopped (queue is None)") return if self.worker is None: self.log.debug("worker already stopped (worker is None)") return try: if not self.worker.is_alive(): self.log.debug("worker already stopped (not alive)") return except AssertionError: self.log.debug("don't stop worker (not a child of this process)") return self.log.debug("give poison pill to worker") self.queue.put(None) self.worker.join() self.queue = None self.worker = None def init_worker(self): if self._worker: return if self.worker is not None: return try: self.queue = Queue() except: self.log.error("Queue not supported. disable async mode") self.queue = None return self.worker = Process(target=call_worker, name="xmlrpc", args=(self.queue,)) self.worker.start() self.log.debug("worker started") def begin_action(self, svc, action, begin, sync=True): try: import version version = version.version except: version = "0"; args = [['svcname', 'action', 'hostname', 'hostid', 'version', 'begin', 'cron'], [repr(svc.svcname), repr(action), repr(rcEnv.nodename), repr(hostid), repr(version), repr(str(begin)), '1' if svc.cron else '0'] ] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] if sync: self.proxy.begin_action(*args) else: self.submit("begin_action", *args) def end_action(self, svc, action, begin, end, logfile, sync=True): err = 'ok' dateprev = None lines = open(logfile, 'r').read() pids = set([]) """Example logfile line: 2009-11-11 01:03:25,252;;DISK.VG;;INFO;;unxtstsvc01_data is already up;;10200;;EOL """ vars = ['svcname', 'action', 'hostname', 'hostid', 'pid', 'begin', 'end', 'status_log', 'status', 'cron'] vals = [] for line in lines.split(';;EOL\n'): if line.count(';;') != 4: continue date = line.split(';;')[0] """Push to database the previous line, so that begin and end date are available. """ if dateprev is not None: res = res.lower() res = res.replace(svc.svcname+'.','') vals.append([svc.svcname, res+' '+action, rcEnv.nodename, hostid, pid, dateprev, date, msg, res_err, '1' if svc.cron else '0']) res_err = 'ok' (date, res, lvl, msg, pid) = line.split(';;') # database overflow protection trim_lim = 10000 trim_tag = ' ' trim_head = int(trim_lim/2) trim_tail = trim_head-len(trim_tag) if len(msg) > trim_lim: msg = msg[:trim_head]+' '+msg[-trim_tail:] pids |= set([pid]) if lvl is None or lvl == 'DEBUG': continue if lvl == 'ERROR': err = 'err' res_err = 'err' if lvl == 'WARNING' and err != 'err': err = 'warn' if lvl == 'WARNING' and res_err != 'err': res_err = 'warn' dateprev = date """Push the last log entry, using 'end' as end date """ if dateprev is not None: res = res.lower() res = res.replace(svc.svcname+'.','') vals.append([svc.svcname, res+' '+action, rcEnv.nodename, hostid, pid, dateprev, date, msg, res_err, '1' if svc.cron else '0']) if len(vals) > 0: args = [vars, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] if sync: self.proxy.res_action_batch(*args) else: self.submit("res_action_batch", *args) """Complete the wrap-up database entry """ """ If logfile is empty, default to current process pid """ if len(pids) == 0: pids = set([os.getpid()]) args = [ ['svcname', 'action', 'hostname', 'hostid', 'pid', 'begin', 'end', 'time', 'status', 'cron'], [repr(svc.svcname), repr(action), repr(rcEnv.nodename), repr(hostid), repr(','.join(map(str, pids))), repr(str(begin)), repr(str(end)), repr(str(end-begin)), repr(str(err)), '1' if svc.cron else '0'] ] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] if sync: self.proxy.end_action(*args) else: self.submit("end_action", *args) def svcmon_update_combo(self, g_vars, g_vals, r_vars, r_vals, sync=True): if 'svcmon_update_combo' in self.proxy_methods: args = [g_vars, g_vals, r_vars, r_vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] if sync: self.proxy.svcmon_update_combo(*args) else: self.submit("svcmon_update_combo", *args) else: args = [g_vars, g_vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] if sync: self.proxy.svcmon_update(*args) else: self.submit("svcmon_update", *args) args = [r_vars, r_vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] if sync: self.proxy.resmon_update(*args) else: self.submit("resmon_update", *args) def _push_appinfo(self, svc, sync=True): if 'update_appinfo' not in self.proxy_methods: return vars = ['app_svcname', 'app_nodename', 'cluster_type', 'app_launcher', 'app_key', 'app_value'] vals = svc.resources_by_id['app'].info() if len(vals) == 0: return for val in vals: print "%s: %s"%(val[4], val[5]) args = [vars, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.update_appinfo(*args) def push_service(self, svc, sync=True): def envfile(svc): envfile = os.path.join(rcEnv.pathsvc, 'etc', svc+'.env') if not os.path.exists(envfile): return with open(envfile, 'r') as f: buff = "" for line in f.readlines(): l = line.strip() if len(l) == 0: continue if l[0] == '#' or l[0] == ';': continue buff += line return buff return try: import version version = version.version except: version = "0"; if hasattr(svc, "guestos"): guestos = svc.guestos else: guestos = "" vars = ['svc_hostid', 'svc_name', 'svc_vmname', 'svc_cluster_type', 'svc_flex_min_nodes', 'svc_flex_max_nodes', 'svc_flex_cpu_low_threshold', 'svc_flex_cpu_high_threshold', 'svc_type', 'svc_nodes', 'svc_drpnode', 'svc_drpnodes', 'svc_comment', 'svc_drptype', 'svc_autostart', 'svc_app', 'svc_containertype', 'svc_envfile', 'svc_version', 'svc_drnoaction', 'svc_guestos', 'svc_ha'] vals = [repr(hostid), repr(svc.svcname), repr(svc.vmname), repr(svc.clustertype), repr(svc.flex_min_nodes), repr(svc.flex_max_nodes), repr(svc.flex_cpu_low_threshold), repr(svc.flex_cpu_high_threshold), repr(svc.svctype), repr(' '.join(svc.nodes)), repr(svc.drpnode), repr(' '.join(svc.drpnodes)), repr(svc.comment), repr(svc.drp_type), repr(' '.join(svc.autostart_node)), repr(svc.app), repr(svc.svcmode), repr(envfile(svc.svcname)), repr(version), repr(svc.drnoaction), repr(guestos), '1' if svc.ha else '0'] if 'container' in svc.resources_by_id: container_info = svc.resources_by_id['container'].get_container_info() vars += ['svc_vcpus', 'svc_vmem'] vals += [container_info['vcpus'], container_info['vmem']] args = [vars, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.update_service(*args) def push_disks(self, node, sync=True): di = __import__('rcDiskInfo'+rcEnv.sysname) disks = di.diskInfo() try: m = __import__("rcDevTree"+rcEnv.sysname) except ImportError: return tree = m.DevTree() tree.load() vars = ['disk_id', 'disk_svcname', 'disk_size', 'disk_used', 'disk_vendor', 'disk_model', 'disk_dg', 'disk_nodename', 'disk_region'] vals = [] # hash to add up disk usage across all services dh = {} served_disks = [] for svc in node.svcs: # hash to add up disk usage inside a service valsh = {} for rs in svc.resSets: for r in rs.resources: if r.is_disabled(): continue if hasattr(r, "name"): disk_dg = r.name elif hasattr(r, "dev"): disk_dg = r.dev else: disk_dg = r.rid if hasattr(r, 'devmap'): served_disks += map(lambda x: (x[0], svc.vm_hostname()+'.'+x[1]), r.devmap()) for devpath in r.devlist(): for d, used, region in tree.get_top_devs_usage_for_devpath(devpath): disk_id = disks.disk_id(d) if disk_id is None or disk_id == "": """ no point pushing to db an empty entry """ continue if disk_id in dh: dh[disk_id] += used else: dh[disk_id] = used disk_size = disks.disk_size(d) if dh[disk_id] > disk_size: dh[disk_id] = disk_size if disk_id in valsh: valsh[disk_id][3] += used else: valsh[disk_id] = [ disk_id, svc.svcname, disk_size, used, disks.disk_vendor(d), disks.disk_model(d), disk_dg, rcEnv.nodename, region ] if valsh[disk_id][3] > disk_size: valsh[disk_id][3] = disk_size for l in valsh.values(): vals += [map(lambda x: repr(x), l)] print l[1], "disk", l[0], "%d/%dM"%(l[3], l[2]), "region", region done = [] region = 0 for d in node.devlist(): disk_id = disks.disk_id(d) if disk_id is None or disk_id == "": """ no point pushing to db an empty entry """ continue # Linux Node:devlist() reports paths, so we can have duplicate # disks here. if disk_id in done: continue done.append(disk_id) if disks.disk_id(d) in dh: left = disks.disk_size(d) - dh[disk_id] else: left = disks.disk_size(d) if left == 0: continue print rcEnv.nodename, "disk", disks.disk_id(d), "%d/%dM"%(left, disks.disk_size(d)), "region", region vals.append([ repr(disks.disk_id(d)), "", repr(disks.disk_size(d)), repr(left), repr(disks.disk_vendor(d)), repr(disks.disk_model(d)), "", repr(rcEnv.nodename), repr(region) ]) args = [vars, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.register_disks(*args) # # register disks this node provides to its VM # vars = ['disk_id', 'disk_arrayid', 'disk_devid', 'disk_size', 'disk_raid', 'disk_group'] vals = [] for dev_id, vdisk_id in served_disks: disk_id = disks.disk_id(dev_id) try: disk_size = disks.disk_size(dev_id) except: continue vals.append([ vdisk_id, rcEnv.nodename, disk_id, str(disk_size), "virtual", "virtual" ]) print "register served disk", disk_id, "as", vdisk_id args = [vars, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.register_diskinfo(*args) def push_stats_fs_u(self, l, sync=True): args = [l[0], l[1]] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.insert_stats_fs_u(*args) def push_pkg(self, sync=True): p = __import__('rcPkg'+rcEnv.sysname) vars = ['pkg_nodename', 'pkg_name', 'pkg_version', 'pkg_arch'] vals = p.listpkg() args = [rcEnv.nodename] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] args = [vars, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.insert_pkg(*args) def push_patch(self, sync=True): p = __import__('rcPkg'+rcEnv.sysname) vars = ['patch_nodename', 'patch_num', 'patch_rev'] vals = p.listpatch() args = [rcEnv.nodename] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] args = [vars, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.insert_patch(*args) def push_stats(self, force=False, interval=None, stats_dir=None, stats_start=None, stats_end=None, sync=True): try: s = __import__('rcStats'+rcEnv.sysname) except ImportError: return sp = s.StatsProvider(interval=interval, stats_dir=stats_dir, stats_start=stats_start, stats_end=stats_end) h = {} for stat in ['cpu', 'mem_u', 'proc', 'swap', 'block', 'blockdev', 'netdev', 'netdev_err', 'svc']: h[stat] = sp.get(stat) import cPickle args = [cPickle.dumps(h)] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.insert_stats(*args) def push_asset(self, node, sync=True): try: m = __import__('rcAsset'+rcEnv.sysname) except ImportError: print "pushasset methods not implemented on", rcEnv.sysname return if "update_asset" not in self.proxy_methods: print "'update_asset' method is not exported by the collector" return d = m.Asset(node).get_asset_dict() gen = {} if 'hba' in d: vars = ['nodename', 'hba_id', 'hba_type'] vals = [] for hba_id, hba_type in d['hba']: vals.append([rcEnv.nodename, hba_id, hba_type]) del(d['hba']) gen.update({'hba': [vars, vals]}) if 'targets' in d: import copy vars = ['hba_id', 'tgt_id'] vals = copy.copy(d['targets']) del(d['targets']) gen.update({'targets': [vars, vals]}) if len(gen) > 0: args = [gen] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.insert_generic(*args) args = [d.keys(), d.values()] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.update_asset(*args) def push_vioserver(self, sync=True): if 'update_vioserver' not in self.proxy_methods: print "'update_vioserver' method is not exported by the collector" return m = __import__('rcVioServer') try: vioservers = m.VioServers() except: return for vioserver in vioservers: vals = [] for key in vioserver.keys: vals.append(getattr(vioserver, 'get_'+key)()) args = [vioserver.name, vioserver.keys, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.update_vioserver(*args) def push_necism(self, sync=True): if 'update_necism' not in self.proxy_methods: print "'update_necism' method is not exported by the collector" return m = __import__('rcNecIsm') try: necisms = m.NecIsms() except: return for necism in necisms: vals = [] for key in necism.keys: vals.append(getattr(necism, 'get_'+key)()) args = [necism.name, necism.keys, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.update_necism(*args) def push_ibmsvc(self, sync=True): if 'update_ibmsvc' not in self.proxy_methods: print "'update_ibmsvc' method is not exported by the collector" return m = __import__('rcIbmSvc') try: ibmsvcs = m.IbmSvcs() except: return for ibmsvc in ibmsvcs: vals = [] for key in ibmsvc.keys: vals.append(getattr(ibmsvc, 'get_'+key)()) args = [ibmsvc.name, ibmsvc.keys, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.update_ibmsvc(*args) def push_dcs(self, sync=True): if 'update_dcs' not in self.proxy_methods: print "'update_dcs' method is not exported by the collector" return m = __import__('rcDcs') try: dcss = m.Dcss() except: return for dcs in dcss: vals = [] for key in dcs.keys: vals.append(getattr(dcs, 'get_'+key)()) args = [dcs.name, dcs.keys, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.update_dcs(*args) def push_eva(self, sync=True): if 'update_eva_xml' not in self.proxy_methods: print "'update_eva_xml' method is not exported by the collector" return m = __import__('rcEva') try: evas = m.Evas() except: return for eva in evas: vals = [] for key in eva.keys: vals.append(getattr(eva, 'get_'+key)()) args = [eva.name, eva.keys, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.update_eva_xml(*args) def push_sym(self, sync=True): if 'update_sym_xml' not in self.proxy_methods: print "'update_sym_xml' method is not exported by the collector" return m = __import__('rcSymmetrix') try: syms = m.Syms() except: return for sym in syms: vals = [] for key in sym.keys: vals.append(getattr(sym, 'get_'+key)()) args = [sym.sid, sym.keys, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.update_sym_xml(*args) def push_all(self, svcs, sync=True): args = [[svc.svcname for svc in svcs]] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] for svc in svcs: self.push_service(svc, sync=sync) def push_appinfo(self, svcs, sync=True): args = [[svc.svcname for svc in svcs]] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] for svc in svcs: self._push_appinfo(svc, sync=sync) def push_checks(self, vars, vals, sync=True): if "push_checks" not in self.proxy_methods: print "'push_checks' method is not exported by the collector" return args = [vars, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] self.proxy.push_checks(*args) def register_node(self, sync=True): return self.proxy.register_node(rcEnv.nodename) def comp_get_moduleset_modules(self, moduleset, sync=True): args = [moduleset] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_get_moduleset_modules(*args) def comp_get_moduleset(self, sync=True): args = [rcEnv.nodename] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_get_moduleset(*args) def comp_get_svc_moduleset(self, svc, sync=True): args = [svc] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_get_svc_moduleset(*args) def comp_attach_moduleset(self, moduleset, sync=True): args = [rcEnv.nodename, moduleset] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_attach_moduleset(*args) def comp_attach_svc_moduleset(self, svc, moduleset, sync=True): args = [svc, moduleset] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_attach_svc_moduleset(*args) def comp_detach_svc_moduleset(self, svcname, moduleset, sync=True): args = [svcname, moduleset] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_detach_svc_moduleset(*args) def comp_detach_moduleset(self, moduleset, sync=True): args = [rcEnv.nodename, moduleset] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_detach_moduleset(*args) def comp_get_svc_ruleset(self, svcname, sync=True): args = [svcname] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_get_svc_ruleset(*args) def comp_get_ruleset(self, sync=True): args = [rcEnv.nodename] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_get_ruleset(*args) def comp_get_ruleset_md5(self, rset_md5, sync=True): args = [rset_md5] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_get_ruleset_md5(*args) def comp_attach_ruleset(self, ruleset, sync=True): args = [rcEnv.nodename, ruleset] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_attach_ruleset(*args) def comp_detach_svc_ruleset(self, svcname, ruleset, sync=True): args = [svcname, ruleset] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_detach_svc_ruleset(*args) def comp_attach_svc_ruleset(self, svcname, ruleset, sync=True): args = [svcname, ruleset] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_attach_svc_ruleset(*args) def comp_detach_ruleset(self, ruleset, sync=True): args = [rcEnv.nodename, ruleset] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_detach_ruleset(*args) def comp_list_ruleset(self, pattern='%', sync=True): args = [pattern, rcEnv.nodename] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_list_rulesets(*args) def comp_list_moduleset(self, pattern='%', sync=True): args = [pattern] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_list_modulesets(*args) def comp_log_action(self, vars, vals, sync=True): args = [vars, vals] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_log_action(*args) def comp_show_status(self, svcname, pattern='%', sync=True): args = [svcname, pattern] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.comp_proxy.comp_show_status(*args) def collector_ack_unavailability(self, opts, sync=True): args = [opts] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.proxy.collector_ack_unavailability(*args) def collector_list_unavailability_ack(self, opts, sync=True): args = [opts] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.proxy.collector_list_unavailability_ack(*args) def collector_list_actions(self, opts, sync=True): args = [opts] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.proxy.collector_list_actions(*args) def collector_ack_action(self, opts, sync=True): args = [opts] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.proxy.collector_ack_action(*args) def collector_status(self, opts, sync=True): args = [opts] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.proxy.collector_status(*args) def collector_checks(self, opts, sync=True): args = [opts] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.proxy.collector_checks(*args) def collector_alerts(self, opts, sync=True): args = [opts] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.proxy.collector_alerts(*args) def collector_show_actions(self, opts, sync=True): args = [opts] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.proxy.collector_show_actions(*args) def collector_events(self, opts, sync=True): args = [opts] if self.auth_node: args += [(rcEnv.uuid, rcEnv.nodename)] return self.proxy.collector_events(*args) if __name__ == "__main__": x = Collector() x.init() print x.proxy_methods print x.comp_proxy_methods 070701000245b0000081b40000000000000000000000014faa950900000f49000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/resContainerJail.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from datetime import datetime import rcStatus import resources as Res from rcUtilitiesFreeBSD import check_ping from rcUtilities import qcall import resContainer import rcExceptions as ex class Jail(resContainer.Container): """ jail -c name=jail1 path=/usr/local/opt/jail1.opensvc.com host.hostname=jail1.opensvc.com ip4.addr=192.168.0.208 command=/bin/sh /etc/rc """ def files_to_sync(self): return [] def operational(self): return True def install_drp_flag(self): rootfs = self.svc.jailroot flag = os.path.join(rootfs, ".drp_flag") self.log.info("install drp flag in container : %s"%flag) with open(flag, 'w') as f: f.write(' ') f.close() def container_start(self): ips = [] ip6s = [] for rs in self.svc.get_res_sets("ip"): for r in rs.resources: if ':' in r.addr: ip6s.append(r.addr) else: ips.append(r.addr) cmd = ['jail', '-c', 'name='+self.svc.basevmname, 'path='+self.svc.jailroot, 'host.hostname='+self.svc.vmname] if len(ips) > 0: cmd += ['ip4.addr='+','.join(ips)] if len(ip6s) > 0: cmd += ['ip6.addr='+','.join(ip6s)] cmd += ['command=/bin/sh', '/etc/rc'] self.log.info(' '.join(cmd)) ret = qcall(cmd) if ret != 0: raise ex.excError def container_stop(self): cmd = ['jail', '-r', self.svc.basevmname] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_forcestop(self): """ no harder way to stop a lxc container, raise to signal our helplessness """ self.log.error("no forced stop method") raise ex.excError def ping(self): return check_ping(self.addr, timeout=1) def is_up(self): cmd = ['jls'] (ret, out, err) = self.call(cmd) if ret != 0: raise ex.excError for line in out.split('\n'): l = line.split() if len(l) < 4: continue if l[2] == self.svc.vmname: return True return False def get_container_info(self): print "TODO: get_container_info()" return {'vcpus': '0', 'vmem': '0'} def _status(self, verbose=False): if self.is_up(): return rcStatus.UP else: return rcStatus.DOWN def __init__(self, name, optional=False, disabled=False, monitor=False, tags=set([])): resContainer.Container.__init__(self, rid="jail", name=name, type="container.jail", optional=optional, disabled=disabled, monitor=monitor, tags=tags) def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) 070701000245e4000081b40000000000000000000000014faa950900002c6f000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/resSyncEvasnap.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import logging from rcGlobalEnv import rcEnv from rcUtilities import which import rcExceptions as ex import rcStatus import time import datetime import xml.etree.ElementTree as ET import subprocess import resSync class syncEvasnap(resSync.Sync): def wait_for_devs_ready(self): pass def can_sync(self, target=None): ts = None """ get oldest snap """ for pair in self.pairs: info = self.lun_info(pair['dst']) if info is None: self.log.debug("snap %s missing"%pair['dst']) return True _ts = info['creationdatetime'] if ts is None or _ts < ts: ts = _ts return not self.skip_sync(ts) def recreate(self): def snapname(info): return info['objectname'].split('\\')[-2]+'_'+self.svc.svcname try: self.prereq() except ex.excError as e: self.log.error(str(e)) raise ex.excError status = self._status(skip_prereq=True) if not self.can_sync(): return if not self.svc.force and status == rcStatus.UP: self.log.info("snapshots are already fresh. use --force to bypass") return cmd = [] for pair in self.pairs: if pair['dst'] in self._lun_info: info = self._lun_info[pair['dst']] for mask in pair['mask']: lunid = int(mask.split('\\')[-1]) hostpath = '\\'.join(mask.split('\\')[:-1]) if hostpath in info['mask'] and info['mask'][hostpath] == lunid: cmd += ['delete lun "%s"'%mask] cmd += ['delete vdisk "%s" wait_for_completion'%info['objectname']] self.sssu(cmd, verbose=True) cmd = [] for pair in self.pairs: info = self.lun_info(pair['src']) if 'allocation_policy' in pair: policy = str(pair['allocation_policy']).lower() else: policy = 'demand' if policy not in ['demand', 'fully']: policy = 'demand' if 'vraid' in pair and pair['vraid'] in ['vraid6', 'vraid5', 'vraid0', 'vraid1']: force_vraid = "redundancy=%s"%pair['vraid'] else: force_vraid = "" cmd += ['add snapshot %s vdisk="%s" allocation_policy=%s world_wide_lun_name=%s %s'%(snapname(info), info['objectname'], policy, self.convert_wwid(pair['dst']), force_vraid)] self.sssu(cmd, verbose=True) cmd = [] for pair in self.pairs: info = self.lun_info(pair['dst']) for mask in pair['mask']: lunid = mask.split('\\')[-1] hostpath = '\\'.join(mask.split('\\')[:-1]) cmd += ['add lun %s host="%s" vdisk="%s"'%(lunid, hostpath, snapname(info))] self.sssu(cmd, verbose=True) def sssu(self, cmd=[], verbose=False, check=True): os.chdir(rcEnv.pathtmp) cmd = [self.sssubin, "select manager %s username=%s password=%s"%(self.manager, self.username, self.password), "select system %s"%self.eva_name] + cmd if verbose: import re from copy import copy _cmd = copy(cmd) _cmd[1] = re.sub(r'password=.*', 'password=xxxxx', _cmd[1]) self.log.info(subprocess.list2cmdline(_cmd)) ret, out, err = self.call(cmd) if 'Error:' in out > 0: self.log.error(out) else: self.log.info(out) else: ret, out, err = self.call(cmd) if check and "Error" in out: raise ex.excError("sssu command execution error") return ret, out, err def lun_info(self, wwid): if wwid in self._lun_info: return self._lun_info[wwid] if '-' not in wwid: _wwid = wwid wwid = self.convert_wwid(wwid) info = { 'oxuid': 'unknown', 'lunid': -1, 'creationdatetime': datetime.datetime(year=datetime.MINYEAR, month=1, day=1), 'mask': {} } try: ret, out, err = self.sssu(["find vdisk lunwwid="+wwid+" xml"]) except: return None l = out.split('\n') for i, line in enumerate(l): if line == '': l = l[i:] break e = ET.fromstring('\n'.join(l)) for p in e.findall("presentations/presentation"): host = p.find("hostname").text lunid = p.find("lunnumber").text info['mask'][host] = int(lunid) e_oxuid = e.find("objectparenthexuid") if e_oxuid is not None: info['oxuid'] = e_oxuid.text.replace('-','') e_objectname = e.find("objectname") if e_objectname is not None: info['objectname'] = e_objectname.text e_creationdatetime = e.find("creationdatetime") if e_oxuid is not None: try: creationdatetime = datetime.datetime.strptime(e_creationdatetime.text, "%d-%b-%Y %H:%M:%S") info['creationdatetime'] = creationdatetime except: self.log.error("failed to parse snapshot creation datetime") pass self._lun_info[_wwid] = info return info def _status(self, verbose=False, skip_prereq=False): err = False errlog = [] try: if not skip_prereq: self.prereq() except ex.excError as e: self.status_log(str(e)) return rcStatus.WARN for pair in self.pairs: info_s = self.lun_info(pair['src']) info_d = self.lun_info(pair['dst']) if info_s is None: errlog.append("snapshot source %s does not exists"%pair['src']) err |= True continue if info_d is None: errlog.append("snapshot %s does not exists"%pair['dst']) err |= True continue if info_s['oxuid'].lower() != info_d['oxuid'].lower(): errlog.append("snapshot %s exists but incorrect parent object uid: %s"%(pair['dst'], info_d['oxuid'].lower())) err |= True if info_d['creationdatetime'] < datetime.datetime.now() - datetime.timedelta(minutes=self.sync_max_delay): errlog.append("snapshot %s too old"%pair['dst']) err |= True for mask in pair['mask']: hostpath = '\\'.join(mask.split('\\')[:-1]) hostname = mask.split('\\')[-2] dstlunid = mask.split('\\')[-1] if hostpath not in info_d['mask']: errlog.append("snapshot %s exists but not presented to host %s"%(pair['dst'], hostname)) err |= True continue try: dstlunid = int(dstlunid) if info_d['mask'][hostpath] != dstlunid: errlog.append("snapshot %s exists but incorrect lunid for host %s"%(pair['dst'], hostname)) err |= True except ValueError: pass if err: self.status_log('. '.join(errlog)) return rcStatus.WARN return rcStatus.UP def syncresync(self): self.recreate() def refresh_svcstatus(self): self.svcstatus = self.svc.group_status(excluded_groups=set(["sync", 'hb'])) def get_svcstatus(self): if len(self.svcstatus) == 0: self.refresh_svcstatus() def convert_wwid(self, wwid): s = "" for i, c in enumerate(wwid): s += c if (i+1) % 4 == 0: s += '-' return s.strip('-') def prereq(self): import ConfigParser if not which(self.sssubin): raise ex.excError("missing %s"%self.sssubin) if not os.path.exists(self.conf): raise ex.excError("missing %s"%self.conf) self.config = ConfigParser.RawConfigParser() self.config.read(self.conf) if not self.config.has_section(self.eva_name): raise ex.excError("no credentials for array %s in %s"%(self.eva_name, self.conf)) if not self.config.has_option(self.eva_name, "manager"): raise ex.excError("no manager set for array %s in %s"%(self.eva_name, self.conf)) if not self.config.has_option(self.eva_name, "username"): raise ex.excError("no username set for array %s in %s"%(self.eva_name, self.conf)) if not self.config.has_option(self.eva_name, "password"): raise ex.excError("no password set for array %s in %s"%(self.eva_name, self.conf)) self.manager = self.config.get(self.eva_name, "manager") self.username = self.config.get(self.eva_name, "username") self.password = self.config.get(self.eva_name, "password") for pair in self.pairs: if 'src' not in pair or 'dst' not in pair or 'mask' not in pair: raise ex.excError("missing parameter in pair %s"%str(pair)) ret, out, err = self.sssu(check=False) if "Error opening https connection" in out: raise ex.excError("error login to %s"%self.manager) elif "Error" in out: raise ex.excError("eva %s is not managed by %s"%(self.eva_name, self.manager)) def __init__(self, rid=None, pairs=[], eva_name="", sync_max_delay=None, sync_interval=None, sync_days=None, sync_period=None, optional=False, disabled=False, tags=set([]), internal=False): resSync.Sync.__init__(self, rid=rid, type="sync.evasnap", sync_max_delay=sync_max_delay, sync_interval=sync_interval, sync_days=sync_days, sync_period=sync_period, optional=optional, disabled=disabled, tags=tags) self.label = "EVA snapshot %s"%(rid) self.eva_name = eva_name self.pairs = pairs self.sssubin = os.path.join(rcEnv.pathbin, 'sssu') self.conf = os.path.join(rcEnv.pathetc, 'sssu.conf') self._lun_info = {} def __str__(self): return "%s eva_name=%s pairs=%s" % (resSync.Sync.__str__(self),\ self.eva_name, str(self.pairs)) 070701000245ce000081b40000000000000000000000014faa9509000006bb000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/resIpZone.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. "Module implement SunOS specific ip management" import resIpSunOS as Res from subprocess import * class Ip(Res.Ip): def __init__(self, rid=None, ipDev=None, ipName=None, mask=None, always_on=set([]), monitor=False, disabled=False, tags=set([]), optional=False): Res.Ip.__init__(self, rid=rid, ipDev=ipDev, ipName=ipName, mask=mask, always_on=always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) def startip_cmd(self): cmd=['ifconfig', self.stacked_dev, 'plumb', self.addr, \ 'netmask', '+', 'broadcast', '+', 'up' , 'zone' , self.svc.vmname ] return self.vcall(cmd) if __name__ == "__main__": for c in (Ip,) : help(c) 07070100024573000081b40000000000000000000000014faa9509000004f7000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/rcPkgHP-UX.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from rcUtilities import call, which from rcGlobalEnv import rcEnv def listpkg(): if which('swlist') is None: return [] cmd = ['swlist', '-l', 'product'] (ret, out, err) = call(cmd, errlog=False, cache=True) lines = [] for line in out.split('\n'): l = line.split() if len(l) < 2: continue if line[0] == '#': continue x = [rcEnv.nodename, l[0], l[1], ''] lines.append(x) return lines def listpatch(): return [] 070701000245ba000081b40000000000000000000000014faa95090000194b000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/resDrbd.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import os import resources as Res import rcStatus import rcExceptions as ex from rcUtilities import which, justcall from rcGlobalEnv import rcEnv class Drbd(Res.Resource): """ Drbd device resource The tricky part is that drbd devices can be used as PV and LV can be used as drbd base devices. Treat the ordering with 'prevg' and 'postvg' tags. Start 'ups' and promotes the drbd devices to primary. Stop 'downs' the drbd devices. """ def __init__(self, rid=None, res=None, always_on=set([]), optional=False, disabled=False, tags=set([]), monitor=False): Res.Resource.__init__(self, rid, "disk.drbd", optional=optional, disabled=disabled, tags=tags, monitor=monitor) self.res = res self.label = res self.drbdadm = None self.always_on = always_on self.disks = set() if 'prevg' not in self.tags and 'postvg' not in self.tags: tags |= set(['postvg']) def __str__(self): return "%s resource=%s" % (Res.Resource.__str__(self),\ self.res) def files_to_sync(self): cf = os.path.join(os.sep, 'etc', 'drbd.d', self.res+'.res') if os.path.exists(cf): return [cf] self.log.error("%s does not exist"%cf) return [] def drbdadm_cmd(self, cmd): if self.drbdadm is None: if which('drbdadm'): self.drbdadm = 'drbdadm' else: self.log("drbdadm command not found") raise exc.excError return [self.drbdadm] + cmd.split() + [self.res] def disklist(self): if self.disks != set(): return self.disks self.disks = set() devps = set() (ret, out, err) = self.call(self.drbdadm_cmd('dump-xml')) if ret != 0: raise ex.excError from xml.etree.ElementTree import XML, fromstring tree = fromstring(out) for res in tree.getiterator('resource'): if res.attrib['name'] != self.res: continue for host in res.getiterator('host'): if host.attrib['name'] != rcEnv.nodename: continue d = host.find('disk') if d is None: continue devps |= set([d.text]) try: u = __import__('rcUtilities'+rcEnv.sysname) self.disks = u.devs_to_disks(self, devps) except: self.disks = devps return self.disks def drbdadm_down(self): (ret, out, err) = self.vcall(self.drbdadm_cmd('down')) if ret != 0: raise ex.excError def drbdadm_up(self): (ret, out, err) = self.vcall(self.drbdadm_cmd('up')) if ret != 0: raise ex.excError def get_cstate(self): self.prereq() (out, err, ret) = justcall(self.drbdadm_cmd('cstate')) if ret != 0: if "Device minor not allocated" in err: return "Unattached" else: raise ex.excError return out.strip() def prereq(self): if not os.path.exists("/proc/drbd"): (ret, out, err) = self.vcall(['modprobe', 'drbd']) if ret != 0: raise ex.excError def start_connection(self): cstate = self.get_cstate() if cstate == "Connected": self.log.info("drbd resource %s is already up"%self.res) elif cstate == "StandAlone": self.drbdadm_down() self.drbdadm_up() elif cstate == "WFConnection": self.log.info("drbd resource %s peer node is not listening"%self.res) pass else: self.drbdadm_up() def get_roles(self): (ret, out, err) = self.call(self.drbdadm_cmd('role')) if ret != 0: raise ex.excError out = out.strip().split('/') if len(out) != 2: raise ex.excError return out def start_role(self, role): roles = self.get_roles() if roles[0] != role: (ret, out, err) = self.vcall(self.drbdadm_cmd(role.lower())) if ret != 0: raise ex.excError else: self.log.info("drbd resource %s is already %s"%(self.res, role)) def startstandby(self): self.start_connection() roles = self.get_roles() if roles[0] == "Primary": return self.start_role('Secondary') def stopstandby(self): self.start_connection() roles = self.get_roles() if roles[0] == "Secondary": return self.start_role('Secondary') def start(self): self.start_connection() self.start_role('Primary') def stop(self): self.drbdadm_down() def _status(self, verbose=False): (ret, out, err) = self.call(self.drbdadm_cmd('dstate')) if ret != 0: self.status_log("drbdadm dstate %s failed"%self.res) return rcStatus.WARN out = out.strip() if out == "UpToDate/UpToDate": return self.status_stdby(rcStatus.UP) elif out == "Unconfigured": return self.status_stdby(rcStatus.DOWN) self.status_log("unexpected drbd resource %s state: %s"%(self.res, out)) return rcStatus.WARN if __name__ == "__main__": help(Drbd) v = Drbd(res='test') print v 0707010002450c000081b40000000000000000000000014faa950900000af2000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/checkMpathAIX.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "mpath" def find_svc(self, dev): for svc in self.svcs: if dev in svc.disklist(): return svc.svcname return '' def odmget(self, lname, attr): cmd = ['odmget', '-q', 'name='+lname+' AND attribute='+attr, 'CuAt'] out, err, ret = justcall(cmd) for f in out.split('\n'): if "value" not in f: continue return f.split(" = ")[-1].strip('"') return None def disk_wwid(self, dev): return self.odmget(dev, 'wwid') def disk_id(self, dev, typ): if typ.startswith("vscsi"): return 'vscsi.'+dev else: return self.disk_wwid(dev) def do_check(self): cmd = ['lspath'] out, err, ret = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 1: return self.undef r = [] dev = None wwid = None for line in lines: l = line.split() if len(l) != 3: continue if l[0] != 'Enabled': continue if dev is None: dev = l[1] typ = l[2] wwid = self.disk_id(dev, typ) n = 1 elif dev is not None and wwid is not None and dev != l[1]: r.append({'chk_instance': wwid, 'chk_value': str(n), 'chk_svcname': self.find_svc(dev), }) dev = l[1] typ = l[2] wwid = self.disk_id(dev, typ) n = 1 else: n += 1 if dev is not None and wwid is not None: r.append({'chk_instance': wwid, 'chk_value': str(n), 'chk_svcname': self.find_svc(dev), }) return r 070701000245f8000081b40000000000000000000000014faa9509000015cb000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resVgZfs.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. """Module providing ZFS resources """ from rcGlobalEnv import rcEnv import resDg from rcUtilities import qcall import os import rcExceptions as ex import re class Pool(resDg.Dg): """ basic pool resource """ def __init__(self, rid=None, name=None, type=None, optional=False, disabled=False, tags=set([]), always_on=set([]), monitor=False): self.label = 'pool ' + name resDg.Dg.__init__(self, rid=rid, name=name, type='disk.zpool', always_on=always_on, optional=optional, disabled=disabled, tags=tags, monitor=monitor) def disklist_name(self): return os.path.join(rcEnv.pathvar, 'vg_' + self.svc.svcname + '_' + self.name + '.disklist') def files_to_sync(self): return [self.disklist_name()] def presync(self): """ this one is exported as a service command line arg """ dl = self._disklist() import json with open(self.disklist_name(), 'w') as f: f.write(json.dumps(list(dl))) def has_it(self): """Returns True if the pool is present """ ret = qcall( [ 'zpool', 'list', self.name ] ) if ret == 0 : return True return False def is_up(self): """Returns True if the pool is present and activated """ if not self.has_it(): return False cmd = [ 'zpool', 'list', '-H', '-o', 'health', self.name ] (ret, out, err) = self.call(cmd) if out.strip() == "ONLINE" : return True return False def do_start(self): if self.is_up(): self.log.info("%s is already up" % self.name) return 0 cmd = [ 'zpool', 'import', '-f', '-o', 'cachefile='+os.path.join(rcEnv.pathvar, 'zpool.cache'), self.name ] (ret, out, err) = self.vcall(cmd) return ret def do_stop(self): if not self.is_up(): self.log.info("%s is already down" % self.name) return 0 cmd = [ 'zpool', 'export', self.name ] (ret, out, err) = self.vcall(cmd) return ret def disklist(self): if not os.path.exists(self.disklist_name()): s = self.svc.group_status(excluded_groups=set(["sync", "hb"])) import rcStatus if s['overall'].status == rcStatus.UP: self.log.debug("no disklist cache file and service up ... refresh disklist cache") self.presync() else: self.log.debug("no disklist cache file and service not up ... unable to evaluate disklist") return set([]) with open(self.disklist_name(), 'r') as f: buff = f.read() import json try: dl = set(json.loads(buff)) except: self.log.error("corrupted disklist cache file %s"%self.disklist_name()) raise ex.excError return dl def _disklist(self): """disklist() search zpool vdevs from output of : zpool status poolname if status cmd == 0 else output of : zpool import output if status cmd == 0 disklist(self) update self.disks[] """ # return cache if initialized if len(self.disks) > 0 : return self.disks disks = set([]) cmd = [ 'zpool', 'status', self.name ] (ret, out, err) = self.call(cmd) if ret != 0: raise ex.excError for line in out.split('\n'): if re.match('^\t ', line) is not None: if re.match('^\t mirror', line) is not None: continue if re.match('^\t raid', line) is not None: continue # vdev entry disk=line.split()[0] if re.match("^.*", disk) is not None : disks.add("/dev/rdsk/" + disk ) self.log.debug("found disks %s held by pool %s" % (disks, self.name)) for d in disks: if re.match('^.*s[0-9]*$', d) is None: d += "s2" else: regex = re.compile('s[0-9]*$', re.UNICODE) d = regex.sub('s2', d) self.disks.add(d) return self.disks if __name__ == "__main__": for c in (Pool,) : help(c) # return cache if initialized print """p=Pool("svczfs1")""" p=Pool("svczfs1") print "show p", p print """p.do_action("start")""" p.do_action("start") print """p.do_action("stop")""" p.do_action("stop") 07070100024571000081b40000000000000000000000014faa9509000006da000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/rcPkgDarwin.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcUtilities import call, which from rcGlobalEnv import rcEnv """ format: package-id: com.apple.pkg.X11User version: 10.6.0.1.1.1238328574 volume: / location: / install-time: 1285389505 groups: com.apple.snowleopard-repair-permissions.pkg-group com.apple.FindSystemFiles.pkg-group """ def pkgversion(package): cmd = ['pkgutil', '--pkg-info', package] (ret, out, err) = call(cmd, errlog=False, cache=True) for line in out.split('\n'): l = line.split(': ') if len(l) != 2: continue if l[0] == 'version': return l[1] return '' def listpkg(): if which('pkgutil') is None: return [] cmd = ['pkgutil', '--packages'] (ret, out, err) = call(cmd, errlog=False, cache=True) lines = [] for line in out.split('\n'): if len(line) == 0: continue x = [rcEnv.nodename, line, pkgversion(line), ""] lines.append(x) return lines def listpatch(): return [] 070701000245f7000081b40000000000000000000000014faa950900001098000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/resVgVeritas.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. """Module providing Veritas Volume group resources """ import resDg import re from rcUtilities import qcall class Vg(resDg.Dg): """ basic Veritas Volume group resource """ def __init__(self, rid=None, name=None, type=None, optional=False, disabled=False, tags=set([]), always_on=set([]), monitor=False): self.label = name resDg.Dg.__init__(self, rid=rid, name=name, type='disk.vg', always_on=always_on, optional=optional, disabled=disabled, tags=tags, monitor=monitor) def has_it(self): """Returns True if the vg is present """ ret = qcall( [ 'vxdg', 'list', self.name ] ) if ret == 0 : return True else: return False def is_up(self): """Returns True if the vg is present and not disabled """ if not self.has_it(): return False cmd = [ 'vxprint', '-ng', self.name ] ret = qcall(cmd) if ret == 0 : return True else: return False def do_startvol(self): cmd = [ 'vxvol', '-g', self.name, '-f', 'startall' ] (ret, out, err) = self.vcall(cmd) return ret def do_stopvol(self): cmd = [ 'vxvol', '-g', self.name, '-f', 'stopall' ] (ret, out, err) = self.vcall(cmd) return ret def do_start(self): if self.is_up(): self.log.info("%s is already up" % self.name) ret = self.do_startvol() if self == 0 : return 0 else: return ret for flag in [ '-t', '-tC', '-tCf']: cmd = [ 'vxdg', flag, 'import', self.name ] (ret, out, err) = self.vcall(cmd) if ret == 0 : ret = self.do_startvol() return ret return ret def do_stop(self): if not self.is_up(): self.log.info("%s is already down" % self.name) return 0 ret = self.do_stopvol() cmd = [ 'vxdg', 'deport', self.name ] (ret, out, err) = self.vcall(cmd) return ret def disklist(self): """disklist() search vg disks from output of : vxdisk -g vgname -q path disklist(self) update self.disks[] """ if len(self.disks) > 0 : return self.disks disks = set([]) cmd = [ 'vxdisk', '-g', self.name, '-q', 'list' ] (ret, out, err) = self.call(cmd, errlog=False) if ret != 0 : self.disks = disks return disks for line in out.split('\n'): disk = line.split(" ")[0] if disk != '' : if re.match('^.*s[0-9]$', disk) is None: disk += "s2" disks.add("/dev/rdsk/" + disk ) self.log.debug("found disks %s held by pool %s" % (disks, self.name)) self.disks = disks return disks if __name__ == "__main__": for c in (Pool,) : help(c) print """p=Vg("vzone1vg")""" p=Pool("vzone1vg") print "show p", p print """p.do_action("start")""" p.do_action("start") print """p.do_action("stop")""" p.do_action("stop") 07070100024509000081b40000000000000000000000014faa95090000079c000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/checkFsUsageSunOS.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "fs_u" def find_svc(self, mountpt): for svc in self.svcs: for rs in svc.get_res_sets('fs'): for r in rs.resources: if r.mountPoint == mountpt: return svc.svcname return '' def do_check(self): r = [] for t in ['ufs', 'vxfs']: r += self._do_check(t) return r def _do_check(self, t): cmd = ['df', '-F', t, '-k'] (out,err,ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef r = [] for line in lines[1:]: l = line.split() if len(l) == 5: l = [''] + l elif len(l) != 6: continue r.append({ 'chk_instance': l[5], 'chk_value': l[4], 'chk_svcname': self.find_svc(l[5]), }) return r 07070100024609000081b40000000000000000000000014faa950900000854000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/svcOvm.py# # Copyright (c) 2011 Christophe Varoqui # Copyright (c) 2011 Cyril Galibern # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc import resContainerOvm as ovm from rcGlobalEnv import rcEnv from subprocess import * class SvcOvm(svc.Svc): """ Define Ovm (xen) services""" def __init__(self, svcname, vmname=None, vmuuid=None, guestos=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmuuid = vmuuid self.vmname = vmname self.guestos = guestos self += ovm.Ovm(vmname, vmuuid, disabled=disabled) self.runmethod = rcEnv.rsh.split() + [vmname] def _migrate(self): self.sub_set_action("container.ovm", "_migrate") def vm_hostname(self): if hasattr(self, 'vmhostname'): return self.vmhostname if self.guestos == "windows": self.vmhostname = self.vmname return self.vmhostname cmd = self.runmethod + ['hostname'] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: self.vmhostname = self.vmname else: self.vmhostname = out.strip() return self.vmhostname 070701000245b3000081b40000000000000000000000014faa950900001be0000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/resContainerLxc.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from datetime import datetime from subprocess import * import sys import rcStatus import resources as Res from rcUtilitiesLinux import check_ping from rcUtilities import which import resContainer import rcExceptions as ex class Lxc(resContainer.Container): """ container status transition diagram : --------- | STOPPED |<--------------- --------- | | | start | | | V | ---------- | | STARTING |--error- | ---------- | | | | | V V | --------- ---------- | | RUNNING | | ABORTING | | --------- ---------- | | | | no process | | | | | V | | ---------- | | | STOPPING |<------- | ---------- | | | --------------------- """ def files_to_sync(self): return [self.cf] def lxc(self, action): outf = '/var/tmp/svc_'+self.name+'_lxc_'+action+'.log' if action == 'start': cmd = ['lxc-start', '-d', '-n', self.name, '-o', outf] elif action == 'stop': cmd = ['lxc-stop', '-n', self.name, '-o', outf] else: self.log.error("unsupported lxc action: %s" % action) return 1 t = datetime.now() (ret, out, err) = self.vcall(cmd) len = datetime.now() - t self.log.info('%s done in %s - ret %i - logs in %s' % (action, len, ret, outf)) if ret != 0: raise ex.excError def get_cf_value(self, param): value = None if not os.path.exists(self.cf): return None with open(self.cf, 'r') as f: for line in f.readlines(): if param not in line: continue if line.strip()[0] == '#': continue l = line.replace('\n', '').split('=') if len(l) < 2: continue if l[0].strip() != param: continue value = ' '.join(l[1:]).strip() break return value def get_rootfs(self): rootfs = self.get_cf_value("lxc.rootfs") if rootfs is None: self.log.error("could not determine lxc container rootfs") raise ex.excError return rootfs def install_drp_flag(self): rootfs = self.get_rootfs() flag = os.path.join(rootfs, ".drp_flag") self.log.info("install drp flag in container : %s"%flag) with open(flag, 'w') as f: f.write(' ') f.close() def container_start(self): self.lxc('start') def container_stop(self): self.lxc('stop') def container_forcestop(self): """ no harder way to stop a lxc container, raise to signal our helplessness """ raise ex.excError def ping(self): return check_ping(self.addr, timeout=1) def is_up(self): self.log.debug("call: lxc-ps --name %s | grep %s" % (self.name, self.name)) p1 = Popen(['lxc-ps', '--name', self.name], stdout=PIPE) p2 = Popen(["grep", self.name], stdin=p1.stdout, stdout=PIPE) p2.communicate()[0] if p2.returncode == 0: return True return False def get_container_info(self): cpu_set = self.get_cf_value("lxc.cgroup.cpuset.cpus") if cpu_set is None: vcpus = 0 else: vcpus = len(cpu_set.split(',')) return {'vcpus': str(vcpus), 'vmem': '0'} def check_manual_boot(self): return True def check_capabilities(self): if not which('lxc-info'): self.log.debug("lxc-info is not in PATH") return False return True def find_cf(self): d_lxc = os.path.join('var', 'lib', 'lxc') # seen on debian squeeze : prefix is /usr, but containers' # config files paths are /var/lib/lxc/$name/config # try prefix first, fallback to other know prefixes prefixes = [os.path.join(os.sep), os.path.join(os.sep, 'usr'), os.path.join(os.sep, 'usr', 'local')] for prefix in [self.prefix] + [p for p in prefixes if p != self.prefix]: cf = os.path.join(prefix, d_lxc, self.name, 'config') if os.path.exists(cf): cf_d = os.path.dirname(cf) if not os.path.exists(cf_d): os.makedirs(cf_d) return cf # on Oracle Linux, config is in /etc/lxc cf = os.path.join(os.sep, 'etc', 'lxc', self.name, 'config') if os.path.exists(cf): return cf return None def find_prefix(self): prefixes = [os.path.join(os.sep), os.path.join(os.sep, 'usr'), os.path.join(os.sep, 'usr', 'local')] for prefix in prefixes: if os.path.exists(os.path.join(prefix, 'bin', 'lxc-start')): return prefix return None def __init__(self, name, optional=False, disabled=False, monitor=False, tags=set([])): resContainer.Container.__init__(self, rid="lxc", name=name, type="container.lxc", optional=optional, disabled=disabled, monitor=monitor, tags=tags) self.prefix = self.find_prefix() if self.prefix is None: print >>sys.stderr, "lxc install prefix not found" raise ex.excInitError self.cf = self.find_cf() if self.cf is None: print >>sys.stderr, "lxc container config file not found" raise ex.excInitError def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def provision(self): m = __import__("provLxc") prov = m.ProvisioningLxc(self) prov.provisioner() 0707010002452d000081b40000000000000000000000014faa9509000011db000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/provKvm.pyfrom provisioning import Provisioning from rcGlobalEnv import rcEnv from rcUtilities import which import os import rcExceptions as ex class ProvisioningKvm(Provisioning): def __init__(self, r): Provisioning.__init__(self, r) self.section = r.svc.config.defaults() if 'snapof' in self.section: self.snapof = self.section['snapof'] else: self.snapof = None if 'snap' in self.section: self.snap = self.section['snap'] else: self.snap = None if 'virtinst' in self.section: self.virtinst = self.section['virtinst'] else: self.virtinst = None def check_kvm(self): if os.path.exists(self.r.cf): return True return False def setup_kvm(self): if self.virtinst is None: self.r.log.error("the 'virtinst' parameter must be set") raise ex.excError ret, out, err = self.r.vcall(self.virtinst.split()) if ret != 0: raise ex.excError def setup_ips(self): self.purge_known_hosts() for rs in self.r.svc.get_res_sets("ip"): for r in rs.resources: self.purge_known_hosts(r.addr) def purge_known_hosts(self, ip=None): if ip is None: cmd = ['ssh-keygen', '-R', self.r.svc.svcname] else: cmd = ['ssh-keygen', '-R', ip] ret, out, err = self.r.vcall(cmd, err_to_info=True) def setup_snap(self): if self.snap is None: self.r.log.error("the 'snap' parameter must be set") raise ex.excError if self.snapof is None: self.r.log.error("the 'snapof' parameter must be set") raise ex.excError if not which('btrfs'): self.r.log.error("'btrfs' command not found") raise ex.excError cmd = ['btrfs', 'subvolume', 'snapshot', self.snapof, self.snap] ret, out, err = self.r.vcall(cmd) if ret != 0: raise ex.excError def get_pubkey(self): p = os.path.join(os.sep, 'root', '.ssh', 'id_dsa.pub') try: with open(p) as f: pub = f.read(8000) except: self.r.log.error('failed to read root public key') raise ex.excError return pub def get_gw(self): cmd = ['route', '-n'] ret, out, err = self.r.call(cmd) if ret != 0: self.r.log.error('failed to read routing table') raise ex.excError for line in out.split('\n'): if line.startswith('0.0.0.0'): l = line.split() if len(l) > 1: return l[1] self.r.log.error('failed to find default gateway') raise ex.excError def get_ns(self): p = os.path.join(os.sep, 'etc', 'resolv.conf') with open(p) as f: for line in f.readlines(): if 'nameserver' in line: l = line.split() if len(l) > 1: return l[1] self.r.log.error('failed to find a nameserver') raise ex.excError def get_config(self): cf = ['todo'] s = ';'.join(('vm', self.r.svc.vmname)) cf.append(s) s = 'ns;192.168.122.1' cf.append(s) s = ';'.join(('gw', self.get_gw())) cf.append(s) try: s = ';'.join(('hv_root_pubkey', self.get_pubkey())) cf.append(s) except ex.excError: pass for rs in self.r.svc.get_res_sets("ip"): for r in rs.resources: s = ';'.join((r.rid, r.ipDev, r.addr, r.mask)) cf.append(s) cf.append('') return '\n'.join(cf) def setup_cfdisk(self): config = self.get_config() block = len(config)//512 + 1 cfdisk = os.path.join(rcEnv.pathtmp, self.r.svc.svcname+'.cfdisk') try: with open(cfdisk, 'w') as f: f.write(config) f.seek(block*512) f.write('\0') except: self.r.log.error("failed to create config disk") raise ex.excError self.virtinst += " --disk path=%s,device=floppy"%cfdisk self.r.log.info("created config disk with content;\n%s", config) def provisioner(self): self.setup_snap() self.setup_cfdisk() self.setup_kvm() self.setup_ips() self.r.log.info("provisioned") return True 07070100024608000081b40000000000000000000000014faa9509000008c3000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/svcLxc.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc import resContainerLxc as lxc import rcStatus from rcGlobalEnv import rcEnv from rcUtilities import which import os class SvcLxc(svc.Svc): """ Define Lxc services""" def __init__(self, svcname, vmname=None, guestos=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmname = vmname self.guestos = guestos self += lxc.Lxc(vmname, disabled=disabled) if which('lxc-attach') and os.path.exists('/proc/1/ns/pid'): self.runmethod = ['lxc-attach', '-n', vmname, '--'] else: self.runmethod = rcEnv.rsh.split() + [vmname] if __name__ == "__main__": for c in (SvcLxc,) : help(c) import mountLinux as mount import ipLinux as ip print """ Z=SvcLxc() Z+=mount.Mount("/mnt1","/dev/sda") Z+=mount.Mount("/mnt2","/dev/sdb") Z+=ip.Ip("eth0","192.168.0.173") Z+=ip.Ip("eth0","192.168.0.174") """ Z=SvcLxc() Z+=mount.Mount("/mnt1","/dev/sda") Z+=mount.Mount("/mnt2","/dev/sdb") Z+=ip.Ip("eth0","192.168.0.173") Z+=ip.Ip("eth0","192.168.0.174") print "Show Z: ", Z print "start Z:" Z.start() print "stop Z:" Z.stop() 070701000245b4000081b40000000000000000000000014faa9509000011e5000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/resContainerOvm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import resources as Res import os import rcExceptions as ex import resContainer rcU = __import__("rcUtilities" + os.uname()[0]) class Ovm(resContainer.Container): startup_timeout = 180 shutdown_timeout = 120 def __init__(self, name, uuid, optional=False, disabled=False, monitor=False, tags=set([])): resContainer.Container.__init__(self, rid="ovm", name=name, type="container.ovm", optional=optional, disabled=disabled, monitor=monitor, tags=tags) self.uuid = uuid self.xen_d = os.path.join(os.sep, 'etc', 'xen') self.xen_auto_d = os.path.join(self.xen_d, 'auto') def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def list_conffiles(self): cf = os.path.join(self.xen_d, self.uuid) if os.path.exists(cf): return [cf] return [] def files_to_sync(self): return self.list_conffiles() def check_capabilities(self): cmd = ['xm', 'info'] (ret, out, err) = self.call(cmd, errlog=False) if ret != 0: self.status_log("can not fetch xm info") return False return True def ping(self): return rcU.check_ping(self.addr, timeout=1, count=1) def find_vmcf(self): import glob l = glob.glob('/OVS/Repositories/*/VirtualMachines/'+self.uuid+'/vm.cfg')+glob.glob(os.path.join(self.xen_d, self.uuid)) if len(l) > 1: self.log.warning("%d configuration files found in repositories (%s)"%(len(l), str(l))) elif len(l) == 0: raise ex.excError("no configuration file found in repositories") return l[0] def _migrate(self): cmd = ['xm', 'migrate', '-l', self.uuid, self.svc.destination_node] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_start(self): cf = self.find_vmcf() cmd = ['xm', 'create', cf] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_stop(self): cmd = ['xm', 'shutdown', self.uuid] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_forcestop(self): cmd = ['xm', 'destroy', self.uuid] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def is_up(self): cmd = ['xm', 'list', '--state=running'] (ret, out, err) = self.call(cmd, errlog=False) if ret != 0: return False for line in out.split('\n'): l = line.split() if len(l) < 4: continue if self.uuid == l[0]: return True return False def get_container_info(self): cmd = ['xm', 'list', self.uuid] (ret, out, err) = self.call(cmd, errlog=False, cache=True) self.info = {'vcpus': '0', 'vmem': '0'} if ret != 0: return self.info for line in out.split('\n'): l = line.split() if len(l) < 4: continue if self.uuid != l[0]: continue self.info['vcpus'] = l[3] self.info['vmem'] = l[2] return self.info self.log.error("malformed 'xm list %s' output: %s"%(self.uuid, line)) self.info = {'vcpus': '0', 'vmem': '0'} return self.info def check_manual_boot(self): f = os.path.join(self.xen_auto_d, self.uuid) if os.path.exists(f): return False return True 070701000245a8000081b40000000000000000000000014faa950900000b3d000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/rcVioServer.pyfrom rcUtilities import justcall, which import rcExceptions as ex import os import ConfigParser pathlib = os.path.dirname(__file__) pathbin = os.path.realpath(os.path.join(pathlib, '..', 'bin')) pathetc = os.path.realpath(os.path.join(pathlib, '..', 'etc')) pathtmp = os.path.realpath(os.path.join(pathlib, '..', 'tmp')) if pathbin not in os.environ['PATH']: os.environ['PATH'] += ":"+pathbin def rcmd(cmd, manager, username, key): _cmd = ['ssh', '-i', key, '@'.join((username, manager))] _cmd += [cmd] out, err, ret = justcall(_cmd) if ret != 0: print ' '.join(_cmd) print out raise ex.excError("ssh command execution error") return out, err class VioServers(object): def __init__(self): self.arrays = [] self.index = 0 cf = os.path.join(pathetc, "auth.conf") if not os.path.exists(cf): return conf = ConfigParser.RawConfigParser() conf.read(cf) m = {} for s in conf.sections(): if not conf.has_option(s, "type") or \ conf.get(s, "type") != "vioserver": continue try: username = conf.get(s, 'username') key = conf.get(s, 'key') m[s] = [username, key] except: print "error parsing section", s pass del(conf) for name, creds in m.items(): username, key = creds self.arrays.append(VioServer(name, username, key)) def __iter__(self): return self def next(self): if self.index == len(self.arrays): raise StopIteration self.index += 1 return self.arrays[self.index-1] class VioServer(object): def __init__(self, name, username, key): self.name = name self.username = username self.key = key self.keys = ['lsmap', 'bootinfo', 'lsfware', 'lsdevattr'] def rcmd(self, cmd): return rcmd(cmd, self.name, self.username, self.key) def get_lsmap(self): cmd = 'ioscli lsmap -all -fmt :' print "%s: %s"%(self.name, cmd) return self.rcmd(cmd)[0] def get_bootinfo(self): cmd = 'for i in $(ioscli lsmap -all -field backing|sed "s/Backing device//"); do echo $i $(bootinfo -s $i) ; done' print "%s: %s"%(self.name, cmd) return self.rcmd(cmd)[0] def get_lsfware(self): cmd = 'ioscli lsfware' print "%s: %s"%(self.name, cmd) return self.rcmd(cmd)[0] def get_lsdevattr(self): cmd = 'for i in $(ioscli lsdev -type disk -field name -fmt .) ; do echo $i $(ioscli lsdev -dev $i -attr|grep ww_name);done' print "%s: %s"%(self.name, cmd) return self.rcmd(cmd)[0] if __name__ == "__main__": o = VioServers() for vioserver in o: print vioserver.lsmap() 070701000245fc000081b40000000000000000000000014faa950900000f3b000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/snapLvmLinux.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcGlobalEnv import rcEnv from rcUtilities import protected_mount, justcall from rcUtilitiesLinux import lv_info, lv_exists import rcExceptions as ex import snap class Snap(snap.Snap): def mntopt_and_ro(self, m): if m.mntOpt is None: return 'ro' opt_set = set(m.mntOpt.split(',')) opt_set -= set(['rw', 'ro']) opt_set |= set(['ro']) return ','.join(opt_set) def snapcreate(self, m): snap_name = '' snap_mnt = '' (vg_name, lv_name, lv_size) = lv_info(self, m.device) if lv_name is None: self.log.error("can not snap %s: not a logical volume"%m.device) raise ex.syncNotSnapable snap_name = 'osvc_sync_'+lv_name if lv_exists(self, os.path.join(os.sep, 'dev', vg_name, snap_name)): self.log.error("snap of %s already exists"%(lv_name)) raise ex.syncSnapExists if m.snap_size is not None: snap_size = m.snap_size else: snap_size = int(lv_size//10) (ret, buff, err) = self.vcall(['lvcreate', '-s', '-L'+str(snap_size)+'M', '-n', snap_name, os.path.join(vg_name, lv_name)]) if ret != 0: raise ex.syncSnapCreateError snap_mnt = os.path.join(rcEnv.pathtmp, 'osvc_sync_'+vg_name+'_'+lv_name) if not os.path.exists(snap_mnt): os.makedirs(snap_mnt, 0755) snap_dev = os.path.join(os.sep, 'dev', vg_name, snap_name) self.vcall(['fsck', '-a', snap_dev], err_to_warn=True) (ret, buff, err) = self.vcall(['mount', '-o', self.mntopt_and_ro(m), snap_dev, snap_mnt]) if ret != 0: raise ex.syncSnapMountError self.snaps[m.mountPoint] = dict(lv_name=lv_name, vg_name=vg_name, snap_name=snap_name, snap_mnt=snap_mnt, snap_dev=snap_dev) def snapdestroykey(self, s): if protected_mount(self.snaps[s]['snap_mnt']): self.log.error("the snapshot is no longer mounted in %s. panic."%self.snaps[s]['snap_mnt']) raise ex.excError cmd = ['fuser', '-kmv', self.snaps[s]['snap_mnt']] (ret, out, err) = self.vcall(cmd, err_to_info=True) cmd = ['umount', self.snaps[s]['snap_mnt']] (ret, out, err) = self.vcall(cmd) cmd = ['lvremove', '-f', self.snaps[s]['snap_dev']] self.log.info(' '.join(cmd)) for i in range(1, 30): out, err, ret = justcall(cmd) if ret == 0: break if len(out) > 0: self.log.info(out) if len(err) > 0: self.log.error(err) if ret != 0: self.log.error("failed to remove snapshot %s (attempts: %d)"%(self.snaps[s]['snap_dev'], i)) elif i > 1: self.log.info("successfully removed snapshot %s (attempts: %d)"%(self.snaps[s]['snap_dev'], i)) del(self.snaps[s]) 070701000245ec000081b40000000000000000000000014faa950900000fb7000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resVgAIX.py# # Copyright (c) 2010 Christophe Varoqui # Copyright (c) 2010 Cyril Galibern # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcExceptions as ex import resDg from subprocess import * class Vg(resDg.Dg): def __init__(self, rid=None, name=None, type=None, always_on=set([]), dsf=True, monitor=False, disabled=False, tags=set([]), optional=False): self.label = name self.dsf = dsf resDg.Dg.__init__(self, rid=rid, name=name, type='disk.vg', always_on=always_on, optional=optional, disabled=disabled, tags=tags, monitor=monitor) def has_it(self): """ returns True if the volume is present """ if self.is_active(): return True if self.is_imported(): return True return False def is_active(self): cmd = [ 'lsvg', self.name ] process = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) buff = process.communicate() if not "active" in buff[0]: return False return True def is_imported(self): cmd = ['lsvg'] process = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) buff = process.communicate() for vg in buff[0].split('\n'): if vg == self.name: return True return False def is_up(self): """Returns True if the volume group is present and activated """ if not self.is_imported(): return False if not self.is_active(): return False return True def do_import(self): if self.is_imported(): self.log.info("%s is already imported" % self.name) return cmd = ['importvg', self.name] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def do_export(self): if not self.is_imported(): self.log.info("%s is already exported" % self.name) return cmd = ['exportvg', self.name] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def do_activate(self): if self.is_active(): self.log.info("%s is already available" % self.name) return cmd = ['varyonvg', self.name] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def do_deactivate(self): if not self.is_active(): self.log.info("%s is already unavailable" % self.name) return cmd = ['varyoffvg', self.name] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def do_start(self): self.do_import() self.do_activate() def do_stop(self): self.do_deactivate() def start(self): self.do_start() def disklist(self): cmd = ['lsvg', '-p', self.name] (ret, out, err) = self.call(cmd) if ret != 0: raise ex.excError for e in out.split('\n'): x = e.split() if len(x) != 5: continue self.disks |= set([x[0]]) return self.disks 07070100024606000081b40000000000000000000000014faa9509000007ed000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/svcKvm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc import resContainerKvm as kvm import rcStatus import rcExceptions as ex from rcGlobalEnv import rcEnv from subprocess import * class SvcKvm(svc.Svc): """ Define kvm services""" def __init__(self, svcname, vmname=None, guestos=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmname = vmname self.guestos = guestos self += kvm.Kvm(vmname, disabled=disabled) self.runmethod = rcEnv.rsh.split() + [vmname] def vm_hostname(self): if hasattr(self, 'vmhostname'): return self.vmhostname if self.guestos == "windows": self.vmhostname = self.vmname return self.vmhostname cmd = self.runmethod + ['hostname'] p = Popen(cmd, stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: self.vmhostname = self.vmname else: self.vmhostname = out.strip() return self.vmhostname 070701000245d1000081b40000000000000000000000014faa9509000009f2000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/resLoopLinux.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import re from rcGlobalEnv import * from rcUtilities import call, which import rcStatus import resLoop as Res import rcExceptions as ex from rcLoopLinux import file_to_loop class Loop(Res.Loop): def is_up(self): """Returns True if the loop group is present and activated """ self.loop = file_to_loop(self.loopFile) if len(self.loop) == 0: return False return True def start(self): if self.is_up(): self.log.info("%s is already up" % self.loopFile) return cmd = [ 'losetup', '-f', self.loopFile ] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError self.loop = file_to_loop(self.loopFile) self.log.info("%s now loops to %s" % (', '.join(self.loop), self.loopFile)) def stop(self): if not self.is_up(): self.log.info("%s is already down" % self.loopFile) return 0 for loop in self.loop: cmd = [ 'losetup', '-d', loop ] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def _status(self, verbose=False): if self.is_up(): return rcStatus.UP else: return rcStatus.DOWN def __init__(self, rid, loopFile, always_on=set([]), disabled=False, tags=set([]), optional=False, monitor=False): Res.Loop.__init__(self, rid, loopFile, always_on=always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) def provision(self): m = __import__("provLoopLinux") prov = m.ProvisioningLoop(self) prov.provisioner() 07070100024568000081b40000000000000000000000014faa950900000637000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/rcNecIsm.pyfrom rcUtilities import which, justcall import rcExceptions as ex import os class NecIsms(object): arrays = [] def __init__(self): self.index = 0 if which('iSMview') is None: print 'Can not find iSMview programs in PATH' raise ex.excError out, err, ret = justcall(['iSMview', '-d']) if ret != 0: print err raise ex.excError """ --- Disk Array List --- Product ID Disk Array Name Resource State Monitoring D1-10 D1_10 ready running """ lines = out.split('\n') for line in lines: if len(line) == 0: continue if '---' in line: continue if 'Product ID' in line: continue l = line.split() if len(l) != 4: continue self.arrays.append(NecIsm(l[1])) def __iter__(self): return self def next(self): if self.index == len(self.arrays): raise StopIteration self.index += 1 return self.arrays[self.index-1] class NecIsm(object): def __init__(self, name): self.keys = ['all'] self.name = name def _cmd(self, cmd): cmd = ['iSMview'] + cmd + [self.name] return justcall(cmd) def get_all(self): cmd = ['-all'] out, err, ret = self._cmd(cmd) return out if __name__ == "__main__": o = NecIsms() for necism in o: print necism.all() 070701000245dd000081b40000000000000000000000014faa9509000001ea000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/resStonithCallout.pyimport resStonith import rcStatus from rcGlobalEnv import rcEnv class Stonith(resStonith.Stonith): def __init__(self, rid=None, cmd="/bin/false", always_on=set([]), optional=False, disabled=False, tags=set([])): resStonith.Stonith.__init__(self, rid, "stonith.callout", optional=optional, disabled=disabled, tags=tags) self.cmd = cmd def _start(self): cmd = self.cmd.split(' ') self.vcall(cmd) 070701000245a5000081b40000000000000000000000014faa950900000ac4000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/rcUtilitiesLinux.pyimport os import re from rcUtilities import call, qcall def major(driver): path = os.path.join(os.path.sep, 'proc', 'devices') try: f = open(path) except: raise for line in f.readlines(): words = line.split() if len(words) == 2 and words[1] == driver: f.close() return int(words[0]) f.close() raise def get_blockdev_sd_slaves(syspath): slaves = set() if not os.path.exists(syspath): return slaves for s in os.listdir(syspath): if re.match('^sd[a-z]*', s) is not None: slaves.add('/dev/' + s) continue deeper = os.path.join(syspath, s, 'slaves') if os.path.isdir(deeper): slaves |= get_blockdev_sd_slaves(deeper) return slaves def check_ping(addr, timeout=5, count=1): if ':' in addr: ping = 'ping6' else: ping = 'ping' cmd = [ping, '-c', repr(count), '-W', repr(timeout), '-w', repr(timeout), addr] (ret, out, err) = call(cmd) if ret == 0: return True return False def lv_exists(self, device): if qcall(['lvs', device]) == 0: return True return False def lv_info(self, device): (ret, buff, err) = self.call(['lvs', '-o', 'vg_name,lv_name,lv_size', '--noheadings', '--units', 'm', device]) if ret != 0: return (None, None, None) info = buff.split() if 'M' in info[2]: lv_size = float(info[2].split('M')[0]) elif 'm' in info[2]: lv_size = float(info[2].split('m')[0]) else: self.log.error("%s output does not have the expected unit (m or M)"%' '.join(cmd)) ex.excError return (info[0], info[1], lv_size) def devs_to_disks(self, devs=set([])): """ If PV is a device map, replace by its sysfs name (dm-*) If device map has slaves, replace by its slaves """ disks = set() dm_major = major('device-mapper') try: lo_major = major('loop') except: lo_major = 0 for dev in devs: try: statinfo = os.stat(dev) except: self.log.error("can not stat %s" % dev) raise if os.major(statinfo.st_rdev) == dm_major: dm = 'dm-' + str(os.minor(statinfo.st_rdev)) syspath = '/sys/block/' + dm + '/slaves' disks |= get_blockdev_sd_slaves(syspath) elif lo_major != 0 and os.major(statinfo.st_rdev) == lo_major: self.log.debug("skip loop device %s from disklist"%dev) pass else: disks.add(dev) _disks = list(disks) for i, disk in enumerate(_disks): _disks[i] = re.sub("^(/dev/[vhs]d[a-z]*)[0-9]*$", r"\1", disk) return disks 0707010002450a000081b40000000000000000000000014faa9509000006d2000000ae00010002ffffffffffffffff0000002c00000000root/opt/opensvc/lib/checkFsUsageWindows.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilitiesWindows import get_drives class check(checks.check): chk_type = "fs_u" def find_svc(self, mountpt): for svc in self.svcs: for rs in svc.get_res_sets('fs'): for r in rs.resources: if r.mountPoint == mountpt: return svc.svcname return '' def do_check(self): import win32api cmd = ['df', '-lP'] r = [] for drive in get_drives(): try: n_free_user, n_total, n_free = win32api.GetDiskFreeSpaceEx(drive+':\\') except: continue pct = 100 * (n_total - n_free) // n_total r.append({ 'chk_instance': drive, 'chk_value': str(pct), 'chk_svcname': self.find_svc(drive), }) return r if __name__ == "__main__": o = check() print o.do_check() 0707010002460b000081b40000000000000000000000014faa9509000007ab000000ae00010002ffffffffffffffff0000001e00000000root/opt/opensvc/lib/svcVz.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc import resContainerVz as vz class SvcVz(svc.Svc): def __init__(self, svcname, vmname=None, guestos=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmname = vmname self.guestos = guestos self += vz.Vz(vmname, disabled=disabled) self.runmethod = ['vzctl', 'exec', vmname] if __name__ == "__main__": for c in (SvcVz,) : help(c) import mountLinux as mount import ipLinux as ip print """ Z=SvcVz() Z+=mount.Mount("/mnt1","/dev/sda") Z+=mount.Mount("/mnt2","/dev/sdb") Z+=ip.Ip("eth0","192.168.0.173") Z+=ip.Ip("eth0","192.168.0.174") """ Z=SvcVz() Z+=mount.Mount("/mnt1","/dev/sda") Z+=mount.Mount("/mnt2","/dev/sdb") Z+=ip.Ip("eth0","192.168.0.173") Z+=ip.Ip("eth0","192.168.0.174") print "Show Z: ", Z print "start Z:" Z.start() print "stop Z:" Z.stop() 070701000245df000081b40000000000000000000000014faa950900001531000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/resSync.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import logging import rcExceptions as ex import resources as Res import datetime import time from rcGlobalEnv import rcEnv class Sync(Res.Resource): def __init__(self, rid=None, sync_max_delay=None, sync_interval=None, sync_period=None, sync_days=None, optional=False, disabled=False, tags=set([]), type=type): if sync_max_delay is None: self.sync_max_delay = 1500 else: self.sync_max_delay = sync_max_delay if sync_interval is None: self.sync_interval = 121 else: self.sync_interval = sync_interval if sync_period is None: self.sync_period = ["03:59", "05:59"] else: self.sync_period = sync_period if sync_days is None: self.sync_days = ["monday", "tuesday", "wednesday", "thursday", "friday", "saturday", "sunday"] else: self.sync_days = sync_days Res.Resource.__init__(self, rid=rid, type=type, optional=optional, disabled=disabled, tags=tags) def check_timestamp(self, ts, comp='more', delay=10): """ Return False if timestamp is fresher than now-interval Return True otherwize. Zero is a infinite interval """ if delay == 0: raise limit = ts + datetime.timedelta(minutes=delay) if comp == "more" and datetime.datetime.now() < limit: return False elif comp == "less" and datetime.datetime.now() < limit: return False else: return True return True def in_period(self, period=None): if period is None: period = self.sync_period if len(period) == 0: return True if isinstance(period[0], list): r = False for p in period: r |= self.in_period(p) return r elif (not isinstance(period[0], unicode) and \ not isinstance(period[0], str)) or \ len(period) != 2 or \ (not isinstance(period[1], unicode) and \ not isinstance(period[1], str)): self.log.error("malformed period: %s"%str(period)) return False start_s, end_s = period try: start_t = time.strptime(start_s, "%H:%M") end_t = time.strptime(end_s, "%H:%M") except ValueError: self.log.error("malformed period: %s"%str(period)) return False start = start_t.tm_hour * 60 + start_t.tm_min end = end_t.tm_hour * 60 + end_t.tm_min try: start_t = time.strptime(start_s, "%H:%M") end_t = time.strptime(end_s, "%H:%M") start = start_t.tm_hour * 60 + start_t.tm_min end = end_t.tm_hour * 60 + end_t.tm_min except: self.log.error("malformed time string: %s"%str(period)) return False now = datetime.datetime.now() now_m = now.hour * 60 + now.minute if start <= end: if now_m >= start and now_m <= end: return True elif start > end: """ XXXXXXXXXXXXXXXXX 23h 0h 1h """ if (now_m >= start and now_m <= 1440) or \ (now_m >= 0 and now_m <= end): return True return False def in_days(self): now = datetime.datetime.now() today = now.strftime('%A').lower() if today in map(lambda x: x.lower(), self.sync_days): return True return False def skip_sync(self, ts): if self.svc.force: return False if self.sync_interval == 0: self.log.info('skip sync: disabled by sync_interval = 0') return True if not self.in_days(): self.log.info('skip sync: not in allowed days (%s)'%str(self.sync_days)) return True if not self.in_period(): self.log.info('skip sync: not in allowed period (%s)'%str(self.sync_period)) return True if ts is None: self.log.info("don't skip sync: no timestamp") elif not self.check_timestamp(ts, comp="less", delay=self.sync_interval): self.log.info('skip sync: too soon (%d)'%self.sync_interval) return True return False def alert_sync(self, ts): if ts is None: return True if not self.check_timestamp(ts, comp="less", delay=self.sync_max_delay): return False return True 070701000245cd000081b40000000000000000000000014faa95090000064c000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resIpXen.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. from rcGlobalEnv import rcEnv resIpHv = __import__("resIp"+rcEnv.sysname) import resIpVm class Ip(resIpVm.Ip, resIpHv.Ip): def __init__(self, rid=None, ipDev=None, ipName=None, mask=None, always_on=set([]), monitor=False, disabled=False, tags=set([]), optional=False): resIpVm.Ip.__init__(self, rid=rid, ipDev=ipDev, ipName=ipName, mask=mask, always_on=always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) def check_ping(self): return resIpHv.Ip.check_ping(self) if __name__ == "__main__": for c in (Ip,) : help(c) 0707010002455b000081b40000000000000000000000014faa950900000b27000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/rcIfconfigSunOS.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * import rcIfconfig class ifconfig(rcIfconfig.ifconfig): def __init__(self): self.intf = [] out = Popen(['ifconfig', '-a'], stdin=None, stdout=PIPE,stderr=PIPE,close_fds=True).communicate()[0] self.parse(out) def parse(self, out): for l in out.split("\n"): if l == '' : break if l[0]!='\t' : (ifname,ifstatus)=l.split(': ') i=rcIfconfig.interface(ifname) self.intf.append(i) # defaults i.link_encap = '' i.scope = '' i.bcast = '' i.mask = '' i.mtu = '' i.ipaddr = '' i.ip6addr = [] i.ip6mask = [] i.hwaddr = '' i.flag_up = False i.flag_broadcast = False i.flag_running = False i.flag_multicast = False i.flag_ipv4 = False i.flag_ipv6 = False i.flag_loopback = False if 'UP' in ifstatus : i.flag_up = True elif 'BROADCAST' in ifstatus : i.flag_broadcast = True elif 'RUNNING' in ifstatus : i.flag_running = True elif 'MULTICAST' in ifstatus : i.flag_multicast = True elif 'IPv4' in ifstatus : i.flag_ipv4 = True elif 'IPv6' in ifstatus : i.flag_ipv6 = True else: n=0 w=l.split() while n < len(w) : [p,v]=w[n:n+2] if p == 'inet' : i.ipaddr=v elif p == 'netmask' : i.mask=v elif p == 'broadcast' : i.bcast=v elif p == 'inet6' : (a, m) = v.split('/') i.ip6addr += [a] i.ip6mask += [m] n+=2 if __name__ == "__main__": for c in (ifconfig,) : help(c) 0707010002452f000081b40000000000000000000000014faa950900002096000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/provLxc.pyfrom provisioning import Provisioning from rcGlobalEnv import rcEnv import os import rcExceptions as ex class ProvisioningLxc(Provisioning): config_template = """\ lxc.utsname = %(vm_name)s lxc.tty = 4 lxc.pts = 1024 lxc.console = /opt/opensvc/log/%(vm_name)s.console.log lxc.rootfs = %(rootfs)s lxc.cgroup.devices.deny = a # /dev/null and zero lxc.cgroup.devices.allow = c 1:3 rwm lxc.cgroup.devices.allow = c 1:5 rwm # consoles lxc.cgroup.devices.allow = c 5:1 rwm lxc.cgroup.devices.allow = c 5:0 rwm lxc.cgroup.devices.allow = c 4:0 rwm lxc.cgroup.devices.allow = c 4:1 rwm # /dev/{,u}random lxc.cgroup.devices.allow = c 1:9 rwm lxc.cgroup.devices.allow = c 1:8 rwm lxc.cgroup.devices.allow = c 136:* rwm lxc.cgroup.devices.allow = c 5:2 rwm # rtc lxc.cgroup.devices.allow = c 254:0 rwm lxc.network.type = veth lxc.network.flags = up lxc.network.link = br0 lxc.network.name = eth0 lxc.network.mtu = 1500 # mounts point lxc.mount.entry=proc %(rootfs)s/proc proc nodev,noexec,nosuid 0 0 lxc.mount.entry=devpts %(rootfs)s/dev/pts devpts defaults 0 0 lxc.mount.entry=sysfs %(rootfs)s/sys sysfs defaults 0 0 """ def __init__(self, r): Provisioning.__init__(self, r) self.section = r.svc.config.defaults() # hostname file in the container rootfs self.p_hostname = os.path.join(self.section['rootfs'], 'etc', 'hostname') # container name and hostname if "vm_name" in self.section: self.vm_name = self.section["vm_name"] else: self.vm_name = self.r.svc.svcname # lxc root conf dir self.d_lxc = os.path.join(os.sep, 'var', 'lib', 'lxc') if not os.path.exists(self.d_lxc): self.d_lxc = os.path.join(os.sep, 'usr', 'local', 'var', 'lib', 'lxc') if not os.path.exists(self.d_lxc): self.d_lxc = None # container config file if self.d_lxc is not None: self.config = os.path.join(self.d_lxc, self.vm_name, 'config') # network config candidates self.interfaces = os.path.join(self.section['rootfs'], 'etc', 'network', 'interfaces') self.network = os.path.join(self.section['rootfs'], 'etc', 'sysconfig', 'network-scripts') def validate(self): if self.d_lxc is None: self.r.log.error("this node is not lxc capable") return True if not self.check_vm_name(): return False if not self.check_lxc(): self.r.log.error("container is not created") return False return True def check_lxc(self): if os.path.exists(self.r.cf): return True return False def setup_lxc_config(self): import tempfile f = tempfile.NamedTemporaryFile(delete=False) f.write(self.config_template%dict(vm_name=self.vm_name, rootfs=self.section['rootfs'])) self.config = f.name f.close() def setup_lxc(self): if self.check_lxc(): self.r.log.info("container is already created") return name = self.setup_lxc_config() with open("/opt/opensvc/log/%s.console.log"%self.vm_name, "a+") as f: f.write("") cmd = ['lxc-create', '-n', self.vm_name, '-f', self.config] (ret, out, err) = self.r.vcall(cmd) if ret != 0: raise ex.excError def check_vm_name(self): if not os.path.exists(self.p_hostname): return False try: with open(self.p_hostname) as f: h = f.read().strip() except: self.r.log.error("can not get container hostname") raise ex.excError if h != self.vm_name: self.r.log.info("container hostname is not %s"%self.vm_name) return False return True def set_vm_name(self): if self.check_vm_name(): self.r.log.info("container hostname already set") return with open(self.p_hostname, 'w') as f: f.write(self.vm_name+'\n') self.r.log.info("container hostname set to %s"%self.vm_name) def get_template(self): template = self.section['template'] self.template_fname = os.path.basename(template) self.template_local = os.path.join(rcEnv.pathtmp, self.template_fname) if os.path.exists(self.template_local): self.r.log.info("template %s already downloaded"%self.template_fname) return import urllib fname, headers = urllib.urlretrieve(template, self.template_local) if 'invalid file' in headers.values(): self.r.log.error("%s not found"%template) raise ex.excError def unpack_template(self): import tarfile os.chdir(self.section['rootfs']) tar = tarfile.open(name=self.template_local, errorlevel=0) if os.path.exists(os.path.join(self.section['rootfs'],'etc')): self.r.log.info("template already unpacked") return tar.extractall() tar.close() def setup_template(self): self.set_vm_name() def disable_udev(self): updaterc = os.path.join(self.section['rootfs'], 'usr', 'sbin', 'update-rc.d') chkconfig = os.path.join(self.section['rootfs'], 'sbin', 'chkconfig') if os.path.exists(updaterc): self.r.vcall(['chroot', self.section['rootfs'], 'update-rc.d', '-f', 'udev', 'remove']) elif os.path.exists(chkconfig): self.r.vcall(['chroot', self.section['rootfs'], 'chkconfig', 'udev', 'off']) def setup_getty(self): getty = os.path.join(self.section['rootfs'], 'sbin', 'getty') if os.path.exists(getty): self.r.log.info("setup getty") inittab = os.path.join(self.section['rootfs'], 'etc', 'inittab') with open(inittab, 'a') as f: f.write(""" 1:2345:respawn:/sbin/getty 38400 console c1:12345:respawn:/sbin/getty 38400 tty1 linux """) def setup_authkeys(self): pub = os.path.join(os.sep, 'root', '.ssh', 'id_dsa.pub') authkeys = os.path.join(self.section['rootfs'], 'root', '.ssh', 'authorized_keys') if not os.path.exists(pub): self.r.log.error("no dsa found on node for root") return import shutil if not os.path.exists(os.path.dirname(authkeys)): os.makedirs(os.path.dirname(authkeys)) shutil.copyfile(pub, authkeys) os.chmod(authkeys, int('600', 8)) self.r.log.info("setup hypervisor root trust") def setup_ip(self, r): self.purge_known_hosts(r.addr) if os.path.exists(self.interfaces): return self.setup_ip_debian(r) elif os.path.exists(self.network): return self.setup_ip_rh(r) def setup_ip_rh(self, r): r.getaddr() buff = """ DEVICE=%(ipdev)s IPADDR=%(ipaddr)s NETMASK=%(netmask)s ONBOOT=yes """%dict(ipdev=r.ipDev, netmask=r.mask, ipaddr=r.addr) intf = os.path.join(self.network, 'ifcfg-'+r.ipDev) with open(intf, 'w') as f: f.write(buff) def setup_ip_debian(self, r): r.getaddr() buff = """ auto lo iface lo inet loopback auto %(ipdev)s iface %(ipdev)s inet static address %(ipaddr)s netmask %(netmask)s """%dict(ipdev=r.ipDev, netmask=r.mask, ipaddr=r.addr) with open(self.interfaces, 'w') as f: f.write(buff) def setup_ips(self): self.purge_known_hosts() for rs in self.r.svc.get_res_sets("ip"): for r in rs.resources: self.setup_ip(r) def purge_known_hosts(self, ip=None): if ip is None: cmd = ['ssh-keygen', '-R', self.r.svc.svcname] else: cmd = ['ssh-keygen', '-R', ip] ret, out, err = self.r.vcall(cmd, err_to_info=True) def provisioner(self): path = self.section['rootfs'] template = self.section['template'] if not os.path.exists(path): os.makedirs(path) self.get_template() self.unpack_template() self.setup_template() self.setup_lxc() self.disable_udev() self.setup_getty() self.setup_authkeys() self.setup_ips() self.r.start() self.r.log.info("provisioned") return True 070701000245b1000081b40000000000000000000000014faa9509000014fd000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/resContainerKvm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcStatus import resources as Res import time import os import rcExceptions as ex from rcGlobalEnv import rcEnv from rcUtilities import qcall from rcUtilitiesLinux import check_ping import resContainer class Kvm(resContainer.Container): startup_timeout = 180 shutdown_timeout = 120 def __init__(self, name, optional=False, disabled=False, monitor=False, tags=set([])): resContainer.Container.__init__(self, rid="kvm", name=name, type="container.kvm", optional=optional, disabled=disabled, monitor=monitor, tags=tags) self.cf = os.path.join(os.sep, 'etc', 'libvirt', 'qemu', name+'.xml') def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def list_kvmconffiles(self): if os.path.exists(self.cf): return [self.cf] return [] def files_to_sync(self): return self.list_kvmconffiles() def check_capabilities(self): cmd = ['virsh', 'capabilities'] (ret, out, err) = self.call(cmd, errlog=False) if ret != 0: self.status_log("can not fetch capabilities") return False if 'hvm' not in out: self.status_log("hvm not supported by host") return False return True def ping(self): return check_ping(self.addr, timeout=1, count=1) def container_start(self): if not os.path.exists(self.cf): self.log.error("%s not found"%self.cf) raise ex.excError cmd = ['virsh', 'define', self.cf] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError cmd = ['virsh', 'start', self.name] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_stop(self): cmd = ['virsh', 'shutdown', self.name] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_forcestop(self): cmd = ['virsh', 'destroy', self.name] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def is_up(self): cmd = ['virsh', 'dominfo', self.name] (ret, out, err) = self.call(cmd, errlog=False) if ret != 0: return False if "running" in out.split(): return True return False def get_container_info(self): cmd = ['virsh', 'dominfo', self.name] (ret, out, err) = self.call(cmd, errlog=False, cache=True) self.info = {'vcpus': '0', 'vmem': '0'} if ret != 0: return self.info for line in out.split('\n'): if "CPU(s):" in line: self.info['vcpus'] = line.split(':')[1].strip() if "Used memory:" in line: self.info['vmem'] = line.split(':')[1].strip() return self.info def check_manual_boot(self): cf = os.path.join(os.sep, 'etc', 'libvirt', 'qemu', 'autostart', self.name+'.xml') if os.path.exists(cf): return False return True def install_drp_flag(self): flag_disk_path = os.path.join(rcEnv.pathvar, 'drp_flag.vdisk') from xml.etree.ElementTree import ElementTree, SubElement tree = ElementTree() tree.parse(self.cf) """ create the vdisk if it does not exist yet """ if not os.path.exists(flag_disk_path): with open(flag_disk_path, 'w') as f: f.write('') f.close() """ check if drp flag is already set up """ for disk in tree.getiterator("disk"): e = disk.find('source') if e is None: continue (dev, path) = e.items()[0] if path == flag_disk_path: self.log.info("flag virtual disk already exists") return """ add vdisk to the vm xml config """ self.log.info("install drp flag virtual disk") devices = tree.find("devices") e = SubElement(devices, "disk", {'device': 'disk', 'type': 'file'}) SubElement(e, "driver", {'name': 'qemu'}) SubElement(e, "source", {'file': flag_disk_path}) SubElement(e, "target", {'bus': 'virtio', 'dev': 'vdosvc'}) tree.write(self.cf) def provision(self): m = __import__("provKvm") prov = m.ProvisioningKvm(self) prov.provisioner() 0707010002454a000081b40000000000000000000000014faa9509000012ff000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/rcDiskInfoSunOS.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcDiskInfo from rcUtilities import justcall import math from rcGlobalEnv import rcEnv class diskInfo(rcDiskInfo.diskInfo): def get_val(self, line): l = line.split(":") if len(l) != 2: return return l[-1].strip() def get_part_size(self, dev): part = dev[-1] size = 0 cmd = ['prtvtoc', dev] (out, err, ret) = justcall(cmd) if ret != 0: return size bytes_per_sect = 0 for line in out.split('\n'): if not line.startswith('*'): continue if "bytes/sector" in line: bytes_per_sect = int(line.split()[1]) if bytes_per_sect == 0: return 0 for line in out.split('\n'): if line.startswith('*'): continue l = line.split() if len(l) != 6: continue if l[0] != part: continue return math.ceil(1.*int(l[4])*bytes_per_sect/1024/1024) return 0 def get_size(self, dev): size = 0 cmd = ['prtvtoc', dev] (out, err, ret) = justcall(cmd) if ret != 0: return size """ * 512 bytes/sector * 63 sectors/track * 255 tracks/cylinder * 16065 sectors/cylinder * 19581 cylinders * 19579 accessible cylinders ** OR: * 188743612 accessible sectors """ for line in out.split('\n'): if not line.startswith('*'): continue try: if "bytes/sector" in line: n1 = int(line.split()[1]) if "accessible sectors" in line: s0 = int(line.split()[1]) size = math.ceil(1. * s0 * n1 / 1024 / 1024) break if "sectors/cylinder" in line: n2 = int(line.split()[1]) if "cylinders" in line: n3 = int(line.split()[1]) size = math.ceil(1. * n1 * n2 * n3 / 1024 / 1024) except: pass return size def __init__(self): self.h = {} cmd = ["/usr/bin/find", "/dev/rdsk", "-name", "c*s2"] (out, err, ret) = justcall(cmd) if ret != 0: return lines = out.split('\n') for e in lines: if "/dev/" not in e: continue dev = e.strip() cmd = ["mpathadm", "show", "lu", dev] (out, err, ret) = justcall(cmd) if ret != 0: continue if "Error: Logical-unit " + dev + " is not found" in err: dsk = dev.replace("/dev/rdsk/", "") dsk = dsk.replace("s2", "") wwid = rcEnv.nodename + "." + dsk vid = "LOCAL" pid = "" size = 0 else: wwid = "" vid = "" pid = "" size = 0 for line in out.split('\n'): if line.startswith("\tVendor:"): vid = self.get_val(line) elif line.startswith("\tProduct:"): pid = self.get_val(line) elif line.startswith("\tName:"): wwid = self.get_val(line) size = self.get_size(dev) self.h[dev] = dict(wwid=wwid, vid=vid, pid=pid, size=size) def get(self, dev, type): dummy = dict(wwid="unknown", vid="unknown", pid="unknown", size=0) if dev not in self.h: return dummy[type] return self.h[dev][type] def disk_id(self, dev): return self.get(dev, 'wwid') def disk_vendor(self, dev): return self.get(dev, 'vid') def disk_model(self, dev): return self.get(dev, 'pid') def disk_size(self, dev): return self.get(dev, 'size') 07070100024543000081b40000000000000000000000014faa950900002176000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/rcDevTreeSunOS.pyimport rcDevTree import glob import os import re from subprocess import * from rcUtilities import which from rcGlobalEnv import rcEnv from rcDiskInfoSunOS import diskInfo class DevTree(rcDevTree.DevTree): zpool_members = {} zpool_used = {} zpool_used_zfs = {} zpool_size = {} zpool_datasets = {} zpool_datasets_used = {} def load_partitions(self, d): """ * First Sector Last * Partition Tag Flags Sector Count Sector Mount Directory 0 2 00 16779312 54281421 71060732 1 3 01 0 16779312 16779311 2 5 00 0 71127180 71127179 7 0 00 71060733 66447 71127179 """ p = Popen(["prtvtoc", d.devpath[0]], stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return for line in out.split("\n"): line = line.strip() if line.startswith('*'): continue if line.startswith('2'): continue l = line.split() if len(l) < 6: continue partname = d.devname + 's' + l[0] partpath = d.devpath[0][:-1] + l[0] partsize = self.di.get_part_size(partpath) p = self.add_dev(partname, partsize, "linear") p.set_devpath(partpath) d.add_child(partname) p.add_parent(d.devname) def load_format(self): """ 0. c3t0d0 /pci@1f,700000/scsi@2/sd@0,0 4. c5t600508B4000971CD00010000024A0000d0 EVA_SAVE /scsi_vhci/ssd@g600508b4000971cd00010000024a0000 """ p = Popen(["format", "-e"], stdout=PIPE, stderr=PIPE, stdin=PIPE) out, err = p.communicate(input=None) for line in out.split("\n"): line = line.strip() if re.match(r"[0-9]+\. ", line) is None: continue l = line.split() devname = l[1] devpath = '/dev/rdsk/'+devname+'s2' size = self.di.get_size(devpath) d = self.add_dev(devname, size, "linear") d.set_devpath(devpath) self.load_partitions(d) def load_sds(self): p = Popen(["metastat", "-p"], stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return lines = out.split('\n') lines.reverse() """ # metastat -p d11 -m d2 d3 1 d2 1 1 c3t0d0s1 d3 1 1 c3t1d0s1 """ for line in lines: l = line.split() if len(l) < 3: continue childname = l[0] childpath = "/dev/md/dsk/"+childname childsize = self.di.get_size(childpath) if l[1] == "-m": childtype = "raid1" else: childtype = "linear" childdev = self.add_dev(childname, childsize, childtype) childdev.set_devpath(childpath) if l[1] == "-m": parentnames = l[2:-1] else: parentnames = [l[-1]] for parentname in parentnames: parentpath = "/dev/md/dsk/"+parentname parentsize = self.di.get_size(parentpath) parentdev = self.add_dev(parentname, parentsize, "linear") childdev.add_parent(parentname) parentdev.add_child(childname) def load_zpool(self): p = Popen(["zpool", "list", "-H"], stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return for line in out.split('\n'): l = line.split() if len(l) == 0: continue poolname = l[0] self.load_zpool1(poolname) def load_zpool1(self, poolname): p = Popen(["zpool", "status", poolname], stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return self.zpool_members[poolname] = [] for line in out.split('\n'): l = line.split() if len(l) != 5: continue if l[0] == 'NAME': continue if l[0] == poolname: continue devname = l[0] d = self.get_dev(devname) if d is None: continue self.zpool_members[poolname].append(d) p = Popen(["zpool", "iostat", poolname], stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return lines = out.split('\n') lines = [l for l in lines if len(l) > 0] self.zpool_used[poolname] = self.read_size(lines[-1].split()[1]) zpool_free = self.read_size(lines[-1].split()[2]) self.zpool_size[poolname] = self.zpool_used[poolname] + zpool_free p = Popen(["zfs", "list", "-H", "-r", "-t", "filesystem", poolname], stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return self.zpool_datasets[poolname] = [] self.zpool_datasets_used[poolname] = 0 for line in out.split('\n'): l = line.split() if len(l) == 0: continue zfsname = l[0] size = self.read_size(l[1]) refer = self.read_size(l[3]) size -= refer mnt = l[4] if zfsname == poolname: self.zpool_used_zfs[poolname] = size continue self.zpool_datasets[poolname].append((zfsname, size)) self.zpool_datasets_used[poolname] += size p = Popen(["zfs", "list", "-H", "-t", "snapshot"], stdout=PIPE, stderr=PIPE) out, err = p.communicate() if p.returncode != 0: return for line in out.split('\n'): l = line.split() if len(l) == 0: continue zfsname = l[0] if not zfsname.startswith(poolname+'/') and \ not zfsname.startswith(poolname+'@'): continue size = self.read_size(l[1]) #refer = self.read_size(l[3]) self.zpool_datasets[poolname].append((zfsname, size)) self.zpool_datasets_used[poolname] += size rest = self.zpool_used_zfs[poolname] - self.zpool_datasets_used[poolname] if rest < 0: rest = 0 self.zpool_datasets[poolname].append((poolname, rest)) self.zpool_datasets_used[poolname] += rest if self.zpool_datasets_used[poolname] == 0: ratio = 0 else: ratio = 1.0 * self.zpool_used[poolname] / self.zpool_datasets_used[poolname] for zfsname, size in self.zpool_datasets[poolname]: used = int(size*ratio) d = self.add_dev(zfsname, used, "zfs") d.set_devpath(zfsname) for m in self.zpool_members[poolname]: member_ratio = 1.0 * m.size / self.zpool_size[poolname] d.add_parent(m.devname) m.add_child(zfsname) self.set_relation_used(m.devname, zfsname, int(used*member_ratio)) def read_size(self, s): if s == '0': return 0 unit = s[-1] size = float(s[:-1].replace(',','.')) if unit == 'K': size = size / 1024 elif unit == 'M': pass elif unit == 'G': size = size * 1024 elif unit == 'T': size = size * 1024 * 1024 elif unit == 'P': size = size * 1024 * 1024 * 1024 elif unit == 'Z': size = size * 1024 * 1024 * 1024 * 1024 else: raise Exception("unit not supported: %s"%unit) return int(size) def load(self): self.di = diskInfo() self.load_format() self.load_zpool() self.load_sds() def blacklist(self, devname): bl = [r'^loop[0-9]*.*', r'^ram[0-9]*.*', r'^scd[0-9]*', r'^sr[0-9]*'] for b in bl: if re.match(b, devname): return True return False if __name__ == "__main__": tree = DevTree() tree.load() #print tree tree.print_tree_bottom_up() #print map(lambda x: x.alias, tree.get_top_devs()) 0707010002452a000081b40000000000000000000000014faa95090000008f000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/provFsExt4.pyfrom provFs import ProvisioningFs class ProvisioningFsExt4(ProvisioningFs): mkfs = ['mkfs.ext4', '-F', '-q'] info = ['tune2fs', '-l'] 07070100024572000081b40000000000000000000000014faa95090000051c000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcPkgFreeBSD.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from rcUtilities import call, which from rcGlobalEnv import rcEnv def listpkg(): if which('pkg_info') is None: return [] cmd = ['pkg_info'] (ret, out, err) = call(cmd, errlog=False, cache=True) lines = [] for line in out.split('\n'): l = line.split() if len(l) < 2: continue nv = l[0].split('-') version = nv[-1] pkgname = '-'.join(nv[0:-1]) x = [rcEnv.nodename, pkgname, version, ''] lines.append(x) return lines def listpatch(): return [] 07070100024544000081b40000000000000000000000014faa950900000447000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/rcDiskInfo.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # class diskInfo(object): """Parent class for diskInfo OS""" def disk_id(self, dev): return "tbd" def disk_vendor(self, dev): return "tbd" def disk_model(self, dev): return "tbd" def disk_size(self, dev): return "tbd" 070701000245f0000081b40000000000000000000000014faa950900000b3c000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/resVgLibvirtVm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import re import os import rcExceptions as ex import rcStatus resVg = __import__("resDg") from subprocess import * from rcUtilities import qcall from rcGlobalEnv import rcEnv from subprocess import * class Vg(resVg.Dg): def __init__(self, rid=None, name=None, type=None, optional=False, disabled=False, tags=set([]), monitor=False): self.label = name resVg.Dg.__init__(self, rid=rid, name=name, type='disk.vg', optional=optional, disabled=disabled, tags=tags, monitor=monitor) def has_it(self): return True def is_up(self): return True def _status(self, verbose=False): return rcStatus.NA def do_start(self): pass def do_stop(self): pass def devlist(self): if self.devs != set(): return self.devs devmapping = self.devmap() self.devs = map(lambda x: x[0], devmapping) return self.devs def disklist(self): devps = self.devs try: u = __import__('rcUtilities'+rcEnv.sysname) self.disks = u.devs_to_disks(self, devps) except: self.disks = devps return self.disks def devmap(self): if hasattr(self, "devmapping"): return self.devmapping self.devmapping = [] from xml.etree.ElementTree import ElementTree, SubElement tree = ElementTree() tree.parse(self.svc.resources_by_id['container'].cf) for dev in tree.getiterator('disk'): s = dev.find('source') if s is None: continue if 'dev' not in s.attrib: continue src = s.attrib['dev'] s = dev.find('target') if s is None: continue if 'dev' not in s.attrib: continue dst = s.attrib['dev'] self.devmapping.append((src, dst)) return self.devmapping 070701000245af000081b40000000000000000000000014faa950900000f3f000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/resContainerHpVm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcStatus import resources as Res import time import os import rcExceptions as ex from rcUtilities import qcall from rcGlobalEnv import rcEnv import resContainer u = __import__('rcUtilitiesHP-UX') class HpVm(resContainer.Container): def __init__(self, name, optional=False, disabled=False, monitor=False, tags=set([])): resContainer.Container.__init__(self, rid="hpvm", name=name, type="container.hpvm", optional=optional, disabled=disabled, monitor=monitor, tags=tags) def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def files_to_sync(self): import glob a = [] guest = os.path.join(os.sep, 'var', 'opt', 'hpvm', 'guests', self.name) uuid = os.path.realpath(guest) share = os.path.join(rcEnv.pathvar, 'vg_'+self.svc.svcname+'_*.share') if os.path.exists(guest): a.append(guest) if os.path.exists(uuid): a.append(uuid) files = glob.glob(share) if len(files) > 0: a += files return a def ping(self): return u.check_ping(self.addr, timeout=1, count=1) def container_start(self): cmd = ['/opt/hpvm/bin/hpvmstart', '-P', self.name] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_stop(self): cmd = ['/opt/hpvm/bin/hpvmstop', '-g', '-F', '-P', self.name] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_forcestop(self): cmd = ['/opt/hpvm/bin/hpvmstop', '-F', '-P', self.name] (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def check_manual_boot(self): cmd = ['/opt/hpvm/bin/hpvmstatus', '-M', '-P', self.name] (ret, out, err) = self.call(cmd, cache=True) if ret != 0: return False if out.split(":")[11] == "Manual": return True self.log.info("Auto boot should be turned off") return False def get_container_info(self): cmd = ['/opt/hpvm/bin/hpvmstatus', '-M', '-P', self.name] (ret, out, err) = self.call(cmd, cache=True) self.info = {'vcpus': '0', 'vmem': '0'} if ret != 0: return self.info self.info['vcpus'] = out.split(':')[19].split(';')[0] self.info['vmem'] = out.split(':')[20].split(';')[0] if 'GB' in self.info['vmem']: self.info['vmem'] = str(1024*1024*int(self.info['vmem'].replace('GB',''))) return self.info def is_up(self): cmd = ['/opt/hpvm/bin/hpvmstatus', '-M', '-P', self.name] (ret, out, err) = self.call(cmd) if ret != 0: return False if out.split(":")[10] == "On": return True return False def check_capabilities(self): if os.path.exists('/opt/hpvm/bin/hpvmstatus'): return True return False 07070100024563000081b40000000000000000000000014faa950900000984000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/rcMountsDarwin.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcMounts from rcUtilities import * from subprocess import Popen def get_src_dir_dev(dev): """Given a directory path, return its hosting device """ process = Popen(['df', '-l', dev], stdout=PIPE, stderr=STDOUT, close_fds=True) buff = process.communicate() out = buff[0] i = out.index('/') return out[i:].split()[0] class Mounts(rcMounts.Mounts): def match_mount(self, i, dev, mnt): """Given a line of 'mount' output, returns True if (dev, mnt) matches this line. Returns False otherwize. Also care about weirdos like loops and binds, ... """ if os.path.isdir(dev): is_bind = True src_dir_dev = get_src_dir_dev(dev) else: is_bind = False if i.mnt != mnt: return False if i.dev == dev: return True if is_bind and i.dev == src_dir_dev: return True return False def __init__(self): self.mounts = [] (ret, out, err) = call(['mount']) for l in out.split('\n'): words = l.split() if len(words) < 4: return dev = words[0] mnt = words[2] opts = ' '.join(words[3:]).strip('(').strip(')').split(', ') type = opts[0] if len(opts) < 3: mnt_opt = '' else: mnt_opt = ','.join(opts[2:]) m = rcMounts.Mount(dev, mnt, type, mnt_opt) self.mounts.append(m) if __name__ == "__main__" : help(Mounts) for m in Mounts(): print m 0707010002451c000081b40000000000000000000000014faa950900000453000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/hostidAIX.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * def hostid(): cmd = ['uname', '-u'] p = Popen(cmd, stderr=None, stdout=PIPE, close_fds=True) buff = p.communicate() if p.returncode != 0: return '1' sn = buff[0].split()[0] return str(hex(abs(sn.__hash__()))).replace('0x', '') 070701000245f6000081b40000000000000000000000014faa95090000094f000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/resVgRawSunOS.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import resVgRaw import os import rcStatus import re class Vg(resVgRaw.Vg): def __init__(self, rid=None, devs=set([]), type=None, optional=False, disabled=False, tags=set([]), always_on=set([]), monitor=False): resVgRaw.Vg.__init__(self, rid=rid, devs=devs, type=type, optional=optional, disabled=disabled, tags=tags, always_on=always_on, monitor=monitor) self.devs = set([]) self.devs_not_found = set([]) for dev in devs: if re.match("^.*[sp][0-9]*$", dev) is not None: # partition, substitute s2 to given part regex = re.compile("[sp][0-9]*$", re.UNICODE) dev = regex.sub("s2", dev) else: # base device, append s2 dev += 's2' if os.path.exists(dev): self.devs.add(dev) else: self.devs_not_found.add(dev) def disklist(self): l = set([]) for dev in self.devs: if re.match("^/dev/rdsk/c[0-9]*", dev) is not None: if os.path.exists(dev): if re.match('^.*s[0-9]*$', dev) is None: dev += "s2" else: regex = re.compile('s[0-9]*$', re.UNICODE) dev = regex.sub('s2', dev) l.add(dev) return l 070701000245f2000081b40000000000000000000000014faa950900000b8a000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resVgOvm.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import re import os import rcExceptions as ex import rcStatus resVg = __import__("resDg") from subprocess import * from rcUtilities import qcall from rcGlobalEnv import rcEnv from subprocess import * class Vg(resVg.Dg): def __init__(self, rid=None, name=None, type=None, optional=False, disabled=False, tags=set([]), monitor=False): self.label = name resVg.Dg.__init__(self, rid=rid, name=name, type='disk.vg', optional=optional, disabled=disabled, tags=tags, monitor=monitor) def has_it(self): return True def is_up(self): return True def _status(self, verbose=False): return rcStatus.NA def do_start(self): pass def do_stop(self): pass def devmap(self): if hasattr(self, "devmapping"): return self.devmapping self.devmapping = [] cf = self.svc.resources_by_id['container'].find_vmcf() with open(cf, 'r') as f: buff = f.read() for line in buff.split('\n'): if not line.startswith('disk'): continue disks = line[line.index('['):] if len(line) <= 2: break disks = disks[1:-1] disks = disks.split(', ') for disk in disks: disk = disk.strip("'") d = disk.split(',') if not d[0].startswith('phy:'): continue l = [d[0].strip('phy:'), d[1]] self.devmapping.append(l) break return self.devmapping def devlist(self): if self.devs != set(): return self.devs self.devs = set(map(lambda x: x[0], self.devmap())) return self.devs def disklist(self): if self.disks != set(): return self.disks self.disks = set() devps = self.devlist() try: u = __import__('rcUtilities'+rcEnv.sysname) self.disks = u.devs_to_disks(self, devps) except: self.disks = devps return self.disks 070701000245d4000081b40000000000000000000000014faa950900001620000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/resMountDarwin.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import os import rcMountsFreeBSD as rcMounts import resMount as Res from rcUtilities import qcall, protected_mount, getmount from rcGlobalEnv import rcEnv import rcExceptions as ex from stat import * def try_umount(self): cmd = ['umount', self.mountPoint] (ret, out, err) = self.vcall(cmd, err_to_info=True) if ret == 0: return 0 """ don't try to kill process using the source of a protected bind mount """ if protected_mount(self.mountPoint): return 1 """ best effort kill of all processes that might block the umount operation. The priority is given to mass action reliability, ie don't contest oprator's will """ cmd = ['sync'] (ret, out, err) = self.vcall(cmd, err_to_info=True) for i in range(4): nb_killed = self.killfuser(self.mountPoint) self.log.info('umount %s'%self.mountPoint) cmd = ['umount', self.mountPoint] ret = qcall(cmd) if ret == 0 or nb_killed == 0: break if ret != 0: self.log.info("no more process using %s, yet umount fails. try forced umount."%self.mountPoint) cmd = ['umount', '-f', self.mountPoint] (ret, out, err) = self.vcall(cmd, err_to_info=True) return ret class Mount(Res.Mount): """ define FreeBSD mount/umount doAction """ def __init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size=None, always_on=set([]), disabled=False, tags=set([]), optional=False, monitor=False): self.Mounts = None Res.Mount.__init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size, always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) self.fsck_h = { 'ufs': {'bin': 'fsck', 'cmd': ['fsck', '-t', 'ufs', '-p', self.device]}, } def killfuser(self, dir): cmd = ['fuser', '-kmc', dir] (ret, out, err) = self.vcall(cmd, err_to_info=True) """ return the number of process we sent signal to """ l = out.split(':') if len(l) < 2: return 0 return len(l[1].split()) def is_up(self): self.Mounts = rcMounts.Mounts() return self.Mounts.has_mount(self.device, self.mountPoint) def realdev(self): dev = None try: mode = os.stat(self.device)[ST_MODE] except: self.log.debug("can not stat %s" % self.device) return None if S_ISCHR(mode): dev = self.device else: mnt = getmount(self.device) if self.Mounts is None: self.Mounts = rcMounts.Mounts() m = self.Mounts.has_param("mnt", mnt) if m is None: self.log.debug("can't find dev %(dev)s mounted in %(mnt)s in mnttab"%dict(mnt=mnt, dev=self.device)) return None dev = m.dev return dev def disklist(self): dev = self.realdev() if dev is None: return set([]) try: statinfo = os.stat(dev) except: self.log.error("can not stat %s" % dev) raise ex.excError return set([dev]) def can_check_writable(self): return True def start(self): if self.Mounts is None: self.Mounts = rcMounts.Mounts() Res.Mount.start(self) if self.is_up() is True: self.log.info("fs(%s %s) is already mounted"% (self.device, self.mountPoint)) return 0 self.fsck() if not os.path.exists(self.mountPoint): os.makedirs(self.mountPoint, 0755) if self.fsType != "": fstype = ['-t', self.fsType] else: fstype = [] if self.mntOpt != "": mntopt = ['-o', self.mntOpt] else: mntopt = [] cmd = ['mount']+fstype+mntopt+[self.device, self.mountPoint] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError self.Mounts = None def stop(self): if self.Mounts is None: self.Mounts = rcMounts.Mounts() if self.is_up() is False: self.log.info("fs(%s %s) is already umounted"% (self.device, self.mountPoint)) return for i in range(3): ret = try_umount(self) if ret == 0: break if ret != 0: self.log.error('failed to umount %s'%self.mountPoint) raise ex.excError self.Mounts = None if __name__ == "__main__": for c in (Mount,) : help(c) 070701000245d8000081b40000000000000000000000014faa950900001585000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/resMountSunOS.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. "Module implement SunOS specific mounts" import os import rcStatus import rcMountsSunOS as rcMounts import resMount as Res import rcExceptions as ex from rcZfs import zfs_getprop, zfs_setprop from rcUtilities import justcall class Mount(Res.Mount): """ define SunOS mount/umount doAction """ def __init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size=None, always_on=set([]), disabled=False, tags=set([]), optional=False, monitor=False): self.rdevice = device.replace('/dsk/','/rdsk/',1) self.Mounts = rcMounts.Mounts() Res.Mount.__init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size, always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) self.fsck_h = { 'ufs': {'bin': 'fsck', 'cmd': ['fsck', '-F', 'ufs', '-y', self.rdevice], 'reportcmd': ['fsck', '-F', 'ufs', '-m', self.rdevice], 'reportclean': [ 32 ], }, 'vxfs': {'bin': 'fsck', 'cmd': ['fsck', '-F', 'vxfs', '-y', self.rdevice], 'reportcmd': ['fsck', '-F', 'vxfs', '-m', self.rdevice], 'reportclean': [ 32 ], }, } def is_up(self): self.Mounts = rcMounts.Mounts() return self.Mounts.has_mount(self.device, self.mountPoint) def start(self): self.Mounts = None Res.Mount.start(self) if self.is_up() is True: self.log.info("fs(%s %s) is already mounted"% (self.device, self.mountPoint)) return if self.fsType == 'zfs' : if zfs_getprop(self.device, 'mountpoint' ) != self.mountPoint : if zfs_setprop(self.device, 'zoned', 'off') : if not zfs_setprop(self.device, 'mountpoint', self.mountPoint) : raise ex.excError self.Mounts = None if self.is_up() is True: return (stdout,stderr,returncode)= justcall(['rm', self.mountPoint+"/.opensvc" ]) ret, out, err = self.vcall(['zfs', 'mount', self.device ]) if ret != 0: ret, out, err = self.vcall(['zfs', 'mount', '-O', self.device ]) if ret != 0: raise ex.excError return elif self.fsType != "": fstype = ['-F', self.fsType] self.fsck() else: fstype = [] if self.mntOpt != "": mntopt = ['-o', self.mntOpt] else: mntopt = [] if not os.path.exists(self.mountPoint): os.makedirs(self.mountPoint, 0755) cmd = ['mount']+fstype+mntopt+[self.device, self.mountPoint] (ret, out, err) = self.vcall(cmd) if ret != 0: self.Mounts = None raise ex.excError self.Mounts = None def try_umount(self): if self.fsType == 'zfs' : ret, out, err = self.vcall(['zfs', 'umount', self.device ], err_to_info=True) if ret != 0 : ret, out, err = self.vcall(['zfs', 'umount', '-f', self.device ], err_to_info=True) if ret != 0 : raise ex.excError return (ret, out, err) = self.vcall(['umount', self.mountPoint], err_to_info=True) if ret == 0 : return for i in range(4): (ret, out, err) = self.vcall(['fuser', '-ck', self.mountPoint], err_to_info=True) (ret, out, err) = self.vcall(['umount', self.mountPoint], err_to_info=True) if ret == 0 : return if self.fsType != 'lofs' : (ret, out, err) = self.vcall(['umount', '-f', self.mountPoint], err_to_info=True) if ret == 0 : return raise ex.excError def stop(self): self.Mounts = None if self.is_up() is False: self.log.info("fs(%s %s) is already umounted"% (self.device, self.mountPoint)) return try: self.try_umount() except: self.Mounts = None self.log.error("failed") raise ex.excError self.Mounts = None if __name__ == "__main__": for c in (Mount,) : help(c) 07070100024511000081b40000000000000000000000014faa95090000139a000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/checkRaidMegaRaid.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks import os from rcUtilities import justcall, which from rcGlobalEnv import rcEnv class check(checks.check): prefixes = [os.path.join(os.sep, "usr", "local", "admin")] megacli = "MegaCli" chk_type = "raid" chk_name = "MegaCli" def find_megacli(self): if which(self.megacli): return self.megacli for prefix in self.prefixes: megacli = os.path.join(prefix, self.megacli) if os.path.exists(megacli): return megacli return def do_check(self): r = self.do_check_ldpdinfo() r += self.do_check_bbustatus() return r def do_check_ldpdinfo(self): megacli = self.find_megacli() if megacli is None: return self.undef os.chdir(rcEnv.pathtmp) logs = [os.path.join(rcEnv.pathtmp, 'MegaSAS.log'), os.path.join(rcEnv.pathtmp, 'MegaCli.log'), os.path.join(rcEnv.pathtmp, 'MegaRaid.log')] for log in logs: try: os.unlink(log) except OSError, e: if e.errno == 2: pass else: raise cmd = [megacli, '-LdPdInfo', '-aALL'] out, err, ret = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) == 0: return self.undef r = [] slot = "" errs = 0 for line in lines: if line.startswith('Adapter'): l = line.split('#') if slot != "": r.append({ 'chk_instance': slot, 'chk_value': str(errs), 'chk_svcname': '', }) slot = 'slot'+l[-1] errs = 0 if (line.startswith('State:') and 'Optimal' not in line) or \ (line.startswith('Firmware state:') and 'Online' not in line): errs += 1 if slot != "": r.append({ 'chk_instance': slot, 'chk_value': str(errs), 'chk_svcname': '', }) return r def do_check_bbustatus(self): megacli = self.find_megacli() if megacli is None: return self.undef os.chdir(rcEnv.pathtmp) logs = [os.path.join(rcEnv.pathtmp, 'MegaSAS.log'), os.path.join(rcEnv.pathtmp, 'MegaCli.log'), os.path.join(rcEnv.pathtmp, 'MegaRaid.log')] for log in logs: try: os.unlink(log) except OSError, e: if e.errno == 2: pass else: raise cmd = [megacli, '-AdpBbuCmd', '-GetBbuStatus', '-aALL'] out, err, ret = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) == 0: return self.undef r = [] slot = "" for line in lines: if 'Adapter:' in line: l = line.split() slot = 'slot'+l[-1] if line.startswith('Relative State of Charge:'): val = line.strip('%').split()[-1] r.append({ 'chk_instance': '%s battery charge'%slot, 'chk_value': str(val), 'chk_svcname': '', }) if line.startswith('Temperature:'): val = line.split()[-2] r.append({ 'chk_instance': '%s battery temp'%slot, 'chk_value': str(val), 'chk_svcname': '', }) if line.startswith('isSOHGood:'): if 'Yes' in line: val = 0 else: val = 1 r.append({ 'chk_instance': '%s battery isSOHGood'%slot, 'chk_value': str(val), 'chk_svcname': '', }) return r 0707010002452e000081b40000000000000000000000014faa95090000036d000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/provLoopLinux.pyfrom provisioning import Provisioning import os import rcExceptions as ex class ProvisioningLoop(Provisioning): def __init__(self, r): Provisioning.__init__(self, r) self.path = r.svc.config.get(self.r.rid, 'file') self.size = r.svc.config.get(self.r.rid, 'size') def provisioner(self): d = os.path.dirname(self.path) try: if not os.path.exists(d): self.r.log.info("create directory %s"%d) os.makedirs(d) with open(self.path, 'w') as f: self.r.log.info("create file %s, size %sMB"%(self.path, self.size)) f.seek(int(self.size)*1024*1024) f.write('\0') except: self.r.log.error("Failed to create %s"%self.path) raise ex.excError self.r.log.info("provisioned") self.r.start() 07070100024515000081b40000000000000000000000014faa950900000a4b000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/checkVgUsageHP-UX.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import call class check(checks.check): chk_type = "vg_u" def find_svc(self, vgname): for svc in self.svcs: for rs in svc.get_res_sets('disk.vg'): for r in rs.resources: if r.name == vgname: return svc.svcname return '' def do_check(self): """ # vgdisplay -F vg_name=/dev/vg00:vg_write_access=read,write:vg_status=available:max_lv=255:cur_lv=9:open_lv=9:max_pv=16:cur_pv=1:act_pv=1:max_pe_per_pv=4384:vgda=2:pe_size=32:total_pe=4347:alloc_pe=2712:free_pe=1635:total_pvg=0:total_spare_pvs=0:total_spare_pvs_in_use=0:vg_version=1.0:vg_max_size=2192g:vg_max_extents=70144 """ cmd = ['vgdisplay', '-F'] (ret, out, err) = call(cmd, errlog=False) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 1: return self.undef r = [] for line in lines: l = line.split(':') if len(l) < 10: continue instance = None free = None size = None for w in l: if 'vg_name' in w: instance = w.split('=')[1].replace('/dev/','') elif 'total_pe' in w: size = int(w.split('=')[1]) elif 'free_pe' in w: free = int(w.split('=')[1]) if instance is None or free is None or size is None: continue val = int(100*(size-free)/size) r.append({'chk_instance': instance, 'chk_value': str(val), 'chk_svcname': self.find_svc(instance), } ) return r 070701000245b5000081b40000000000000000000000014faa95090000116a000000ae00010002ffffffffffffffff0000002900000000root/opt/opensvc/lib/resContainerVbox.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import resources as Res import rcExceptions as ex from rcUtilities import qcall import resContainer from rcGlobalEnv import rcEnv import os utilities = __import__('rcUtilities'+rcEnv.sysname) class Vbox(resContainer.Container): def __init__(self, name, optional=False, disabled=False, monitor=False, tags=set([])): resContainer.Container.__init__(self, rid="vbox", name=name, type="container.vbox", optional=optional, disabled=disabled, monitor=monitor, tags=tags) self.shutdown_timeout = 240 #self.sshbin = '/usr/local/bin/ssh' self.vminfo = None def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def get_vminfo(self): if self.vminfo is not None: return self.vminfo cmd = ['VBoxManage', 'showvminfo', '--machinereadable', self.name] (ret, out, err) = self.call(cmd) if ret != 0: return None h = {} for line in out.split('\n'): l = line.split('=') if len(l) != 2: continue key = l[0].strip('"') val = l[1].strip('"') h[key] = val self.vminfo = h return self.vminfo def files_to_sync(self): a = [] vminfo = self.get_vminfo() if vminfo is None: return [] a.append(vminfo['CfgFile']) a.append(vminfo['SnapFldr']) a.append(vminfo['LogFldr']) return a def check_capabilities(self): cmd = ['VBoxManage', '-v'] (ret, out, err) = self.call(cmd) if ret != 0: return False return True def state(self): cmd = ['VBoxManage', 'list', 'runningvms'] (ret, out, err) = self.call(cmd) if ret != 0: return None for line in out.split('\n'): l = line.split('"') if len(l) < 2: continue if l[1] == self.name: return 'on' return 'off' def ping(self): return utilities.check_ping(self.addr) def container_action(self, action, add=[]): cmd = ['VBoxManage', action, self.name] + add (ret, buff, err) = self.vcall(cmd) if ret != 0: raise ex.excError def container_start(self): state = self.state() if state == 'None': raise ex.excError elif state == 'off': self.container_action('startvm') elif state == 'on': self.log.info("container is already up") def container_forcestop(self): self.container_action('controlvm', ['poweroff']) def container_stop(self): state = self.state() if state == 'None': raise ex.excError elif state == 'off': self.log.info("container is already down") if state == 'on' : self.container_action('controlvm', ['acpipowerbutton']) try: self.log.info("wait for container shutdown") self.wait_for_fn(self.is_shutdown, self.shutdown_timeout, 2) except ex.excError: self.container_forcestop() def check_manual_boot(self): return True def is_shutdown(self): state = self.state() if state == 'off': return True return False def is_down(self): if self.state() == 'off': return True return False def is_up(self): if self.state() == 'on': return True return False 0707010002453a000081b40000000000000000000000014faa950900001807000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcAssetSunOS.py# # Copyright (c) 2010 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import datetime from rcUtilities import justcall, which from rcGlobalEnv import rcEnv import rcAsset class Asset(rcAsset.Asset): def __init__(self, node): rcAsset.Asset.__init__(self, node) self.zone = True if not which('zonename'): self.zone = False else: (out, err, ret) = justcall(['zonename']) if ret != 0: self.zone = False elif out.strip() == 'global': self.zone = False (out, err, ret) = justcall(['prtdiag']) if ret != 0: self.prtdiag = [] else: self.prtdiag = out.split('\n') (out, err, ret) = justcall(['prtconf']) if ret != 0: self.prtconf = [] else: self.prtconf = out.split('\n') def _get_mem_bytes(self): for l in self.prtconf: if 'Memory size:' in l: return l.split(':')[-1].split()[0] return '0' def _get_mem_banks(self): l = [e for e in self.prtdiag if 'DIMM' in e and 'in use' in e] return str(len(l)) def _get_mem_slots(self): l = [e for e in self.prtdiag if 'DIMM' in e] return str(len(l)) def _get_os_vendor(self): return 'Oracle' def _get_os_name(self): f = '/etc/release' if os.path.exists(f): (out, err, ret) = justcall(['cat', f]) if ret != 0: return 'Unknown' if 'OpenSolaris' in out: return 'OpenSolaris' return 'SunOS' def _get_os_release(self): f = '/etc/release' if os.path.exists(f): (out, err, ret) = justcall(['cat', f]) if ret != 0: return 'Unknown' return out.split('\n')[0].replace('OpenSolaris','').strip() return 'Unknown' def _get_os_kernel(self): (out, err, ret) = justcall(['uname', '-v']) if ret != 0: return 'Unknown' return out.split('\n')[0] def _get_os_arch(self): (out, err, ret) = justcall(['uname', '-m']) if ret != 0: return 'Unknown' return out.split('\n')[0] def _get_cpu_freq(self): (out, err, ret) = justcall(['psrinfo', '-pv']) if ret != 0: return '0' for w in out.split(): if 'MHz)' in w: return ' '.join([prev, w.strip(')')]) prev = w return '0' def _get_cpu_cores(self): (out, err, ret) = justcall(['psrinfo']) if ret != 0: return '0' return str(len(out.split('\n'))-1) def _get_cpu_dies(self): (out, err, ret) = justcall(['psrinfo', '-p']) if ret != 0: return '0' return out.split('\n')[0] def _get_cpu_model(self): (out, err, ret) = justcall(['psrinfo', '-pv']) if ret != 0: return 'Unknown' lines = out.split('\n') lines = [line for line in lines if len(line) > 0] if len(lines) == 0: return 'Unknown' return lines[-1].strip() def _get_serial(self): if which("sneep"): cmd = ['sneep'] else: cmd = ['hostid'] (out, err, ret) = justcall(cmd) if ret != 0: return 'Unknown' return out.split('\n')[0] def _get_model(self): if self.zone: return "Solaris Zone" for l in self.prtdiag: if 'System Configuration:' in l: return l.split(':')[-1].strip() return 'Unknown' def __get_hba(self): # fc / fcoe """ # cfgadm -s match="exact,select=type(fc-fabric)" Ap_Id Type Receptacle Occupant Condition c5 fc-fabric connected configured unknown """ l = [] if not which('cfgadm'): print "no cfgadm" return [] if not which('luxadm'): print "no luxadm" return [] cmd = ['cfgadm', '-lv', '-s', 'match=exact,select=type(fc-fabric)'] out, err, ret = justcall(cmd) if ret != 0: print out, err, ret return [] words = out.split() hba_names = [word for word in words if word.startswith("/devices/")] if len(hba_names) == 0: return [] hba_type = 'fc' for hba_name in hba_names: targets = [] cmd = ['luxadm', '-e', 'dump_map', hba_name] out, err, ret = justcall(cmd) if ret != 0: continue lines = out.split('\n') if len(lines) < 2: continue for line in lines[1:]: words = line.split() if len(words) < 5: continue if 'Host Bus' in line: hba_id = words[3] else: targets.append(words[3]) l.append((hba_id, hba_type, targets)) return l def _get_hba(self): l = self.__get_hba() return map(lambda x: (x[0], x[1]), l) def _get_targets(self): l = self.__get_hba() m = [] for hba_id, hba_type, targets in l: for target in targets: m.append((hba_id, target)) return m 07070100024502000081b40000000000000000000000014faa9509000006fe000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/checkFsInodeAIX.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "fs_i" def find_svc(self, mountpt): for svc in self.svcs: for rs in svc.get_res_sets('fs'): for r in rs.resources: if r.mountPoint == mountpt: return svc.svcname return '' def do_check(self): cmd = ['df', '-i'] out, err, ret = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef r = [] for line in lines[1:]: l = line.split() if len(l) != 7: continue if l[1] == '-': continue if ":/" in l[0]: continue r.append({ 'chk_instance': l[6], 'chk_value': l[5], 'chk_svcname': self.find_svc(l[6]), }) return r 07070100024513000081b40000000000000000000000014faa950900000d3a000000ae00010002ffffffffffffffff0000002c00000000root/opt/opensvc/lib/checkRaidSmartArray.py# # Copyright (c) 2012 Christophe Varoqui # Copyright (c) 2012 Lucien Hercaud # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall, which import os path_list = os.environ['PATH'].split(':') + ['/opt/HPQacucli/sbin'] os.environ['PATH'] = ':'.join(path_list) class check(checks.check): chk_type = "raid" chk_name = "HP SmartArray" def parse_errors(self, out): r = 0 lines = out.split('\n') if len(lines) == 0: return r for line in lines: l = line.split(':') if len(l) < 2: continue if l[-1].strip() != "OK": r += 1 return r def check_logicaldrive(self, slot): cmd = ['hpacucli', 'controller', 'slot='+slot, 'logicaldrive', 'all', 'show', 'status'] (out,err,ret) = justcall(cmd) if ret != 0: return 0 return self.parse_errors(out) def check_physicaldrive(self, slot): cmd = ['hpacucli', 'controller', 'slot='+slot, 'physicaldrive', 'all', 'show', 'status'] (out,err,ret) = justcall(cmd) if ret != 0: return 0 return self.parse_errors(out) def check_array(self, slot): cmd = ['hpacucli', 'controller', 'slot='+slot, 'array', 'all', 'show', 'status'] (out,err,ret) = justcall(cmd) if ret != 0: return 0 return self.parse_errors(out) def check_controller(self, slot): cmd = ['hpacucli', 'controller', 'slot='+slot, 'show', 'status'] (out,err,ret) = justcall(cmd) if ret != 0: return 0 return self.parse_errors(out) def do_check(self): if not which('hpacucli'): return self.undef cmd = ['hpacucli', 'controller', 'all', 'show', 'status'] (out,err,ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) == 0: return self.undef r = [] for line in lines: if ' Slot ' in line: l = line.split() idx = l.index('Slot') uslot = l[idx+1] slot = 'slot ' + uslot value = 0 value += self.check_controller(uslot) value += self.check_array(uslot) value += self.check_logicaldrive(uslot) value += self.check_physicaldrive(uslot) r.append({ 'chk_instance': slot, 'chk_value': str(value), 'chk_svcname': '', }) return r 0707010002453f000081b40000000000000000000000014faa950900002453000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/rcDevTree.py""" Top devices are bare disks or multipath paths. Bottom devices are formatted devices or devices given to applications like raw database devices. A relation describes a parent-child link. A 'used' size can be arbitrarily set on a relation : DevRelation.set_used() A logical volume lv0 with segments on pv1 pv2 has two parent relations : lv0-pv1 and lv0-pv2 """ from hashlib import md5 class DevRelation(object): def __init__(self, parent, child, used=0): self.child = child self.parent = parent self.used = used self.used_set = False def set_used(self, used): self.used_set = True self.used = used def get_used(self, used): # # logical volumes and concatset need to set explicitly # the 'used' size the child consumes on the parent. # if self.used_set: return self.used child = self.tree.get_dev(self.child) if used == 0: used = child.size if child.devtype in ("multipath", "linear", "partition"): return used elif child.devtype in ("raid0"): n = len(child.parents) return used/n elif child.devtype in ("raid1", "raid10"): n = len(child.parents) return used*2/n elif child.devtype in ("raid5"): n = len(child.parents) return used/(n-1) elif child.devtype in ("raid6"): n = len(child.parents) return used/(n-2) raise Exception("unknown devtype %s for %s"%(child.devtype, child.devname)) def get_size(self, chain): if self.used_set: return self.used if len(chain) < 2: self.used = self.tree.get_dev(chain[-1].child).size else: self.used = chain[-2].used return self.used class Dev(object): def __init__(self, devname, size, devtype): self.devname = devname self.devpath = [] self.alias = devname self.size = size self.devtype = devtype # list of relations self.parents = [] self.children = [] def __iadd__(self, o): pass def set_alias(self, alias): self.alias = alias def get_dev(self, devname): return self.tree.get_dev(devname) def get_size(self): return self.size def set_devtype(self, devtype): self.devtype = devtype def set_devpath(self, devpath): self.devpath.append(devpath) def print_dev(self, level=0, relation=None): if relation is None: parent_size = self.size else: parent_size = self.get_dev(relation.parent).get_size() if parent_size == 0: pct = 0 else: pct = 100*self.size//parent_size s = "%s %s %d %d%%\n" % (self.alias, self.devtype, self.size, pct) for r in self.children: d = self.get_dev(r.child) for i in range(level+1): s += " " if d is None: s += "unknown (dev %s not added)\n"%r.child else: s += d.print_dev(level=level+1, relation=r) return s def get_child(self, devname): for r in self.children: if r.parent == devname: return r return None def get_parent(self, devname): for r in self.parents: if r.child == devname: return r return None def add_child(self, devname, size=0, devtype=None): r = self.get_child(devname) if r is None: r = self.tree.get_relation(self.devname, devname) if r is None: r = DevRelation(parent=self.devname, child=devname, used=size) r.tree = self.tree self.children.append(r) self.tree.add_dev(devname, size, devtype) return r def add_parent(self, devname, size=0, devtype=None): r = self.get_parent(devname) if r is None: r = self.tree.get_relation(devname, self.devname) if r is None: r = DevRelation(parent=devname, child=self.devname, used=size) r.tree = self.tree self.parents.append(r) self.tree.add_dev(devname, size, devtype) return r def is_parent(self, devname): for r in self.children: if r.child == devname: return True d = self.get_dev(r.child) if d.is_parent(devname): return True return False def get_top_devs(self): if len(self.parents) == 0: return set([self]) d = set([]) for parent in self.parents: dev = self.get_dev(parent.parent) d |= dev.get_top_devs() return d def get_top_devs_chain(self, chain=[]): if len(self.parents) == 0: return [[self, chain]] d = [] for parent in self.parents: dev = self.get_dev(parent.parent) d += dev.get_top_devs_chain(chain+[parent]) return d def print_dev_bottom_up(self, level=0, chain=[]): if len(chain) == 0: used = self.size else: used = chain[-1].get_size(chain) s = "" for i in range(level+1): s += " " s += "%s %s %d %d"%(self.alias, self.devtype, self.size, used) s += " %s"%self.devpath print s for parent in self.parents: dev = self.get_dev(parent.parent) #print map(lambda x: (x.parent, x.child, x.used, x.get_size(chain+[parent]), x.used), chain+[parent]) dev.print_dev_bottom_up(level+1, chain+[parent]) class DevTree(object): def __init__(self): self.dev = {} # root node of the relation tree self.root = [] def __iadd__(self, o): if isinstance(o, Dev): o.tree = self self.dev[o.devname] = o if not self.has_relations(o.devname): r = DevRelation(parent=None, child=o.devname, used=o.size) r.tree = self self.root.append(r) return self def __str__(self): s = "" for r in self.root: s += self.dev[r.child].print_dev() return s def print_tree_bottom_up(self): for dev in self.get_bottom_devs(): dev.print_dev_bottom_up() def has_relations(self, devname): l = [] for r in self.root: if r.child == devname: return True d = self.get_dev(r.child) if d.is_parent(devname): return True return False def get_dev(self, devname): if devname not in self.dev: return None return self.dev[devname] def get_dev_by_devpath(self, devpath): for dev in self.dev.values(): if devpath in dev.devpath: return dev return None def blacklist(self, dev): """ overload this fn with os specific implementation """ return False def add_dev(self, devname, size=0, devtype=None): if devname in self.dev: return self.dev[devname] if self.blacklist(devname): return d = Dev(devname, size, devtype) self += d return d def set_relation_used(self, parent, child, used): for d in self.dev.values(): for r in d.children + d.parents: if parent == r.parent and child == r.child: r.set_used(used) def get_relation(self, parent, child): for d in self.dev.values(): for r in d.children + d.parents: if parent == r.parent and child == r.child: return r return None def get_bottom_devs(self): return [self.dev[devname] for devname in self.dev if len(self.dev[devname].children) == 0] def get_top_devs(self): d = set([]) for dev in self.get_bottom_devs(): d |= dev.get_top_devs() return list(d) def get_used(self, chain): used = 0 for rel in chain: used = rel.get_used(used) return used def get_top_devs_usage_for_devpath(self, devpath): dev = self.get_dev_by_devpath(devpath) if dev is None: return [] l = [] for d, chain in dev.get_top_devs_chain(): if len(chain) == 0: used = d.size region = 0 else: used = self.get_used(chain) ref = self.get_dev(chain[0].child).alias o = md5() o.update(ref) region = o.hexdigest() l.append((d.devpath[0], used, region)) return l if __name__ == "__main__": tree = DevTree() d = tree.add_dev('/dev/sdb', 10000) d.add_child('/dev/sdb1', 8000) d.add_child('/dev/sdb2', 2000) d = tree.add_dev('/dev/sdc', 20000) d.add_child('/dev/mapper/vg01-foo', 1000) d = tree.get_dev('/dev/sdb2') d.add_child('/dev/mapper/vg01-foo', 1000) d = tree.get_dev('/dev/mapper/vg01-foo') d.add_child('foo.vmdk', 500) print tree 070701000245d0000081b40000000000000000000000014faa950900000c81000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/resLoopFreeBSD.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import re from rcGlobalEnv import * from rcUtilities import call, which import rcStatus import resLoop as Res import rcExceptions as ex def file_to_loop(f): """Given a file path, returns the loop device associated. For example, /path/to/file => /dev/loop0 """ if which('mdconfig') is None: return [] if not os.path.isfile(f): return [] (ret, out, err) = call(['mdconfig', '-l', '-v']) if ret != 0: return [] """ It's possible multiple loopdev are associated with the same file """ devs= [] for line in out.split('\n'): l = line.split() if len(l) < 4: continue path = ' '.join(l[3:]) if path != f: continue if not os.path.exists('/dev/'+l[0]): continue devs.append(l[0]) return devs class Loop(Res.Loop): def is_up(self): """Returns True if the loop group is present and activated """ self.loop = file_to_loop(self.loopFile) if len(self.loop) == 0: return False return True def start(self): if self.is_up(): self.log.info("%s is already up" % self.loopFile) return cmd = ['mdconfig', '-a', '-t', 'vnode', '-f', self.loopFile] (ret, out, err) = self.call(cmd, info=True, outlog=False) if ret != 0: raise ex.excError self.loop = file_to_loop(self.loopFile) self.log.info("%s now loops to %s" % (', '.join(self.loop), self.loopFile)) def stop(self): if not self.is_up(): self.log.info("%s is already down" % self.loopFile) return 0 for loop in self.loop: cmd = ['mdconfig', '-d', '-u', loop.strip('md')] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def _status(self, verbose=False): if self.is_up(): return self.status_stdby(rcStatus.UP) else: return self.status_stdby(rcStatus.DOWN) def __init__(self, rid, loopFile, always_on=set([]), disabled=False, tags=set([]), optional=False, monitor=False): Res.Loop.__init__(self, rid, loopFile, always_on=always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) 070701000245bb000081b40000000000000000000000014faa950900000a2f000000ae00010002ffffffffffffffff0000001e00000000root/opt/opensvc/lib/resHb.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import resources as Res from rcGlobalEnv import rcEnv import os import rcExceptions as ex import rcStatus class Hb(Res.Resource): """ HeartBeat ressource """ def cluster_files(self): svcfile = os.path.join(rcEnv.pathetc, self.svc.svcname) svcmgr = os.path.join('..', 'bin', 'svcmgr') svcmgr_real = os.path.join(rcEnv.pathbin, 'svcmgr') cluster_f = '.'.join((svcfile, 'cluster')) stonith_f = '.'.join((svcfile, 'stonith')) for f in (cluster_f, stonith_f): if os.path.islink(f): if os.path.exists(f): if os.path.realpath(f) == svcmgr_real: self.log.debug("%s: symlink ok."%f) pass else: self.log.info("%s: symlink exists but points to wrong file. fix."%f) os.unlink(f) os.symlink(svcmgr, f) else: self.log.info("%s: broken link. fix."%f) os.unlink(f) os.symlink(svcmgr, f) else: if os.path.exists(f): self.log.info("%s: regular file. fix."%f) os.unlink(f) os.symlink(svcmgr, f) else: self.log.info("%s: not regular file nor symlink. fix."%f) os.symlink(svcmgr, f) def __str__(self): return "%s" % (Res.Resource.__str__(self)) def stop(self): pass def start(self): pass def __status(self, verbose=False): return rcStatus.UNDEF def _status(self, verbose=False): self.cluster_files() return self.__status(verbose) 07070100024531000081b40000000000000000000000014faa950900002033000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/provZone.py# # Copyright (c) 2011 Christophe Varoqui # Copyright (c) 2011 Cyril Galibern # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import resContainerZone import lock from provisioning import Provisioning from rcZfs import Dataset import rcZone from rcExceptions import excError from rcGlobalEnv import rcEnv SYSIDCFG="/etc/sysidcfg" class ProvisioningZone(Provisioning): def __init__(self, r): """ """ Provisioning.__init__(self, r) self.log = self.r.log self.section = r.svc.config.defaults() if 'container_origin' in self.section: self.container_origin = self.section['container_origin'] else: self.container_origin = "skelzone" if 'snapof' in self.section: self.snapof = self.section['snapof'] else: self.snapof = None if 'snap' in self.section: self.clone = self.section['snap'] else: self.clone = "rpool/zones/" + r.name if 'zonepath' in self.section: self.zonepath = self.section['zonepath'] else: self.zonepath = None def get_ns(self): "return (domain, nameservers) detected from resolv.conf" p = os.path.join(os.sep, 'etc', 'resolv.conf') domain = None nameservers = set() with open(p) as f: for line in f.readlines(): if 'domain' in line: l = line.split() if len(l) > 1: domain = l[1] if 'nameserver' in line: l = line.split() if len(l) > 1: nameservers.add(l[1]) if len(nameservers) > 0: return (domain, nameservers) else: return None def create_sysidcfg(self, zone=None): try: self.r.log.info("creating zone sysidcfg file") ns = self.get_ns() #if ns is None: if True: name_service = "name_service=NONE\n" else: (domain, nameservers) = ns name_service = "name_service=DNS {domain_name=%s name_server=%s}\n" % (domain, ",".join(nameservers)) sysidcfg_filename = zone.zonepath + "/root" + SYSIDCFG sysidcfg_file = open(sysidcfg_filename, "w" ) contents = "" contents += "system_locale=C\n" contents += "timezone=MET\n" contents += "terminal=vt100\n" contents += "timeserver=localhost\n" contents += "security_policy=NONE\n" contents += "root_password=NP\n" contents += "nfs4_domain=dynamic\n" contents += "network_interface=NONE {hostname=%(zonename)s}\n" % {"zonename":zone.name} contents += name_service sysidcfg_file.write(contents) sysidcfg_file.close() except Exception,e: raise(excError("exception from %s: %s during create_sysidcfg file" % (e.__class__.__name__, e.__str__()))) def zone_configure(self, zone=None): "configure zone, if zone is None, configure self.r" if zone is None: zone = self.r if zone.state is None: zone.zonecfg("create; set zonepath=" + zone.zonepath) if zone.state != "configured": raise(excError("zone %s is not configured" % (zone.name))) def create_zone2clone(self): """verify if self.container_origin zone is installed else configure container_origin if required then install container_origin if required """ zonename = self.container_origin zone2clone = resContainerZone.Zone(name=zonename) zone2clone.log = self.r.log if zone2clone.state == "installed": return self.zone_configure(zone=zone2clone) if zone2clone.state != "configured": raise(excError("zone %s is not configured" % (zonename))) zone2clone.zoneadm("install") if zone2clone.state != "installed": raise(excError("zone %s is not installed" % (zonename))) self.create_sysidcfg(zone2clone) brand = zone2clone.brand if brand == "native": zone2clone.boot_and_wait_reboot() elif brand == "ipkg": zone2clone.boot() else: raise(excError("zone brand: %s not yet implemented" % (brand))) zone2clone.wait_multi_user() zone2clone.stop() zone2clone.zone_refresh() if zone2clone.state != "installed": raise(excError("zone %s is not installed" % (zonename))) def create_cloned_zone(self): "clone zone self.r from container_origin" zone = self.r if zone.state == "running": self.log.info("zone %s already running"%zone.name) return if zone.state == "configured": zone.zoneadm("clone", [self.container_origin]) if zone.state != "installed": raise(excError("zone %s is not installed" % (zone.name))) def create_zonepath(self): """create zonepath dataset from clone of snapshot of self.snapof snapshot for self.snapof will be created then cloned to self.clone """ zonename = self.r.name source_ds = Dataset(self.snapof) if source_ds.exists(type="filesystem") is False: raise(excError("source dataset doesn't exist " + self.snapof)) snapshot = source_ds.snapshot(zonename) snapshot.clone(self.clone, ['-o', 'mountpoint=' + self.r.zonepath]) def provisioner(self, need_boot=True): """provision zone - configure zone - if snapof and zone brand is native then create zonepath from snapshot of snapof then attach zone - if snapof and zone brand is ipkg then try to detect zone associated with snapof then define container_origin - if container_origin then clone container_origin - create sysidcfg - if need_boot boot and wait multiuser """ self.zone_configure() if self.snapof is not None and self.r.brand == 'native': self.create_zonepath() self.r.zoneadm("attach", ["-F"]) elif self.snapof is not None and self.r.brand == 'ipkg': zones = rcZone.Zones() src_dataset = Dataset(self.snapof) zonepath = src_dataset.getprop('mountpoint') self.container_origin = zones.zonename_from_zonepath(zonepath).zonename self.log.info("source zone is %s (detected from snapof %s)" % (self.container_origin, self.snapof)) if self.container_origin is not None: lockname='create_zone2clone-' + self.container_origin lockfile = os.path.join(rcEnv.pathlock, lockname) self.log.info("wait get lock %s"%(lockname)) try: lockfd = lock.lock(timeout=1200, delay=5, lockfile=lockfile) except: raise(excError("failure in get lock %s"%(lockname))) try: self.create_zone2clone() except: lock.unlock(lockfd) raise lock.unlock(lockfd) self.create_cloned_zone() self.create_sysidcfg(self.r) if need_boot is True: self.r.boot() self.r.wait_multi_user() self.r.log.info("provisioned") return True 0707010002455f000081b40000000000000000000000014faa95090000069e000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/rcLoopLinux.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import re from rcGlobalEnv import * from rcUtilities import call, which import rcStatus import resLoop as Res import rcExceptions as ex def file_to_loop(f): """Given a file path, returns the loop device associated. For example, /path/to/file => /dev/loop0 """ if which('losetup') is None: return [] if not os.path.isfile(f): return [] if rcEnv.sysname != 'Linux': return [] (ret, out, err) = call(['losetup', '-j', f]) if len(out) == 0: return [] """ It's possible multiple loopdev are associated with the same file """ devs= [] for line in out.split('\n'): l = line.split(':') if len(l) == 0: continue if len(l[0]) == 0: continue if not os.path.exists(l[0]): continue devs.append(l[0]) return devs 070701000245c7000081b40000000000000000000000014faa950900000625000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/resIpLdom.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. resIpHv = __import__("resIpSunOS") import resIpVm class Ip(resIpVm.Ip, resIpHv.Ip): def __init__(self, rid=None, ipDev=None, ipName=None, mask=None, always_on=set([]), monitor=False, disabled=False, tags=set([]), optional=False): resIpVm.Ip.__init__(self, rid=rid, ipDev=ipDev, ipName=ipName, mask=mask, always_on=always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) def check_ping(self): return resIpHv.Ip.check_ping(self) if __name__ == "__main__": for c in (Ip,) : help(c) 070701000245d5000081b40000000000000000000000014faa950900001620000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/resMountFreeBSD.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import os import rcMountsFreeBSD as rcMounts import resMount as Res from rcUtilities import qcall, protected_mount, getmount from rcGlobalEnv import rcEnv import rcExceptions as ex from stat import * def try_umount(self): cmd = ['umount', self.mountPoint] (ret, out, err) = self.vcall(cmd, err_to_info=True) if ret == 0: return 0 """ don't try to kill process using the source of a protected bind mount """ if protected_mount(self.mountPoint): return 1 """ best effort kill of all processes that might block the umount operation. The priority is given to mass action reliability, ie don't contest oprator's will """ cmd = ['sync'] (ret, out, err) = self.vcall(cmd, err_to_info=True) for i in range(4): nb_killed = self.killfuser(self.mountPoint) self.log.info('umount %s'%self.mountPoint) cmd = ['umount', self.mountPoint] ret = qcall(cmd) if ret == 0 or nb_killed == 0: break if ret != 0: self.log.info("no more process using %s, yet umount fails. try forced umount."%self.mountPoint) cmd = ['umount', '-f', self.mountPoint] (ret, out, err) = self.vcall(cmd, err_to_info=True) return ret class Mount(Res.Mount): """ define FreeBSD mount/umount doAction """ def __init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size=None, always_on=set([]), disabled=False, tags=set([]), optional=False, monitor=False): self.Mounts = None Res.Mount.__init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size, always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) self.fsck_h = { 'ufs': {'bin': 'fsck', 'cmd': ['fsck', '-t', 'ufs', '-p', self.device]}, } def killfuser(self, dir): cmd = ['fuser', '-kmc', dir] (ret, out, err) = self.vcall(cmd, err_to_info=True) """ return the number of process we sent signal to """ l = out.split(':') if len(l) < 2: return 0 return len(l[1].split()) def is_up(self): self.Mounts = rcMounts.Mounts() return self.Mounts.has_mount(self.device, self.mountPoint) def realdev(self): dev = None try: mode = os.stat(self.device)[ST_MODE] except: self.log.debug("can not stat %s" % self.device) return None if S_ISCHR(mode): dev = self.device else: mnt = getmount(self.device) if self.Mounts is None: self.Mounts = rcMounts.Mounts() m = self.Mounts.has_param("mnt", mnt) if m is None: self.log.debug("can't find dev %(dev)s mounted in %(mnt)s in mnttab"%dict(mnt=mnt, dev=self.device)) return None dev = m.dev return dev def disklist(self): dev = self.realdev() if dev is None: return set([]) try: statinfo = os.stat(dev) except: self.log.error("can not stat %s" % dev) raise ex.excError return set([dev]) def can_check_writable(self): return True def start(self): if self.Mounts is None: self.Mounts = rcMounts.Mounts() Res.Mount.start(self) if self.is_up() is True: self.log.info("fs(%s %s) is already mounted"% (self.device, self.mountPoint)) return 0 self.fsck() if not os.path.exists(self.mountPoint): os.makedirs(self.mountPoint, 0755) if self.fsType != "": fstype = ['-t', self.fsType] else: fstype = [] if self.mntOpt != "": mntopt = ['-o', self.mntOpt] else: mntopt = [] cmd = ['mount']+fstype+mntopt+[self.device, self.mountPoint] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError self.Mounts = None def stop(self): if self.Mounts is None: self.Mounts = rcMounts.Mounts() if self.is_up() is False: self.log.info("fs(%s %s) is already umounted"% (self.device, self.mountPoint)) return for i in range(3): ret = try_umount(self) if ret == 0: break if ret != 0: self.log.error('failed to umount %s'%self.mountPoint) raise ex.excError self.Mounts = None if __name__ == "__main__": for c in (Mount,) : help(c) 07070100024530000081b40000000000000000000000014faa9509000006e0000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/provVgLinux.pyfrom provisioning import Provisioning import os import json import rcExceptions as ex from stat import * from rcUtilities import justcall import glob class ProvisioningVg(Provisioning): def __init__(self, r): Provisioning.__init__(self, r) self.pvs = r.svc.config.get(self.r.rid, 'pvs') self.pvs = self.pvs.split() l = [] for pv in self.pvs: l += glob.glob(pv) self.pvs = l def provisioner(self): if self.r.has_it(): self.r.log.info("already provisioned") err = False for i, pv in enumerate(self.pvs): if not os.path.exists(pv): self.r.log.error("pv %s does not exist"%pv) err |= True mode = os.stat(pv)[ST_MODE] if S_ISBLK(mode): continue elif S_ISREG(mode): cmd = ['losetup', '-j', pv] out, err, ret = justcall(cmd) if ret != 0 or not out.startswith('/dev/loop'): self.r.log.error("pv %s a regular file but not a loop"%pv) err |= True continue self.pvs[i] = out.split(':')[0] else: self.r.log.error("pv %s is not a block device nor a loop file"%pv) err |= True if err: raise ex.excError for pv in self.pvs: cmd = ['pvcreate', '-f', pv] ret, out, err = self.r.vcall(cmd) if ret != 0: raise ex.excError cmd = ['vgcreate', self.r.name] + self.pvs ret, out, err = self.r.vcall(cmd) if ret != 0: raise ex.excError self.r.log.info("provisioned") return True 07070100024534000081b40000000000000000000000014faa950900003ac6000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/rcAsset.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from rcGlobalEnv import rcEnv class Asset(object): s_config = "node configuration file" s_probe = "probe" s_default = "default" def __init__(self, node): self.node = node def get_mem_bytes(self): s = '0' source = self.s_default try: s = self.node.config.get('node', 'mem_bytes') source = self.s_config except: try: s = self._get_mem_bytes() source = self.s_probe except: pass self.print_mem_bytes(s, source) return s def print_mem_bytes(self, s, source): print "mem (%s)"%source print " %s MB"%s def get_mem_banks(self): s = '0' source = self.s_default try: s = self.node.config.get('node', 'mem_banks') source = self.s_config except: try: s = self._get_mem_banks() source = self.s_probe except: pass self.print_mem_banks(s, source) return s def print_mem_banks(self, s, source): print "mem banks (%s)"%source print " %s"%s def get_mem_slots(self): s = '0' source = self.s_default try: s = self.node.config.get('node', 'mem_slots') source = self.s_config except: try: s = self._get_mem_slots() source = self.s_probe except: pass self.print_mem_slots(s, source) return s def print_mem_slots(self, s, source): print "mem slots (%s)"%source print " %s"%s def get_os_vendor(self): s = 'Unknown' source = self.s_default try: s = self.node.config.get('node', 'os_vendor') source = self.s_config except: try: s = self._get_os_vendor() source = self.s_probe except: pass self.print_os_vendor(s, source) return s def print_os_vendor(self, s, source): print "os vendor (%s)"%source print " %s"%s def get_os_release(self): s = 'Unknown' source = self.s_default try: s = self.node.config.get('node', 'os_release') source = self.s_config except: try: s = self._get_os_release() source = self.s_probe except: pass self.print_os_release(s, source) return s def print_os_release(self, s, source): print "os release (%s)"%source print " %s"%s def get_os_kernel(self): s = 'Unknown' source = self.s_default try: s = self.node.config.get('node', 'os_kernel') source = self.s_config except: try: s = self._get_os_kernel() source = self.s_probe except: pass self.print_os_kernel(s, source) return s def print_os_kernel(self, s, source): print "os kernel (%s)"%source print " %s"%s def get_os_arch(self): s = 'Unknown' source = self.s_default try: s = self.node.config.get('node', 'os_arch') source = self.s_config except: try: s = self._get_os_arch() source = self.s_probe except: pass self.print_os_arch(s, source) return s def print_os_arch(self, s, source): print "os arch (%s)"%source print " %s"%s def get_cpu_freq(self): s = '0' source = self.s_default try: s = self.node.config.get('node', 'cpu_freq') source = self.s_config except: try: s = self._get_cpu_freq() source = self.s_probe except: pass self.print_cpu_freq(s, source) return s def print_cpu_freq(self, s, source): print "cpu freq (%s)"%source print " %s Mhz"%s def get_cpu_cores(self): s = '0' source = self.s_default try: s = self.node.config.get('node', 'cpu_cores') source = self.s_config except: try: s = self._get_cpu_cores() source = self.s_probe except: pass self.print_cpu_cores(s, source) return s def print_cpu_cores(self, s, source): print "cpu cores (%s)"%source print " %s"%s def get_cpu_dies(self): s = '0' source = self.s_default try: s = self.node.config.get('node', 'cpu_dies') source = self.s_config except: try: s = self._get_cpu_dies() source = self.s_probe except: pass self.print_cpu_dies(s, source) return s def print_cpu_dies(self, s, source): print "cpu dies (%s)"%source print " %s"%s def get_cpu_model(self): s = 'Unknown' source = self.s_default try: s = self.node.config.get('node', 'cpu_model') source = self.s_config except: try: s = self._get_cpu_model() source = self.s_probe except: pass self.print_cpu_model(s, source) return s def print_cpu_model(self, s, source): print "cpu model (%s)"%source print " %s"%s def get_serial(self): s = 'Unknown' source = self.s_default try: s = self.node.config.get('node', 'serial') source = self.s_config except: try: s = self._get_serial() source = self.s_probe except: pass self.print_serial(s, source) return s def print_serial(self, s, source): print "serial (%s)"%source print " %s"%s def get_model(self): s = 'Unknown' source = self.s_default try: s = self.node.config.get('node', 'model') source = self.s_config except: try: s = self._get_model() source = self.s_probe except: pass self.print_model(s, source) return s def print_model(self, s, source): print "model (%s)"%source print " %s"%s def get_host_mode(self): s = 'TST' source = self.s_default try: s = self.node.config.get('node', 'host_mode') source = self.s_config except: pass self.print_host_mode(s, source) return s def print_host_mode(self, s, source): print "host mode (%s)"%source print " %s"%s def get_environnement(self): s = None source = self.s_default try: s = self.node.config.get('node', 'environment') source = self.s_config except: pass self.print_environnement(s, source) return s def print_environnement(self, s, source): if s is None: return print "environment (%s)"%source print " %s"%s def get_team_responsible(self): s = None source = self.s_default try: s = self.node.config.get('node', 'team_responsible') source = self.s_config except: pass self.print_team_responsible(s, source) return s def print_team_responsible(self, s, source): if s is None: return print "team responsible (%s)"%source print " %s"%s def print_generic_cf(self, s, source, title): if s is None: return print "%s (%s)"%(title, source) print " %s"%s def get_loc_country(self): s = None source = self.s_default try: s = self.node.config.get('node', 'loc_country') source = self.s_config except: pass self.print_generic_cf(s, source, "location country") return s def get_loc_city(self): s = None source = self.s_default try: s = self.node.config.get('node', 'loc_city') source = self.s_config except: pass self.print_generic_cf(s, source, "location city") return s def get_loc_addr(self): s = None source = self.s_default try: s = self.node.config.get('node', 'loc_addr') source = self.s_config except: pass self.print_generic_cf(s, source, "location city") return s def get_loc_building(self): s = None source = self.s_default try: s = self.node.config.get('node', 'loc_building') source = self.s_config except: pass self.print_generic_cf(s, source, "location building") return s def get_loc_floor(self): s = None source = self.s_default try: s = self.node.config.get('node', 'loc_floor') source = self.s_config except: pass self.print_generic_cf(s, source, "location floor") return s def get_loc_room(self): s = None source = self.s_default try: s = self.node.config.get('node', 'loc_room') source = self.s_config except: pass self.print_generic_cf(s, source, "location room") return s def get_loc_rack(self): s = None source = self.s_default try: s = self.node.config.get('node', 'loc_rack') source = self.s_config except: pass self.print_generic_cf(s, source, "location rack") return s def get_loc_zip(self): s = None source = self.s_default try: s = self.node.config.get('node', 'loc_zip') source = self.s_config except: pass self.print_generic_cf(s, source, "location zip") return s def get_team_integ(self): s = None source = self.s_default try: s = self.node.config.get('node', 'team_integ') except: pass self.print_generic_cf(s, source, "team integration") return s def get_team_support(self): s = None source = self.s_default try: s = self.node.config.get('node', 'team_support') except: pass self.print_generic_cf(s, source, "team support") return s def get_project(self): s = None source = self.s_default try: s = self.node.config.get('node', 'project') except: pass self.print_generic_cf(s, source, "project") return s def get_hba(self): try: hba = self._get_hba() except: hba = [] self.print_hba(hba) return hba def print_hba(self, hba): print "hba (probe)" for h in hba: print " %-5s %s"%(h[1], h[0]) def get_targets(self): try: s = self._get_targets() except: s = [] self.print_targets(s) return s def print_targets(self, targets): print "paths to targets (probe)" for t in targets: print " %s - %s"%t def get_asset_dict(self): d = {} d['nodename'] = rcEnv.nodename d['os_name'] = rcEnv.sysname d['os_vendor'] = self.get_os_vendor() d['os_release'] = self.get_os_release() d['os_kernel'] = self.get_os_kernel() d['os_arch'] = self.get_os_arch() d['mem_bytes'] = self.get_mem_bytes() d['mem_banks'] = self.get_mem_banks() d['mem_slots'] = self.get_mem_slots() d['cpu_freq'] = self.get_cpu_freq() d['cpu_cores'] = self.get_cpu_cores() d['cpu_dies'] = self.get_cpu_dies() d['cpu_model'] = self.get_cpu_model() d['serial'] = self.get_serial() d['model'] = self.get_model() d['host_mode'] = self.get_host_mode() environnement = self.get_environnement() if environnement is not None: d['environnement'] = environnement loc_country = self.get_loc_country() if loc_country is not None: d['loc_country'] = loc_country loc_city = self.get_loc_city() if loc_city is not None: d['loc_city'] = loc_city loc_building = self.get_loc_building() if loc_building is not None: d['loc_building'] = loc_building loc_room = self.get_loc_room() if loc_room is not None: d['loc_room'] = loc_room loc_rack = self.get_loc_rack() if loc_rack is not None: d['loc_rack'] = loc_rack loc_addr = self.get_loc_addr() if loc_addr is not None: d['loc_addr'] = loc_addr loc_floor = self.get_loc_floor() if loc_floor is not None: d['loc_floor'] = loc_floor loc_zip = self.get_loc_zip() if loc_zip is not None: d['loc_zip'] = loc_zip team_responsible = self.get_team_responsible() if team_responsible is not None: d['team_responsible'] = team_responsible team_integ = self.get_team_integ() if team_integ is not None: d['team_integ'] = team_integ team_support = self.get_team_support() if team_support is not None: d['team_support'] = team_support project = self.get_project() if project is not None: d['project'] = project hba = self.get_hba() if hba is not None: d['hba'] = hba targets = self.get_targets() if targets is not None: d['targets'] = targets return d 070701000245d2000081b40000000000000000000000014faa9509000016fc000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resMount.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import resources as Res import os import rcExceptions as ex import rcStatus from rcGlobalEnv import rcEnv from rcUtilities import which class Mount(Res.Resource): """Define a mount resource """ def __init__(self, rid=None, mountPoint=None, device=None, fsType=None, mntOpt=None, snap_size=None, always_on=set([]), optional=False, disabled=False, tags=set([]), monitor=False): Res.Resource.__init__(self, rid=rid, type="fs", optional=optional, disabled=disabled, tags=tags, monitor=monitor) self.mountPoint = mountPoint self.device = device self.fsType = fsType self.mntOpt = mntOpt self.snap_size = snap_size self.always_on = always_on self.label = device + '@' + mountPoint self.fsck_h = {} self.testfile = os.path.join(mountPoint, '.opensvc') self.netfs = ['nfs', 'nfs4', 'cifs', 'smbfs', '9pfs', 'gpfs', 'afs', 'ncpfs'] def start(self): if self.fsType in ["zfs"] + self.netfs: return None if not os.path.exists(self.device): self.log.error("device does not exist %s" % self.device) raise ex.excError if not os.path.exists(self.mountPoint): try: os.makedirs(self.mountPoint) except: self.log.info("failed to create missing mountpoint %s" % self.mountPoint) raise self.log.info("create missing mountpoint %s" % self.mountPoint) def startstandby(self): if rcEnv.nodename in self.always_on: self.start() def fsck(self): if self.fsType not in self.fsck_h: self.log.info("fsck not implemented for %s"%self.fsType) return bin = self.fsck_h[self.fsType]['bin'] if which(bin) is None: self.log.warning("%s not found. bypass."%self.fsType) return if self.fsck_h[self.fsType].has_key('reportcmd'): cmd = self.fsck_h[self.fsType]['reportcmd'] (ret, out, err) = self.vcall(cmd, err_to_info=True) if ret not in self.fsck_h[self.fsType]['reportclean']: return cmd = self.fsck_h[self.fsType]['cmd'] (ret, out, err) = self.vcall(cmd) if 'allowed_ret' in self.fsck_h[self.fsType]: allowed_ret = self.fsck_h[self.fsType]['allowed_ret'] else: allowed_ret = [0] if ret not in allowed_ret: raise ex.excError def need_check_writable(self): if 'ro' in self.mntOpt.split(','): return False if self.fsType in self.netfs: return False return True def can_check_writable(self): """ orverload in child classes to check os-specific conditions when a write test might hang (solaris lockfs, linux multipath with queueing on and no active path) """ return True def check_writable(self): if not self.can_check_writable(): return False try: f = open(self.testfile, 'w') f.write(' ') f.close() except IOError, e: if e.errno == 28: self.log.error('No space left on device. Invalidate writable test.') return True return False except: return False return True def _status(self, verbose=False): if rcEnv.nodename in self.always_on: if self.is_up(): if self.need_check_writable() and not self.check_writable(): self.status_log("fs is not writable") return rcStatus.WARN return rcStatus.STDBY_UP else: return rcStatus.STDBY_DOWN else: if self.is_up(): if self.need_check_writable() and not self.check_writable(): self.status_log("fs is not writable") return rcStatus.WARN return rcStatus.UP else: return rcStatus.DOWN def devlist(self): return set([self.device]) def __str__(self): return "%s mnt=%s dev=%s fsType=%s mntOpt=%s" % (Res.Resource.__str__(self),\ self.mountPoint, self.device, self.fsType, self.mntOpt) def __cmp__(self, other): """order so that deepest mountpoint can be umount first """ return cmp(self.mountPoint, other.mountPoint) def provision(self): t = self.fsType[0].upper()+self.fsType[1:].lower() m = __import__("provFs"+t) prov = getattr(m, "ProvisioningFs"+t)(self) prov.provisioner() if __name__ == "__main__": for c in (Mount,) : help(c) print """ m=Mount("/mnt1","/dev/sda1","ext3","rw") """ m=Mount("/mnt1","/dev/sda1","ext3","rw") print "show m", m 070701000245db000081b40000000000000000000000014faa9509000013bc000000ae00010002ffffffffffffffff0000002b00000000root/opt/opensvc/lib/resScsiReservLinux.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import resources as Res import uuid import re import time import rcStatus import rcExceptions as ex from rcUtilities import which from subprocess import * import resScsiReserv from rcGlobalEnv import rcEnv class ScsiReserv(resScsiReserv.ScsiReserv): def scsireserv_supported(self): if which('sg_persist') is None: self.log.debug("sg_persist must be installed to use scsi-3 reservations" ) return False return True def ack_unit_attention(self, d): i = self.preempt_timeout while i>0: i -= 1 cmd = [ 'sg_persist', '-n', '-r', d ] p = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) out = p.communicate() ret = p.returncode if "unsupported service action" in out[1]: self.log.error("disk %s does not support persistent reservation" % d) raise ex.excScsiPrNotsupported if "Unit Attention" in out[0] or ret != 0: self.log.debug("disk %s reports 'Unit Attention' ... waiting" % d) time.sleep(1) continue break if i == 0: self.log.error("timed out waiting for 'Unit Attention' to go away on disk %s" % d) return 1 return 0 def disk_registered(self, disk): cmd = [ 'sg_persist', '-n', '-k', disk ] (ret, out, err) = self.call(cmd) if ret != 0: self.log.error("failed to read registrations for disk %s" % disk) if self.hostid in out: return True return False def disk_register(self, disk): cmd = [ 'sg_persist', '-n', '--out', '--register-ignore', '--param-sark='+self.hostid, disk ] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("failed to register key %s with disk %s" % (self.hostid, disk)) return ret def disk_unregister(self, disk): cmd = [ 'sg_persist', '-n', '--out', '--register-ignore', '--param-rk='+self.hostid, disk ] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("failed to unregister key %s with disk %s" % (self.hostid, disk)) return ret def get_reservation_key(self, disk): cmd = [ 'sg_persist', '-n', '-r', disk ] (ret, out, err) = self.call(cmd) if ret != 0: self.log.error("failed to list reservation for disk %s" % disk) if 'Key=' not in out: return None for w in out.split(): if 'Key=' in w: return w.split('=')[1] raise Exception() def disk_reserved(self, disk): cmd = [ 'sg_persist', '-n', '-r', disk ] (ret, out, err) = self.call(cmd) if ret != 0: self.log.error("failed to read reservation for disk %s" % disk) if self.hostid in out: return True return False def disk_release(self, disk): cmd = [ 'sg_persist', '-n', '--out', '--release', '--param-rk='+self.hostid, '--prout-type='+self.prtype, disk ] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("failed to release disk %s" % disk) return ret def disk_reserve(self, disk): cmd = [ 'sg_persist', '-n', '--out', '--reserve', '--param-rk='+self.hostid, '--prout-type='+self.prtype, disk ] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("failed to reserve disk %s" % disk) return ret def _disk_preempt_reservation(self, disk, oldkey): m = __import__("rcDiskInfo"+rcEnv.sysname) if m.diskInfo().disk_vendor(disk).strip() in ["VMware"] or self.no_preempt_abort: preempt_opt = '--preempt' else: preempt_opt = '--preempt-abort' cmd = [ 'sg_persist', '-n', '--out', preempt_opt, '--param-sark='+oldkey, '--param-rk='+self.hostid, '--prout-type='+self.prtype, disk ] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("failed to preempt reservation for disk %s" % disk) return ret 070701000245ad000081b40000000000000000000000014faa9509000016c7000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/resContainer.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcStatus import resources as Res import time import rcExceptions as ex from rcUtilities import qcall from rcGlobalEnv import rcEnv import socket class Container(Res.Resource): """ in seconds """ startup_timeout = 600 shutdown_timeout = 60 def __init__(self, name, rid=None, type=None, optional=False, disabled=False, monitor=False, tags=set([])): Res.Resource.__init__(self, rid=rid, type=type, optional=optional, disabled=disabled, monitor=monitor, tags=tags) self.sshbin = '/usr/bin/ssh' self.name = name self.label = name def getaddr(self): if hasattr(self, 'addr'): return try: a = socket.getaddrinfo(self.name, None) if len(a) == 0: raise Exception self.addr = a[0][4][0] except: if not disabled: raise ex.excInitError def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def operational(self): if self.svc.guestos == "Windows": """ Windows has no sshd. """ return True timeout = 1 cmd = [ self.sshbin, '-o', 'StrictHostKeyChecking=no', '-o', 'ForwardX11=no', '-o', 'BatchMode=yes', '-n', '-o', 'ConnectTimeout='+repr(timeout), self.name, 'pwd'] ret = qcall(cmd) if ret == 0: return True return False def wait_for_fn(self, fn, tmo, delay): for tick in range(tmo//2): if fn(): return time.sleep(delay) self.log.error("Waited too long for startup") raise ex.excError def wait_for_startup(self): self.log.info("wait for container up status") self.wait_for_fn(self.is_up, self.startup_timeout, 2) if hasattr(self, 'ping'): self.log.info("wait for container ping") self.wait_for_fn(self.ping, self.startup_timeout, 2) self.log.info("wait for container operational") self.wait_for_fn(self.operational, self.startup_timeout, 2) def wait_for_shutdown(self): self.log.info("wait for container down status") for tick in range(self.shutdown_timeout): if self.is_down(): return time.sleep(1) self.log.error("Waited too long for shutdown") raise ex.excError def install_drp_flag(self): print "TODO: install_drp_flag()" def start(self): try: self.getaddr() except: self.log.error("could not resolve %s to an ip address"%self.name) raise ex.excError if self.is_up(): self.log.info("container %s already started" % self.name) return if rcEnv.nodename in self.svc.drpnodes: self.install_drp_flag() self.container_start() self.wait_for_startup() def stop(self): try: self.getaddr() except: self.log.error("could not resolve %s to an ip address"%self.name) raise ex.excError if self.is_down(): self.log.info("container %s already stopped" % self.name) return self.container_stop() try: self.wait_for_shutdown() except ex.excError: self.container_forcestop() self.wait_for_shutdown() def check_capabilities(self): #print "TODO: check_capabilities(self)" pass def container_start(self): print "TODO: container_start(self)" def container_stop(self): print "TODO: container_stop(self)" def container_forcestop(self): print "TODO: container_forcestop(self)" def check_manual_boot(self): print "TODO: check_manual_boot(self)" return False def is_up(self): return False def is_down(self): return not self.is_up() def _status(self, verbose=False): try: self.getaddr() except: self.status_log("could not resolve %s to an ip address"%self.name) return rcStatus.WARN if not self.check_capabilities(): self.status_log("node capabilities do not permit this action") return rcStatus.WARN if not self.check_manual_boot(): self.status_log("container auto boot is on") return rcStatus.WARN if self.is_up(): return rcStatus.UP if self.is_down(): return rcStatus.DOWN else: self.status_log("container status is neither up nor down") return rcStatus.WARN def get_container_info(self): print "TODO: get_container_info(self)" return {'vcpus': '0', 'vmem': '0'} 070701000245a3000081b40000000000000000000000014faa950900000124000000ae00010002ffffffffffffffff0000002b00000000root/opt/opensvc/lib/rcUtilitiesFreeBSD.pyfrom rcUtilities import call def check_ping(addr, timeout=5, count=1): if ':' in addr: cmd = ['ping6'] else: cmd = ['ping', '-W', str(timeout)] cmd += ['-c', repr(count), addr] (ret, out, err) = call(cmd) if ret == 0: return True return False 070701000245ee000081b40000000000000000000000014faa950900001454000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/resVgHpVm.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import re import os import rcExceptions as ex import rcStatus resVg = __import__("resVgHP-UX") from subprocess import * from rcUtilities import qcall from rcGlobalEnv import rcEnv from subprocess import * class Vg(resVg.Vg): def __init__(self, rid=None, name=None, type=None, optional=False, disabled=False, tags=set([]), monitor=False): self.label = name resVg.Vg.__init__(self, rid=rid, name=name, type='disk.vg', monitor=monitor, optional=optional, disabled=disabled, tags=tags) def has_it(self): return True def is_up(self): return True def _status(self, verbose=False): return rcStatus.NA def do_start(self): self.do_mksf() def do_stop(self): pass def files_to_sync(self): return [self.sharefile_name(), self.mkfsfile_name()] def postsync(self): s = self.svc.group_status(excluded_groups=set(["sync", "hb"])) if s['overall'].status != rcStatus.UP: self.do_mksf() self.do_share() def presync(self): s = self.svc.group_status(excluded_groups=set(["sync", "hb"])) if self.svc.force or s['overall'].status == rcStatus.UP: self.write_mksf() self.write_share() def sharefile_name(self): return os.path.join(rcEnv.pathvar, 'vg_' + self.svc.svcname + '_' + self.name + '.share') def get_devs(self): cmd = ['/opt/hpvm/bin/hpvmdevmgmt', '-l', 'all'] (ret, buff, err) = self.call(cmd) if ret != 0: raise ex.excError if len(buff) == 0: return [] a = {} for line in buff.split('\n'): if len(line) == 0: continue if "DEVTYPE=FILE" not in line and "DEVTYPE=DISK" not in line: continue if "SHARE=YES" in line: share = "YES" else: share = "NO" devs = line.split(":")[0] for dev in devs.split(","): a[dev] = {'share': share} return a def write_share(self): devs = self.get_devs() disklist = self.disklist() with open(self.sharefile_name(), 'w') as f: for dev in devs: if dev not in disklist: continue f.write("%s:%s\n"%(dev, devs[dev]['share'])) def do_share(self): if not os.path.exists(self.sharefile_name()): return devs = self.get_devs() errors = 0 with open(self.sharefile_name(), 'r') as f: for line in f.readlines(): l = line.split(':') if len(l) != 2: continue dev = l[0] share = l[1].strip() if len(dev) == 0: continue if not os.path.exists(dev): continue if dev not in devs: cmd = ['/opt/hpvm/bin/hpvmdevmgmt', '-a', 'gdev:'+dev] (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("error adding device %s hpvm device table"%dev) raise ex.excError if dev in devs and share == devs[dev]['share']: self.log.debug("skip set sharing of %s: already set to %s"%(dev, devs[dev]['share'])) continue cmd = ['/opt/hpvm/bin/hpvmdevmgmt', '-m', 'gdev:'+dev+':attr:SHARE='+share] (ret, buff, err) = self.vcall(cmd) if ret != 0: self.log.error("error setting the shared attribute for %s"%dev) errors += 1 continue if errors > 0: raise ex.excError def disklist(self): cmd = ['/opt/hpvm/bin/hpvmstatus', '-d', '-P', self.svc.vmname] p = Popen(cmd, stdout=PIPE, stderr=PIPE, close_fds=True) buff = p.communicate() if p.returncode != 0: raise ex.excError for line in buff[0].split('\n'): l = line.split(':') if len(l) < 5: continue if l[3] != 'disk': continue self.disks |= set([l[4]]) return self.disks 07070100024602000081b40000000000000000000000014faa9509000005c9000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/svcEsx.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc import resContainerEsx as esx from rcGlobalEnv import rcEnv class SvcEsx(svc.Svc): """ Define Esx services""" def __init__(self, svcname, vmname=None, guestos=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmname = vmname self.guestos = guestos self += esx.Esx(vmname, disabled=disabled) self.runmethod = rcEnv.rsh.split() + [vmname] def _migrate(self): self.sub_set_action("container.esx", "_migrate") 070701000245fd000081b40000000000000000000000014faa950900000df1000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/snapVxfsHP-UX.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcGlobalEnv import rcEnv from rcUtilities import which, qcall, protected_mount import rcExceptions as ex import snap class Snap(snap.Snap): def lv_exists(self, device): if qcall(['lvdisplay', device]) == 0: return True return False def lv_info(self, device): (ret, buff, err) = self.call(['lvdisplay', device]) if ret != 0: return (None, None, None) vg_name = None lv_name = None lv_size = 0 for line in buff.split('\n'): if "VG Name" in line: vg_name = line.split()[-1] if "LV Name" in line: lv_name = line.split()[-1] if "LV Size" in line: lv_size = int(line.split()[-1]) return (vg_name, lv_name, lv_size) def snapcreate(self, m): snap_name = '' snap_mnt = '' (vg_name, lv_name, lv_size) = self.lv_info(m.device) if lv_name is None: self.log.error("can not snap %s: not a logical volume"%m.device) raise ex.syncNotSnapable snap_name = 'osvc_sync_'+os.path.basename(lv_name) if self.lv_exists(os.path.join(vg_name, snap_name)): self.log.error("snap of %s already exists"%(lv_name)) raise ex.syncSnapExists (ret, buff, err) = self.vcall(['lvcreate', '-L', str(lv_size//10)+'M', '-n', snap_name, vg_name]) if ret != 0: raise ex.syncSnapCreateError snap_mnt = '/service/tmp/osvc_sync_'+os.path.basename(vg_name)+'_'+os.path.basename(lv_name) if not os.path.exists(snap_mnt): os.makedirs(snap_mnt, 0755) snap_dev = os.path.join(vg_name, snap_name) (ret, buff, err) = self.vcall(['mount', '-F', 'vxfs', '-o', 'ro,snapof='+m.device, snap_dev, snap_mnt]) if ret != 0: raise ex.syncSnapMountError self.snaps[m.mountPoint] = dict(lv_name=lv_name, vg_name=vg_name, snap_name=snap_name, snap_mnt=snap_mnt, snap_dev=snap_dev) def snapdestroykey(self, s): if protected_mount(self.snaps[s]['snap_mnt']): self.log.error("the snapshot is no longer mounted in %s. panic."%self.snaps[s]['snap_mnt']) raise ex.excError """ fuser on HP-UX outs to stderr ... """ cmd = ['fuser', '-kc', self.snaps[s]['snap_mnt']] ret = qcall(cmd) cmd = ['umount', self.snaps[s]['snap_mnt']] (ret, out, err) = self.vcall(cmd) cmd = ['lvremove', '-f', self.snaps[s]['snap_dev']] (ret, buff, err) = self.vcall(cmd) 070701000245aa000081b40000000000000000000000014faa950900000ee8000000ae00010002ffffffffffffffff0000001f00000000root/opt/opensvc/lib/rcZone.py# # Copyright (c) 2011 Christophe Varoqui # Copyright (c) 2011 Cyril Galibern # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcZfs import Dataset from rcUtilities import justcall ZONEADM="/usr/sbin/zoneadm" class Zones(object): """Define zones (a.k.a. container) defined on a node""" def __init__(self): """scan node to get informations about its zones """ self.zone_list = [] self.zonename2zone = dict() self.zonepath2zone = dict() cmd = [ZONEADM, 'list', '-cip'] (out, err, status) = justcall(cmd) if status == 0: #zoneid:zonename:state:zonepath:uuid:brand:ip-type for zoneadm_line in out.split('\n'): v = zoneadm_line.split(':') if len(v) != 7: continue zone = Zone(zoneid=v[0], zonename=v[1], state=v[2], zonepath=v[3], uuid=v[4], brand=v[5], ip_type=v[6]) self.zonename2zone[zone.zonename] = zone self.zonepath2zone[zone.zonepath] = zone self.zone_list.append(zone) def refresh(self): """refresh zones information""" self.__init__() def zonename_from_zonepath(self, zonepath=None): """return zonename associated with zonepath, else return None""" if zonepath in self.zonepath2zone: return self.zonepath2zone[zonepath] else: return None class Zone(object): def __init__(self, zoneid=None, zonename=None, state=None, zonepath=None, uuid=None, brand=None, ip_type=None ): """define Zone object attribute from zoneadm output line zoneid:zonename:state:zonepath:uuid:brand:ip-type """ if state is None and zonename is not None: self.zonename = zonename self.refresh() else: self.zoneid = zoneid self.zonename = zonename self.state = state self.zonepath = zonepath self.uuid = uuid self.brand = brand self.ip_type = ip_type def refresh(self): """refresh zone information""" cmd = [ZONEADM, '-z', self.zonename, 'list', '-p'] (out, err, status) = justcall(cmd) if status == 0: (self.zoneid, self.zonename, self.state, self.zonepath, self.uuid, self.brand, self.ip_type ) = out.split('\n')[0].split(':') else: print "fail to refresh zone informations for zonename", self.zonename if __name__ == "__main__": zones = Zones() print "Detected %s zones on system" % (len(zones.zone_list)) for zone in zones.zone_list: zonepath = zone.zonepath zonename = zone.zonename print "zonename=%s zonepath=%s zones.zonepath2zone[%s].zonename=%s" % ( zonename, zonepath, zonepath, zones.zonepath2zone[zonepath].zonename ) z = Zone(zonename=zonename) print "zone %s : zoneid=%s, zonepath=%s brand=%s" % (zonename, z.zoneid, z.zonepath, z.brand) 070701000245ae000081b40000000000000000000000014faa95090000103d000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/resContainerEsx.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import resources as Res import os import rcExceptions as ex import resContainer from rcUtilities import which rcU = __import__("rcUtilities" + os.uname()[0]) class Esx(resContainer.Container): startup_timeout = 180 shutdown_timeout = 120 def __init__(self, name, optional=False, disabled=False, monitor=False, tags=set([])): resContainer.Container.__init__(self, rid="esx", name=name, type="container.esx", optional=optional, disabled=disabled, monitor=monitor, tags=tags) self.vmx = None def __str__(self): return "%s name=%s" % (Res.Resource.__str__(self), self.name) def vmcmd(self, l, verbose=False): self.find_vmx() if verbose: ret, out, err = self.vcall(['vmware-cmd', self.vmx] + l) else: ret, out, err = self.call(['vmware-cmd', self.vmx] + l) return ret, out, err def list_conffiles(self): return [] def files_to_sync(self): return self.list_conffiles() def check_capabilities(self): return which('vmware-cmd') def ping(self): return rcU.check_ping(self.addr, timeout=1, count=1) def find_vmx(self): if self.vmx is not None: return self.vmx cmd = ['vmware-cmd', '-l'] ret, out, err = self.call(cmd) if ret != 0: raise ex.excError l = out.split() pattern = '/'+self.name+'.vmx' for vmx in l: if pattern in vmx: self.vmx = vmx if self.vmx is None: self.log.error("vm %s not found on this node"%self.name) raise ex.excError return self.vmx def _migrate(self): print "TODO" pass def container_start(self): cmd = ['start'] ret, buff, err = self.vmcmd(cmd, verbose=True) if ret != 0: raise ex.excError def container_stop(self): cmd = ['stop', 'soft'] ret, buff, err = self.vmcmd(cmd, verbose=True) if ret != 0: raise ex.excError def container_forcestop(self): cmd = ['stop', 'hard'] ret, buff, err = self.vmcmd(cmd, verbose=True) if ret != 0: raise ex.excError def is_up(self): try: (ret, out, err) = self.vmcmd(['getstate']) except: return False if ret != 0: return False l = out.split() if len(l) != 3: return False if l[-1] == 'on': return True return False def getconfig(self, key): cmd = ['getconfig', key] ret, out, err = self.vmcmd(cmd) if ret != 0: return None l = out.split() if len(l) != 3: return None return l[-1] def get_container_info(self): self.info = {'vcpus': '0', 'vmem': '0'} try: self.info['vcpus'] = self.getconfig('numvcpus') except: self.info['vcpus'] = '0' try: self.info['vmem'] = self.getconfig('memsize') except: self.info['vmem'] = '0' return self.info def check_manual_boot(self): """ ESX will handle the vm startup itself """ return True 070701000245ff000081b40000000000000000000000014faa95090000c01d000000ae00010002ffffffffffffffff0000001c00000000root/opt/opensvc/lib/svc.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. from resources import Resource, ResourceSet from freezer import Freezer import rcStatus from rcGlobalEnv import rcEnv import rcExceptions as ex import xmlrpcClient import os import signal import lock import rcLogger import logging import datetime import node def signal_handler(signum, frame): raise ex.excSignal def dblogger(self, action, begin, end, actionlogfile, sync=False): self.node.collector.call('end_action', self, action, begin, end, actionlogfile, sync=sync) g_vars, g_vals, r_vars, r_vals = self.svcmon_push_lists() self.node.collector.call('svcmon_update_combo', g_vars, g_vals, r_vars, r_vals, sync=sync) os.unlink(actionlogfile) try: logging.shutdown() except: pass class Options(object): def __init__(self): self.cron = False self.force = False self.debug = False self.moduleset = "" self.module = "" self.ruleset_date = "" os.environ['LANG'] = 'C' class Svc(Resource, Freezer): """Service class define a Service Resource It contain list of ResourceSet where each ResourceSets contain same resource type """ def __init__(self, svcname=None, type="hosted", optional=False, disabled=False, tags=set([])): """usage : aSvc=Svc(type)""" self.options = Options() self.node = None self.ha = False self.sync_dblogger = False self.svcname = svcname self.vmname = "" self.containerize = True self.hostid = rcEnv.nodename self.resSets = [] self.type2resSets = {} self.disks = set([]) self.cron = False self.force = False self.cluster = False self.pathenv = os.path.join(rcEnv.pathetc, self.svcname+'.env') self.push_flag = os.path.join(rcEnv.pathvar, svcname+'.push') self.status_types = ["container.hpvm", "container.kvm", "container.xen", "container.esx", "container.ovm", "container.lxc", "container.vz", "container.zone", "container.jail", "container.ldom", "container.vbox", "disk.drbd", "disk.loop", "disk.scsireserv", "disk.vg", "disk.zpool", "fs", "ip", "sync.rsync", "sync.symclone", "sync.evasnap", "sync.dcssnap", "sync.dcsckpt", "sync.dds", "sync.zfs", "sync.netapp", "sync.nexenta", "app", "hb.openha", "hb.ovm", "hb.linuxha"] Resource.__init__(self, type=type, optional=optional, disabled=disabled, tags=tags) self.log = rcLogger.initLogger(self.svcname.upper()) Freezer.__init__(self, svcname) self.scsirelease = self.prstop self.scsireserv = self.prstart self.scsicheckreserv = self.prstatus self.runmethod = [] self.resources_by_id = {} self.rset_status_cache = None self.print_status_fmt = "%-14s %-8s %s" self.presync_done = False self.presnap_trigger = None self.postsnap_trigger = None self.lockfd = None self.action_start_date = datetime.datetime.now() self.monitor_action = None self.group_status_cache = None def __cmp__(self, other): """order by service name """ return cmp(self.svcname, other.svcname) def __iadd__(self, r): """svc+=aResourceSet svc+=aResource """ if r.type in self.type2resSets: self.type2resSets[r.type] += r elif isinstance(r, ResourceSet): self.resSets.append(r) self.type2resSets[r.type] = r elif isinstance(r, Resource): R = ResourceSet(r.type, [r]) self.__iadd__(R) else: # Error pass if isinstance(r, Resource): self.resources_by_id[r.rid] = r if r.rid in rcEnv.vt_supported: self.resources_by_id["container"] = r r.svc = self import logging if r.rid is not None: r.log = logging.getLogger(str(self.svcname+'.'+str(r.rid)).upper()) else: r.log = logging.getLogger(str(self.svcname+'.'+str(r.type)).upper()) if r.type.startswith("hb"): self.ha = True if hasattr(r, "on_add"): r.on_add() return self def svclock(self, action=None, timeout=30, delay=5): suffix = None list_actions_no_pre_action = [ 'push', 'push_appinfo', 'print_status', 'status', 'freeze', 'frozen', 'thaw', 'freezestop', 'print_disklist', 'json_status', 'json_disklist' ] if action in list_actions_no_pre_action: # no need to serialize this action return if action.startswith("collector"): # no need to serialize collector gets return if action.startswith("compliance"): # compliance modules are allowed to execute actions on the service # so give them their own lock suffix = "compliance" if self.lockfd is not None: # already acquired return lockfile = os.path.join(rcEnv.pathlock, self.svcname) if suffix is not None: lockfile = ".".join((lockfile, suffix)) try: lockfd = lock.lock(timeout=timeout, delay=delay, lockfile=lockfile) except lock.lockTimeout: self.log.error("timed out waiting for lock") raise ex.excError except lock.lockNoLockFile: self.log.error("lock_nowait: set the 'lockfile' param") raise ex.excError except lock.lockCreateError: self.log.error("can not create lock file %s"%lockfile) raise ex.excError except lock.lockAcquire as e: self.log.warn("another action is currently running (pid=%s)"%e.pid) raise ex.excError except ex.excSignal: self.log.error("interrupted by signal") raise ex.excError except: self.log.error("unexpected locking error") import traceback traceback.print_exc() raise ex.excError if lockfd is not None: self.lockfd = lockfd def svcunlock(self): lock.unlock(self.lockfd) self.lockfd = None def setup_signal_handlers(self): signal.signal(signal.SIGINT, signal_handler) signal.signal(signal.SIGTERM, signal_handler) def get_res_sets(self, type): if not isinstance(type, list): l = [type] else: l = type rsets = [] for t in l: rsets += [ r for r in self.resSets if r.type == t ] return rsets def has_res_set(self, type): if len(self.get_res_sets(type)) > 0: return True else: return False def all_set_action(self, action=None, tags=set([])): """Call action on each member of the subset of specified type """ self.set_action(self.resSets, action=action, tags=tags) def sub_set_action(self, type=None, action=None, tags=set([])): """Call action on each member of the subset of specified type """ self.set_action(self.get_res_sets(type), action=action, tags=tags) def need_snap_trigger(self, sets, action): if action not in ["syncnodes", "syncdrp", "syncresync", "syncupdate"]: return False for rs in sets: for r in rs.resources: """ avoid to run pre/post snap triggers when there is no resource flagged for snap and on drpnodes """ if hasattr(r, "snap") and r.snap is True and \ rcEnv.nodename in self.nodes: return True return False def set_action(self, sets=[], action=None, tags=set([])): """ TODO: r.is_optional() not doing what's expected if r is a rset """ list_actions_no_pre_action = [ "status", "print_status", "print_disklist", "push_appinfo", "push", "json_status", "json_disklist", "group_status", "presync", "postsync", "freezestop", "resource_monitor" ] list_actions_no_post_action = list_actions_no_pre_action ns = self.need_snap_trigger(sets, action) """ snapshots are created in pre_action and destroyed in post_action place presnap and postsnap triggers around pre_action """ if ns and self.presnap_trigger is not None: (ret, out, err) = self.vcall(self.presnap_trigger) if ret != 0: raise ex.excError for r in sets: if action in list_actions_no_pre_action: break try: r.log.debug("start %s pre_action"%r.type) r.pre_action(r, action) except ex.excError: if r.is_optional(): pass else: raise except ex.excAbortAction: if r.is_optional(): pass else: break except: self.save_exc() raise ex.excError if ns and self.postsnap_trigger is not None: (ret, out, err) = self.vcall(self.postsnap_trigger) if ret != 0: raise ex.excError for r in sets: self.log.debug('set_action: action=%s rset=%s'%(action, r.type)) try: r.action(action, tags=tags) except ex.excError: if r.is_optional(): pass else: raise except ex.excAbortAction: if r.is_optional(): pass else: break for r in sets: if action in list_actions_no_post_action: break try: r.post_action(r, action) except ex.excError: if r.is_optional(): pass else: raise ex.excError except ex.excAbortAction: if r.is_optional(): pass else: break except: self.save_exc() raise ex.excError def __str__(self): output="Service %s available resources:" % (Resource.__str__(self)) for k in self.type2resSets.keys() : output += " %s" % k output+="\n" for r in self.resSets: output+= " [%s]" % (r.__str__()) return output def status(self): """aggregate status a service """ ss = rcStatus.Status() for r in self.get_res_sets(self.status_types): if "sync." not in r.type: ss += r.status() else: """ sync are expected to be up """ s = r.status() if s == rcStatus.UP: ss += rcStatus.UNDEF elif s in [rcStatus.NA, rcStatus.UNDEF, rcStatus.TODO]: ss += s else: ss += rcStatus.WARN if ss.status == rcStatus.STDBY_UP_WITH_UP: ss.status = rcStatus.UP elif ss.status == rcStatus.STDBY_UP_WITH_DOWN: ss.status = rcStatus.STDBY_UP return ss.status def json_status(self): import json d = { 'resources': {}, } for rs in self.get_res_sets(self.status_types): for r in [_r for _r in rs.resources]: rid, status, label, log, monitor, disable, optional = r.status_quad() d['resources'][rid] = {'status': status, 'label': label, 'log':log, 'monitor':monitor, 'disable': disable, 'optional': optional} ss = self.group_status() for g in ss: d[g] = str(ss[g]) print json.dumps(d) def print_status(self): """print each resource status for a service """ from textwrap import wrap def print_res(e, fmt, pfx): rid, status, label, log, monitor, disabled, optional = e flags = '' flags += 'M' if monitor else '.' flags += 'D' if disabled else '.' flags += 'O' if optional else '.' print fmt%(rid, flags, status, label) if len(log) > 0: print '\n'.join(wrap(log, initial_indent = pfx, subsequent_indent = pfx, width=78 ) ) print self.svcname fmt = "%-20s %4s %-8s %s" print fmt%("overall", '', str(self.group_status()['overall']), "\n"), fmt = "|- %-17s %4s %-8s %s" print fmt%("avail", '', str(self.group_status()['avail']), "\n"), l = [] for rs in self.get_res_sets(self.status_types): for r in [_r for _r in rs.resources if not _r.rid.startswith('sync') and not _r.rid.startswith('hb')]: l.append(r.status_quad()) last = len(l) - 1 if last >= 0: for i, e in enumerate(l): if i == last: fmt = "| '- %-14s %4s %-8s %s" pfx = "| %-14s %4s %-8s "%('','','') print_res(e, fmt, pfx) else: fmt = "| |- %-14s %4s %-8s %s" pfx = "| | %-14s %4s %-8s "%('','','') print_res(e, fmt, pfx) fmt = "|- %-17s %4s %-8s %s" print fmt%("sync", '', str(self.group_status()['sync']), "\n"), l = [] for rs in self.get_res_sets(self.status_types): for r in [_r for _r in rs.resources if _r.rid.startswith('sync')]: l.append(r.status_quad()) last = len(l) - 1 if last >= 0: for i, e in enumerate(l): if i == last: fmt = "| '- %-14s %4s %-8s %s" pfx = "| %-14s %4s %-8s "%('','','') print_res(e, fmt, pfx) else: fmt = "| |- %-14s %4s %-8s %s" pfx = "| | %-14s %4s %-8s "%('','','') print_res(e, fmt, pfx) fmt = "'- %-17s %4s %-8s %s" print fmt%("hb", '', str(self.group_status()['hb']), "\n"), l = [] for rs in self.get_res_sets(self.status_types): for r in [_r for _r in rs.resources if _r.rid.startswith('hb')]: l.append(r.status_quad()) last = len(l) - 1 if last >= 0: for i, e in enumerate(l): if i == last: fmt = " '- %-14s %4s %-8s %s" pfx = " %-14s %4s %-8s "%('','','') print_res(e, fmt, pfx) else: fmt = " |- %-14s %4s %-8s %s" pfx = " | %-14s %4s %-8s "%('','','') print_res(e, fmt, pfx) def svcmon_push_lists(self, status=None): if status is None: status = self.group_status() if self.frozen(): frozen = "1" else: frozen = "0" r_vars=["svcname", "nodename", "rid", "res_desc", "res_status", "updated", "res_log"] r_vals = [] import datetime now = datetime.datetime.now() for rs in self.resSets: for r in rs.resources: r_vals.append([repr(self.svcname), repr(rcEnv.nodename), repr(r.rid), repr(r.label), repr(rcStatus.status_str(r.rstatus)), repr(str(now)), r.status_log_str]) g_vars=["mon_svcname", "mon_svctype", "mon_nodname", "mon_nodtype", "mon_ipstatus", "mon_diskstatus", "mon_syncstatus", "mon_hbstatus", "mon_containerstatus", "mon_fsstatus", "mon_appstatus", "mon_availstatus", "mon_overallstatus", "mon_updated", "mon_prinodes", "mon_frozen"] g_vals=[self.svcname, self.svctype, rcEnv.nodename, rcEnv.host_mode, str(status["ip"]), str(status["disk"]), str(status["sync"]), str(status["hb"]), str(status["container"]), str(status["fs"]), str(status["app"]), str(status["avail"]), str(status["overall"]), str(now), ' '.join(self.nodes), frozen] return g_vars, g_vals, r_vars, r_vals def get_rset_status(self, groups): self.setup_environ() rset_status = {} for t in self.status_types: g = t.split('.')[0] if g not in groups: continue for rs in self.get_res_sets(t): rset_status[rs.type] = rs.status() return rset_status def resource_monitor(self): if self.group_status_cache is None: self.group_status(excluded_groups=set(['sync'])) has_hb = False for rs in self.get_res_sets(['hb.ovm', 'hb.openha', 'hb.linuxha']): for r in rs.resources: if not r.disabled: has_hb = True if not has_hb: self.log.debug("no active heartbeat resource. no need to check monitored resources.") return hb_status = self.group_status_cache['hb'] if hb_status.status != rcStatus.UP: self.log.debug("heartbeat status is not up. no need to check monitored resources.") return monitored_resources = [] for rs in self.resSets: for r in rs.resources: if r.monitor: monitored_resources.append(r) if len(monitored_resources) == 0: self.log.debug("no monitored resource") return for r in monitored_resources: if r.rstatus != rcStatus.UP: if self.monitor_action is not None and \ hasattr(self, self.monitor_action): if len(r.status_log_str) > 0: rstatus_log = ''.join((' ', '(', r.status_log_str.strip().strip("# "), ')')) else: rstatus_log = '' self.log.info("monitored resource %s is in state %s%s"%(r.rid, rcStatus.status_str(r.rstatus), rstatus_log)) raise self.exMonitorAction else: self.log.info("Would TOC but no (or unknown) resource monitor action set.") return self.log.debug("monitored resources are up") class exMonitorAction(Exception): pass def reboot(self): self.node.os.reboot() def crash(self): self.node.os.crash() def freezestop(self): self.sub_set_action('hb.openha', 'freezestop') def stonith(self): self.sub_set_action('stonith.ilo', 'start') self.sub_set_action('stonith.callout', 'start') def toc(self): self.log.info("start monitor action '%s'"%self.monitor_action) def group_status(self, groups=set(["container", "ip", "disk", "fs", "sync", "app", "hb"]), excluded_groups=set([])): from copy import copy """print each resource status for a service """ status = {} groups = groups.copy() - excluded_groups rset_status = self.get_rset_status(groups) moregroups = groups | set(["overall", "avail"]) # initialise status of each group for group in moregroups: status[group] = rcStatus.Status(rcStatus.NA) for t in [_t for _t in self.status_types if not _t.startswith('sync') and not _t.startswith('hb')]: group = t.split('.')[0] if group not in groups: continue for r in self.get_res_sets(t): s = rset_status[r.type] status[group] += s status["avail"] += s if status["avail"].status == rcStatus.STDBY_UP_WITH_UP: status["avail"].status = rcStatus.UP # now that we now the avail status we can promote # stdbyup to up for g in status: if status[g] == rcStatus.STDBY_UP: status[g] = rcStatus.UP elif status["avail"].status == rcStatus.STDBY_UP_WITH_DOWN: status["avail"].status = rcStatus.STDBY_UP # overall status is avail + sync status # seed overall with avail status["overall"] = copy(status["avail"]) for t in [_t for _t in self.status_types if _t.startswith('hb')]: if 'hb' not in groups: continue for r in self.get_res_sets(t): s = rset_status[r.type] status['hb'] += s status["overall"] += s for t in [_t for _t in self.status_types if _t.startswith('sync')]: if 'sync' not in groups: continue for r in self.get_res_sets(t): """ sync are expected to be up """ s = rset_status[r.type] status['sync'] += s if s == rcStatus.UP: status["overall"] += rcStatus.UNDEF elif s in [rcStatus.NA, rcStatus.UNDEF, rcStatus.TODO]: status["overall"] += s else: status["overall"] += rcStatus.WARN self.group_status_cache = status return status def print_disklist(self): print '\n'.join(self.disklist()) def json_disklist(self): import json print json.dumps(list(self.disklist())) def disklist(self): """List all disks held by all resources of this service """ disks = set() for rs in self.resSets: for r in rs.resources: if r.is_disabled(): continue disks |= r.disklist() self.log.debug("found disks %s held by service" % disks) return disks def boot(self): if rcEnv.nodename in self.autostart_node: try: self.start() except ex.excError: self.log.info("start failed. try to start standby") self.startstandby() else: self.cluster = True self.startstandby() def shutdown(self): # don't loose the action log on node shutdown self.sync_dblogger = True self.force = True self.stop() def start(self): self.startip() self.mount() self.startcontainer() self.startapp() self.starthb() def stop(self): self.stophb() try: self.stopapp() except ex.excError: pass self.stopcontainer() self.umount() self.stopip() def cluster_mode_safety_net(self): if not self.has_res_set(['hb.ovm', 'hb.openha', 'hb.linuxha']): return all_disabled = True for rs in self.get_res_sets(['hb.ovm', 'hb.openha', 'hb.linuxha']): for r in rs.resources: if not r.disabled: all_disabled = False if all_disabled: return if not self.cluster: self.log.info("this service is managed by a clusterware, thus direct service manipulation is disabled. the --cluster option circumvent this safety net.") raise ex.excError def starthb(self): self.sub_set_action("hb.ovm", "start") self.sub_set_action("hb.openha", "start") self.sub_set_action("hb.linuxha", "start") def stophb(self): self.sub_set_action("hb.ovm", "stop") self.sub_set_action("hb.openha", "stop") self.sub_set_action("hb.linuxha", "stop") def startdrbd(self): self.sub_set_action("disk.drbd", "start") def stopdrbd(self): self.sub_set_action("disk.drbd", "stop") def startloop(self): self.sub_set_action("disk.loop", "start") def stoploop(self): self.sub_set_action("disk.loop", "stop") def stopvg(self): self.sub_set_action("disk.vg", "stop") self.sub_set_action("disk.scsireserv", "stop") def startvg(self): self.sub_set_action("disk.scsireserv", "start") self.sub_set_action("disk.vg", "start") def startpool(self): self.sub_set_action("disk.scsireserv", "start") self.sub_set_action("disk.zpool", "start") def stoppool(self): self.sub_set_action("disk.zpool", "stop") self.sub_set_action("disk.scsireserv", "stop") def startdisk(self): self.sub_set_action("sync.netapp", "start") self.sub_set_action("sync.dcsckpt", "start") self.sub_set_action("sync.nexenta", "start") self.sub_set_action("sync.symclone", "start") self.sub_set_action("disk.loop", "start") self.sub_set_action("disk.scsireserv", "start") self.sub_set_action("disk.drbd", "start", tags=set(['prevg'])) self.sub_set_action("disk.zpool", "start") self.sub_set_action("disk.vg", "start") self.sub_set_action("disk.drbd", "start", tags=set(['postvg'])) def stopdisk(self): self.sub_set_action("disk.drbd", "stop", tags=set(['postvg'])) self.sub_set_action("disk.vg", "stop") self.sub_set_action("disk.zpool", "stop") self.sub_set_action("disk.drbd", "stop", tags=set(['prevg'])) self.sub_set_action("disk.scsireserv", "stop") self.sub_set_action("disk.loop", "stop") def startip(self): self.sub_set_action("ip", "start") def stopip(self): self.sub_set_action("ip", "stop") def mount(self): self.startdisk() self.sub_set_action("fs", "start") def umount(self): self.sub_set_action("fs", "stop") self.stopdisk() def startcontainer(self): self.sub_set_action("container.lxc", "start") self.sub_set_action("container.vz", "start") self.sub_set_action("container.jail", "start") self.sub_set_action("container.kvm", "start") self.sub_set_action("container.xen", "start") self.sub_set_action("container.esx", "start") self.sub_set_action("container.ovm", "start") self.sub_set_action("container.hpvm", "start") self.sub_set_action("container.ldom", "start") self.sub_set_action("container.vbox", "start") self.refresh_ip_status() def refresh_ip_status(self): """ Used after start/stop container because the ip resource status change after its own start/stop """ for rs in self.get_res_sets("ip"): for r in rs.resources: r.status(refresh=True) def stopcontainer(self): self.sub_set_action("container.vbox", "stop") self.sub_set_action("container.ldom", "stop") self.sub_set_action("container.hpvm", "stop") self.sub_set_action("container.xen", "stop") self.sub_set_action("container.esx", "stop") self.sub_set_action("container.ovm", "stop") self.sub_set_action("container.kvm", "stop") self.sub_set_action("container.jail", "stop") self.sub_set_action("container.lxc", "stop") self.sub_set_action("container.vz", "stop") self.refresh_ip_status() def provision(self): self.sub_set_action("disk.loop", "provision") self.sub_set_action("disk.vg", "provision") self.sub_set_action("fs", "provision") self.sub_set_action("container.lxc", "provision") self.sub_set_action("container.kvm", "provision") self.sub_set_action("container.zone", "provision") self.sub_set_action("ip", "provision") self.sub_set_action("fs", "start", tags=set(['postboot'])) self.push() def startapp(self): self.sub_set_action("app", "start") def stopapp(self): self.sub_set_action("app", "stop") def prstop(self): self.sub_set_action("disk.scsireserv", "scsirelease") def prstart(self): self.sub_set_action("disk.scsireserv", "scsireserv") def prstatus(self): self.sub_set_action("disk.scsireserv", "scsicheckreserv") def startstandby(self): self.sub_set_action("ip", "startstandby") self.sub_set_action("disk.loop", "startstandby") self.sub_set_action("disk.scsireserv", "startstandby") self.sub_set_action("disk.drbd", "startstandby", tags=set(['prevg'])) self.sub_set_action("disk.vg", "startstandby") self.sub_set_action("disk.zpool", "startstandby") self.sub_set_action("disk.drbd", "startstandby", tags=set(['postvg'])) self.sub_set_action("fs", "startstandby") self.sub_set_action("app", "startstandby") def postsync(self): """ action triggered by a remote master node after syncnodes and syncdrp. Typically make use of files received in var/ """ self.all_set_action("postsync") def remote_postsync(self): """ run the remote exec of postsync async because the waitlock timeout is long, and we ourselves still hold the service lock we want to release early. """ """ action triggered by a remote master node after syncnodes and syncdrp. Typically make use of files received in var/. use a long waitlock timeout to give a chance to remote syncs to finish """ for n in self.need_postsync: self.remote_action(n, 'postsync', waitlock=3600) self.need_postsync = set([]) def remote_action(self, node, action, waitlock=60): rcmd = [os.path.join(rcEnv.pathetc, self.svcname)] if self.cluster: rcmd += ['--cluster'] if self.cron: rcmd += ['--cron'] rcmd += ['--waitlock', str(waitlock), action] self.log.info("exec '%s' on node %s"%(' '.join(rcmd), node)) cmd = rcEnv.rsh.split() + [node] + rcmd self.node.cmdworker.enqueue(cmd) def presync(self): """ prepare files to send to slave nodes in var/. Each resource can prepare its own set of files. """ self.need_postsync = set([]) if self.presync_done: return self.all_set_action("presync") self.presync_done = True def syncnodes(self): self.presync() self.sub_set_action("sync.rsync", "syncnodes") self.sub_set_action("sync.zfs", "syncnodes") self.sub_set_action("sync.dds", "syncnodes") self.remote_postsync() def syncdrp(self): self.presync() self.sub_set_action("sync.rsync", "syncdrp") self.sub_set_action("sync.zfs", "syncdrp") self.sub_set_action("sync.dds", "syncdrp") self.remote_postsync() def syncswap(self): self.sub_set_action("sync.netapp", "syncswap") self.sub_set_action("sync.nexenta", "syncswap") def syncresume(self): self.sub_set_action("sync.netapp", "syncresume") self.sub_set_action("sync.dcsckpt", "syncresume") self.sub_set_action("sync.nexenta", "syncresume") def syncquiesce(self): self.sub_set_action("sync.netapp", "syncquiesce") self.sub_set_action("sync.nexenta", "syncquiesce") def resync(self): self.stop() self.syncresync() self.start() def syncresync(self): self.sub_set_action("sync.netapp", "syncresync") self.sub_set_action("sync.nexenta", "syncresync") self.sub_set_action("sync.symclone", "syncresync") self.sub_set_action("sync.evasnap", "syncresync") self.sub_set_action("sync.dcssnap", "syncresync") self.sub_set_action("sync.dds", "syncresync") def syncbreak(self): self.sub_set_action("sync.netapp", "syncbreak") self.sub_set_action("sync.nexenta", "syncbreak") self.sub_set_action("sync.symclone", "syncbreak") self.sub_set_action("sync.dcsckpt", "syncbreak") def syncupdate(self): self.sub_set_action("sync.netapp", "syncupdate") self.sub_set_action("sync.nexenta", "syncupdate") self.sub_set_action("sync.dcsckpt", "syncupdate") self.sub_set_action("sync.dds", "syncupdate") self.sub_set_action("sync.zfs", "syncnodes") def syncfullsync(self): self.sub_set_action("sync.dds", "syncfullsync") self.sub_set_action("sync.zfs", "syncnodes") def syncverify(self): self.sub_set_action("sync.dds", "syncverify") def printsvc(self): print str(self) def can_sync(self, target=None): ret = False rtypes = ["sync.netapp", "sync.nexenta", "sync.dds", "sync.zfs", "sync.rsync", "sync.zfs"] for rt in rtypes: for rs in self.get_res_sets(rt): for r in rs.resources: try: ret |= r.can_sync(target) except ex.excError: return False if ret: return True return False def syncall(self): self.presync() self.sub_set_action("sync.rsync", "syncnodes") self.sub_set_action("sync.zfs", "syncnodes") self.sub_set_action("sync.dds", "syncnodes") self.sub_set_action("sync.rsync", "syncdrp") self.sub_set_action("sync.zfs", "syncdrp") self.sub_set_action("sync.dds", "syncdrp") self.syncupdate() self.remote_postsync() def push_appinfo(self): self.node.collector.call('push_appinfo', [self]) def push(self): self.node.collector.call('push_all', [self]) import time with open(self.push_flag, 'w') as f: f.write(str(time.time())) def tag_match(self, rtags, keeptags): for tag in rtags: if tag in keeptags: return True return False def disable_resources(self, keeprid=[], keeptags=set([])): if len(keeprid) > 0: ridfilter = True else: ridfilter = False if len(keeptags) > 0: tagsfilter = True else: tagsfilter = False if not tagsfilter and not ridfilter: return for rs in self.resSets: for r in rs.resources: if ridfilter and r.rid in keeprid: continue if tagsfilter and self.tag_match(r.tags, keeptags): continue r.disable() def setup_environ(self): """ Those are available to startup scripts and triggers """ os.environ['OPENSVC_SVCNAME'] = self.svcname for rs in self.resSets: for r in rs.resources: r.setup_environ() def action(self, action, rid=[], tags=set([]), waitlock=60): if self.node is None: self.node = node.Node() self.action_start_date = datetime.datetime.now() if self.svctype != 'PRD' and rcEnv.host_mode == 'PRD': self.log.error("Abort action for non PRD service on PRD node") return 1 actions_list_allow_on_frozen = [ 'get', 'set', 'update', 'enable', 'disable', 'delete', 'thaw', 'status', 'frozen', 'push', 'push_appinfo', 'print_status', 'print_disklist', 'json_status', 'json_disklist' ] actions_list_allow_on_cluster = actions_list_allow_on_frozen + [ 'resource_monitor', 'presync', 'postsync', 'syncall' ] if action not in actions_list_allow_on_frozen and \ 'compliance' not in action and \ 'collector' not in action: if self.frozen(): self.log.info("Abort action for frozen service") return 1 try: if action not in actions_list_allow_on_cluster: self.cluster_mode_safety_net() except ex.excError: return 1 self.setup_environ() self.setup_signal_handlers() self.disable_resources(keeprid=rid, keeptags=tags) actions_list_no_log = [ 'get', 'set', 'push', 'push_appinfo', 'enable', 'disable', 'delete', 'print_status', 'print_disklist', 'json_status', 'json_disklist', 'status', 'group_status', 'resource_monitor' ] if action in actions_list_no_log or \ 'compliance' in action or \ 'collector' in action: err = self.do_action(action, waitlock=waitlock) elif action in ["syncall", "syncdrp", "syncnodes", "syncupdate"]: if action == "syncall" or "syncupdate": kwargs = {} elif action == "syncnodes": kwargs = {'target': 'nodes'} elif action == "syncdrp": kwargs = {'target': 'drpnodes'} if self.can_sync(**kwargs): err = self.do_logged_action(action, waitlock=waitlock) else: err = 0 self.log.debug("nothing to sync for the service for now") else: err = self.do_logged_action(action, waitlock=waitlock) return err def do_action(self, action, waitlock=60): """Trigger action """ err = 0 try: self.svclock(action, timeout=waitlock) except: return 1 try: if action.startswith("compliance_"): from compliance import Compliance o = Compliance(self.node.skip_action, self.options, self.node.collector, self.svcname) getattr(o, action)() elif action.startswith("collector_"): from collector import Collector o = Collector(self.options, self.node.collector, self.svcname) getattr(o, action)() elif hasattr(self, action): getattr(self, action)() else: self.log.error("unsupported action") err = 1 except ex.excError, e: s = "'%s' action stopped on execution error"%action if len(str(e)) > 0: s += ": %s"%str(e) self.log.error(s) err = 1 if 'start' in action: try: self.log.info("trying to rollback %s"%action) getattr(self, action.replace('start', 'stop'))() except: self.log.error("rollback %s failed"%action) pass except ex.excSignal: self.log.error("interrupted by signal") err = 1 except self.exMonitorAction: self.svcunlock() raise except: err = 1 self.save_exc() self.svcunlock() return err def do_logged_action(self, action, waitlock=60): from datetime import datetime import tempfile import logging begin = datetime.now() """Provision a database entry to store action log later """ self.node.collector.call('begin_action', self, action, begin, sync=self.sync_dblogger) """Per action logfile to push to database at the end of the action """ f = tempfile.NamedTemporaryFile(delete=False, dir=rcEnv.pathtmp, prefix=self.svcname+'.'+action) actionlogfile = f.name f.close() log = logging.getLogger() actionlogformatter = logging.Formatter("%(asctime)s;;%(name)s;;%(levelname)s;;%(message)s;;%(process)d;;EOL") actionlogfilehandler = logging.FileHandler(actionlogfile) actionlogfilehandler.setFormatter(actionlogformatter) log.addHandler(actionlogfilehandler) err = self.do_action(action, waitlock=waitlock) """ Push result and logs to database """ actionlogfilehandler.close() log.removeHandler(actionlogfilehandler) end = datetime.now() dblogger(self, action, begin, end, actionlogfile, self.sync_dblogger) return err def restart(self): """ stop then start service """ self.stop() self.start() def migrate(self): if not hasattr(self, "destination_node"): self.log.error("a destination node must be provided for the switch action") raise ex.excError if self.destination_node not in self.nodes: self.log.error("destination node %s is not in service node list"%self.destination_node) raise ex.excError if not hasattr(self, '_migrate'): self.log.error("the 'migrate' action is not supported with %s service mode"%self.svcmode) raise ex.excError self.prstop() try: self.remote_action(node=self.destination_node, action='mount') self._migrate() except: if self.has_res_set(['disk.scsireserv']): self.log.error("scsi reservations where dropped. you have to acquire them now using the 'prstart' action either on source node or destination node, depending on your problem analysis.") raise self.umount() self.remote_action(node=self.destination_node, action='prstart') def switch(self): """ stop then start service """ if not hasattr(self, "destination_node"): self.log.error("a destination node must be provided for the switch action") raise ex.excError if self.destination_node not in self.nodes: self.log.error("destination node %s is not in service node list"%self.destination_node) raise ex.excError self.stop() self.remote_action(node=self.destination_node, action='start') def collector_outdated(self): """ return True if the env file has changed since last push else return False """ import datetime if not os.path.exists(self.push_flag): self.log.debug("no last push timestamp found") return True try: mtime = os.stat(self.pathenv).st_mtime f = open(self.push_flag) last_push = float(f.read()) f.close() except: self.log.error("can not read timestamp from %s or %s"%(self.pathenv, self.push_flag)) return True if mtime > last_push: self.log.debug("env file changed since last push") return True return False def write_config(self): try: fp = open(self.pathenv, 'w') self.config.write(fp) fp.close() except: print >>sys.stderr, "failed to write new %s"%self.nodeconf raise ex.excError() def load_config(self): import ConfigParser self.config = ConfigParser.RawConfigParser() self.config.read(self.pathenv) def unset(self): self.load_config() import sys if self.options.param is None: print >>sys.stderr, "no parameter. set --param" return 1 l = self.options.param.split('.') if len(l) != 2: print >>sys.stderr, "malformed parameter. format as 'section.key'" return 1 section, option = l if section != 'DEFAULT' and not self.config.has_section(section): print >>sys.stderr, "section '%s' not found"%section return 1 if not self.config.has_option(section, option): print >>sys.stderr, "option '%s' not found in section '%s'"%(option, section) return 1 try: self.config.remove_option(section, option) self.write_config() except: return 1 return 0 def get(self): self.load_config() import sys if self.options.param is None: print >>sys.stderr, "no parameter. set --param" return 1 l = self.options.param.split('.') if len(l) != 2: print >>sys.stderr, "malformed parameter. format as 'section.key'" return 1 section, option = l if section != 'DEFAULT' and not self.config.has_section(section): print >>sys.stderr, "section '%s' not found"%section return 1 if not self.config.has_option(section, option): print >>sys.stderr, "option '%s' not found in section '%s'"%(option, section) return 1 print self.config.get(section, option) return 0 def set(self): self.load_config() import sys if self.options.param is None: print >>sys.stderr, "no parameter. set --param" return 1 if self.options.value is None: print >>sys.stderr, "no value. set --value" return 1 l = self.options.param.split('.') if len(l) != 2: print >>sys.stderr, "malformed parameter. format as 'section.key'" return 1 section, option = l if section != 'DEFAULT' and not self.config.has_section(section): self.config.add_section(section) if self.config.has_option(section, option) and \ self.config.get(section, option) == self.options.value: return self.config.set(section, option, self.options.value) try: self.write_config() except: return 1 return 0 if __name__ == "__main__" : for c in (Svc,) : help(c) print """s1=Svc("Zone")""" s1=Svc("Zone") print "s1=",s1 print """s2=Svc("basic")""" s2=Svc("basic") print "s2=",s2 print """s1+=Resource("ip")""" s1+=Resource("ip") print "s1=",s1 print """s1+=Resource("ip")""" s1+=Resource("ip") print """s1+=Resource("fs")""" s1+=Resource("fs") print """s1+=Resource("fs")""" s1+=Resource("fs") print "s1=",s1 print """s1.action("status")""" s1.action("status") 07070100024520000081b40000000000000000000000014faa950900000378000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/hostidSunOS.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from uuid import getnode def hostid(): return str(getnode()) 0707010002456b000081b40000000000000000000000014faa9509000026a1000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/rcOptParser.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import optparse from rcGlobalEnv import * action_desc = { 'Service actions': { 'printsvc': 'display service live configuration', 'boot': 'start a service if executed on the primary node (or one of the primary nodes in case of a flex service), startstandby if not', 'shutdown': 'stop a service, disabling the background database logging', 'start': 'start a service, chaining startip-diskstart-startapp', 'startstandby': 'start service resources marked always_on', 'startip': 'configure service ip addresses', 'mount': 'prepare devices, logical volumes, mount service filesystems, bootstrap containers', 'startapp': 'execute service application startup script', 'stop': 'stop a service, chaining stopapp-stopdisk-stopip', 'stopip': 'unconfigure service ip addresses', 'umount': 'shutdown container, umount service filesystems, deactivate logical volumes', 'stopapp': 'execute service application stop script', 'syncnodes': 'send to peer nodes the service config files and additional files described in the config file. --force bypass the schedule check.', 'syncdrp': 'send to drp nodes the service config files and additional files described in the config file. --force bypass the schedule check.', 'startcontainer': 'start the container resource', 'stopcontainer': 'stop the container resource', 'disable': 'disable resources passed through --rid in services passed through --service. Specifying no resource disables the whole service.', 'enable': 'enable resources passed through --rid in services passed through --service. Specifying no resource enables the whole service.', 'status': 'return service overall status code', 'print_status': 'display service resource status', 'freeze': 'set up a flag to block actions on this service', 'thaw': 'remove the flag to unblock actions on this service', 'frozen': 'report on the current blocking of actions on this service', 'startloop': 'attach loop resources of this service', 'stoploop': 'detach loop resources of this service', 'startvg': 'activate/import volume group resources of this service', 'stopvg': 'deactivate/deport volume group resources of this service', 'startpool': 'activate zpool resources of this service', 'stoppool': 'deactivate zpool resources of this service', 'startdisk': 'combo action, activating standby disks, taking reservations, starting loopback devices and volume groups', 'stopdisk': 'combo action, stopping volume groups and loopback devices, droping reservations, disabling standby disks', 'presync': 'update var files associated to resources', 'postsync': 'make use of files received from master nodes in var', 'prstart': 'reserve scsi disks held by this service', 'prstop': 'release scsi disks held by this service', 'prstatus': 'report status of reservations on scsi disks held by this service', 'restart': 'combo action, chaining stop-start', 'resync': 'combo action, chaining stop-syncresync-start', 'syncquiesce': 'trigger a storage hardware-assisted disk synchronization', 'syncbreak': 'split a storage hardware-assisted disk synchronization', 'syncresync': 'like syncupdate, but not triggered by the scheduler (thus adapted for clone/snap operations)', 'syncfullsync': 'trigger a full copy of the volume to its target', 'syncupdate': 'trigger a one-time resync of the volume to its target', 'syncresume': 're-establish a broken storage hardware-assisted synchronization', 'syncverify': 'trigger a one-time checksum-based verify of the volume and its target', 'syncall': 'combo action, chaining syncnodes-syncdrp-syncupdate. --force bypass the schedule check.', 'push': 'push service configuration to database', 'push_appinfo': 'push service application launchers appinfo key/value pairs to database', 'print_disklist': 'print service disk list', 'switch': 'stop the service on the local node and start on the remote node. --to specify the remote node to switch the service to.', 'migrate': 'live migrate the service to the remote node. --to specify the remote node to migrate the service to.', 'json_status': 'provide the resource and aggregated status in json format, for use by tier tools', 'json_disklist': 'provide the service disk list in json format, for use by tier tools', 'resource_monitor': 'detect monitored resource failures and trigger monitor_action', 'stonith': 'command provided to the heartbeat daemon to fence peer node in case of split brain', }, 'Service configuration': { 'create': 'create a new service configuration file. --interactive triggers the interactive mode', 'update': 'update definitions in an existing service configuration file', 'delete': 'delete resources passed through --rid in services passed through --service', 'set': 'set a service configuration parameter (pointed by --param) value (pointed by --value)', 'get': 'get the value of the node configuration parameter pointed by --param', 'unset': 'unset a node configuration parameter pointed by --param', }, 'Compliance': { 'compliance_check': 'run compliance checks. --ruleset instruct the collector to provide an historical ruleset.', 'compliance_fix': 'run compliance fixes. --ruleset instruct the collector to provide an historical ruleset.', 'compliance_fixable': 'verify compliance fixes prerequisites. --ruleset instruct the collector to provide an historical ruleset.', 'compliance_show_status': 'show compliance modules status', 'compliance_show_moduleset': 'show compliance rules applying to this service', 'compliance_list_moduleset': 'list available compliance modulesets. --moduleset f% limit the scope to modulesets matching the f% pattern.', 'compliance_attach_moduleset': 'attach moduleset specified by --moduleset to this service', 'compliance_detach_moduleset': 'detach moduleset specified by --moduleset from this service', 'compliance_list_ruleset': 'list available compliance rulesets. --ruleset f% limit the scope to rulesets matching the f% pattern.', 'compliance_show_ruleset': 'show compliance rules applying to this node', 'compliance_attach_ruleset': 'attach ruleset specified by --ruleset to this service', 'compliance_detach_ruleset': 'detach ruleset specified by --ruleset from this service', }, 'Collector management': { 'collector_ack_unavailability': 'acknowledge an unavailability period. the period is specified by --begin/--end or --begin/--duration. omitting --begin defaults to now. an acknowlegment can be completed by --author (defaults to root@nodename), --account (default to 1) and --comment', 'collector_list_unavailability_ack': 'list acknowledged periods for the service. the periods can be filtered by --begin/--end. omitting --end defaults to now. the wildcartd for --comment and --author is %', 'collector_list_actions': 'list actions on the service, whatever the node, during the period specified by --begin/--end. --end defaults to now. --begin defaults to 7 days ago', 'collector_ack_action': 'acknowledge an action error on the service. an acknowlegment can be completed by --author (defaults to root@nodename) and --comment', 'collector_show_actions': 'show actions detailled log. a single action is specified by --id. a range is specified by --begin/--end dates. --end defaults to now. --begin defaults to 7 days ago', 'collector_status': 'display service status on all nodes, according to the collector.', 'collector_checks': 'display service checks', 'collector_alerts': 'display service alerts', 'collector_events': 'display service events during the period specified by --begin/--end. --end defaults to now. --begin defaults to 7 days ago', }, } def format_desc(svc=False): from textwrap import TextWrapper wrapper = TextWrapper(subsequent_indent="%19s"%"", width=78) desc = "" for s in sorted(action_desc): l = len(s) desc += s+'\n' for i in range(0, l): desc += '-' desc += "\n\n" for a in sorted(action_desc[s]): if svc and not hasattr(svc, a): continue fancya = a.replace('_', ' ') if len(a) < 16: text = " %-16s %s\n"%(fancya, action_desc[s][a]) desc += wrapper.fill(text) else: text = " %-16s"%(fancya) desc += wrapper.fill(text) desc += '\n' text = "%19s%s"%(" ", action_desc[s][a]) desc += wrapper.fill(text) desc += '\n\n' return desc[0:-2] def supported_actions(): a = [] for s in action_desc: a += action_desc[s].keys() return a 0707010002456c000081b40000000000000000000000014faa95090000007e000000ae00010002ffffffffffffffff0000001d00000000root/opt/opensvc/lib/rcOs.pyclass Os(object): def reboot(self): print "not implemented" def crash(self): print "not implemented" 07070100024519000081b40000000000000000000000014faa950900001771000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/collector.pyfrom stat import * import os import sys import re import datetime import rcExceptions as ex from rcGlobalEnv import rcEnv from rcUtilities import is_exe, justcall, banner from subprocess import * from rcPrintTable import print_table class Collector(object): def __init__(self, options=None, collector=None, svcname=None): self.options = options self.collector = collector self.svcname = svcname self.options = options def collector_ack_unavailability(self): if self.svcname is None: return opts = {} opts['svcname'] = self.svcname if self.options.begin is not None: opts['begin'] = self.options.begin if self.options.end is not None: opts['end'] = self.options.end if self.options.author is not None: opts['author'] = self.options.author if self.options.comment is not None: opts['comment'] = self.options.comment if self.options.duration is not None: opts['duration'] = self.options.duration if self.options.account: opts['account'] = "1" else: opts['account'] = "0" d = self.collector.call('collector_ack_unavailability', opts) if d is None: raise ex.excError("xmlrpc unknown failure") if d['ret'] != 0: raise ex.excError(d['msg']) def collector_list_unavailability_ack(self): if self.svcname is None: return opts = {} opts['svcname'] = self.svcname if self.options.begin is not None: opts['begin'] = self.options.begin if self.options.end is not None: opts['end'] = self.options.end if self.options.author is not None: opts['author'] = self.options.author if self.options.comment is not None: opts['comment'] = self.options.comment if self.options.duration is not None: opts['duration'] = self.options.duration if self.options.account: opts['account'] = "1" else: opts['account'] = "0" d = self.collector.call('collector_list_unavailability_ack', opts) if d is None: raise ex.excError("xmlrpc unknown failure") if d['ret'] != 0: raise ex.excError(d['msg']) print_table(d['data']) def collector_list_actions(self): opts = {} if self.svcname is not None: opts['svcname'] = self.svcname if self.options.begin is not None: opts['begin'] = self.options.begin if self.options.end is not None: opts['end'] = self.options.end if self.options.duration is not None: opts['duration'] = self.options.duration d = self.collector.call('collector_list_actions', opts) if d is None: raise ex.excError("xmlrpc unknown failure") if d['ret'] != 0: raise ex.excError(d['msg']) print_table(d['data']) def collector_ack_action(self): opts = {} if self.svcname is not None: opts['svcname'] = self.svcname if self.options.author is not None: opts['author'] = self.options.author if self.options.comment is not None: opts['comment'] = self.options.comment if self.options.id == 0: raise ex.excError("--id is not set") else: opts['id'] = self.options.id d = self.collector.call('collector_ack_action', opts) if d is None: raise ex.excError("xmlrpc unknown failure") if d['ret'] != 0: raise ex.excError(d['msg']) def collector_status(self): opts = {} if self.svcname is not None: opts['svcname'] = self.svcname d = self.collector.call('collector_status', opts) if d is None: raise ex.excError("xmlrpc unknown failure") if d['ret'] != 0: raise ex.excError(d['msg']) print_table(d['data']) def collector_checks(self): opts = {} if self.svcname is not None: opts['svcname'] = self.svcname d = self.collector.call('collector_checks', opts) if d is None: raise ex.excError("xmlrpc unknown failure") if d['ret'] != 0: raise ex.excError(d['msg']) print_table(d['data']) def collector_alerts(self): opts = {} if self.svcname is not None: opts['svcname'] = self.svcname d = self.collector.call('collector_alerts', opts) if d is None: raise ex.excError("xmlrpc unknown failure") if d['ret'] != 0: raise ex.excError(d['msg']) print_table(d['data'], width=30) def collector_events(self): opts = {} if self.svcname is not None: opts['svcname'] = self.svcname if self.options.begin is not None: opts['begin'] = self.options.begin if self.options.end is not None: opts['end'] = self.options.end d = self.collector.call('collector_events', opts) if d is None: raise ex.excError("xmlrpc unknown failure") if d['ret'] != 0: raise ex.excError(d['msg']) print_table(d['data'], width=50) def collector_show_actions(self): opts = {} if self.svcname is not None: opts['svcname'] = self.svcname if self.options.id != 0: opts['id'] = self.options.id if self.options.begin is not None: opts['begin'] = self.options.begin if self.options.end is not None: opts['end'] = self.options.end d = self.collector.call('collector_show_actions', opts) if d is None: raise ex.excError("xmlrpc unknown failure") if d['ret'] != 0: raise ex.excError(d['msg']) print_table(d['data'], width=50) 070701000245c1000081b40000000000000000000000014faa9509000007c2000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/resIpDarwin.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. "Module implement Linux specific ip management" import resIp as Res import rcExceptions as ex from rcUtilitiesFreeBSD import check_ping class Ip(Res.Ip): def check_ping(self): self.log.info("checking %s availability"%self.addr) return check_ping(self.addr) def arp_announce(self): return def startip_cmd(self): if ':' in self.addr: if '.' in self.mask: self.log.error("netmask parameter is mandatory for ipv6 adresses") raise ex.excError cmd = ['ifconfig', self.ipDev, 'inet6', '/'.join([self.addr, self.mask]), 'add'] else: cmd = ['ifconfig', self.ipDev, 'inet', self.addr, 'netmask', self.mask, 'add'] return self.vcall(cmd) def stopip_cmd(self): if ':' in self.addr: cmd = ['ifconfig', self.ipDev, 'inet6', self.addr, 'delete'] else: cmd = ['ifconfig', self.ipDev, 'inet', self.addr, 'delete'] return self.vcall(cmd) if __name__ == "__main__": for c in (Ip,) : help(c) 0707010002451b000081b40000000000000000000000014faa9509000006f4000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/freezer.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import glob def dummy(): return class Freezer: flag_dir = os.path.join(os.path.dirname(__file__), '..', 'var') base_flag = os.path.join(flag_dir, 'FROZEN') flag = base_flag def frozen(self): if os.path.exists(self.flag) or os.path.exists(self.base_flag): return True return False def freeze(self): open(self.flag, 'w').close() def thaw(self): if self.flag != self.base_flag and os.path.exists(self.flag): os.unlink(self.flag) return for name in glob.glob(self.flag_dir + '/FROZEN*'): os.unlink(name) def __init__(self, name=''): if len(name) == 0: pass elif not os.path.exists(os.path.join(os.path.dirname(__file__), '..', 'etc', name)): self.freeze = dummy self.thaw = dummy self.frozen = dummy else: self.flag = self.flag + "." + name 0707010002459c000081b40000000000000000000000014faa9509000029fe000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcStatsLinux.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2011 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import datetime from rcUtilities import justcall, which import rcStats from rcGlobalEnv import rcEnv class StatsProvider(rcStats.StatsProvider): def xentopfile(self, day): f = os.path.join(rcEnv.pathlog, 'xentop', 'xentop'+day) if os.path.exists(f): return f return None def svc(self, d, day, start, end): cols = ['date', 'svcname', 'cpu', 'mem', 'cap', 'nodename'] f = self.xentopfile(day) lines = [] if f is None: return cols, lines try: with open(f, 'r') as f: buff = f.read() except: return cols, lines _start = datetime.datetime.strptime(start, "%H:%M:%S") _start = _start.hour * 3600 + _start.minute * 60 + _start.second _end = datetime.datetime.strptime(end, "%H:%M:%S") _end = _end.hour * 3600 + _end.minute * 60 + _end.second for line in buff.split('\n'): l = line.split() if len(l) != 21: continue _d = datetime.datetime.strptime(" ".join(l[0:2]), "%Y-%m-%d %H:%M:%S") _d = _d.hour * 3600 + _d.minute * 60 + _d.second if _d < _start or _d > _end: continue l = [" ".join((l[0], l[1]))] + [l[2], l[5], l[7], l[8], self.nodename] lines.append(l) return cols, lines def cpu(self, d, day, start, end): f = self.sarfile(day) if f is None: return [], [] cmd = ['sar', '-t', '-u', 'ALL', '-P', 'ALL', '-f', f, '-s', start, '-e', end] (buff, err, ret) = justcall(cmd) if ret != 0: cmd = ['sar', '-t', '-u', '-P', 'ALL', '-f', f, '-s', start, '-e', end] (buff, err, ret) = justcall(cmd) cols = [] lines = [] for line in buff.split('\n'): l = line.split() if 'Linux' in l: continue if len(l) == 7: """ redhat 4 18:50:01 CPU %user %nice %system %iowait %idle """ cols = ['date', 'cpu', 'usr', 'nice', 'sys', 'iowait', 'idle', 'nodename'] elif len(l) == 8: """ redhat 5 05:20:01 CPU %user %nice %system %iowait %steal %idle """ cols = ['date', 'cpu', 'usr', 'nice', 'sys', 'iowait', 'steal', 'idle', 'nodename'] elif len(l) == 11: cols = ['date', 'cpu', 'usr', 'nice', 'sys', 'iowait', 'steal', 'irq', 'soft', 'guest', 'idle', 'nodename'] else: continue if l[1] == 'CPU': continue if l[0] == 'Average:': continue l.append(self.nodename) l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines def mem_u(self, d, day, start, end): f = self.sarfile(day) cols = ['date', 'kbmemfree', 'kbmemused', 'pct_memused', 'kbbuffers', 'kbcached', 'kbcommit', 'pct_commit', 'kbmemsys', 'nodename'] if f is None: return [], [] cmd = ['sar', '-t', '-r', '-f', f, '-s', start, '-e', end] (buff, err, ret) = justcall(cmd) lines = [] for line in buff.split('\n'): l = line.split() if len(l) == 10: """ redhat 5 """ l = l[0:6] + ['0', '0'] if len(l) != 8: continue if l[1] == 'kbmemfree': continue if l[0] == 'Average:': continue """ Linux has no kbmemsys """ l.append('0') l.append(self.nodename) l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines def proc(self, d, day, start, end): f = self.sarfile(day) cols = ['date', 'runq_sz', 'plist_sz', 'ldavg_1', 'ldavg_5', 'ldavg_15', 'nodename'] if f is None: return [], [] cmd = ['sar', '-t', '-q', '-f', f, '-s', start, '-e', end] (buff, err, ret) = justcall(cmd) lines = [] for line in buff.split('\n'): l = line.split() if len(l) != 6: continue if l[1] == 'runq-sz': continue if l[0] == 'Average:': continue l.append(self.nodename) l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines def swap(self, d, day, start, end): f = self.sarfile(day) cols = ['date', 'kbswpfree', 'kbswpused', 'pct_swpused', 'kbswpcad', 'pct_swpcad', 'nodename'] if f is None: return [], [] cmd = ['sar', '-t', '-S', '-f', f, '-s', start, '-e', end] (buff, err, ret) = justcall(cmd) if ret != 0: """ redhat 5 """ cmd = ['sar', '-t', '-r', '-f', f, '-s', start, '-e', end] (buff, err, ret) = justcall(cmd) lines = [] for line in buff.split('\n'): l = line.split() if len(l) == 10: """ redhat 5 """ l = [l[0]] + l[6:] + ['0'] if len(l) != 6: continue if 'kbswpfree'in l: continue if l[0] == 'Average:': continue l.append(self.nodename) l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines def block(self, d, day, start, end): f = self.sarfile(day) cols = ['date', 'tps', 'rtps', 'wtps', 'rbps', 'wbps', 'nodename'] if f is None: return [], [] cmd = ['sar', '-t', '-b', '-f', f, '-s', start, '-e', end] (buff, err, ret) = justcall(cmd) lines = [] for line in buff.split('\n'): l = line.split() if len(l) != 6: continue if l[1] == 'tps': continue if l[0] == 'Average:': continue l.append(self.nodename) l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines def blockdev(self, d, day, start, end): f = self.sarfile(day) cols = ['date', 'dev', 'tps', 'rsecps', 'wsecps', 'avgrq_sz', 'avgqu_sz', 'await', 'svctm', 'pct_util', 'nodename'] if f is None: return [], [] cmd = ['sar', '-t', '-d', '-p', '-f', f, '-s', start, '-e', end] (buff, err, ret) = justcall(cmd) lines = [] for line in buff.split('\n'): l = line.split() if len(l) != 10: continue if l[1] == 'DEV': continue if l[0] == 'Average:': continue l.append(self.nodename) l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines def netdev(self, d, day, start, end): f = self.sarfile(day) cols = ['date', 'dev', 'rxpckps', 'txpckps', 'rxkBps', 'txkBps', 'nodename'] if f is None: return [], [] cmd = ['sar', '-t', '-n', 'DEV', '-f', f, '-s', start, '-e', end] (buff, err, ret) = justcall(cmd) lines = [] div = 1 for line in buff.split('\n'): l = line.split() if len(l) != 9: continue if l[1] in ['IFACE', 'lo'] : if 'rxbyt/s' in l: div = 1024 continue if 'dummy' in l[1] or 'vnet' in l[1] or 'veth' in l[1] or \ 'pan' in l[1] or 'sit' in l[1]: continue if l[0] == 'Average:': continue m = l[0:3] m.append(str(float(l[4])/div)) m.append(str(float(l[5])/div)) m.append(l[6]) m.append(self.nodename) m[0] = '%s %s'%(d, l[0]) lines.append(m) return cols, lines def netdev_err(self, d, day, start, end): f = self.sarfile(day) cols = ['date', 'dev', 'rxerrps', 'txerrps', 'collps', 'rxdropps', 'txdropps', 'nodename'] if f is None: return [], [] cmd = ['sar', '-t', '-n', 'EDEV', '-f', f, '-s', start, '-e', end] (buff, err, ret) = justcall(cmd) lines = [] for line in buff.split('\n'): l = line.split() if len(l) != 11: continue if l[1] in ['IFACE', 'lo'] : continue if 'dummy' in l[1] or 'vnet' in l[1] or 'veth' in l[1] or \ 'pan' in l[1] or 'sit' in l[1]: continue if l[0] == 'Average:': continue l = l[0:7] l.append(self.nodename) l[0] = '%s %s'%(d, l[0]) lines.append(l) return cols, lines if __name__ == "__main__": sp = StatsProvider(interval=20) print sp.get('cpu') print sp.get('swap') 070701000245e8000081b40000000000000000000000014faa9509000025d6000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/resSyncSymclone.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import logging from rcGlobalEnv import rcEnv from rcUtilities import which import rcExceptions as ex import rcStatus import time import datetime import resSync class syncSymclone(resSync.Sync): def wait_for_devs_ready(self): pass def get_symdevs(self): for symdev in self.symdevs: l = symdev.split(':') if len(l) != 2: self.log.error("symdevs must be in symid:symdev ... format") raise ex.excError self.symdev[l[0],l[1]] = dict(symid=l[0], symdev=l[1]) def get_symld(self): cmd = ['/usr/symcli/bin/symld', '-g', self.symdg, 'list', '-v'] (ret, out, err) = self.call(cmd) if ret != 0: raise ex.excError ld = {} for line in out.split('\n'): if len(line) == 0: continue l = line.split(': ') if len(l) != 2: continue if "Device Physical Name" in l[0]: """ New logical device """ if ld != {}: self.symld[ld['symid'],ld['symdev']] = ld ld = {} ld['pdev'] = l[1].strip() elif " Symmetrix ID" in l[0]: ld['symid'] = l[1].strip() elif " Device Symmetrix Name" in l[0]: ld['symdev'] = l[1].strip() elif " Device Logical Name" in l[0]: ld['symld'] = l[1].strip() elif " Product Revision" in l[0]: ld['symrev'] = l[1].strip() elif " Source (SRC) Device Symmetrix Name" in l[0]: ld['clone_srcdev'] = l[1].strip() elif " Target (TGT) Device Symmetrix Name" in l[0]: ld['clone_tgtdev'] = l[1].strip() elif " State of Session" in l[0]: ld['clone_state'] = l[1].strip() elif " Time of Last Clone Action" in l[0]: ld['clone_lastaction'] = l[1].strip() elif " Changed Tracks for SRC Device" in l[0]: ld['clone_srcchangedtracks'] = l[1].strip() elif " Changed Tracks for TGT Device" in l[0]: ld['clone_tgtchangedtracks'] = l[1].strip() if ld != {}: self.symld[ld['symid'],ld['symdev']] = ld def is_active(self): for pair in self._pairs: if pair in self.active_pairs: continue cmd = ['/usr/symcli/bin/symclone', '-g', self.symdg, 'verify', '-copied']+pair (ret, out, err) = self.call(cmd) if ret == 0: self.active_pairs.append(pair) continue cmd = ['/usr/symcli/bin/symclone', '-g', self.symdg, 'verify', '-copyinprog']+pair (ret, out, err) = self.call(cmd) if ret == 0: self.active_pairs.append(pair) continue if len(self.active_pairs) == len(self._pairs): return True return False def is_copied(self): cmd = ['/usr/symcli/bin/symclone', '-g', self.symdg, 'verify', '-copied']+self.pairs (ret, out, err) = self.call(cmd) if ret == 0: return True return False def is_activable(self): cmd = ['/usr/symcli/bin/symclone', '-g', self.symdg, 'verify', '-precopy']+self.pairs (ret, out, err) = self.call(cmd) if ret == 0: return True return False def get_pairs(self): for symid, dev in self.symdev: ld = self.symld[symid,dev] if dev == ld['clone_tgtdev']: tgtld = ld['symld'] srcld = self.symld[ld['symid'],ld['clone_srcdev']]['symld'] else: self.log.error("device %s not a clone target"%(dev)) raise ex.excError pair = [srcld, 'sym', 'ld', tgtld] self.pairs += pair self._pairs += [pair] def wait_for_active(self): delay = 20 timeout = 300 self.active_pairs = [] for i in range(timeout/delay): if self.is_active(): return if i == 0: self.log.info("waiting for copied or copyinprog state (max %i secs)"%timeout) time.sleep(delay) self.log.error("timed out waiting for copied or copyinprog state (%i secs)"%timeout) ina = set(self._pairs) - set(self.active_pairs) ina = map(lambda x: ' '.join(x), ina) ina = ", ".join(ina) self.log.error("%s still not in copied or copyinprod state"%ina) raise ex.excError def wait_for_activable(self): delay = 30 for i in range(self.precopy_timeout/delay): if self.is_activable(): return if i == 0: self.log.info("waiting for precopied state (max %i secs)"%self.precopy_timeout) time.sleep(delay) self.log.error("timed out waiting for precopied state (%i secs)"%self.precopy_timeout) raise ex.excError def activate(self): self.get_syminfo() if self.is_active(): self.log.info("symclone dg %s is already active"%self.symdg) return self.wait_for_activable() cmd = ['/usr/symcli/bin/symclone', '-g', self.symdg, '-noprompt', 'activate', '-i', '20', '-c', '30']+self.pairs (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError self.wait_for_active() self.wait_for_devs_ready() def can_sync(self, target=None): self.get_syminfo() self.get_last() if skip_sync(self.last): return False return True def recreate(self): self.get_syminfo() self.get_last() if self.skip_sync(self.last): return self.get_svcstatus() if self.svcstatus['overall'].status != rcStatus.DOWN: self.log.error("the service (sync excluded) is in '%s' state. Must be in 'down' state"%self.svcstatus['overall']) raise ex.excError if not self.is_copied(): self.log.info("symclone dg %s is not fully copied"%self.symdg) return cmd = ['/usr/symcli/bin/symclone', '-g', self.symdg, '-noprompt', 'recreate', '-precopy', '-i', '20', '-c', '30']+self.pairs (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def get_syminfo(self): self.get_symdevs() self.get_symld() self.get_pairs() def get_last(self): if self.last is not None: return for symid, symdev in self.symdev: ld = self.symld[symid,symdev] # format: Thu Feb 25 10:20:56 2010 last = datetime.datetime.strptime(ld['clone_lastaction'], "%a %b %d %H:%M:%S %Y") if self.last is None or last > self.last: self.last = last def _status(self, verbose=False): self.get_syminfo() self.get_last() if self.last is None: return rcStatus.DOWN elif self.last < datetime.datetime.now() - datetime.timedelta(minutes=self.sync_max_delay): self.status_log("Last sync on %s older than %d minutes"%(self.last, self.sync_max_delay)) return rcStatus.WARN else: return rcStatus.UP def syncbreak(self): self.activate() def syncresync(self): self.recreate() def start(self): self.syncbreak() def refresh_svcstatus(self): self.svcstatus = self.svc.group_status(excluded_groups=set(["sync", 'hb'])) def get_svcstatus(self): if len(self.svcstatus) == 0: self.refresh_svcstatus() def __init__(self, rid=None, symdg=None, symdevs=[], precopy_timeout=300, sync_max_delay=None, sync_interval=None, sync_days=None, sync_period=None, optional=False, disabled=False, tags=set([]), internal=False): resSync.Sync.__init__(self, rid=rid, type="sync.symclone", sync_max_delay=sync_max_delay, sync_interval=sync_interval, sync_days=sync_days, sync_period=sync_period, optional=optional, disabled=disabled, tags=tags) self.label = "clone symdg %s"%(symdg) self.symdg = symdg self.symdevs = symdevs self.precopy_timeout = precopy_timeout self.disks = set([]) self.symdev = {} self.pdevs = {} self.svcstatus = {} self.symld = {} self.pairs = [] self._pairs = [] self.active_pairs = [] self.last = None def __str__(self): return "%s symdg=%s symdevs=%s" % (resSync.Sync.__str__(self),\ self.symdg, self.symdevs) 070701000245e1000081b40000000000000000000000014faa950900001dac000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/resSyncDcsCkpt.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import rcExceptions as ex import rcStatus import datetime import resSyncDcs from rcGlobalEnv import rcEnv from rcUtilities import justcall class syncDcsCkpt(resSyncDcs.SyncDcs): def can_sync(self, target=None): return True def checkpoint(self): cmd = "" vars = "" for i, d in enumerate(self.pairs): cmd += '$v%d=Get-DcsVirtualDisk -VirtualDisk %s;'%(i, d['src']) vars += '$v%d '%i cmd += "echo %s|Set-DcsReplicationCheckPoint"%vars self.dcscmd(cmd, verbose=True) self.update_tsfile() def get_snap(self, snap): if snap in self._info: return self._info[snap] cmd = 'get-dcssnapshot -snapshot %s;'%snap try: ret, out, err = self.dcscmd(cmd) except: return None info = {} lines = out.split('\n') for line in lines: l = line.split(': ') if len(l) != 2: continue var = l[0].strip() val = l[1].strip() if var == 'TimeStamp': info['TimeStamp'] = datetime.datetime.strptime(val, "%d/%m/%Y %H:%M:%S") elif var in ['Type', 'State', 'ActiveOperation', 'Failure']: info[var] = val if len(info) > 0: self._info[snap] = info return info def drpnodes_status(self, verbose=False, skip_prereq=False): err = False errlog = [] log = [] try: self.get_auth() except ex.excError as e: self.status_log(str(e)) return rcStatus.WARN for snap in [p['dst_ckpt'] for p in self.pairs]: info = self.get_snap(snap) if info is None: errlog.append("checkpoint snapshot %s does not exists"%snap) err |= True continue if info['State'] not in ['Healthy']: errlog.append("checkpoint snapshot %s state is %s"%(snap, info['State'])) err |= True if info['Failure'] not in ['NoFailure']: errlog.append("checkpoint snapshot %s failure state is %s"%(snap, info['Failure'])) err |= True if info['TimeStamp'] < datetime.datetime.now() - datetime.timedelta(minutes=self.sync_max_delay): errlog.append("checkpoint snapshot %s too old"%snap) err |= True log.append("last update on %s"%info['TimeStamp']) if err: self.status_log('\n'.join(errlog)) return rcStatus.WARN self.status_log('\n'.join(log)) return rcStatus.UP def nodes_status(self, verbose=False, skip_prereq=False): err = False ts = self.read_tsfile() if ts < datetime.datetime.now() - datetime.timedelta(minutes=self.sync_max_delay): self.status_log("checkpoint too old") err |= True self.status_log("last update on %s"%str(ts)) if err: return rcStatus.WARN return rcStatus.UP def _status(self, verbose=False, skip_prereq=False): if rcEnv.nodename in self.svc.nodes: return self.nodes_status(verbose, skip_prereq) else: return self.drpnodes_status(verbose, skip_prereq) def pause_checkpoint(self): cmd = "" for d in self.pairs: cmd += 'Disable-DcsTask -Task %s ; '%self.task_name(d['dst_ckpt']) self.dcscmd(cmd, verbose=True) def create_task(self): cmd = "Get-DcsTask" tasks = [] ret, out, err = self.dcscmd(cmd, verbose=False) for line in out.split('\n'): if line.startswith("Caption"): tasks.append(line.split(':')[-1].strip()) cmd = "" for d in self.pairs: if self.task_name(d['dst_ckpt']) in tasks: continue cmd += "Add-DcsTask -Disabled -Name %s ; "%self.task_name(d['dst_ckpt']) cmd += 'Add-DcsTrigger -Task %s -VirtualDisk "%s" ; '%(self.task_name(d['dst_ckpt']), d['dst']) cmd += 'Add-DcsAction -Task %s -MethodActionType UpdateSnapshot -TargetId (Get-DcsSnapshot -snapshot "%s").Id ; '%(self.task_name(d['dst_ckpt']), d['dst_ckpt']) self.dcscmd(cmd, verbose=True) def resume_checkpoint(self): self.create_task() cmd = "" for d in self.pairs: cmd += 'Enable-DcsTask -Task %s ; '%self.task_name(d['dst_ckpt']) self.dcscmd(cmd, verbose=True) def task_name(self, id): return '-'.join((self.svc.svcname, self.rid, id)) def syncbreak(self): self.pause_checkpoint() def start(self): if rcEnv.nodename not in self.svc.drpnodes: return self.pause_checkpoint() def syncresume(self): self.resume_checkpoint() def syncupdate(self): self.checkpoint() def refresh_svcstatus(self): self.svcstatus = self.svc.group_status(excluded_groups=set(["sync", 'hb', 'app'])) def get_svcstatus(self): if len(self.svcstatus) == 0: self.refresh_svcstatus() def __init__(self, rid=None, pairs=[], manager=set([]), dcs=set([]), sync_max_delay=None, sync_interval=None, sync_days=None, sync_period=None, optional=False, disabled=False, tags=set([]), internal=False): resSyncDcs.SyncDcs.__init__(self, rid=rid, type="sync.dcsckpt", manager=manager, dcs=dcs, sync_max_delay=sync_max_delay, sync_interval=sync_interval, sync_days=sync_days, sync_period=sync_period, optional=optional, disabled=disabled, tags=tags) self.label = "DCS checkpoint snapshot of %s"%' ,'.join(map(lambda x: x['src'], pairs)) self.pairs = pairs self._info = {} def tsfile(self): return os.path.join(rcEnv.pathvar, '.'.join((self.svc.svcname, self.rid, 'ts'))) def update_tsfile(self): import datetime now = datetime.datetime.now() with open(self.tsfile(), 'w') as f: f.write(str(now)+'\n') def read_tsfile(self): import datetime try: with open(self.tsfile(), 'r') as f: ts = datetime.datetime.strptime(f.read(),"%Y-%m-%d %H:%M:%S.%f\n") except: ts = datetime.datetime(year=2000, month=01, day=01) return ts def __str__(self): return "%s dcs=%s manager=%s pairs=%s" % ( resSync.Sync.__str__(self), ' '.join(self.dcs), ' '.join(self.manager), str(pairs)) 070701000245bf000081b40000000000000000000000014faa9509000022b4000000ae00010002ffffffffffffffff0000001e00000000root/opt/opensvc/lib/resIp.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import resources as Res from rcGlobalEnv import * from rcUtilities import qcall, which rcIfconfig = __import__('rcIfconfig'+rcEnv.sysname) import socket import rcStatus import rcExceptions as ex import os class Ip(Res.Resource): """ basic ip resource """ def __init__(self, rid=None, ipDev=None, ipName=None, mask=None, optional=False, disabled=False, tags=set([]), always_on=set([]), monitor=False): Res.Resource.__init__(self, rid, "ip", optional=optional, disabled=disabled, tags=tags, monitor=monitor) self.ipDev=ipDev self.ipName=ipName self.mask=mask self.label = ipName + '@' + ipDev self.always_on = always_on def getaddr(self): if hasattr(self, 'addr'): return try: a = socket.getaddrinfo(self.ipName, None) if len(a) == 0: raise Exception self.addr = a[0][4][0] except: if not self.disabled: self.log.error("could not resolve name %s"%self.ipName) raise ex.excError def __str__(self): return "%s ipdev=%s ipname=%s" % (Res.Resource.__str__(self),\ self.ipDev, self.ipName) def setup_environ(self): os.environ['OPENSVC_IPDEV'] = str(self.ipDev) os.environ['OPENSVC_IPNAME'] = str(self.ipName) os.environ['OPENSVC_MASK'] = str(self.mask) try: self.getaddr() os.environ['OPENSVC_IPADDR'] = str(self.addr) except: pass l = self.rid.split('#') if len(l) == 2: index = l[1] else: index = '' var = 'OPENSVC_IP'+index l = [] for p in ['ipName', 'ipDev', 'addr', 'mask']: if hasattr(self, p): l.append(str(getattr(self, p))) else: l.append('unknown') val = ' '.join(l) os.environ[var] = val def _status(self, verbose=False): try: self.getaddr() except: self.status_log("could not resolve %s to an ip address"%self.ipName) return rcStatus.WARN try: if self.is_up(): return self.status_stdby(rcStatus.UP) else: return self.status_stdby(rcStatus.DOWN) except ex.excNotSupported: self.status_log("not supported") return rcStatus.UNDEF def arp_announce(self): if ':' in self.addr: return if not which("arping"): self.log.warning("arp annouce skipped. install 'arping'") return cmd = ["arping", "-U", "-c", "1", "-I", self.ipDev, "-s", self.addr, "0.0.0.0"] self.log.info(' '.join(cmd)) qcall(cmd) def check_ping(self): raise ex.MissImpl('check_ping') def startip_cmd(self): raise ex.MissImpl('startip_cmd') def stopip_cmd(self): raise ex.MissImpl('stopip_cmd') def is_up(self): ifconfig = rcIfconfig.ifconfig() if ifconfig.has_param("ipaddr", self.addr) is not None or \ ifconfig.has_param("ip6addr", self.addr) is not None: self.log.debug("%s@%s is up" % (self.addr, self.ipDev)) return True self.log.debug("%s@%s is down" % (self.addr, self.ipDev)) return False def allow_start(self): ifconfig = rcIfconfig.ifconfig() intf = ifconfig.interface(self.ipDev) if intf is None or not intf.flag_up: self.log.error("Interface %s is not up. Cannot stack over it." % self.ipDev) raise ex.IpDevDown(self.ipDev) if self.is_up() is True: self.log.info("%s is already up on %s" % (self.addr, self.ipDev)) raise ex.IpAlreadyUp(self.addr) if self.check_ping(): self.log.error("%s is already up on another host" % (self.addr)) raise ex.IpConflict(self.addr) return def startstandby(self): if rcEnv.nodename in self.always_on: self.start() def lock(self, timeout=30, delay=1): import lock lockfile = os.path.join(rcEnv.pathlock, 'startip') lockfd = None try: lockfd = lock.lock(timeout=timeout, delay=delay, lockfile=lockfile) except lock.lockTimeout: self.log.error("timed out waiting for lock") raise ex.excError except lock.lockNoLockFile: self.log.error("lock_nowait: set the 'lockfile' param") raise ex.excError except lock.lockCreateError: self.log.error("can not create lock file %s"%lockfile) raise ex.excError except lock.lockAcquire as e: self.log.warn("another action is currently running (pid=%s)"%e.pid) raise ex.excError except ex.excSignal: self.log.error("interrupted by signal") raise ex.excError except: self.log.error("unexpected locking error") import traceback traceback.print_exc() raise ex.excError self.lockfd = lockfd def unlock(self): import lock lock.unlock(self.lockfd) def start(self): try: self.getaddr() except: self.log.error("could not resolve %s to an ip address"%self.ipName) raise ex.excError try: self.allow_start() except (ex.IpConflict, ex.IpDevDown): raise ex.excError except ex.IpAlreadyUp: return self.log.debug('pre-checks passed') self.lock() ifconfig = rcIfconfig.ifconfig() if self.mask is None: self.mask = ifconfig.interface(self.ipDev).mask if self.mask == '': self.log.error("No netmask set on parent interface %s" % self.ipDev) raise ex.excError elif isinstance(self.mask, list): if len(self.mask) > 0: self.mask = self.mask[0] else: self.log.error("No netmask set on parent interface %s" % self.ipDev) raise ex.excError self.stacked_dev = ifconfig.get_stacked_dev(self.ipDev,\ self.addr,\ self.log) (ret, out, err) = self.startip_cmd() self.unlock() if ret != 0: self.log.error("failed") raise ex.excError self.arp_announce() def stop(self): try: self.getaddr() except: self.log.error("could not resolve %s to an ip address"%self.ipName) raise ex.excError if self.is_up() is False: self.log.info("%s is already down on %s" % (self.addr, self.ipDev)) return ifconfig = rcIfconfig.ifconfig() self.stacked_dev = ifconfig.get_stacked_dev(self.ipDev,\ self.addr,\ self.log) (ret, out, err) = self.stopip_cmd() if ret != 0: self.log.error("failed") raise ex.excError import time tmo = 15 for i in range(tmo): if not self.check_ping(): break time.sleep(1) if i == tmo-1: self.log.error("%s refuse to go down"%self.addr) raise ex.excError def provision(self): m = __import__("provIp") prov = m.ProvisioningIp(self) prov.provisioner() if __name__ == "__main__": for c in (Ip,) : help(c) print """i1=Ip("eth0","192.168.0.173")""" i=Ip("eth0","192.168.0.173") print "show i", i print """i.do_action("start")""" i.do_action("start") 07070100024607000081b40000000000000000000000014faa9509000005e2000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/svcLdom.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import svc import resContainerLdom as ldom import rcStatus import rcExceptions as ex from rcGlobalEnv import rcEnv class SvcLdom(svc.Svc): """ Define ldom services""" def __init__(self, svcname, vmname=None, guestos=None, optional=False, disabled=False, tags=set([])): svc.Svc.__init__(self, svcname, optional=optional, disabled=disabled, tags=tags) if vmname is None: vmname = svcname self.vmname = vmname self.guestos = guestos self += ldom.Ldom(vmname, disabled=disabled) self.runmethod = rcEnv.rsh.split() + [vmname] 070701000245a2000081b40000000000000000000000014faa950900000178000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/rcUtilitiesDarwin.pyfrom rcUtilities import call, qcall def check_ping(addr, timeout=5, count=1): if ':' in addr: ping = 'ping6' else: ping = 'ping' cmd = [ping, '-c', repr(count), '-W', repr(timeout), '-t', repr(timeout), addr] (ret, out, err) = call(cmd) if ret == 0: return True return False 070701000245fb000081b40000000000000000000000014faa950900001338000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/snapJfs2AIX.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcGlobalEnv import rcEnv from rcUtilities import which, qcall, protected_mount import rcExceptions as ex import snap class Snap(snap.Snap): def lv_exists(self, device): device = device.split("/")[-1] ret = qcall(['lslv', device], cache=True) if ret == 0: return True return False def lv_info(self, device): device = device.split("/")[-1] (ret, buff, err) = self.call(['lslv', device], cache=True) if ret != 0: return (None, None, None) vg_name = None lv_name = None lv_size = 0 prev = '' prevprev = '' pp_unit = '' pps = 0 pp_size = 0 for word in buff.split(): if prev == "GROUP:": vg_name = word if prev == "VOLUME:": lv_name = word if prev == "SIZE:": pp_size = int(word) if prevprev == "SIZE:": pp_unit = word if prev == "PPs:" and prevprev != "STALE": pps = int(word) prevprev = prev prev = word if pps == 0 or pp_size == 0 or pp_unit == '' or vg_name is None: self.log.error("logical volume %s information fetching error"%device) print "pps = ", pps print "pp_size = ", pp_size print "pp_unit = ", pp_unit print "vg_name = ", vg_name raise ex.excError if pp_unit == 'megabyte(s)': mult = 1 elif pp_unit == 'gigabyte(s)': mult = 1024 elif pp_unit == 'terabyte(s)': mult = 1024*1024 else: self.log.error("unexpected logical volume PP size unit: %s"%pp_unit) raise ex.excError return (vg_name, lv_name, pps*pp_size*mult) def snapcreate(self, m): snap_name = '' snap_mnt = '' (vg_name, lv_name, lv_size) = self.lv_info(m.device) if lv_name is None: self.log.error("can not snap %s: not a logical volume"%m.device) raise ex.syncNotSnapable if len(lv_name) > 12: self.log.error("can not snap lv with name >12 chars") raise ex.excError snap_name = 'sy_'+os.path.basename(lv_name) if self.lv_exists(os.path.join(vg_name, snap_name)): self.log.error("snap of %s already exists"%(lv_name)) raise ex.syncSnapExists print lv_size print lv_size//10 (ret, buff, err) = self.vcall(['mklv', '-t', 'jfs2', '-y', snap_name, vg_name, str(lv_size//10)+'M']) if ret != 0: raise ex.syncSnapCreateError snap_mnt = '/service/tmp/osvc_sync_'+os.path.basename(vg_name)+'_'+os.path.basename(lv_name) if not os.path.exists(snap_mnt): os.makedirs(snap_mnt, 0755) snap_dev = os.path.join(os.sep, 'dev', snap_name) (ret, buff, err) = self.vcall(['snapshot', '-o', 'snapfrom='+m.mountPoint, snap_dev]) if ret != 0: raise ex.syncSnapMountError (ret, buff, err) = self.vcall(['mount', '-o', 'snapshot', snap_dev, snap_mnt]) if ret != 0: raise ex.syncSnapMountError self.snaps[m.mountPoint] = dict(lv_name=lv_name, vg_name=vg_name, snap_name=snap_name, snap_mnt=snap_mnt, snap_dev=snap_dev) def snapdestroykey(self, s): if protected_mount(self.snaps[s]['snap_mnt']): self.log.error("the snapshot is no longer mounted in %s. panic."%self.snaps[s]['snap_mnt']) raise ex.excError """ fuser on HP-UX outs to stderr ... """ cmd = ['fuser', '-c', '-x', '-k', self.snaps[s]['snap_mnt']] ret = qcall(cmd) cmd = ['umount', self.snaps[s]['snap_mnt']] (ret, out, err) = self.vcall(cmd) cmd = ['snapshot', '-d', self.snaps[s]['snap_dev']] (ret, buff, err) = self.vcall(cmd) 0707010002451e000081b40000000000000000000000014faa9509000004b3000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/hostidHP-UX.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from rcUtilities import which from subprocess import * def hostid(): if which('getconf') is None: return '1' cmd = ['getconf', 'MACHINE_SERIAL'] p = Popen(cmd, stderr=None, stdout=PIPE, close_fds=True) buff = p.communicate() sn = buff[0].split()[0] if p.returncode != 0: return '1' return str(hex(abs(sn.__hash__()))).replace('0x', '') 0707010002451a000081b40000000000000000000000014faa9509000045c9000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/compliance.pyfrom stat import * import os import sys import re import datetime import rcExceptions as ex from rcGlobalEnv import rcEnv from rcUtilities import is_exe, justcall, banner from subprocess import * from rcPrintTable import print_table comp_dir = os.path.join(rcEnv.pathvar, 'compliance') # ex: \x1b[37;44m\x1b[1mContact List\x1b[0m\n regex = re.compile("\x1b\[([0-9]{1,3}(;[0-9]{1,3})*)?[m|K|G]", re.UNICODE) class Module(object): pattern = '^S*[0-9]+-*%(name)s$' def __init__(self, name): self.name = name self.executable = None dl = os.listdir(comp_dir) match = [] for e in dl: if re.match(self.pattern%dict(name=name), e) is not None: match.append(e) if len(match) == 0: raise ex.excInitError('module %s not found in %s'%(name, comp_dir)) if len(match) > 1: raise ex.excError('module %s matches too many entries in %s'%(name, comp_dir)) base = match[0] if base[0] == 'S': base == base[1:] for i, c in enumerate(base): if not c.isdigit(): break self.ordering = int(base[0:i]) regex2 = re.compile("^S*[0-9]+-*", re.UNICODE) self.name = regex2.sub("", match[0]) locations = [] locations.append(os.path.join(comp_dir, match[0])) locations.append(os.path.join(locations[0], 'main')) locations.append(os.path.join(locations[0], 'scripts', 'main')) for loc in locations: if not os.path.exists(loc): continue statinfo = os.stat(loc) mode = statinfo[ST_MODE] if statinfo.st_uid != 0 or statinfo.st_gid not in (0,2,3,4): raise ex.excError('%s is not owned by root. security hazard.'%(loc)) if not S_ISREG(mode): continue if not is_exe(loc): mode |= S_IXUSR os.chmod(loc, mode) self.executable = loc if self.executable is None: raise ex.excError('executable not found for module %s'%(name)) def __str__(self): a = [] a.append("name: %s"%self.name) a.append("ordering: %d"%self.ordering) a.append("executable: %s"%self.executable) return '\n'.join(a) def strip_unprintable(self, s): return regex.sub('', s) def log_action(self, out, ret, action): ruleset = ','.join(self.ruleset) vars = ['run_nodename', 'run_module', 'run_status', 'run_log', 'run_ruleset', 'run_action', 'rset_md5'] vals = [rcEnv.nodename, self.name, str(ret), self.strip_unprintable(out), ruleset, action, self.rset_md5] if self.svcname is not None: vars.append('run_svcname') vals.append(self.svcname) self.collector.call('comp_log_action', vars, vals, sync=False) def action(self, action): print banner(self.name) if action not in ['check', 'fix', 'fixable']: print 'action %s not supported' return 1 if self.options.force: # short-circuit all pre and post action return self.do_action(action) if action == 'fix': if self.do_action('check') == 0: print 'check passed, skip fix' return 0 if self.do_action('fixable') not in (0, 2): print 'not fixable, skip fix' return 1 self.do_action('fix') r = self.do_action('check') elif action == 'check': r = self.do_action('check') if r == 1: self.do_action('fixable') elif action == 'fixable': r = self.do_action('fixable') return r def do_action(self, action): start = datetime.datetime.now() cmd = [self.executable, action] log = '' print "ACTION: %s"%action print "START: %s"%str(start) print "COMMAND: %s"%' '.join(cmd) print "LOG:" import tempfile import time fo = tempfile.NamedTemporaryFile() fe = tempfile.NamedTemporaryFile() _fo = None _fe = None def poll_out(): fop = _fo.tell() line = _fo.readline() if not line: _fo.seek(fop) return None sys.stdout.write(line) sys.stdout.flush() return line def poll_err(): fep = _fe.tell() line = _fe.readline() if not line: _fe.seek(fep) return None line = 'ERR: '+line sys.stdout.write(line) sys.stdout.flush() return line def poll_pipes(log): i = 0 while True: o = poll_out() e = poll_err() if o is not None: log += o if e is not None: log += e if o is None and e is None: break return log try: p = Popen(cmd, stdout=fo, stderr=fe) _fo = open(fo.name, 'r') _fe = open(fe.name, 'r') while True: time.sleep(0.1) log = poll_pipes(log) if p.poll() != None: log = poll_pipes(log) break except OSError, e: if _fo is not None: _fo.close() if _fe is not None: _fe.close() fo.close() fe.close() if e.errno == 2: raise ex.excError("%s execution error (File not found or bad interpreter)"%self.executable) elif e.errno == 8: raise ex.excError("%s execution error (Exec format error)"%self.executable) else: raise fo.close() fe.close() _fo.close() _fe.close() end = datetime.datetime.now() print "RCODE: %d"%p.returncode print "DURATION: %s"%str(end-start) self.log_action(log, p.returncode, action) return p.returncode def check(self): return self.action('check') def fix(self): return self.action('fix') def fixable(self): return self.action('fixable') class Compliance(object): def __init__(self, skip_action=None, options=None, collector=None, svcname=None): self.skip_action = skip_action self.options = options self.collector = collector self.svcname = svcname self.options = options self.module_o = {} self.module = [] def compliance_check(self): flag = "last_comp_check" if self.svcname is not None: flag = '.'.join((flag, self.svcname)) if self.skip_action is not None and \ self.skip_action("compliance", 'comp_check_interval', flag, period_option='comp_check_period', days_option='comp_check_days'): return self.do_checks() def __iadd__(self, o): self.module_o[o.name] = o o.svcname = self.svcname o.ruleset = self.ruleset o.options = self.options o.collector = self.collector o.rset_md5 = self.rset_md5 return self def set_rset_md5(self): self.rset_md5 = "" if 'OSVC_COMP_RULESET_MD5' in os.environ: self.rset_md5 = os.environ['OSVC_COMP_RULESET_MD5'] def init(self): if self.options.moduleset != "" and self.options.module != "": raise ex.excError('--moduleset and --module are exclusive') if self.options.moduleset == "" and self.options.module == "": self.moduleset = self.get_moduleset() else: self.moduleset = self.options.moduleset.split(',') self.module = self.options.module.split(',') if len(self.moduleset) > 0 and hasattr(self.options, "attach") and self.options.attach: self._compliance_attach_moduleset(self.moduleset) self.module = self.merge_moduleset_modules() self.ruleset = self.get_ruleset() self.setup_env() self.set_rset_md5() if not os.path.exists(comp_dir): os.makedirs(comp_dir, 0755) raise ex.excError('modules [%s] are not present in %s'%( ','.join(self.module), comp_dir)) for module in self.module: try: self += Module(module) except ex.excInitError, e: print >>sys.stderr, e self.ordered_module = self.module_o.keys() self.ordered_module.sort(lambda x, y: cmp(self.module_o[x].ordering, self.module_o[y].ordering)) def __str__(self): print banner('run context') a = [] a.append('modules:') for m in self.ordered_module: a.append(' %0.2d %s'%(self.module_o[m].ordering, m)) a.append(self.str_ruleset()) return '\n'.join(a) def format_rule_var(self, var): var = var.upper().replace('-', '_').replace(' ', '_').replace('.','_') var = '_'.join(('OSVC_COMP', var)) return var def format_rule_val(self, val): if isinstance(val, unicode): val = repr(val).strip("'") else: val = str(val) return val def setup_env(self): for rule in self.ruleset.values(): for var, val in rule['vars']: os.environ[self.format_rule_var(var)] = self.format_rule_val(val) def get_moduleset(self): if self.svcname is not None: moduleset = self.collector.call('comp_get_svc_moduleset', self.svcname) else: moduleset = self.collector.call('comp_get_moduleset') if moduleset is None: raise ex.excError('could not fetch moduleset') return moduleset def get_ruleset(self): if hasattr(self.options, 'ruleset') and \ len(self.options.ruleset) > 0: return self.get_ruleset_md5(self.options.ruleset) return self.get_current_ruleset() def get_current_ruleset(self): if self.svcname is not None: ruleset = self.collector.call('comp_get_svc_ruleset', self.svcname) else: ruleset = self.collector.call('comp_get_ruleset') if ruleset is None: raise ex.excError('could not fetch ruleset') return ruleset def get_ruleset_md5(self, rset_md5): ruleset = self.collector.call('comp_get_ruleset_md5', rset_md5) if ruleset is None: raise ex.excError('could not fetch ruleset') return ruleset def str_ruleset(self): a = [] a.append('rules:') for rule in self.ruleset.values(): if len(rule['filter']) == 0: a.append(' %s'%rule['name']) else: a.append(' %s (%s)'%(rule['name'],rule['filter'])) for var, val in rule['vars']: val = self.format_rule_val(val) if ' ' in val: val = repr(val) a.append(' %s=%s'%(self.format_rule_var(var), val)) return '\n'.join(a) def merge_moduleset_modules(self): modules = self.get_moduleset_modules(self.moduleset) return set(self.module + modules) - set(['']) def get_moduleset_modules(self, m): moduleset = self.collector.call('comp_get_moduleset_modules', m) if moduleset is None: raise ex.excError('could not expand moduleset modules') return moduleset def digest_errors(self, err): passed = [m for m in err if err[m] == 0] errors = [m for m in err if err[m] == 1] na = [m for m in err if err[m] == 2] n_passed = len(passed) n_errors = len(errors) n_na = len(na) def _s(n): if n > 1: return 's' else: return '' def modules(l): if len(l) == 0: return '' return '\n%s'%'\n'.join(map(lambda x: ' '+x, l)) print banner("digest") print "%d n/a%s"%(n_na, modules(na)) print "%d passed%s"%(n_passed, modules(passed)) print "%d error%s%s"%(n_errors, _s(n_errors), modules(errors)) if len(errors) > 0: return 1 return 0 def compliance_show_moduleset(self): self.moduleset = self.get_moduleset() for ms in self.moduleset: print ms+':' for m in self.get_moduleset_modules(ms): print ' %s'%m def compliance_show_ruleset(self): self.ruleset = self.get_ruleset() self.setup_env() print self.str_ruleset() def do_run(self, action): err = {} self.init() start = datetime.datetime.now() for module in self.ordered_module: err[module] = getattr(self.module_o[module], action)() r = self.digest_errors(err) end = datetime.datetime.now() print "total duration: %s"%str(end-start) return r def do_checks(self): return self.do_run('check') def compliance_fix(self): return self.do_run('fix') def compliance_fixable(self): return self.do_run('fixable') def compliance_attach_moduleset(self): if not hasattr(self.options, 'moduleset') or \ len(self.options.moduleset) == 0: raise ex.excError('no moduleset specified. use --moduleset') self._compliance_attach_moduleset(self.options.moduleset.split(',')) def _compliance_attach_moduleset(self, modulesets): err = False for moduleset in modulesets: if self.svcname is not None: d = self.collector.call('comp_attach_svc_moduleset', self.svcname, moduleset) else: d = self.collector.call('comp_attach_moduleset', moduleset) if not d['status']: err = True print d['msg'] if err: raise ex.excError() def compliance_detach_moduleset(self): if not hasattr(self.options, 'moduleset') or \ len(self.options.moduleset) == 0: raise ex.excError('no moduleset specified. use --moduleset') err = False for moduleset in self.options.moduleset.split(','): if self.svcname is not None: d = self.collector.call('comp_detach_svc_moduleset', self.svcname, moduleset) else: d = self.collector.call('comp_detach_moduleset', moduleset) if not d['status']: err = True print d['msg'] if err: raise ex.excError() def compliance_attach_ruleset(self): if not hasattr(self.options, 'ruleset') or \ len(self.options.ruleset) == 0: raise ex.excError('no ruleset specified. use --ruleset') err = False for ruleset in self.options.ruleset.split(','): if self.svcname is not None: d = self.collector.call('comp_attach_svc_ruleset', self.svcname, ruleset) else: d = self.collector.call('comp_attach_ruleset', ruleset) if not d['status']: err = True print d['msg'] if err: raise ex.excError() def compliance_detach_ruleset(self): if not hasattr(self.options, 'ruleset') or \ len(self.options.ruleset) == 0: raise ex.excError('no ruleset specified. use --ruleset') err = False for ruleset in self.options.ruleset.split(','): if self.svcname is not None: d = self.collector.call('comp_detach_svc_ruleset', self.svcname, ruleset) else: d = self.collector.call('comp_detach_ruleset', ruleset) if not d['status']: err = True print d['msg'] if err: raise ex.excError() def compliance_show_status(self): args = ['comp_show_status'] if self.svcname is None: args.append('') else: args.append(self.svcname) if hasattr(self.options, 'module') and \ len(self.options.module) > 0: args.append(self.options.module) l = self.collector.call(*args) if l is None: return print_table(l, width=50) def compliance_list_ruleset(self): if not hasattr(self.options, 'ruleset') or \ len(self.options.ruleset) == 0: l = self.collector.call('comp_list_ruleset') else: l = self.collector.call('comp_list_ruleset', self.options.ruleset) if l is None: return print '\n'.join(l) def compliance_list_moduleset(self): if not hasattr(self.options, 'moduleset') or \ len(self.options.moduleset) == 0: l = self.collector.call('comp_list_moduleset') else: l = self.collector.call('comp_list_moduleset', self.options.moduleset) if l is None: return print '\n'.join(l) def compliance_list_module(self): import glob regex2 = re.compile("^S*[0-9]+-*", re.UNICODE) for path in glob.glob(os.path.join(comp_dir, '*')): name = regex2.sub("", os.path.basename(path)) try: m = Module(name) print m.name except: continue 07070100024562000081b40000000000000000000000014faa9509000011e9000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/rcMountsAIX.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcMounts #import resLoopAIX as Res from rcUtilities import * from subprocess import Popen def get_src_dir_dev(dev): """Given a directory path, return its hosting device """ process = Popen(['df', dev], stdout=PIPE, stderr=STDOUT, close_fds=True) buff = process.communicate() out = buff[0] i = out.index('/') return out[i:].split()[0] class Mounts(rcMounts.Mounts): def match_mount(self, i, dev, mnt): """Given a line of 'mount' output, returns True if (dev, mnt) matches this line. Returns False otherwize. Also care about weirdos like loops and binds, ... """ if os.path.isdir(dev): is_bind = True src_dir_dev = get_src_dir_dev(dev) else: is_bind = False if i.mnt != mnt: return False if i.dev == dev: return True # if i.dev in Res.file_to_loop(dev): # return True if is_bind and i.dev == src_dir_dev: return True return False def __init__(self): self.mounts = [] (ret, out, err) = call(['mount']) lines = out.split('\n') if len(lines) < 3: return for l in lines[2:]: if len(l) == 0: continue x = l.split() if x[0] == '-hosts': continue elif x[0][0] == '/': dev, mnt, type, null, null, null, mnt_opt = l.split() else: v = l.split() if len(v) == 7: node, dev, mnt, type, null, null, null = l.split() mntopt = "" if len(v) == 8: node, dev, mnt, type, null, null, null, mnt_opt = l.split() else: continue m = rcMounts.Mount(dev, mnt, type, mnt_opt) self.mounts.append(m) """ node mounted mounted over vfs date options -------- --------------- --------------- ------ ------------ --------------- /dev/hd4 / jfs2 Jun 14 19:42 rw,log=/dev/hd8 /dev/hd2 /usr jfs2 Jun 14 19:42 rw,log=/dev/hd8 /dev/hd9var /var jfs2 Jun 14 19:42 rw,log=/dev/hd8 /dev/hd3 /tmp jfs2 Jun 14 19:42 rw,log=/dev/hd8 /dev/hd1 /home jfs2 Jun 14 19:48 rw,log=/dev/hd8 /proc /proc procfs Jun 14 19:48 rw /dev/hd10opt /opt jfs2 Jun 14 19:48 rw,log=/dev/hd8 node mounted mounted over vfs date options -------- --------------- --------------- ------ ------------ --------------- /dev/hd4 / jfs2 Nov 29 11:22 rw,log=/dev/hd8 /dev/hd2 /usr jfs2 Nov 29 11:22 rw,log=/dev/hd8 /dev/hd9var /var jfs2 Nov 29 11:22 rw,log=/dev/hd8 /dev/hd3 /tmp jfs2 Nov 29 11:23 rw,log=/dev/hd8 /dev/hd1 /home jfs2 Nov 29 11:23 rw,log=/dev/hd8 /proc /proc procfs Nov 29 11:23 rw /dev/hd10opt /opt jfs2 Nov 29 11:23 rw,log=/dev/hd8 /dev/lv_logs /logs jfs2 Nov 29 11:23 rw,log=/dev/hd8 /dev/lv_moteurs /moteurs jfs2 Nov 29 11:23 rw,log=/dev/hd8 -hosts /net autofs Nov 29 11:23 nosuid,vers=3,rw,nobrowse,ignore x64lmwbief4 /install/outils /mnt nfs3 Dec 07 11:53 """ if __name__ == "__main__" : help(Mounts) for m in Mounts(): print m 07070100024522000081b40000000000000000000000014faa950900000bb8000000ae00010002ffffffffffffffff0000001d00000000root/opt/opensvc/lib/lock.pyimport os import time import rcExceptions as ex from rcGlobalEnv import rcEnv class lockTimeout(Exception): """ acquire lock timed out """ class lockNoLockFile(Exception): """ no lockfile specified """ class lockCreateError(Exception): """ could not create lockfile """ class lockAcquire(Exception): """ could not acquire lock on lockfile """ def __init__(self, pid): self.pid = pid def monlock(timeout=30, delay=5, fname='svcmon.lock'): lockfile = os.path.join(rcEnv.pathlock, fname) try: lockfd = lock(timeout=timeout, delay=delay, lockfile=lockfile) except lockTimeout: print("timed out waiting for lock (%s)"%lockfile) raise ex.excError except lockNoLockFile: print("lock_nowait: set the 'lockfile' param") raise ex.excError except lockCreateError: print("can not create lock file (%s)"%lockfile) raise ex.excError except lockAcquire as e: print("another svcmon is currently running (pid=%s)"%e.pid) raise ex.excError except: print("unexpected locking error (%s)"%lockfile) raise ex.excError return lockfd def monunlock(lockfd): unlock(lockfd) def lock(timeout=30, delay=5, lockfile=None): for i in range(timeout//delay): try: return lock_nowait(lockfile) except lockAcquire: time.sleep(delay) raise lockTimeout def lock_nowait(lockfile=None): if lockfile is None: raise lockNoLockFile pid = 0 dir = os.path.dirname(lockfile) if not os.path.exists(dir): os.makedirs(dir) try: with open(lockfile, 'r') as fd: pid = int(fd.read()) fd.close() except: pass try: lockfd = os.open(lockfile, os.O_RDWR|os.O_SYNC|os.O_CREAT|os.O_TRUNC, 0644) except: raise lockCreateError try: """ test if we already own the lock """ if pid == os.getpid(): os.close(lockfd) return """ FD_CLOEXEC makes sure the lock is the held by processes we fork from this process """ if os.name == 'posix': import fcntl fcntl.flock(lockfd, fcntl.LOCK_EX|fcntl.LOCK_NB) flags = fcntl.fcntl(lockfd, fcntl.F_GETFD) flags |= fcntl.FD_CLOEXEC """ acquire lock """ fcntl.fcntl(lockfd, fcntl.F_SETFD, flags) elif os.name == 'nt': import msvcrt size = os.path.getsize(lockfile) msvcrt.locking(lockfd, msvcrt.LK_RLCK, size) """ drop our pid in the lockfile """ os.write(lockfd, str(os.getpid())) os.fsync(lockfd) return lockfd except IOError: raise lockAcquire(pid) except: raise def unlock(lockfd): if lockfd is None: return try: os.close(lockfd) except: """ already released by a parent process ? """ pass 07070100024505000081b40000000000000000000000014faa95090000085c000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/checkFsInodeLinux.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "fs_i" def find_svc(self, mountpt): for svc in self.svcs: for rs in svc.get_res_sets('fs'): for r in rs.resources: if r.mountPoint == mountpt: return svc.svcname return '' def do_check(self): cmd = ['df', '-lPi'] (out,err,ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef r = [] for line in lines[1:]: l = line.split() if len(l) != 6: continue # discard bind mounts: we get metric from the source anyway if l[0].startswith('/') and not l[0].startswith('/dev') and not l[0].startswith('//'): continue if l[5].startswith('/Volumes'): continue if "osvc_sync_" in l[0]: # do not report osvc sync snapshots fs usage continue r.append({ 'chk_instance': l[5], 'chk_value': l[4], 'chk_svcname': self.find_svc(l[5]), }) return r 0707010002456d000081b40000000000000000000000014faa95090000007a000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/rcOsHP-UX.pyimport rcOs from rcUtilities import justcall class Os(rcOs.Os): def reboot(self): justcall(['reboot', '-q']) 07070100024529000081b40000000000000000000000014faa95090000008f000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/provFsExt3.pyfrom provFs import ProvisioningFs class ProvisioningFsExt3(ProvisioningFs): mkfs = ['mkfs.ext3', '-F', '-q'] info = ['tune2fs', '-l'] 0707010002454d000081b40000000000000000000000014faa95090000171d000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/rcGlobalEnv.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # """module rcGlobalEnv module define rcEnv class rcEnv class attribute may be updated with rcLocalEnv module if present rcLocalEnv module is not provided with opensvc and allow customers to redefine following vars: o dbopensvc_host o dbopensvc_port o rsh o rcp rcLocalEnv.py may be installed into path_opensvc/lib """ import sys import os import platform class rcEnv: """Class to store globals """ allowed_svctype = ['PRD', 'PPRD', 'REC', 'INT', 'DEV', 'TST', 'TMP'] _platform = sys.platform sysname, nodename, x, x, machine, x = platform.uname() """program used to execute remote command on other nodes or virtual hosts """ if _platform == "sunos5" : if os.path.exists('/usr/local/bin/ssh'): rsh = "/usr/local/bin/ssh -o StrictHostKeyChecking=no -o ForwardX11=no -o BatchMode=yes -o ConnectTimeout=10" rcp = "/usr/local/bin/scp -o StrictHostKeyChecking=no -o ForwardX11=no -o BatchMode=yes -o ConnectTimeout=10" else: rsh = "/usr/bin/ssh -o StrictHostKeyChecking=no -o ForwardX11=no -o BatchMode=yes -n" rcp = "/usr/bin/scp -o StrictHostKeyChecking=no -o ForwardX11=no -o BatchMode=yes" elif os.path.exists('/etc/vmware-release'): rsh = "/usr/bin/ssh -o StrictHostKeyChecking=no -o ForwardX11=no -o BatchMode=yes" rcp = "/usr/bin/scp -o StrictHostKeyChecking=no -o ForwardX11=no -o BatchMode=yes" else: rsh = "/usr/bin/ssh -o StrictHostKeyChecking=no -o ForwardX11=no -o BatchMode=yes -o ConnectTimeout=10" rcp = "/usr/bin/scp -o StrictHostKeyChecking=no -o ForwardX11=no -o BatchMode=yes -o ConnectTimeout=10" """Database sink for node and service configurations and status collection. """ dbopensvc_host = "dbopensvc" dbopensvc_port = "8000" dbopensvc_app = "feed" dbcompliance_host = dbopensvc_host dbcompliance_port = dbopensvc_port dbcompliance_app = "init" """EZ-HA defines. EZ-HA does heartbeat, stonith, automatic service failover ez_last_chance == True: check_up_script_gen.sh will try a ping + RSH other node before stonith ez_startapp_bg == True: startapp in background if EZ-HA take-over is succesful """ ez_path = "/usr/local/cluster" ez_path_services = ez_path + "/conf/services" ez_last_chance = True ez_startapp_bg = True """Directory on DRP node where to store the PRD nodes files necessary for takeover. """ drp_path = "/opt/opensvc/var/cache/" drp_sync_excludes = [ '--exclude="/spice"', '--exclude="/dbadm"', '--exclude="*.dmp"', '--exclude="*.dbf"', '--exclude="*.rdo"', '--exclude="*.log"', '--exclude="*.Z"', '--exclude="*.gz"', '--exclude="*.tgz"', '--exclude="*.tar"', '--exclude="*.tmp"', '--exclude="/oracle/ficimp"', '--exclude="/oracle/tmp"', '--exclude="/oracle/LOG/*"', '--exclude="/oracle/product/*/network/log/listener*.log"', ] drp_sync_etc_solaris = [ "/etc/inet", "/etc/inetd.conf", "/etc/defaultdomain", "/etc/lp", "/etc/printers.conf", "/etc/system", "/etc/auto_master", "/etc/auto_home", "/etc/hosts.equiv", "/etc/pam.conf", "/etc/cron.d", ] drp_sync_etc_linux = [ # linux "/etc/xinetd.d", "/etc/xinetd.conf", "/etc/sysconfig", "/etc/cups", "/etc/auto.master", "/etc/auto.misc", "/etc/listener.ora", "/etc/oratab", "/etc/sqlnet.ora", "/etc/tnsnames.ora", "/etc/yp.conf", "/etc/pam.d", "/etc/cron.allow", "/etc/cron.deny", ] drp_sync_etc_common = [ # common "/etc/shadow", "/etc/passwd", "/etc/group", "/etc/syslog.conf", "/etc/services", "/etc/hosts", "/etc/nsswitch.conf", "/etc/sudoers", "/etc/project", "/etc/user_attr", "/etc/ssh", "/etc/centrifydc", "/etc/krb5*", "/etc/sudoers", ] drp_sync_misc = [ "/var/centrifydc", "/var/opt/oracle", "/var/spool/cron", "/var/spool/cron/crontabs", "/var/yp/binding", "/usr/local/oraenv", "/usr/local/coraenv", "/usr/local/dbhome", "/usr/local/etc/sudoers", ] drp_sync_files = [ [drp_sync_etc_solaris + drp_sync_etc_linux + drp_sync_etc_common + drp_sync_misc, []], [["/home/oracle", "/home/sybase", "/opt/oracle", "/opt/sybase"], drp_sync_excludes], ] vt_libvirt = ['kvm', 'lxc', 'xen'] vt_vm = ['ldom', 'hpvm', 'kvm', 'xen', 'vbox', 'ovm', 'esx'] vt_container = ['zone', 'lxc', 'jail', 'vz'] vt_supported = vt_vm + vt_container dbopensvc = "http://%s:%s/%s/default/call/xmlrpc"%(dbopensvc_host, dbopensvc_port, dbopensvc_app) dbcompliance = "http://%s:%s/%s/compliance/call/xmlrpc"%(dbcompliance_host, dbcompliance_port, dbcompliance_app) 0707010002453b000081b40000000000000000000000014faa950900000e7c000000ae00010002ffffffffffffffff0000002700000000root/opt/opensvc/lib/rcAssetWindows.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import sys import platform import datetime from rcUtilities import justcall, which from rcUtilitiesWindows import get_registry_value import rcAsset import ctypes import wmi class MEMORYSTATUSEX(ctypes.Structure): _fields_ = [("dwLength", ctypes.c_uint), ("dwMemoryLoad", ctypes.c_uint), ("ullTotalPhys", ctypes.c_ulonglong), ("ullAvailPhys", ctypes.c_ulonglong), ("ullTotalPageFile", ctypes.c_ulonglong), ("ullAvailPageFile", ctypes.c_ulonglong), ("ullTotalVirtual", ctypes.c_ulonglong), ("ullAvailVirtual", ctypes.c_ulonglong), ("sullAvailExtendedVirtual", ctypes.c_ulonglong),] def __init__(self): # have to initialize this to the size of MEMORYSTATUSEX self.dwLength = 2*4 + 7*8 # size = 2 ints, 7 longs return super(MEMORYSTATUSEX, self).__init__() class Asset(rcAsset.Asset): def __init__(self, node): self.w = wmi.WMI() rcAsset.Asset.__init__(self, node) self.memstat = MEMORYSTATUSEX() ctypes.windll.kernel32.GlobalMemoryStatusEx(ctypes.byref(self.memstat)) def _get_mem_bytes(self): return str(self.memstat.ullTotalPhys // 1024 // 1024) def _get_mem_banks(self): return '0' def _get_mem_slots(self): return '0' def _get_os_vendor(self): return 'Microsoft' def _get_os_name(self): return 'Windows' def _get_os_release(self): v = sys.getwindowsversion() product = { 1: 'Workstation', 2: 'Domain Controller', 3: 'Server', } s = platform.release() s = s.replace('Server', ' Server') s = s.replace('Workstation', ' Workstation') s += " %s" % v.service_pack return s def _get_os_kernel(self): v = sys.getwindowsversion() return ".".join(map(str, [v.major, v.minor, v.build])) def _get_os_arch(self): return platform.uname()[4] def _get_cpu_freq(self): c = wmi.WMI() for i in c.Win32_Processor(): cpuspeed = i.MaxClockSpeed return str(cpuspeed) def _get_cpu_cores(self): n = len(self.w.Win32_Processor()) return str(n) def _get_cpu_dies(self): n = len(self.w.Win32_Processor()) return str(n) def _get_cpu_model(self): for i in self.w.Win32_Processor(): cputype = i.Name return cputype def _get_serial(self): return 'Unknown' def _get_model(self): key = ["HKEY_LOCAL_MACHINE", "SYSTEM\\CurrentControlSet\\Control\\SystemInformation", "SystemProductName"] #key = "HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\OEMInformation" #key = "HKEY_LOCAL_MACHINE\DESCRIPTION\SYSTEM\BIOS" compname = get_registry_value(*key) return compname def _get_hba(self): return [] def _get_targets(self): return [] 07070100024525000081b40000000000000000000000014faa950900000452000000ae00010002ffffffffffffffff0000002200000000root/opt/opensvc/lib/nodeHP-UX.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import node class Node(node.Node): def shutdown(self): cmd = ["shutdown", "-h", "-y", "0"] ret, out, err = self.vcall(cmd) def reboot(self): cmd = ["shutdown", "-r", "-y", "0"] ret, out, err = self.vcall(cmd) 070701000245c3000081b40000000000000000000000014faa9509000007c2000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/resIpFreeBSD.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. "Module implement Linux specific ip management" import resIp as Res import rcExceptions as ex from rcUtilitiesFreeBSD import check_ping class Ip(Res.Ip): def check_ping(self): self.log.info("checking %s availability"%self.addr) return check_ping(self.addr) def arp_announce(self): return def startip_cmd(self): if ':' in self.addr: if '.' in self.mask: self.log.error("netmask parameter is mandatory for ipv6 adresses") raise ex.excError cmd = ['ifconfig', self.ipDev, 'inet6', '/'.join([self.addr, self.mask]), 'add'] else: cmd = ['ifconfig', self.ipDev, 'inet', self.addr, 'netmask', self.mask, 'add'] return self.vcall(cmd) def stopip_cmd(self): if ':' in self.addr: cmd = ['ifconfig', self.ipDev, 'inet6', self.addr, 'delete'] else: cmd = ['ifconfig', self.ipDev, 'inet', self.addr, 'delete'] return self.vcall(cmd) if __name__ == "__main__": for c in (Ip,) : help(c) 07070100024528000081b40000000000000000000000014faa95090000008f000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/provFsExt2.pyfrom provFs import ProvisioningFs class ProvisioningFsExt2(ProvisioningFs): mkfs = ['mkfs.ext2', '-F', '-q'] info = ['tune2fs', '-l'] 070701000245d6000081b40000000000000000000000014faa950900000f40000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/resMountHP-UX.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import os import rcStatus from rcGlobalEnv import rcEnv rcMounts = __import__('rcMounts'+rcEnv.sysname) import resMount as Res from rcUtilities import qcall, protected_mount import rcExceptions as ex def try_umount(self): cmd = ['umount', self.mountPoint] (ret, out, err) = self.vcall(cmd, err_to_info=True) if ret == 0: return 0 """ don't try to kill process using the source of a protected bind mount """ if protected_mount(self.mountPoint): return 1 """ best effort kill of all processes that might block the umount operation. The priority is given to mass action reliability, ie don't contest oprator's will """ cmd = ['sync'] (ret, out, err) = self.vcall(cmd, err_to_info=True) for i in range(4): cmd = ['fuser', '-kc', self.mountPoint] (ret, out, err) = self.vcall(cmd, err_to_info=True) self.log.info('umount %s'%self.mountPoint) cmd = ['umount', self.mountPoint] ret = qcall(cmd) if ret == 0: break return ret class Mount(Res.Mount): """ define HP-UX mount/umount doAction """ def __init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size=None, always_on=set([]), disabled=False, tags=set([]), optional=False, monitor=False): Res.Mount.__init__(self, rid, mountPoint, device, fsType, mntOpt, snap_size, always_on, disabled=disabled, tags=tags, optional=optional, monitor=monitor) self.fsck_h = { 'vxfs': {'bin': 'fsck', 'cmd': ['fsck', '-F', 'vxfs', '-y', self.device]}, } def is_up(self): return rcMounts.Mounts().has_mount(self.device, self.mountPoint) def start(self): Res.Mount.start(self) if self.is_up() is True: self.log.info("fs(%s %s) is already mounted"% (self.device, self.mountPoint)) return 0 self.fsck() if not os.path.exists(self.mountPoint): os.makedirs(self.mountPoint, 0755) if self.fsType != "": fstype = ['-F', self.fsType] else: fstype = [] if self.mntOpt != "": mntopt = ['-o', self.mntOpt] else: mntopt = [] cmd = ['mount']+fstype+mntopt+[self.device, self.mountPoint] (ret, out, err) = self.vcall(cmd) if ret != 0: raise ex.excError def stop(self): if self.is_up() is False: self.log.info("fs(%s %s) is already umounted"% (self.device, self.mountPoint)) return 0 for i in range(3): ret = try_umount(self) if ret == 0: break if ret != 0: self.log.error('failed to umount %s'%self.mountPoint) raise ex.excError if __name__ == "__main__": for c in (Mount,) : help(c) 07070100024535000081b40000000000000000000000014faa950900000f35000000ae00010002ffffffffffffffff0000002300000000root/opt/opensvc/lib/rcAssetAIX.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import datetime from rcUtilities import justcall, which from rcGlobalEnv import rcEnv import rcAsset class Asset(rcAsset.Asset): def __init__(self, node): rcAsset.Asset.__init__(self, node) (out, err, ret) = justcall(['prtconf']) if ret != 0: self.prtconf = [] else: self.prtconf = out.split('\n') self.lpar = self.is_lpar() def is_lpar(self): cmd = ["prtconf", "-L"] out, err, ret = justcall(cmd) if ret != 0: raise if '-1' in out: return False return True def _get_mem_bytes(self): cmd = ["prtconf", "-m"] out, err, ret = justcall(cmd) if ret != 0: return '0' l = out.split() if 'Memory Size:' not in out: return '0' if len(l) != 4: return '0' size = int(l[2]) unit = l[3] if unit == 'GB': size = size * 1024 elif unit == 'MB': pass else: return '0' return str(size) def _get_mem_banks(self): if self.lpar: return '0' return 'TODO' def _get_mem_slots(self): if self.lpar: return '0' return 'TODO' def _get_os_vendor(self): return 'IBM' def _get_os_name(self): return 'AIX' def _get_os_release(self): cmd = ["oslevel", "-s"] (out, err, ret) = justcall(cmd) if ret != 0: return 'Unknown' return out.strip() def _get_os_kernel(self): cmd = ["oslevel", "-r"] (out, err, ret) = justcall(cmd) if ret != 0: return 'Unknown' return out.strip() def _get_os_arch(self): for line in self.prtconf: if "Kernel Type:" in line: return line.split(":")[-1].strip() return 'Unknown' def _get_cpu_freq(self): for line in self.prtconf: if "Processor Clock Speed:" in line: return line.split(":")[-1].split()[0].strip() return '0' def _get_cpu_cores(self): cmd = ["bindprocessor", "-q"] out, err, ret = justcall(cmd) if ret != 0: return '0' l = out.split(":") return str(len(l[-1].strip().split())) def _get_cpu_dies(self): cmd = ["lsdev", "-Cc", "processor"] out, err, ret = justcall(cmd) if ret != 0: return '0' return str(len([line for line in out.split('\n') if 'proc' in line])) def _get_cpu_model(self): for line in self.prtconf: if "Processor Type:" in line: return line.split(":")[-1].strip() return 'Unknown' def _get_serial(self): for line in self.prtconf: if "Machine Serial Number:" in line: return line.split(":")[-1].strip() return 'Unknown' def _get_model(self): for line in self.prtconf: if "System Model:" in line: return line.split(":")[-1].strip() return 'Unknown' 07070100024553000081b40000000000000000000000014faa950900000a47000000ae00010002ffffffffffffffff0000002a00000000root/opt/opensvc/lib/rcIfconfigFreeBSD.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # from subprocess import * import rcIfconfig class ifconfig(rcIfconfig.ifconfig): def parse(self, out): prev = '' prevprev = '' for w in out.split(): if 'flags=' in w: i = rcIfconfig.interface(prev.replace(':','')) self.intf.append(i) # defaults i.link_encap = '' i.scope = '' i.bcast = '' i.mtu = '' i.ipaddr = [] i.mask = [] i.ip6addr = [] i.ip6mask = [] i.hwaddr = '' i.flag_up = False i.flag_broadcast = False i.flag_running = False i.flag_multicast = False i.flag_loopback = False flags = w.split('<')[1].split('>')[0].split(',') if 'UP' in flags: i.flag_up = True if 'BROADCAST' in flags: i.flag_broadcast = True if 'RUNNING' in flags: i.flag_running = True if 'MULTICAST' in flags: i.flag_multicast = True if 'LOOPBACK' in flags: i.flag_loopback = True elif 'inet' == prev: i.ipaddr += [w] elif 'inet6' == prev: i.ip6addr += [w.split('%')[0]] elif 'netmask' == prev: i.mask += [w] elif 'prefixlen' == prev: i.ip6mask += [w] elif 'ether' == prev: i.hwaddr = w prevprev = prev prev = w def __init__(self): self.intf = [] out = Popen(['ifconfig', '-a'], stdout=PIPE).communicate()[0] self.parse(out) 070701000245f4000081b40000000000000000000000014faa950900000726000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/resVgRawHP-UX.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import resVgRaw import os import rcStatus import re from rcUtilities import justcall class Vg(resVgRaw.Vg): def __init__(self, rid=None, devs=set([]), type=None, optional=False, disabled=False, tags=set([]), always_on=set([]), monitor=False): resVgRaw.Vg.__init__(self, rid=rid, devs=devs, type=type, optional=optional, disabled=disabled, tags=tags, always_on=always_on, monitor=monitor) self.devs = set([]) self.devs_not_found = set([]) for dev in devs: if os.path.exists(dev) and self.verify_dev(dev): self.devs.add(dev) else: self.devs_not_found.add(dev) def verify_dev(self, dev): cmd = ["diskinfo", dev] out, err, ret = justcall(cmd) if ret != 0: return False return True 0707010002459e000081b40000000000000000000000014faa9509000016eb000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/rcStatus.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os UP = 0 DOWN = 1 WARN = 2 NA = 3 TODO = 4 UNDEF = 5 STDBY_UP = 6 STDBY_DOWN = 7 STDBY_UP_WITH_UP = 8 STDBY_UP_WITH_DOWN = 9 GREEN = 32 RED = 31 YELLOW = 33 def colorize(color, text): #if os.isatty(1): # return '\033['+str(color)+'m'+text+'\033[m' #else: return text _status_value = { 'up': UP, 'down': DOWN, 'warn': WARN, 'n/a': NA, 'na': NA, 'todo': TODO, 'undef': UNDEF, 'stdby up': STDBY_UP, 'stdby down': STDBY_DOWN, } _status_str = { UP: colorize(GREEN, 'up'), DOWN: colorize(RED, 'down'), WARN: colorize(YELLOW, 'warn'), NA: 'n/a', TODO: 'todo', UNDEF: 'undef', STDBY_UP: 'stdby up', STDBY_DOWN: 'stdby down', STDBY_UP_WITH_UP: 'up', STDBY_UP_WITH_DOWN: 'stdby up', } def status_value(str): if str not in _status_value.keys(): return None return _status_value[str.lower()] def status_str(val): if val not in _status_str.keys(): return None return _status_str[val] def _merge(s1, s2): """Merge too status: WARN and TODO taint UP and DOWN """ if s1 not in _status_str: raise Exception("left member has unsupported value: %s"%str(s1)) elif s2 not in _status_str: raise Exception("right member has unsupported value: %s"%str(s2)) if s1 == UNDEF: return s2 elif s2 == UNDEF: return s1 setstate = set([s1, s2]) if setstate == set([ UP, UP ]): return UP elif setstate == set([ UP, DOWN ]): return WARN elif setstate == set([ UP, WARN ]): return WARN elif setstate == set([ UP, NA ]): return UP elif setstate == set([ UP, TODO ]): return WARN elif setstate == set([ UP, STDBY_UP ]): return STDBY_UP_WITH_UP elif setstate == set([ UP, STDBY_DOWN ]): return WARN elif setstate == set([ UP, STDBY_UP_WITH_UP ]): return STDBY_UP_WITH_UP elif setstate == set([ UP, STDBY_UP_WITH_DOWN ]): return WARN elif setstate == set([ DOWN, DOWN ]): return DOWN elif setstate == set([ DOWN, WARN ]): return WARN elif setstate == set([ DOWN, NA ]): return DOWN elif setstate == set([ DOWN, TODO ]): return WARN elif setstate == set([ DOWN, STDBY_UP ]): return STDBY_UP_WITH_DOWN elif setstate == set([ DOWN, STDBY_DOWN ]): return STDBY_DOWN elif setstate == set([ DOWN, STDBY_UP_WITH_UP ]): return WARN elif setstate == set([ DOWN, STDBY_UP_WITH_DOWN ]): return STDBY_UP_WITH_DOWN elif setstate == set([ WARN, WARN ]): return WARN elif setstate == set([ WARN, NA ]): return WARN elif setstate == set([ WARN, TODO ]): return WARN elif setstate == set([ WARN, STDBY_UP ]): return WARN elif setstate == set([ WARN, STDBY_DOWN ]): return WARN elif setstate == set([ WARN, STDBY_UP_WITH_UP ]): return WARN elif setstate == set([ WARN, STDBY_UP_WITH_DOWN ]): return WARN elif setstate == set([ NA, NA ] ): return NA elif setstate == set([ NA, TODO ]): return WARN elif setstate == set([ NA, STDBY_UP ]): return STDBY_UP elif setstate == set([ NA, STDBY_DOWN ]): return STDBY_DOWN elif setstate == set([ NA, STDBY_UP_WITH_UP ]): return STDBY_UP_WITH_UP elif setstate == set([ NA, STDBY_UP_WITH_DOWN ]): return STDBY_UP_WITH_DOWN elif setstate == set([ TODO, TODO ]): return TODO elif setstate == set([ TODO, STDBY_UP ]): return TODO elif setstate == set([ TODO, STDBY_DOWN ]): return TODO elif setstate == set([ TODO, STDBY_UP_WITH_UP ]): return TODO elif setstate == set([ TODO, STDBY_UP_WITH_DOWN ]): return TODO elif setstate == set([ STDBY_UP, STDBY_UP ]): return STDBY_UP elif setstate == set([ STDBY_UP, STDBY_DOWN ]): return WARN elif setstate == set([ STDBY_UP, STDBY_UP_WITH_UP ]): return STDBY_UP_WITH_UP elif setstate == set([ STDBY_UP, STDBY_UP_WITH_DOWN ]): return STDBY_UP_WITH_DOWN elif setstate == set([ STDBY_DOWN, STDBY_DOWN ]): return STDBY_DOWN elif setstate == set([ STDBY_DOWN, STDBY_UP_WITH_UP ]): return WARN elif setstate == set([ STDBY_DOWN, STDBY_UP_WITH_DOWN ]): return WARN elif setstate == set([ STDBY_UP_WITH_UP, STDBY_UP_WITH_DOWN ]): return WARN elif setstate == set([ STDBY_UP_WITH_UP, STDBY_UP_WITH_UP ]): return STDBY_UP_WITH_UP elif setstate == set([ STDBY_UP_WITH_DOWN, STDBY_UP_WITH_DOWN ]): return STDBY_UP_WITH_DOWN raise Exception("some member has unsupported value: %s , %s "%(str(s1),str(s2)) ) class Status(object): """Class that wraps printing and calculation of resource status """ def reset(self): self.status = UNDEF def __add__(self, s): self.status = _merge(self.status, s.status) return self def __iadd__(self, s): """Merge a status with current global status """ if isinstance(s, Status): self.status = _merge(self.status, s.status) else: self.status = _merge(self.status, s) return self def __str__(self): return status_str(self.status) def __init__(self, initial_status=UNDEF): self.status = initial_status 07070100024503000081b40000000000000000000000014faa95090000071d000000ae00010002ffffffffffffffff0000002b00000000root/opt/opensvc/lib/checkFsInodeDarwin.py# # Copyright (c) 2010 Christophe Varoqui ' # Copyright (c) 2010 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "fs_i" def find_svc(self, mountpt): for svc in self.svcs: for rs in svc.get_res_sets('fs'): for r in rs.resources: if r.mountPoint == mountpt: return svc.svcname return '' def do_check(self): cmd = ['df', '-lPi'] (out,err,ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef r = [] for line in lines[1:]: l = line.split() if len(l) != 9: continue if l[5].startswith('/Volumes'): continue r.append({ 'chk_instance': l[8], 'chk_value': l[7], 'chk_svcname': self.find_svc(l[8]), }) return r 070701000245a0000081b40000000000000000000000014faa950900001d56000000ae00010002ffffffffffffffff0000002400000000root/opt/opensvc/lib/rcUtilities.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os, sys import select import logging from subprocess import * from rcGlobalEnv import rcEnv def ximport(base): mod = base + rcEnv.sysname try: m = __import__(mod) return m except: pass return __import__(base) def fork(fn, kwargs): if os.fork() > 0: """ return to parent execution """ return pid """ separate the son from the father """ os.chdir('/') os.setsid() os.umask(0) try: pid = os.fork() if pid > 0: os._exit(0) except: os._exit(1) fn(**kwargs) os._exit(0) def check_privs(): if os.name == 'nt': return if os.getuid() != 0: print 'Insufficient privileges. Try:\n sudo ' + ' '.join(sys.argv) sys.exit(1) def banner(text, ch='=', length=78): spaced_text = ' %s ' % text banner = spaced_text.center(length, ch) return banner def is_exe(fpath): """Returns True if file path is executable, False otherwize does not follow symlink """ return os.path.exists(fpath) and os.access(fpath, os.X_OK) def which(program): def ext_candidates(fpath): yield fpath for ext in os.environ.get("PATHEXT", "").split(os.pathsep): yield fpath + ext fpath, fname = os.path.split(program) if fpath: if is_exe(program): return program else: for path in os.environ["PATH"].split(os.pathsep): exe_file = os.path.join(path, program) for candidate in ext_candidates(exe_file): if is_exe(candidate): return candidate return None def justcall(argv=['/bin/false']): """subprosses call argv, return (stdout,stderr,returncode) """ if which(argv[0]) is None: return ("", "", 1) if os.name == 'nt': close_fds = False else: close_fds = True process = Popen(argv, stdout=PIPE, stderr=PIPE, close_fds=close_fds) (stdout, stderr)=process.communicate(input=None) return (stdout, stderr, process.returncode) def empty_string(buff): b = buff.strip(' ').strip('\n') if len(b) == 0: return True return False def call(argv=['/bin/false'], cache=False, # serve/don't serve cmd output from cache log=None, # callers should provide there own logger # or we'll have to allocate a generic one info=False, # False: log cmd as debug # True: log cmd as info outlog=False, # False: discard stdout errlog=True, # False: discard stderr # True: log stderr as err, warn or info # depending on err_to_warn and # err_to_info value outdebug=True, # True: log.debug cmd stdout # False: skip log.debug stdout errdebug=True, # True: log.debug cmd stderr # False: skip log.debug stderr # depending on err_to_warn and # err_to_info value err_to_warn=False, err_to_info=False): "return(ret, stdout,stderr)" if log is None: log = logging.getLogger('CALL') if not argv or len(argv) == 0: return (0, '', '') if which(argv[0]) is None: log.error("%s does not exist or not in path or is not executable"% argv[0]) return (1, '', '') cmd = ' '.join(argv) if info: log.info(cmd) else: log.debug(cmd) if not hasattr(rcEnv, "call_cache"): rcEnv.call_cache = {} if not cache or cmd not in rcEnv.call_cache: if not cache: log.debug("caching for '%s' explicitely disabled"%cmd) elif cmd not in rcEnv.call_cache: log.debug("cache miss for '%s'"%cmd) process = Popen(argv, stdout=PIPE, stderr=PIPE, close_fds=True) buff = process.communicate() ret = process.returncode if ret == 0: log.debug("store '%s' output in cache"%cmd) rcEnv.call_cache[cmd] = buff elif cmd in rcEnv.call_cache: log.debug("discard '%s' output from cache because ret!=0"%cmd) del rcEnv.call_cache[cmd] else: log.debug("skip store '%s' output in cache because ret!=0"%cmd) else: log.debug("serve '%s' output from cache"%cmd) buff = rcEnv.call_cache[cmd] ret = 0 if not empty_string(buff[1]): if err_to_info: log.info('stderr:\n' + buff[1]) elif err_to_warn: log.warning('stderr:\n' + buff[1]) elif errlog: if ret != 0: log.error('stderr:\n' + buff[1]) else: log.warning('command succesful but stderr:\n' + buff[1]) elif errdebug: log.debug('stderr:\n' + buff[1]) if not empty_string(buff[0]): if outlog: if ret == 0: log.info('output:\n' + buff[0]) elif err_to_info: log.info('command failed with stdout:\n' + buff[0]) elif err_to_warn: log.warning('command failed with stdout:\n' + buff[0]) else: log.error('command failed with stdout:\n' + buff[0]) elif outdebug: log.debug('output:\n' + buff[0]) return (ret, buff[0], buff[1]) def qcall(argv=['/bin/false']) : """qcall Launch Popen it args disgarding output and stderr""" if not argv: return (0, '') process = Popen(argv, stdout=open('/dev/null'), stderr=open('/dev/null'), close_fds=True) process.wait() return process.returncode def vcall(argv=['/bin/false'], log=None, err_to_warn=False, err_to_info=False ): return call(argv, log=log, info=True, outlog=True, err_to_warn=err_to_warn, err_to_info=err_to_info) def getmount(path): path = os.path.abspath(path) while path != os.path.sep: if not os.path.islink(path) and os.path.ismount(path): return path path = os.path.abspath(os.path.join(path, os.pardir)) return path def protected_mount(path): if getmount(path) in ['/', '/usr', '/var', '/sys', '/proc', '/tmp', '/opt', '/dev', '/dev/pts', '/home', '/boot', '/dev/shm']: return True return False if __name__ == "__main__": print "call(('id','-a'))" (r,output,err)=call(("/usr/bin/id","-a")) print "status: ",r,"output:",output 070701000245cf000081b40000000000000000000000014faa95090000076d000000ae00010002ffffffffffffffff0000002000000000root/opt/opensvc/lib/resLoop.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # # To change this template, choose Tools | Templates # and open the template in the editor. import resources as Res from rcGlobalEnv import rcEnv class Loop(Res.Resource): """ basic loopback device resource """ def __init__(self, rid=None, loopFile=None, always_on=set([]), optional=False, disabled=False, tags=set([]), monitor=False): Res.Resource.__init__(self, rid, "disk.loop", optional=optional, disabled=disabled, tags=tags, monitor=monitor) self.loopFile = loopFile self.label = loopFile self.always_on = always_on def startstandby(self): if rcEnv.nodename in self.always_on: self.start() def __str__(self): return "%s loopfile=%s" % (Res.Resource.__str__(self),\ self.loopFile) if __name__ == "__main__": for c in (Loop,) : help(c) print """v1=vg("myvg")""" v=vg("myvg") print "show v", v print """v.do_action("start")""" v.do_action("start") 070701000245e7000081b40000000000000000000000014faa950900003c5f000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/resSyncRsync.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os import logging from rcGlobalEnv import rcEnv from rcUtilities import which import rcExceptions as ex import rcStatus import datetime import resSync def lookup_snap_mod(): if rcEnv.sysname == 'Linux': return __import__('snapLvmLinux') elif rcEnv.sysname == 'HP-UX': return __import__('snapVxfsHP-UX') elif rcEnv.sysname == 'AIX': return __import__('snapJfs2AIX') elif rcEnv.sysname in ['SunOS', 'FreeBSD']: return __import__('snapZfsSunOS') else: raise ex.excError def remote_fs_mounted(self, node): """Verify the remote fs is mounted before we send data. """ if self.dstfs is None: """No check has been configured. Assume the admin knows better. """ return True cmd = rcEnv.rsh.split(' ')+[node, '--', 'df', self.dstfs] (ret, out, err) = self.call(cmd, cache=True) if ret != 0: raise ex.excError if self.dstfs not in out.split(): self.log.error("The destination fs %s is not mounted on node %s. refuse to sync %s to protect parent fs"%(self.dstfs, node, self.dst)) return False return True cache_remote_node_type = {} def remote_node_type(self, node, target): if target == 'drpnodes': expected_type = list(set(rcEnv.allowed_svctype) - set(['PRD'])) elif target == 'nodes': expected_type = [self.svc.svctype] else: self.log.error('unknown sync target: %s'%target) raise ex.excError rcmd = [os.path.join(rcEnv.pathbin, 'nodemgr'), 'get', '--param', 'node.host_mode'] if node not in cache_remote_node_type: cmd = rcEnv.rsh.split(' ')+[node, '--'] + rcmd (ret, out, err) = self.call(cmd, cache=True) if ret != 0: return False words = out.split() if len(words) == 1: cache_remote_node_type[node] = words[0] else: cache_remote_node_type[node] = out if cache_remote_node_type[node] in expected_type: return True self.log.error("incompatible remote node '%s' host mode: '%s' (expected in %s)"%\ (node, cache_remote_node_type[node], str(expected_type))) return False def get_timestamp_filename(self, node): sync_timestamp_d = os.path.join(rcEnv.pathvar, 'sync', node) sync_timestamp_f = os.path.join(sync_timestamp_d, self.svc.svcname+'!'+self.rid) return sync_timestamp_f def sync_timestamp(self, node): sync_timestamp_f = get_timestamp_filename(self, node) sync_timestamp_d = os.path.dirname(sync_timestamp_f) sync_timestamp_d_src = os.path.join(rcEnv.pathvar, 'sync', rcEnv.nodename) sync_timestamp_f_src = os.path.join(sync_timestamp_d_src, self.svc.svcname+'!'+self.rid) sched_timestamp_f = os.path.join(rcEnv.pathvar, '_'.join(('last_sync', self.svc.svcname, self.rid))) if not os.path.isdir(sync_timestamp_d): os.makedirs(sync_timestamp_d ,0755) if not os.path.isdir(sync_timestamp_d_src): os.makedirs(sync_timestamp_d_src ,0755) with open(sync_timestamp_f, 'w') as f: f.write(str(self.svc.action_start_date)+'\n') f.close() import shutil shutil.copy2(sync_timestamp_f, sync_timestamp_d_src) shutil.copy2(sync_timestamp_f, sched_timestamp_f) cmd = ['rsync'] + self.options + bwlimit_option(self) + ['-R', sync_timestamp_f, sync_timestamp_f_src, 'root@'+node+':/'] self.call(cmd) def get_timestamp(self, node): ts = None sync_timestamp_f = get_timestamp_filename(self, node) if not os.path.exists(sync_timestamp_f): return None try: with open(sync_timestamp_f, 'r') as f: d = f.read() ts = datetime.datetime.strptime(d,"%Y-%m-%d %H:%M:%S.%f\n") f.close() except: self.log.info("failed get last sync date for %s to %s"%(self.src, node)) return ts return ts def bwlimit_option(self): if self.bwlimit is not None: bwlimit = [ '--bwlimit='+self.bwlimit ] elif self.svc.bwlimit is not None: bwlimit = [ '--bwlimit='+self.svc.bwlimit ] else: bwlimit = [] return bwlimit class Rsync(resSync.Sync): """Defines a rsync job from local node to its remote nodes. Target nodes can be restricted to production sibblings or to disaster recovery nodes, or both. """ def node_can_sync(self, node): ts = get_timestamp(self, node) return not self.skip_sync(ts) def node_need_sync(self, node): ts = get_timestamp(self, node) return self.alert_sync(ts) def can_sync(self, target=None): targets = set([]) if target is None: targets = self.nodes_to_sync('nodes') targets |= self.nodes_to_sync('drpnodes') else: targets = self.nodes_to_sync(target) if len(targets) == 0: return False return True def nodes_to_sync(self, target=None, state="syncable", status=False): """ Checks are ordered by cost """ """ DRP nodes are not allowed to sync nodes nor drpnodes """ if rcEnv.nodename in self.svc.drpnodes: return set([]) """ Refuse to sync from a flex non-primary node """ if self.svc.clustertype in ["flex", "autoflex"] and \ self.svc.flex_primary != rcEnv.nodename: self.log.debug("won't sync this resource from a flex non-primary node") return set([]) """Discard the local node from the set """ if target in self.target.keys(): targets = self.target[target].copy() else: return set([]) targets -= set([rcEnv.nodename]) if len(targets) == 0: return set([]) for node in targets.copy(): if state == "syncable" and not self.node_can_sync(node): targets -= set([node]) continue elif state == "late" and not self.node_need_sync(node): targets -= set([node]) continue if len(targets) == 0: return set([]) """Accept to sync from here only if the service is up Also accept n/a status, because it's what the overall status ends up to be when only sync#* are specified using --rid sync#i1 is an exception, because we want all prd nodes to sync their system files to all drpnodes regardless of the service state """ s = self.svc.group_status(excluded_groups=set(["sync", "hb", "app"])) if s['overall'].status not in [rcStatus.UP, rcStatus.NA] and \ self.rid != "sync#i1": if s['overall'].status == rcStatus.WARN: self.log.debug("won't sync this resource service in warn status") self.log.debug("won't sync this resource for a service not up") return set([]) for node in targets.copy(): if not status and not remote_node_type(self, node, target): targets -= set([node]) continue if not status and not remote_fs_mounted(self, node): targets -= set([node]) continue if len(targets) == 0: return set([]) return targets def sync(self, target): if target not in self.target.keys(): self.log.debug('%s => %s sync not applicable to %s'%(self.src, self.dst, target)) return 0 targets = self.nodes_to_sync(target) if len(targets) == 0: self.log.debug("no nodes to sync") raise ex.syncNoNodesToSync if "delay_snap" in self.tags: if not hasattr(self.rset, 'snaps'): Snap = lookup_snap_mod() self.rset.snaps.log = self.log self.rset.snaps = Snap.Snap(self.rid) self.rset.snaps.try_snap(self.rset, target, rid=self.rid) if hasattr(self, "alt_src"): """ The pre_action() has provided us with a better source to sync from. Use that """ src = self.alt_src else: src = self.src if len(src) == 0: self.log.debug("no files to sync") raise ex.syncNoFilesToSync bwlimit = bwlimit_option(self) for node in targets: dst = 'root@' + node + ':' + self.dst cmd = ['rsync'] + self.options + bwlimit + src cmd.append(dst) (ret, out, err) = self.vcall(cmd) if ret != 0: self.log.error("node %s synchronization failed (%s => %s)" % (node, src, dst)) continue sync_timestamp(self, node) self.svc.need_postsync |= set([node]) return def pre_action(self, rset, action): """Actions to do before resourceSet iterates through the resources to trigger action() on each one """ """Don't sync PRD services when running on !PRD node """ if self.svc.svctype == 'PRD' and rcEnv.host_mode != 'PRD': self.log.debug("won't sync a PRD service running on a !PRD node") raise ex.excAbortAction """ Is there at least one node to sync ? """ targets = set([]) rtargets = {0: set([])} need_snap = False for i, r in enumerate(rset.resources): if r.is_disabled(): continue rtargets[i] = set([]) if action == "syncnodes": rtargets[i] |= r.nodes_to_sync('nodes') else: rtargets[i] |= r.nodes_to_sync('drpnodes') for node in rtargets[i].copy(): if not r.node_can_sync(node): rtargets[i] -= set([node]) elif r.snap: need_snap = True for i in rtargets: targets |= rtargets[i] if len(targets) == 0: self.log.debug("no node to sync") raise ex.excAbortAction if not need_snap: self.log.debug("snap not needed") return Snap = lookup_snap_mod() try: rset.snaps = Snap.Snap(self.rid) rset.snaps.log = self.log rset.snaps.try_snap(rset, action) except ex.syncNotSnapable: raise ex.excError def post_action(self, rset, action): """Actions to do after resourceSet has iterated through the resources to trigger action() on each one """ if hasattr(rset, 'snaps'): rset.snaps.snap_cleanup(rset) def syncnodes(self): try: self.sync("nodes") except ex.syncNoFilesToSync: self.log.debug("no file to sync") pass except ex.syncNoNodesToSync: self.log.debug("no node to sync") pass def syncdrp(self): try: self.sync("drpnodes") except ex.syncNoFilesToSync: self.log.debug("no file to sync") pass except ex.syncNoNodesToSync: self.log.debug("no node to sync") pass def _status(self, verbose=False): """ mono-node service should return n/a as a sync state """ target = set([]) for i in self.target: target |= self.target[i] if len(target - set([rcEnv.nodename])) == 0: self.status_log("no destination nodes") return rcStatus.NA """ sync state on nodes where the service is not UP """ s = self.svc.group_status(excluded_groups=set(["sync", "hb", "app"])) if s['overall'].status != rcStatus.UP or \ (self.svc.clustertype in ['flex', 'autoflex'] and \ rcEnv.nodename != self.svc.flex_primary and \ s['overall'].status == rcStatus.UP): if rcEnv.nodename not in target: self.status_log("passive node not in sync destination nodes") return rcStatus.NA if self.node_need_sync(rcEnv.nodename): self.status_log("passive node needs update") return rcStatus.WARN else: return rcStatus.UP """ sync state on DRP nodes where the service is UP """ if 'drpnodes' in self.target and rcEnv.nodename in self.target['drpnodes']: self.status_log("service up on drp node, sync disabled") return rcStatus.NA """ sync state on nodes where the service is UP """ nodes = [] nodes += self.nodes_to_sync('nodes', state="late", status=True) nodes += self.nodes_to_sync('drpnodes', state="late", status=True) if len(nodes) == 0: return rcStatus.UP self.status_log("%s need update"%', '.join(nodes)) return rcStatus.DOWN def __init__(self, rid=None, src=[], dst=None, options=[], target={}, dstfs=None, snap=False, bwlimit=None, sync_max_delay=None, sync_interval=None, sync_days=None, sync_period=None, optional=False, disabled=False, tags=set([]), internal=False): resSync.Sync.__init__(self, rid=rid, type="sync.rsync", sync_max_delay=sync_max_delay, sync_interval=sync_interval, sync_days=sync_days, sync_period=sync_period, optional=optional, disabled=disabled, tags=tags) if internal: if rcEnv.drp_path in dst: self.label = "rsync system files to drpnodes" else: self.label = "rsync svc config to %s"%(', '.join(target.keys())) else: _src = ', '.join(src) if len(_src) > 300: _src = _src[0:300] _dst = ', '.join(target.keys()) self.label = "rsync %s to %s"%(_src, _dst) self.src = src self.dst = dst self.dstfs = dstfs self.snap = snap self.target = target self.bwlimit = bwlimit self.internal = internal self.timeout = 3600 self.options = ['-HpogDtrlvx', '--stats', '--delete', '--force', '--timeout='+str(self.timeout)] self.options += options def __str__(self): return "%s src=%s dst=%s options=%s target=%s" % (resSync.Sync.__str__(self),\ self.src, self.dst, self.options, str(self.target)) 07070100024512000081b40000000000000000000000014faa9509000011f7000000ae00010002ffffffffffffffff0000002600000000root/opt/opensvc/lib/checkRaidSas2.py# # Copyright (c) 2012 Lucien Hercaud # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks import os from rcUtilities import justcall, which from rcGlobalEnv import rcEnv class check(checks.check): prefixes = [os.path.join(os.sep, "usr", "local", "admin")] sas2ircu = "sas2ircu" chk_type = "raid" chk_name = "LSI SAS200" def find_sas2ircu(self): if which(self.sas2ircu): return self.sas2ircu for prefix in self.prefixes: sas2ircu = os.path.join(prefix, self.sas2ircu) if os.path.exists(sas2ircu): return sas2ircu return def do_check(self): r = self.do_check_ldpdinfo() return r def do_check_ldpdinfo(self): sas2ircu = self.find_sas2ircu() if sas2ircu is None: return self.undef os.chdir(rcEnv.pathtmp) logs = [os.path.join(rcEnv.pathtmp, 'sas2ircu.log')] for log in logs: try: os.unlink(log) except OSError, e: if e.errno == 2: pass else: raise cmd = [sas2ircu, 'LIST'] out, err, ret = justcall(cmd) if ret != 0: return self.undef idx = [] lines = out.split('\n') for line in lines: if 'SAS20' in line: l = line.split() idx.append(l[0]) r = [] errs = 0 for ix in idx: cmd = [sas2ircu, str(ix), 'DISPLAY'] out, err, ret = justcall(cmd) lines = out.split('\n') ctrl = "ctrl:"+str(ix) slot="" chk_dsk = 0 for line in lines: if line.startswith('IR volume'): chk_dsk = 2 if line.startswith(' Volume Name') and 'Virtual Disk' in line and (chk_dsk == 2): l = line.split() slot = 'LD'+str(l[-1]) if line.startswith(' Status of volume') and (chk_dsk == 2): if 'Okay (OKY)' not in line: r.append({ 'chk_instance': ctrl+','+slot, 'chk_value': '1', 'chk_svcname': '', }) errs += 1 else : r.append({ 'chk_instance': ctrl+','+slot, 'chk_value': '0', 'chk_svcname': '', }) if line.startswith('Device is a Hard disk'): chk_dsk = 1 if line.startswith(' Enclosure #') and (chk_dsk == 1): l = line.split() enc = l[-1] if line.startswith(' Slot #') and (chk_dsk == 1): l = line.split() slot = 'PD'+str(enc)+':'+str(l[-1]) if line.startswith(' State') and (chk_dsk == 1): if 'Optimal (OPT)' not in line: r.append({ 'chk_instance': ctrl+','+slot, 'chk_value': '1', 'chk_svcname': '', }) errs += 1 else : r.append({ 'chk_instance': ctrl+','+slot, 'chk_value': '0', 'chk_svcname': '', }) if line.startswith('Device is a Enclosure services device'): chk_dsk = 3 if line.startswith(' Enclosure #') and (chk_dsk == 3): l = line.split() slot = 'Enc'+str(l[-1]) if line.startswith(' State') and (chk_dsk == 3): if 'Standby (SBY)' not in line: r.append({ 'chk_instance': ctrl+','+slot, 'chk_value': '1', 'chk_svcname': '', }) errs += 1 else : r.append({ 'chk_instance': ctrl+','+slot, 'chk_value': '0', 'chk_svcname': '', }) r.append({ 'chk_instance': 'all SAS20*', 'chk_value': str(errs), 'chk_svcname': '', }) return r 07070100024538000081b40000000000000000000000014faa950900001fe7000000ae00010002ffffffffffffffff0000002500000000root/opt/opensvc/lib/rcAssetHP-UX.py# # Copyright (c) 2010 Christophe Varoqui ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import os from rcUtilities import justcall, which from rcGlobalEnv import rcEnv from subprocess import * import rcAsset class Asset(rcAsset.Asset): def __init__(self, node): rcAsset.Asset.__init__(self, node) # echo "selclass qualifier memory;info;wait;infolog"|cstm process = Popen(['cstm'], stdin=PIPE, stdout=PIPE, stderr=None) (out, err) = process.communicate(input='selclass qualifier memory;info;wait;infolog') if process.returncode != 0: self.memory = [] else: self.memory = out.split('\n') (out, err, ret) = justcall(['print_manifest']) if ret != 0: self.manifest = [] else: self.manifest = out.split('\n') self.parse_memory() def _get_mem_bytes(self): cmd = ['swapinfo', '-Mq'] (out, err, ret) = justcall(cmd) if ret != 0: return '0' return str(int(out)//1024) def parse_memory(self): """ DIMM Slot Size (MB) --------- --------- 0A 2048 3D 0 --------- --------- or DIMM Location Size(MB) DIMM Location Size(MB) -------------------- -------- -------------------- -------- Ext 0 DIMM 0A 2048 Ext 0 DIMM 0B 2048 Ext 0 DIMM 5C ---- Ext 0 DIMM 5D ---- Ext 0 Total: 32768 (MB) """ if len(self.memory) == 0: return '0' self.banks = 0 self.slots = 0 begin = 0 end = 0 for i, l in enumerate(self.memory): if 'DIMM ' in l: begin = i+2 if begin == 0: return '0' for i in range(begin, len(self.memory)): e = self.memory[i].split() if len(self.memory[i]) == 0 or '--' in e[0]: end = i break if end == 0: return '0' for i in range(begin, end): e = self.memory[i].split() n = len(e) if n == 2: # old format self.slots += 1 if e[1] != '0': self.banks += 1 continue if n >= 5: # new format 1st col self.slots += 1 if not '--' in e[4]: self.banks += 1 if n == 10: # new format 2nd col self.slots += 1 if not '--' in e[9]: self.banks += 1 def _get_mem_banks(self): return str(self.banks) def _get_mem_slots(self): return str(self.slots) def _get_os_vendor(self): return 'HP' def _get_os_release(self): (out, err, ret) = justcall(['uname', '-r']) if ret != 0: return 'Unknown' return out.split('\n')[0].strip() def _get_os_kernel(self): (out, err, ret) = justcall(['swlist', '-l', 'bundle', 'QPKBASE']) if ret != 0: return 'Unknown' for line in out.split('\n'): if 'QPKBASE' in line: return line.split()[1] return 'Unknown' def _get_os_arch(self): (out, err, ret) = justcall(['uname', '-m']) if ret != 0: return 'Unknown' return out.split('\n')[0].strip() def _get_cpu_freq(self): freq = self._get_cpu_freq_manifest() if freq == "Unknown": freq = self._get_cpu_freq_adb() return freq def _get_cpu_freq_manifest(self): m = self._get_cpu_model() if '(' not in m: return "Unknown" s = m.split('(')[-1] s = s.split(',')[0] freq, unit = s.split() if unit == 'GHz': try: freq = float(freq) except: return "Unknown" freq = str(int(freq * 1000)) return freq def _get_cpu_freq_adb(self): process = Popen(['adb', '/stand/vmunix', '/dev/kmem'], stdin=PIPE, stdout=PIPE, stderr=None) (out, err) = process.communicate(input='itick_per_usec/2d') if process.returncode != 0: process = Popen(['adb', '-k', '/stand/vmunix', '/dev/mem'], stdin=PIPE, stdout=PIPE, stderr=None) (out, err) = process.communicate(input='itick_per_usec/D') if process.returncode != 0: return 'Unknown' lines = out.split('\n') if len(lines) < 2: return 'Unknown' return lines[1].split()[0] def _get_cpu_cores(self): for line in self.manifest: if 'Processors:' in line: return line.split()[-1] return '0' def _get_cpu_dies(self): marker = False for line in self.manifest: if 'Processors:' in line: marker = True continue if marker: return line.split()[0] return '0' def _get_cpu_model(self): marker = False for line in self.manifest: if 'Processors:' in line: marker = True continue if marker: e = line.split() return ' '.join(e[1:]).replace('processors','').replace('processor','') return 'Unknown' def _get_serial(self): (out, err, ret) = justcall(['getconf', 'MACHINE_SERIAL']) if ret != 0: return 'Unknown' return out.strip() def _get_model(self): (out, err, ret) = justcall(['getconf', 'MACHINE_MODEL']) if ret != 0: return 'Unknown' return out.strip() def __get_hba(self): if hasattr(self, "hba"): return self.hba self.hba = [] cmd = ['/usr/sbin/ioscan', '-FunC', 'fc'] out, err, ret = justcall(cmd) if ret != 0: return self.hba lines = out.split('\n') if len(lines) < 2: return self.hba for line in lines: if '/dev/' not in line: continue dev = line.strip() hba_type = 'fc' cmd = ['/opt/fcms/bin/fcmsutil', dev] out, err, ret = justcall(cmd) if ret != 0: continue for _line in out.split('\n'): if not 'N_Port Port World Wide Name' in _line: continue hba_id = _line.split('=')[-1].strip().lstrip("0x") cmd = ['/opt/fcms/bin/fcmsutil', dev, 'get', 'remote', 'all'] out, err, ret = justcall(cmd) if ret != 0: continue targets = [] for _line in out.split('\n'): if not 'Target Port World Wide Name' in _line: continue targets.append(_line.split('=')[-1].strip().lstrip("0x")) self.hba.append((hba_id, hba_type, targets)) return self.hba def _get_hba(self): hba = self.__get_hba() l = [] for hba_id, hba_type, targets in hba: l.append((hba_id, hba_type)) return l def _get_targets(self): hba = self.__get_hba() l = [] for hba_id, hba_type, targets in hba: for target in targets: l.append((hba_id, target)) return l 070701000245f3000081b40000000000000000000000014faa95090000109a000000ae00010002ffffffffffffffff0000002100000000root/opt/opensvc/lib/resVgRaw.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import resDg import os import rcStatus import re import pwd import grp import stat class Vg(resDg.Dg): def __init__(self, rid=None, devs=set([]), user="root", group="root", perm="660", type=None, optional=False, disabled=False, tags=set([]), always_on=set([]), monitor=False): self.label = "raw" resDg.Dg.__init__(self, rid=rid, name="raw", type='disk.vg', always_on=always_on, optional=optional, disabled=disabled, tags=tags, monitor=monitor) self.devs = set([]) self.devs_not_found = set([]) self.user = user self.group = group self.perm = perm for dev in devs: if os.path.exists(dev): self.devs.add(dev) else: self.devs_not_found.add(dev) self.get_uid() self.get_gid() def on_add(self): try: n = self.rid.split('#')[1] except: n = "0" self.name = self.svc.svcname+".raw"+n self.label = self.name def get_uid(self): self.uid = self.user if isinstance(self.uid, (str, unicode)): try: info=pwd.getpwnam(self.uid) self.uid = info[2] except: pass def get_gid(self): self.gid = self.group if isinstance(self.gid, (str, unicode)): try: info=grp.getgrnam(self.gid) self.gid = info[2] except: pass def check_uid(self, rdev, verbose=False): if not os.path.exists(rdev): return True uid = os.stat(rdev).st_uid if uid != self.uid: if verbose: self.status_log('%s uid should be %d but is %d'%(rdev, self.uid, uid)) return False return True def check_gid(self, rdev, verbose=False): if not os.path.exists(rdev): return True gid = os.stat(rdev).st_gid if gid != self.gid: if verbose: self.status_log('%s gid should be %d but is %d'%(rdev, self.gid, gid)) return False return True def check_perm(self, rdev, verbose=False): if not os.path.exists(rdev): return True try: perm = oct(stat.S_IMODE(os.stat(rdev).st_mode)) except: self.log.error('%s can not stat file'%rdev) return False perm = str(perm).lstrip("0") if perm != str(self.perm): if verbose: self.status_log('%s perm should be %s but is %s'%(rdev, str(self.perm), perm)) return False return True def has_it(self): """Returns True if all devices are present """ if len(self.devs_not_found) > 0: self.status_log("%s not found"%', '.join(self.devs_not_found)) return False return True def is_up(self): """Returns True if the volume group is present and activated """ return self.has_it() def _status(self, verbose=False): if self.is_up(): return rcStatus.NA else: return rcStatus.WARN def do_start(self): pass def do_stop(self): pass def disklist(self): return self.devs 07070100024564000081b40000000000000000000000014faa950900000984000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/rcMountsFreeBSD.py# # Copyright (c) 2009 Christophe Varoqui ' # Copyright (c) 2009 Cyril Galibern ' # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import rcMounts from rcUtilities import * from subprocess import Popen def get_src_dir_dev(dev): """Given a directory path, return its hosting device """ process = Popen(['df', '-l', dev], stdout=PIPE, stderr=STDOUT, close_fds=True) buff = process.communicate() out = buff[0] i = out.index('/') return out[i:].split()[0] class Mounts(rcMounts.Mounts): def match_mount(self, i, dev, mnt): """Given a line of 'mount' output, returns True if (dev, mnt) matches this line. Returns False otherwize. Also care about weirdos like loops and binds, ... """ if os.path.isdir(dev): is_bind = True src_dir_dev = get_src_dir_dev(dev) else: is_bind = False if i.mnt != mnt: return False if i.dev == dev: return True if is_bind and i.dev == src_dir_dev: return True return False def __init__(self): self.mounts = [] (ret, out, err) = call(['mount']) for l in out.split('\n'): words = l.split() if len(words) < 4: return dev = words[0] mnt = words[2] opts = ' '.join(words[3:]).strip('(').strip(')').split(', ') type = opts[0] if len(opts) < 3: mnt_opt = '' else: mnt_opt = ','.join(opts[2:]) m = rcMounts.Mount(dev, mnt, type, mnt_opt) self.mounts.append(m) if __name__ == "__main__" : help(Mounts) for m in Mounts(): print m 07070100024507000081b40000000000000000000000014faa9509000006fe000000ae00010002ffffffffffffffff0000002800000000root/opt/opensvc/lib/checkFsUsageAIX.py# # Copyright (c) 2011 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall class check(checks.check): chk_type = "fs_u" def find_svc(self, mountpt): for svc in self.svcs: for rs in svc.get_res_sets('fs'): for r in rs.resources: if r.mountPoint == mountpt: return svc.svcname return '' def do_check(self): cmd = ['df', '-P'] out, err, ret = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 2: return self.undef r = [] for line in lines[1:]: l = line.split() if len(l) != 6: continue if l[1] == '-': continue if ":/" in l[0]: continue r.append({ 'chk_instance': l[5], 'chk_value': l[4], 'chk_svcname': self.find_svc(l[5]), }) return r 0707010002450f000081b40000000000000000000000014faa950900000b80000000ae00010002ffffffffffffffff0000002c00000000root/opt/opensvc/lib/checkMpathPowerpath.py# # Copyright (c) 2012 Christophe Varoqui # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. # import checks from rcUtilities import justcall, which class check(checks.check): chk_type = "mpath" chk_name = "PowerPath" def find_svc(self, dev): for svc in self.svcs: if dev in svc.disklist(): return svc.svcname return '' def do_check(self): """ Pseudo name=emcpowerh Symmetrix ID=000290101523 Logical device ID=17C6 state=alive; policy=SymmOpt; priority=0; queued-IOs=0 ============================================================================== ---------------- Host --------------- - Stor - -- I/O Path - -- Stats --- ### HW Path I/O Paths Interf. Mode State Q-IOs Errors ============================================================================== 0 qla2xxx sdi FA 9dB active alive 0 0 1 qla2xxx sds FA 8dB active alive 0 0 """ if not which('powermt'): return self.undef cmd = ['powermt', 'display', 'dev=all'] (out, err, ret) = justcall(cmd) if ret != 0: return self.undef lines = out.split('\n') if len(lines) < 1: return self.undef r = [] dev = None name = None for line in lines: if 'Pseudo name' in line: # new mpath # - store previous # - reset path counter if dev is not None: r.append({'chk_instance': name, 'chk_value': str(n), 'chk_svcname': self.find_svc(dev), }) n = 0 l = line.split('=') if len(l) != 2: continue name = l[1] dev = "/dev/"+name if "active" in line and \ "alive" in line: n += 1 if dev is not None: r.append({'chk_instance': name, 'chk_value': str(n), 'chk_svcname': self.find_svc(dev), }) return r 07070100000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000b00000000TRAILER!!!