OpsMgr 2007 R2–A funny thing happened on the way to happiness


So, a funny thing happened on one of my customers. Funny in the sense that one would expect this behaviour if you sit down and think about it. But really, who has time to think, right?

You see, we use ConfigMgr (SCCM) as a standard to deploy OpsMgr agents automatically. This typically ensures that every server in the environment is covered.

One of our new SCCM admins configured a package on a customer that recently migrated from MOM to SCOM, and, somehow, included the OpsMgr servers, which means that the OpsMgr agent was pushed out to both the RMS and the MS in that environment. Needless to say, OpsMgr became completely non-functional, as the agent configuration overwrote the MS healthservice config.

Luckily customer had an RMS and an MS. Unfortunately, the agent was deployed to both, which made recovery a little tricky.

Now, to recover, I’ve done the following:

  1. Promoted the MS to RMS. Easy peasy. Bugger, MS reports the same error. Oh, right, agent was also deployed to MS.
  2. Uninstalled OpsMgr from the RMS. Ok so far. No, not really, because it failed.
  3. Stress, turn up the music. Think.
  4. Oh, look, uninstallation succeeded after a reboot.
  5. Rebooted again, just for good measure.
  6. Attempted to install OpsMgr, but UAC was turned on, which returns an error. Ok, disable UAC, reboot again.
  7. Installed OpsMgr, reconnecting back to the database. OMG, it worked.
  8. Breathe.
  9. Promoted newly installed RMS back to RMS role. Ok, right. No errors this time, and it reports healthy in the console.
  10. Run ManagementServerConfigTool.exe UpdateDemotedRMS on the MS that was promoted to RMS. Still ok. Just checked the console to make sure, and everything is still fine.
  11. Vodka! (or it would be, if I could consume alcohol)
  12. Uninstalled OpsMgr, failed. Oh, wait. Uninstall agent first, then uninstall SCOM. Rebooted for good measure.
  13. Switched off UAC (being pro-active here), and reinstalled OpsMgr and Voila! Environment returned back to how it should be.

Don’t try this at home. Please Smile

Soundtrack for this morning’s activities provided by Korpiklaani, Ensiferum, Eluveitie and Kaizers Orchestra

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s