Skip to main content

What to do when your application server goes bang

What happens when someone kills your Application Server?

So imagine the scenario:

Three Server Solution
- SQL
- SharePoint 2010 and Project Server 2010 Application Server (Central Admin Host)
- Wfe/ReportServer

We wake one bleary Monday morning to find that some numpty has killed the application server and the users are baying for blood.

Well surprisingly SharePoint handles this disaster recovery scenario particularly well.  Well.  Better than I thought it would to be honest.

Rough steps:

- quick SQL backup to be safe
- Rebuild your application server
- reinstall pre-reqs
- reinstall SP, PS, SPFSP1, SPS+PSSP1, Cumulative Update and other stuff you usually put on there.
- Run your configuration wizard to reattach to the Farm, and select Host CA Site

The last step was what I was VERY wary of.  Would the server simply reattach to the Farm, even when there is no CA server available?  

Bingo your back.... almost.... you are going to get errors a-gogo in your event log as things just aren't quite back to normal after the farm had its head cut off.

Error:  Navigate to your Project Server site and select BI Center:  Unexpected error occurred
Logs:  URL events stating System.ServiceModel.ServerTooBusyException:  Secure Store Service Did Not Performed (sic) the operation
Fix:       Secure Store needs to be reset 

> Service Applications | Secure Store Properties
> Regenerate Key

Just for safety i went through and reset all properties for configured Service Applications.

Started Microsoft SharePoint Foundation Web Application Service as IIS was also not showing the same sites on application server as on the WFE.

Outstanding issues:
- Navigating to performancepoint content returns an Unexpected Error & Event Log shows
"the user xxxxx attempted to access an item in the following location http://..............."
Verify the location exists and that the user has the Read Items permission

Ok so I missed resetting the PerformancePoint Service Application properties... after doing this, all is well

Search:
Application SErver Administration Job Failed for SErvice instance Microsoft.office.server.search.administration.searchServiceInstance
Reason: There is no project Portal_Content mounted under gatherer application 68d05007-b712-46f2-adc6-58c22066dbd0.

I didnt find a way around this... recreated Search Service Application

Anyway that was my route to getting this farm up and running again.  we were lucky we didnt have any code recover from the dead app server.


At the end of this process we had:
- SP Sites back up and available
- CA Back up and available
- PWA sites and BI reports


Hope it helped some...


Carl

Comments

Post a Comment

Popular posts from this blog

SP2 released

Office Project Server 2007 Sp2 has now been released.  see the details here - http://blogs.msdn.com/chrisfie/archive/2009/04/28/announcing-service-pack-2-sp2-for-microsoft-project-2007-and-microsoft-project-server-2007.aspx .  see teh webcast here http://blogs.msdn.com/brismith/archive/2009/04/28/project-server-2007-service-pack-2-sp2-is-now-available.aspx Blogged with the Flock Browser
Post a Comment
Read more

TPG Apps Highlights - Risk Matrix #projectonline #projectserver #risk

This post is the first of a series to highlight the apps available for Project Server and Project Online from the SharePoint store  ( https://store.office.com/search.aspx?productgroup=SharePoint&qu=tpg ) and direct via your local TPG office. The first of this series will look at the s imple plug-and-play apps that all users of Project Online can make use of quickly and easily.   T hese are: Risk Matrix  Milestone Trend Analysis (MTA) WBS Chart viewer Next we will focus on the challenge of  Resource Request Supply and Demand by demonstrating our more recent TeamLink and TeamManager apps. Team Manager App is a Resource Manager/Owner app for allocating resource supply to Projects and BAU activities and monitoring demands against commitments Team Link App is a PM tool for monitoring Project demands vs the supply provided by the Resource Managers  Finally I will highlight some of the benefits of our integration tools when used i...
Post a Comment
Read more

Restoring PWA Site to another Web App in the same Farm

The scenario is this: SharePoint 2016 Farm with Project Server Two Web Apps Development UAT One PWA on Development Web App. I want to copy the PWA Site on Development web app to UAT to support a testing cycle. As far as I knew there were two options: 1) Content Database Restore and Attach Process would be backup your Dev Content Database, Restore to a new Content Database for QA, then mount the database on the appropriate web app and your off.... Problem:  Although you can do this with the -AssignNewDatabaseID switch in Powershell (to avoid two content db's having the same database id) the Site Collection (PWA) in the db still retains its SiteID which means there is a duplicate SiteID in the Configuration Database.  This stops the PWA site being created and alllocated correctly and becomes essentially orphaned. This method is only any good for MOVING not COPYING Back to the drawing board... 2) Backup-SPSite / Restore-SPSite I didn't believe this ...
1 comment
Read more