SharePoint 2010 farm performance degradation


Developing within SharePoint 2010 - all the latest updates for it are installed (SP2 etc.)

Standard farm with 2 application servers, 2 front-end servers, Active Directory server and 2 SQL servers. All this stuff is hosted by Windows Azure Virtual machines, within Virtual network.

While performing simple SPWebApplication.Lookup() noticed that it takes very-very long to complete - about 16 seconds. To compare - locally it takes about 1 second. And on another very similar farm, also hosted in Azure - about 2 seconds.

What attempts were made to fix performance degradation:

  1. Checked configs and network settings, pings etc. - looks 100% OK.
  2. Profiled with SQL Profiler - no bottlenecks found - there is no hard SQL for this request actually.
  3. Double-check that all the servers and DBs are upgraded and up to date.
  4. Kick off all the possible errors that were found in ULS and Windows logs - now it's clear there.
  5. Investigation of metrics with Metalogix Diagnostics manager - as result nothing critical was found. It only sometimes showed that processor queue length is big. But as I know, normal number for it is #of cores +1. So 4-5 in my case is fine. Also it's needed to note that from my perspective - for VM it's also normal to have such number.
  6. Wrote very simple console app that performs lookup of web app. Profiled with Ants profiler. Noticed that call tree differs from the result received locally. Maybe that's OK, cause locally I have standalone installation. The result at farm is not optimistic - several calls have a huge Hits count. Though, it's clear where the bottleneck in the call tree - all the ideas about the source have already finished. Profiling result as follows:

It would be great if you could advice.

Thanks in advance.

How many disks do you have on your VM?

Azure has limited IOPS, 500 per disk... organise your databases so they are on different disks to get more IOPS. You can have 16 disks per VM.

This video can help you solving your question :)
By: admin