New Zealand | Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

Insentra - 08.09.201720170908

New Zealand | Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

Join our community of 1,000+ IT professionals, and receive tech tips and updates once a week.

Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

New Zealand | Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

RDS Gurus decided to run performance tests on Outlook in non-persistent environments using FSLogix’s Office 365 Containers solution. We wanted to illustrate the user experience of remote desktop users working in an RDS environment configured to use FSLogix Office 365 Containers relative to the typical user experience when using native RDS UPD technology. Our primary focus was to measure how performance degrades when multiple users are simultaneously working with Outlook (“noisy neighbor effect”).

We did this by collecting performance metrics as well as video footage of a series of test runs where users in remote sessions “worked” in Outlook 2016. All the work was automated. Users opened Outlook and conducted a series of searches that queried the local windows search service (queries against All Mailboxes, All Outlook Items or Subfolders) and queried the Office 365 server search service (queries against current folder and mailbox).

We recorded the on-screen user experience of a primary user, and also collected performance counter data during each test run. In some runs only the primary user taxed the system. In other runs, we introduced a number of secondary users who also “worked” in Outlook. We conducted our tests in an on-premises environment, and a duplicate Azure environment to see if there were any notable differences in a cloud based environment.

Benchmarking Test Steps

These are the steps we performed to set up the environments, conduct the test runs and gather the results:

  • Build both the on premises and the Azure environments (includes identical RDS deployments in Azure and on premises locations). Our lab setup is shown here.
  • Create and compile the test sequences that will run the workloads – these are the executables that simulate user’s working in Outlook. Click here for more details about our compiled executables and how they work
  • Conduct the test runs
  • Collect metrics, performance counters and videos
  • Build REX Analyzer 4-Up Video Panels that show the primary user experience along with certain performance monitor counters in real time
  • Analyse the data

Benchmarking Setup

Our benchmarking setup had four parts: The On-Premise RDS deployment, the Azure RDS deployment, the Tracking Component and the Client Component (see Figure 1). The Tracking Environment included a Lab Controller PC connected to the primary client (so it can capture video data from a client PC’s RDS sessions and store those videos for later analysis), and an RD Session Host server to kick off secondary user sessions to the on-prem/azure RDS environments.

 

New Zealand | Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

Figure 1 – The On-Premise RDS deployment, the Azure RDS deployment, the Tracking Component and the Client Component.

REX Analysis and Our Outlook Search Benchmarking Conclusions

In June 2017, we conducted 20 Outlook Search test runs. For each test run we gathered and analysed the screen videos from the primary client and the Performance Monitor footage.

We compared runs that used User Profile Disks to like runs that used FSLogix container technology. In each comparison, the number of secondary users “working” in the background was the same (0, 5, 10 and 20 users). UPD secondary users were not indexed – this simulated the users having to re-index if they move to a different RD Session Host server. FSLogix secondary users started off indexed because their index roams with them (no need to rebuild if they end up on a new RD Session Host server).

We looked for differences in how Outlook search performs in the primary user session when using the two technologies. We watched for any noticeable search result slowdown for the primary user when the secondary user’s OST files were being indexed in the background. We looked for differences in resource consumption per technology when the user load was low, or increased.

We used our own REX Analyzer software to create 4 quadrant video comparisons of each test run match-up. In the top two quadrants, we ran videos of the two primary user sessions we were comparing. In the bottom two quadrants we ran performance counter data from those two sessions.

These are our conclusions from watching all Rex Analyzer 4 video panel match ups.

1. User Experience Is Similar If Outlook Is Indexed

While there are some differences in the resource consumption between UPD and FSLogix technologies (this is more evident through performance counter logs and graphing), the user experience for users using UPD and using FSLogix is very similar if the user’s Outlook is indexed.

Here is a REX Analyzer file comparing test runs using UPD and FSLogix with 5 noisy neighbors. When both primary users are indexed, and the server is under a relatively small user load, user experience is good. UPD users and FSLogix users both get search results returned in good time.

New Zealand | Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

If resources are scarce due to more secondary load placed on the system the primary user’s experience degrades; In the next REX Analyzer panel, we show UPD and FSLogix test runs with 20 noisy neighbors. You will see the stop watch timer stutter and search results are still returned but with slight lag – but this is true for both UPD and FSLogix users. And even though you can see the CPU in the FSLogix test run is pegged more than in the UPD test, the user experience is still very similar.

New Zealand | Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

2. User Experience with FSLogix Wins When Users Roam

This is not surprising as this is a main selling point for FSLogix, but it still rings very true and is worth stating: When users roam from RD session host to another RD Session host, their search experience is far better with FSLogix. This is because it roams the search index on per user basis inside the user’s profile container; there is no need to re-index a user’s Outlook OST no matter which RD Session Host server they end up on.

During our test runs we could observe time and time again that secondary FSLogix users that had Outlook indexed had a far better user experience in than secondary UPD users who had to have their OSTs indexed. The FSLogix secondary users got consistent returned results for searches that used the Windows Local Search service while the UPD secondary users did not. To show this we videoed the Noisy Neighbor sessions in two on premises test runs. Note in the following video where search results are not returned for searches that use the local windows search service (these are non-indexed UPD users):

New Zealand | Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

Now you see next FSLogix users, with Outlook OST files indexed get consistent search results returned in Outlook:

New Zealand | Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

3. The Leveler: Windows Search Service Throttling

Throughout the test runs, resource usage on the RD Session Host servers was similar, even when secondary UPD user sessions were busy indexing Outlook OSTs in the background. The mechanism that keeps the UPD and FSLogix sessions seeming so comparable is the Windows Search Service being throttled back. When the index service needs to index a user’s Outlook OST, this happens in the background and Windows Search service is not given priority on the machine. If many users are all being indexed at the same time, then we see this happen very slowly.

Windows Search Throttling Details

The indexer runs off a basic backoff system where it will do work for X ms then sleep for Y ms, where Y>>X. It doesn’t matter how much work you give it, the CPU usage won’t spike. Indexing just takes longer.

So, it makes sense that if, for example, 10 users all need indexing and the primary user does not, then the primary user will not feel the effects of the other users’ indexing needs. Therefore, it does not seem to matter performance wise if a user is fully indexed and uses either UPD or FSLogix.

There is a GPO that affects this throttling:

Computer Configuration / Policies / Administrative Templates / Windows Components / Search / Disable Indexer Backoff

Hungry for more?

If you’re waiting for a sign, this is it.

We’re a certified amazing place to work, with an incredible team and fascinating projects – and we’re ready for you to join us! Go through our simple application process. Once you’re done, we will be in touch shortly!

New Zealand | Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

Who is Insentra?

Imagine a business which exists to help IT Partners & Vendors grow and thrive.

Insentra is a 100% channel business. This means we provide a range of Advisory, Professional and Managed IT services exclusively for and through our Partners.

Our #PartnerObsessed business model achieves powerful results for our Partners and their Clients with our crew’s deep expertise and specialised knowledge.

We love what we do and are driven by a relentless determination to deliver exceptional service excellence.

New Zealand | Outlook Performance in Non-Persistent Environments Using FSLogix’s Office 365 Containers

Insentra ISO 27001:2013 Certification

SYDNEY, WEDNESDAY 20TH APRIL 2022 – We are proud to announce that Insentra has achieved the  ISO 27001 Certification.