WaaS - Application Compatibility Testing FAQs (Windows 11)


Overview

Windows 11 upgrade and WaaS Feature update FAQ

  1. What is the difference between the Windows 11 upgrade and WaaS Feature Updates?
    • Windows 11 is a major operating system upgrade, but per the WaaS model, it is applied as an in-place upgrade.  It does not require a re-image of the CoreImage device.
    • Within an OS major version (i.e., Windows 11), Microsoft releases two types of updates: Feature updates (semiannual) that add new functionality and Quality updates (monthly) that provide security and reliability fixes.  Michigan Medicine adopts the General Availability Channel's Feature update cadence using the "H2" version released in the fall (e.g., Windows 11 22H2 which was released in September 2022).  These Feature updates are part of Microsoft's Windows as a service (WaaS) model.

  2. When will the CoreImage device I designate for testing be upgraded from Windows 10 to 11 for Application Compatibility testing?
    • You will receive notification(s) from HITS EDEM Business Analysts to coordinate an upgrade of your (test) device.  This will begin in September 2023.

  3. When will production CoreImage devices be upgraded from Windows 10 to 11?
    • Users will receive notification(s) from HITS to "own their upgrade" during the production deployment phase of the Windows 10 to 11 upgrade as they have been with previous WaaS Feature updates).  HITS has not established a precise timeline when production CoreImage Windows 10 devices will be upgraded to Windows 11 aside from an "early" 2024 timeframe.

  4. Is the upgrading process from Windows 10 to 11 similar to a monthly patch or to a Feature update?
    • No, it is a significant upgrade to the operating system and therefore will require significant device downtime to perform the upgrade.

  5. How long will the in-place upgrade from Windows 10 to 11 take?
    • One to two hours.  However, as we have seen with past WaaS Feature updates, once upgraded from Windows 10 to 11, future Windows 11 WaaS Feature updates may take as little as a few minutes to install.

  6. Will I get notified about the upgrade--whether as an application tester or a general user?
    • Yes, you will receive system notification(s) on your device.

  7. Will I have to reinstall my apps after the upgrade?
    • In most cases, no, but it may be necessary if there are issues. Application testing is recommended to ensure you have no issues.

  8. Will the MiChart upgrade cycle be taken into consideration when rolling out the Windows 11 upgrade?
    • Yes, HITS plans to avoid the standard MiChart Upgrade windows.

 

Application Compatibility Testing -- General FAQ

  1. Where is the documentation for testing application compatibility?
  2. Can we assign a team or multiple people as the application owner? Does everyone on a team who uses the app need to be the application steward?
    • Only a single person can be designated as an application steward, but they can delegate testing to multiple users.  It is up to the application steward's team to designate as few or as many resources as needed to test.

  3. Why am I listed as an application steward when I am not in IT?
    • You do not need to work in IT to be the steward of an application. A steward is someone who has knowledge of an application and its functionality who can perform application testing (or designate another user to perform testing). For more information, please see WaaS - Application Stewards Roles and Responsibilities.

  4. If I have questions or experience problems while testing, what should I do? Who should I contact?
    • Please submit a ServiceNow ticket to EDEM Business Analysts.

 

Windows 11 and ServiceNow FAQ

  1. How do I get to the testing questionnaire in ServiceNow?
    • Once the testing phase has been initiated in ServiceNow, an email will be generated and sent out to all application stewards with a link that will take you to your application's test plan.  You can also get to the survey by going to the Service Portal at help.medicine.umich.edu (or help.medicine.umich.edu/sp if you are in a fulfiller role). There will be a banner at the top that says 'Surveys,' and this will take you to a page displaying all of the surveys with test plans assigned to you. 

  2. Is there a way to look up which test plans are assigned to me?
    • Go to Test Management in ServiceNow and click on Test Plans. Filter the results by entering *Windows 11 under Short Description and click Run.
      filter_test_plans_assigned_to
      Click on the three lines at the top of the Assigned to column and select Group By Assigned to from the drop-down menu. Click on the Assigned to: group with your name to see all of the test plans assigned to you.

  3. How are the testing questions going to be customized for each application?
    • The survey has a basic set of questions to test against, such as launching and signing in to the application, printing, etc. You do have the option of building more detail into the test plan for your individual testing and saving it for next year. We will be scheduling another meeting that will go into detail on how to do that for those that are interested.

  4. Will the 'Block' button in the survey be grayed out?
    • Unfortunately, graying out the 'Block' button would cause the change for everyone in ServiceNow, which could adversely affect those that need it.  For now we ask that you do not use that button in the testing survey.

  5. What tells us that the test plan is 100% complete - the color of the progress bar, length of the progress bar, or some other aspect of the progress bar?
    • The progress bar will be gray initially and will fill in with blue as you progress in your testing.  The report also shows what percentage of the survey has been completed. You also have the option to save your progress - when you go back into ServiceNow, you can click on the progress bar, which will show partial progress, and it will take you back into your survey to complete it where you left off.

  6. Will ServiceNow keep a record of who the app steward is for each CoreImage app?
    • Yes. There is an application record in ServiceNow - this is a configuration item that holds the app, data, owner, version, and will be associated with the test plan going forward.

  7. As an application steward, can I go in and see what CoreImage apps I am responsible for?
    • Yes. You can run a report in ServiceNow to see what applications you are responsible for.

  8. How will applications be maintained going forward?
    • Test Management within ServiceNow will be used as a long-term repository for test plans/surveys.

  9. What happens when an application steward leaves?
    • He/she should update the application record in ServiceNow and assign a backup or alternate owner.

  10. Once you have completed the survey, can you go back and change your answers?
    • Yes. You can go back into the Service Portal, select 'Retest,' and change any of your answers if needed.

 

Windows 11 Testing FAQ

  1.  How do I test my application on the new Windows 11 CoreImage version?
    • You can submit a ticket via ServiceNow to the EDEM BAs and request to have a CoreImage machine upgraded for testing.

  2. What kind of testing is required for the Windows 11 upgrade (as well as any WaaS Feature updates)?
    • Testing should be similar to regression testing performed for application upgrades or patch testing. As an application steward, you will determine the appropriate test plan for your application(s).

  3. Will I be notified when to begin testing?
    • Yes, Application Stewards will be notified by ServiceNow notification.  This is different than the notification to upgrade the device from Windows 10 to 11 noted above.

  4. Where do I report results?
    • ServiceNow will be used to document testing your application and recording your results.

  5. What do I do if my application fails testing?
    • If your application fails testing with the current version of Windows 11, you will need to contact EDEM as soon as possible. You will then work with Information Assurance (IA), who will have you complete documentation for a Treatment and Tolerance Plan. For more information, please see IA's Information Security Risk Management

  6. Will there be a tips and tricks PDF to walk you through as the user tests?