November 18th, 2015: This version of the Windows App Certification Kit has been updated to reflect the following test changes:
- The App prelaunch test is now enabled. This test proactively pre-launches and keeps apps in the background, verifying that the app handles the prelaunch scenario correctly.
- The App resources test now runs correctly against UWA apps. Failures not detected by previous versions of the kit, like incorrect image sizes, will now be found. The Windows Store will begin enforcing image size requirements via this test starting January 2016.
- The Supported APIs test no longer fails the app if the app invokes approved APIs by ordinals.
The following is a list of known issues with the Windows App Certification Kit:
- Windows App Certification Kit’s App Manifest Resources test is not running correctly for UWAs. The test is not producing failures for invalid applications.
Resolution: The Windows App Certification KitA has been updated as a part of the SDK released for Windows 10 Version 1511 and includes the fix for this test to properly run and pass/fail on UWAs. Failures not detected by previous versions of the kit, like incorrect image sizes, will now be found. The Windows Store will begin enforcing image size requirements via this test starting January 2016.
During testing, if an installer terminates but leaves active processes or windows running, the app certification kit may detect that there is still work to be done by the installer. In this case, the kit appears stuck running the "Process Install Trace Files" task and it's not possible to move forward with the UI.
Resolution: After your installer is complete, manually close any active processes or windows spawned by the installer.
For ARM UWA, or any UWA app that doesn't target the device family desktop or OneCore, a message may appear in the final report that states “Not all tests were run during validation. This may impact your Store submission.”. This message does not apply in cases where the user didn't manually deselect tests.