Skip to content

Appendix A. Probe catalog

All 443 probes in the handbook. Each one is an experiment you can run as a normal user. Filter by what you want to do or what you want to learn, then open the probe in its chapter to record what you saw.

3. The universal app model

P3.1Offline tour
Whether content appears after the cold start, whether the app mentions the network at all, and whether the action is refused, accepted or accepted with a pending indicator.
5 steps
P3.2Second device
Whether the change reaches the second device at all, and whether it arrives while you watch or only after you refresh.
5 steps
P3.3Delivery to a closed app
Whether a notification arrives, and whether the new item is already inside the app when you open it offline.
5 steps
P3.4Text before media
The order in which text, layout and images arrive, and whether images change sharpness after they appear.
3 steps

4. Probes

P4.1Footprint survey
How large the stored data is next to the app itself, and whether it grew during the ten minutes.
4 steps
P4.2Launch in airplane modeChanges a setting
What the first screen shows, whether the app says it is offline, and whether the change is accepted.
5 steps
P4.3Force-quit and reopen
Which screen opens, whether the scroll position is kept, and whether the typed text is still there when you return to the field.
4 steps
P4.4Long background and return
Whether a launch screen appears, which screen you land on, and whether the content changes without you asking.
4 steps
P4.5Second device
Whether the change reaches B, how long it takes, and what you had to do to make it appear.
5 steps
P4.6Fresh installChanges a setting
Whether your existing content comes back, whether a restore step is needed, and how long the app takes to become usable.
4 steps

7. Launch and startup

P7.1Cold against warm
Whether a splash appears on each launch, and how long each takes by eye. A splash marks a cold start.
4 steps
P7.2First-screen strategy
What stands between the splash and real content, and whether the content changes after it first appears.
3 steps
P7.3Launch in airplane mode
How far the launch gets, and what the first screen contains.
4 steps
P7.4Where it lands
Whether you land on the app's home screen or on the screen you left, in each case.
4 steps
P7.5Launch from a notification
Which screens appear, in order, before the target is shown.
3 steps
P7.6Launch after a device restartChanges a setting
How the time to real content compares with the ordinary cold start.
3 steps
P7.7First launch after install
What the first launch waits for, whether content can be seen before signing in, and whether anything differs on the second launch.
3 steps
P7.8Launch after a long absence
Whether old content appears first, whether the launch waits longer than usual, and whether the app asks you to do anything.
3 steps
P7.9First launch after an update
Whether the launch takes longer than usual, whether a message about updating appears, and whether your content and session are still there.
3 steps
P7.10Old version
Whether the app works, suggests an update, or refuses to continue. In airplane mode, whether the refusal is still there.
3 steps

8. Navigation, deep links and screen state

P8.1Tab histories
Whether the first tab is where you left it, and whether its content reloads.
3 steps
P8.2Half a form
Whether the text is still there after the app switch, and after leaving and re-entering. Note any prompt about discarding.
3 steps
P8.3Long absence in the middle of a task
First, whether a splash appears. A splash means the process died, and only then does this probe test restoration. Then, which screen you are on, and whether scroll position and input are intact.
3 steps
P8.4Force-quit and reopen
Which screen you land on, and whether the typed text is there once you reach the form.
3 steps
P8.5Link while signed in
What opens, and what is on screen. Note the form of the link, a web address or something else.
3 steps
P8.6Back after a link
Where the first back takes you.
3 steps
P8.7Link into a running app
Whether you return to the screen you were on before the link.
3 steps
P8.8Link while signed outChanges a setting
Whether the item is shown without a session, and where you land after signing in.
3 steps
P8.9Link with the app not installed
What the link opens. After an install, where the app lands, whether that happens before or after sign-in, and whether the system shows a notice that the app pasted from the clipboard.
3 steps
P8.10Interrupted flowChanges a setting
Whether your progress is visible on the second device, and whether it is still there on the first.
4 steps

9. State and UI data flow

P9.1Change and go back
Whether the list row shows the new value in each run, and whether the list shows a loading indicator, flickers or loses its scroll position as it reappears.
4 steps
P9.2Every surface
Which surfaces are current at once, which become current after a refresh, and which stay stale after a refresh.
5 steps
P9.3Badge against content
Whether the count matches the content, and whether it changes in the same instant as the content or after a delay.
4 steps
P9.4Tap on a weak connection
Whether the control changes before the network could have answered, whether a pending indicator appears, and how far the change reaches.
3 steps
P9.5Failed refresh
What happens to the content that was already on screen.
3 steps
P9.6Rotate or resize mid-task
Whether the typed text, the scroll position and the open sections are kept, and whether the content reloads.
3 steps
P9.7Act from outside the app
Whether the screen already shows the change, corrects itself after a moment, or keeps the old value.
3 steps
P9.8Long background
Whether you see a splash screen, which screen you land on, whether the typed text is there, and whether content is present at once or loads.
4 steps
P9.9Two devices side by side
The first moment at which A shows the change.
4 steps

10. API shape

P10.1First paint of a composite screen
Whether the text content appears all at once or in parts, and whether the parts always arrive in the same order. Ignore images, which load separately in every design.
3 steps
P10.2The same screen on a weak connection
How far apart the parts arrive. On a weak connection, separate requests separate by seconds.
2 steps
P10.3Failure unit
Whether the failure covers the whole screen or one section, whether a section is missing with no error, and what a retry reloads.
3 steps
P10.4List against detail
Which parts of the detail screen are present in the first frame, and whether any value differs between list and detail.
4 steps
P10.5Change without an update
Whether sections appear, disappear or change order, and whether labels and button text change, while the version stays the same.
4 steps
P10.6Old version
Whether the old version works, what it shows for content it does not understand, and whether it asks you to update.
3 steps
P10.7What an action returns
Whether the affected parts change together or one after another, and whether the screen reloads.
3 steps
P10.8Who computes
Whether the computed value changes while offline, and whether it changes again when the network returns.
4 steps
P10.9Rejected input
Whether the message names a reason, and whether it is attached to the field that caused it.
3 steps
P10.10Language switchChanges a setting
Which text changes language at once, which changes only after a refresh, and which never changes.
4 steps

11. Local storage, caching and prefetching

P11.1Memory or disk
Whether the content appears on each of the two offline visits. Look at text and images separately, since they are often cached by different components.
4 steps
P11.2Read policy
Whether a loading state appears, whether old content appears first, and when the new content replaces it.
5 steps
P11.3Late revisit
Whether the old content is still shown, and whether the app says how old it is.
3 steps
P11.4Storage growth
Whether the figure keeps rising at the same rate, rises and then levels off, or hardly moves.
4 steps
P11.5Clear cacheChanges a setting
What the control removes and what it leaves.
4 steps
P11.6Unvisited detail
Which parts of the detail screen appear. Compare them with what the list row already showed.
3 steps
P11.7Metered and unmetered
Whether less is ready ahead of time on the metered network.
5 steps
P11.8Sign out and inChanges a setting
How far the storage figure drops at sign out, and whether screens appear at once or reload after sign in.
4 steps
P11.9Ahead of opening
Whether content published after you last closed the app is present with no network.
5 steps

12. Offline and sync

P12.1Offline read
Whether content appears, and whether the app says it is offline or that content may be out of date.
4 steps
P12.2Offline write
Whether the control is disabled, an error appears, or the change shows at once. Look for a pending indicator such as a clock icon, a dimmed item or a "waiting" label.
2 steps
P12.3Kill while pending
Whether the offline changes are still present.
3 steps
P12.4Reconnect
When the pending indicators clear, and whether the changes arrive elsewhere without you returning to the original screen.
4 steps
P12.5Two-device conflict
Which value both devices settle on in each run, and whether either device shows a message. Run 2 is the one that separates the rules, because A's edit is earlier by clock and still arrives last.
3 steps
P12.6Conflict unit
Whether both changes survive.
4 steps
P12.7Delete against edit
Whether the item stays deleted, returns with A's edit, or returns as a new item.
4 steps
P12.8Clock skewChanges a setting
Which value wins.
5 steps
P12.9Long absence
Whether the app updates in a moment, or shows a long loading state, a "restoring" message or an empty state that refills.
4 steps
P12.10First sync
What appears first, whether the app is usable before loading ends, and whether old data is present at once or loads on demand.
3 steps
P12.11Flaky network duplicates
Whether any item appears twice.
3 steps

13. Network transport and resilience

P13.1Cut mid-request
How many seconds pass before the app admits failure, and whether the message mentions the connection.
4 steps
P13.2Recovery
What it takes for the content to load.
4 steps
P13.3Weak connection
Whether the app waits, gives up, or stalls and then recovers without a tap.
4 steps
P13.4Quality adaptation
Whether the content itself changes, and not only how fast it arrives.
4 steps
P13.5Network switch
Whether progress pauses, restarts from zero, or fails, and whether you had to do anything.
4 steps
P13.6Leave and return
The state of the first screen when you return.
4 steps
P13.7Data saverChanges a setting
Any change in image quality, autoplay, prefetching or background refresh.
4 steps
P13.8Competing requests
Whether the new screen loads at near-normal speed, and whether the heavy action slows down while it does.
4 steps
P13.9Captive networkChanges a setting
What the app says about the connection, and how long it takes to say it.
4 steps

14. Real-time delivery

P14.1Foreground latency
Whether the change appears on A without any gesture, and after how long.
4 steps
P14.2Update rhythm
The spread of the delays. Look for a largest value that the delays never exceed, and for whether short and long delays are equally common.
2 steps
P14.3Subscription scope
Whether the badge or preview changes while you are elsewhere, and whether the change is already present when you return.
3 steps
P14.4Background delivery
The delay to the notification, and whether the content is already on screen when the app opens or loads after a visible wait.
4 steps
P14.5Notification, then offlineChanges a setting
Whether the full item is present in the app while offline.
4 steps
P14.6Force-quit delivery
Whether a notification still arrives, and whether it is as fast and as complete as with the app in the background.
4 steps
P14.7Notification permission offChanges a setting
Whether changes still appear in the open app, and at the same speed as before.
3 steps
P14.8Reconnect catch-upChanges a setting
Whether all ten items appear without a gesture, in what order they appear, and whether a refresh adds or reorders anything.
4 steps
P14.9Second device of one user
Whether incoming events reach both devices, whether your own action on A1 appears on A2 without a refresh, and whether the notification on A2 is removed after you read on A1.
4 steps
P14.10Ephemeral signal expiryChanges a setting
How long the indicator stays on A after B has lost the network.
4 steps

15. Lists, feeds and pagination

P15.1Scroll rhythm
Where loading indicators or placeholders appear, how regularly, and whether you ever reach them at reading speed.
3 steps
P15.2Page size
Whether the count is the same for every batch, and whether the first batch differs from the rest.
3 steps
P15.3Insert while scrolling
Whether items you noted appear a second time in the next batch, or whether the next batch looks shorter than usual.
4 steps
P15.4Remove while scrollingChanges a setting
Whether any number is missing on A that still exists on B, and whether the deleted items remain visible on A.
4 steps
P15.5Refresh a ranked feed twice
How many items stay, and whether those that stay keep their order.
4 steps
P15.6New items while reading
Whether a control announcing new items appears, whether the content you were reading moves, and whether the new items are at the top when you scroll up.
4 steps
P15.7Leave and return
At which of the three returns, if any, the list goes back to the top or shows different content.
4 steps
P15.8Gap after absence
What happens at the boundary between the items that arrived while you were away and the items you had loaded before.
3 steps
P15.9Landing mid-list
Whether the item appears inside the list, whether loading occurs in both directions, and whether the view holds still while it does.
4 steps
P15.10List against detail
Whether the row shows the change at once, whether the list reloads, and whether the position is kept.
4 steps

16. Images

P16.1Stand-in
What is drawn where each image will be. Compare several image areas with each other, and with the images that later fill them.
4 steps
P16.2Arrival pattern
How the real image fills in once it starts to arrive. Count the steps if it sharpens.
3 steps
P16.3Reserved space
Whether the text and the rows move when an image lands.
3 steps
P16.4Zoom swap
Whether the image is soft at first and becomes sharp, and whether it sharpens again after zooming. Fine text or hair in the image makes the change easy to see.
3 steps
P16.5Offline revisit
Images only, apart from text. Note whether they appear on each of the two offline visits, and whether they appear in the same frame as the screen or after a brief stand-in.
4 steps
P16.6Thumbnail to detail offline
Whether a large image appears, and how sharp it is compared with the thumbnail.
3 steps
P16.7Fast scroll then stop
Whether the rows you stopped on fill about as quickly as the first screen did, and whether the skipped rows already have their images. Also watch for any image that appears in a row and is then replaced by another.
5 steps
P16.8Data-saver modeChanges a setting
Whether images look softer, arrive faster, or do not load until you tap them. Compare fine detail in images of the same kind.
4 steps
P16.9Storage growth
Whether the figure keeps rising at the same rate, rises and then levels off, or hardly moves.
4 steps
P16.10Upload round tripChanges a setting
The pixel dimensions and the location of the saved copy, compared with the original.
4 steps

17. Audio and video playback

P17.1Weak start
Whether playback starts before any download completes, how sharp the picture is in the first seconds compared with later, and whether playback stops. For audio, quality changes are hard to hear, so note only the wait and the stops.
4 steps
P17.2Seek to an unbuffered point
How long the forward seek takes, whether the bar refuses to move, and whether small preview frames appear while you drag.
4 steps
P17.3Airplane mode mid-playback
How many seconds of playback continue with no network, and what the app shows when it stops.
4 steps
P17.4Lock the screen
Whether sound continues, whether the lock screen shows the title and artwork with working controls, and whether the headset button works.
4 steps
P17.5Switch apps
Whether a small floating video window appears, whether sound continues, and whether the video is still playing or paused at the point you left when you return. Note whether the app switcher preview shows the picture or a black area.
3 steps
P17.6Next item offline
Whether the next item starts to play with no network, and for how long.
4 steps
P17.7Position after a force-quit
Where the item offers to start.
3 steps
P17.8Continue on a second device
Whether B offers the position from A, and how close it is in each of the two runs.
4 steps
P17.9Download then go offlineChanges a setting
Whether the item plays with no network after a cold start, and anything the app says about expiry or about needing to go online.
4 steps
P17.10Autoplay and data costChanges a setting
Whether videos still start by themselves on cellular data and under data-saver mode, and whether they look softer.
4 steps

18. File transfer: uploads and downloads

P18.1Preparation pause
Whether a label such as preparing or processing appears before progress moves, and how long that phase lasts.
4 steps
P18.2Interrupt and restoreChanges a setting
Where progress stands when the transfer continues, and whether you had to act.
4 steps
P18.3Network switch mid-transferChanges a setting
Whether progress pauses, falls back, returns to zero or fails.
4 steps
P18.4Background mid-upload
Whether the file arrived while the app was off screen, and whether a persistent notification was shown.
5 steps
P18.5Force-quit mid-upload
Whether the file arrived with no process, and what state the item is in when you reopen the app.
5 steps
P18.6Attach order
When the item first appears on the second device, and whether its media is ready at that moment.
3 steps
P18.7Queue several files
How many transfers advance at once, the order they complete in, and whether the text overtakes them.
4 steps
P18.8Transfer conditionsChanges a setting
Whether the transfer runs, waits or asks, and the words the app uses.
4 steps
P18.9Download pause and resume
Where progress stands after the pause and after the force-quit.
4 steps
P18.10Cancelled download cleanup
Whether the storage figure returns to where it started.
5 steps

19. Live calls and live streaming

P19.1Call delay, side by side
The time between your real movement and its appearance on device B.
5 steps
P19.2Echo
Whether you hear yourself, and whether the helper's voice cuts out while you speak.
4 steps
P19.3Degrade one side
What happens to A's picture and A's voice on device B, and in which order.
4 steps
P19.4Network switch mid-callChanges a setting
Whether the call freezes, shows a reconnecting label, or ends.
4 steps
P19.5Call a force-quit app
What device B shows, how fast, and whether the ring stops when the caller gives up.
5 steps
P19.6Add participants
Whether the existing picture freezes or shows a reconnecting moment when the third person joins, and how quality changes as the call grows.
4 steps
P19.7Enlarge a tile
Whether you control your own layout, and whether the enlarged picture starts soft and then sharpens.
4 steps
P19.8Stream delay against a clock
The difference in seconds between the real clock and the clock in the stream on device B.
5 steps
P19.9Chat against picture
Which arrives first on device B, the message or the picture of the hand, and by how many seconds.
4 steps
P19.10Fall behind the live edge
Whether playback continues from where it stopped, skips forward, or runs fast.
4 steps

20. Identity and sessions

P20.1Offline while signed in
Which screen the app opens on with no network, and whether it still treats you as signed in when the network returns.
4 steps
P20.2Return after idle
Whether you return straight to your screen, meet an unlock prompt, or meet a full sign-in. With an unlock prompt, note whether it succeeds offline.
4 steps
P20.3Many devicesChanges a setting
Whether A stays signed in, and whether A or your inbox reports the new sign-in.
4 steps
P20.4Revoke from the device listChanges a setting
How long B keeps working after it is removed, and what B shows when it stops.
5 steps
P20.5Password change elsewhereChanges a setting
Whether B is signed out, and whether B explains why.
3 steps
P20.6Long absence
Whether you are still signed in, and if not, how much the app remembers about you.
3 steps
P20.7ReinstallChanges a setting
Whether you are signed in, recognized, or unknown. Note whether a filled-in sign-in form was filled by the app or offered by the operating system's password manager.
2 steps
P20.8Guest to account
Whether the guest state is present in the account afterwards, and whether the app asks you what to do with it.
3 steps
P20.9Recovery pathChanges a setting
How many separate proofs stand between a stranger and your account on this path.
3 steps
P20.10Several accounts
Whether a switch asks for credentials, how long it takes, and whether it works offline.
3 steps

21. Security and trust

P21.1Offline refusal
Whether each action is refused, accepted as pending, or completed with a final result while offline.
3 steps
P21.2Screenshot of a sensitive screen
Whether the capture is refused, comes out blank, or works, and whether the app reacts to it.
4 steps
P21.3App switcher
Whether the card shows the live screen or a cover, and whether returning asks for an unlock.
3 steps
P21.4Second proofChanges a setting
Whether any further proof is demanded, and whether it is one the device can check alone or one that only the backend could verify.
3 steps
P21.5One-time code limitChanges a setting
The first restriction you meet. A wait that grows, a message that names a limit, or a challenge that asks you to prove a person is present.
3 steps
P21.6Sign-out residueChanges a setting
What of your account is still visible on the device.
4 steps
P21.7Validation timing
Which messages appear at once and offline, and which appear only after a wait.
4 steps
P21.8Intercepting network
What the app shows while the network is intercepting its requests.
4 steps
P21.9Stated device requirements
Whether the maker states that the app refuses to run, or limits features, on devices it considers modified.
2 steps

22. Privacy, permissions and consent

P22.1First-run prompts
Whether system prompts appear before you have used any feature, and whether the app's own explanation screen comes before each.
3 steps
P22.2Deny on first request
What the feature does without the permission, and what the rest of the app does. Repeat for each permission and record each one.
4 steps
P22.3Ask again
Whether the system prompt returns, the app shows its own screen, or nothing happens.
3 steps
P22.4Grant, then revokeChanges a setting
Whether the app returns to the same screen or restarts, and whether the feature notices that the permission is gone.
4 steps
P22.5Approximate locationChanges a setting
Whether the features work with coarse results, ask for precise location, or stop.
3 steps
P22.6Limited photo access
Whether any permission prompt appears at all, and how the app behaves with a partial library.
4 steps
P22.7Decline tracking and non-essential use
Whether the app behaves the same, asks again, or withholds features.
3 steps
P22.8Account deletion pathChanges a setting
Whether the path stays inside the app, and what it says about timing.
4 steps
P22.9Data export path
Whether the file is available at once or is prepared and delivered later.
3 steps
P22.10Store listing against behavior
Whether everything the app asked for is declared, and how much is declared that you never saw requested.
3 steps

23. Background work and notifications

P23.1Notification categories
Where the switches live, how many there are, and whether a preference follows the account to another device.
4 steps
P23.2User-visible work
Whether the work continues, and what the system shows while it does.
4 steps
P23.3Force-quit, then an event
Whether a notification arrives after the force-quit, and whether it has the same detail as the first.
4 steps
P23.4Leave during a write
Whether the change reaches the second device while the app on A stays in the background.
4 steps
P23.5Act from the notification
Whether the action completes without the app coming to the screen, and whether the result reaches the second device.
4 steps
P23.6Read elsewhere
Whether the notification and the badge on A2 change after the item is read on A1.
4 steps
P23.7Low-power modeChanges a setting
Whether notifications still arrive, and whether they have the same detail as without low-power mode.
4 steps
P23.8Scheduled notification, offlineChanges a setting
Whether the notification appears at the chosen time while the device is offline.
4 steps
P23.9Offline, then reconnectChanges a setting
How many notifications arrive, and whether they are separate, merged or only the latest.
4 steps
P23.10Days unopenedChanges a setting
Whether the first screen holds content newer than the item you noted, while the device is offline.
4 steps

24. Location, sensors and hardware

P24.1Location indicator on screen
On which screens the indicator is on, and whether it turns off after you leave the location screen.
4 steps
P24.2Location indicator in the background
Whether the indicator stays on after the app leaves the screen, and what the system shows about it.
4 steps
P24.3Approximate location onlyChanges a setting
Whether the feature works at area level, asks for more, or shows a wrong position as if it were exact.
4 steps
P24.4Location deniedChanges a setting
Whether the feature offers another way in, still shows local content, or stops.
4 steps
P24.5Move in the background
Whether the route covers the whole walk, whether turns are followed, and what the line looks like where you stood still.
4 steps
P24.6Record offlineChanges a setting
Whether the part walked offline is present on the other device.
4 steps
P24.7Battery after a session
The app's share of battery use, and how much of its activity was in the background.
4 steps
P24.8Capture path
Who draws the capture screen and the photo grid, and which permission prompts appear.
4 steps
P24.9Scan offlineChanges a setting
Whether the scanner reacts to the item offline, and whether it shows a result.
4 steps
P24.10Hardware unavailableChanges a setting
What the feature shows with the radio off, and whether it recovers when the radio returns.
4 steps

25. Platform surfaces: widgets, wearables and extensions

P25.1Widget after a change in the app
How long the widget takes to show a change made in the app on the same device.
4 steps
P25.2Widget after a change elsewhere
Whether the widget on A shows the change without the app being opened, and after how long.
4 steps
P25.3Action without the app
Whether the action completes without the app appearing, and whether its result reaches the backend.
4 steps
P25.4Share while force-quit
Whether the main app opens, and whether the shared item reaches the second device before the main app is opened.
4 steps
P25.5Live status after a force-quit
Whether the live status keeps following the activity after the app is force-quit.
4 steps
P25.6Sign out, then check every surface
Which surfaces still show the account's data or still act as signed in after the sign-out.
4 steps
P25.7Watch with the phone offChanges a setting
Whether the watch app opens, whether it shows data, and whether it shows the change made after the phone went off.
4 steps
P25.8Watch write with the phone offChanges a setting
When the change made on the watch reaches the second device.
4 steps

26. Payments and subscriptions

P26.1Read the paywall
What is being sold, and which party the text says will charge you. Small print that mentions your store account and automatic renewal belongs to store billing. A list of card brands or a card form belongs to an external payment provider.
4 steps
P26.2Start a checkout and cancelChanges a setting
Who draws the surface that asks for the money. A sheet that slides over the app, shows your store account and looks the same in every app belongs to the operating system. A page with an address bar or a different visual style belongs to a provider.
4 steps
P26.3Look for the abandoned payment
Whether the app kept any record of the attempt you canceled.
4 steps
P26.4Paywall in airplane modeChanges a setting
Whether the paywall draws, whether it shows prices, and what the purchase button does.
4 steps
P26.5Restore purchases
Which identity the app uses to look for past purchases. The store account needs no sign-in to the app. The app account does.
3 steps
P26.6Existing entitlement on a second device
Whether the entitlement arrives with the sign-in, only after a restore, or not at all.
4 steps
P26.7Existing entitlement offlineChanges a setting
Whether the app still treats you as paid without being able to ask the backend.
4 steps
P26.8Where to manage or cancel
Whether you stay in the app, land in the store's own subscription settings, or land on a website.
3 steps
P26.9Saved payment methods
How much of a saved card the app can show, and who draws the form that adds one.
3 steps

27. Ads, attribution and growth

P27.1Ad inventory
Which ad formats the app uses and where it places them. Sort each sighting into banner, full-screen ad, rewarded ad or native ad.
4 steps
P27.2Ad slots in airplane modeChanges a setting
What occupies each ad slot when no ad can be fetched, and whether the app itself still works.
4 steps
P27.3Rewarded ad readiness
Whether the ad starts at once, and whether the control has a not-ready state. Compare the first tap after launch with the tap right after an ad has finished.
4 steps
P27.4Count the full-screen ads
Whether ads follow the count of actions, the time since the last ad, or neither.
4 steps
P27.5Decline tracking and compareChanges a setting
Whether the subject of the ads changes, whether as many slots are filled, and whether the app asks you again.
4 steps
P27.6Install from a referral linkChanges a setting
Whether the app knows who invited you, when it knows, and whether you had to type anything.
4 steps
P27.7Invitation screenChanges a setting
Whether the app offers a link to share, asks for your contacts, or both.
4 steps
P27.8Rating prompt timing
What triggers the prompt, and what stands in front of the system dialog.
4 steps
P27.9Re-engagement notifications
Whether the notifications refer to real activity, follow a schedule, or stop.
4 steps
P27.10Promotional content over time
Whether promotions change without a release, and whether two accounts see the same ones.
3 steps

28. Search and discovery

P28.1Search in airplane mode
Whether results appear at all, and whether they include items you have not opened.
4 steps
P28.2Typing rhythm
When the result list changes. On each letter, shortly after you stop, or only on submit. Note whether some rows change at once while others arrive later.
3 steps
P28.3Fast typing on a weak connection
Whether the list ever shows results that belong to the shorter text, and whether it ends on the right results.
5 steps
P28.4Misspelling
Whether the item is found, and whether the app says it changed your query.
3 steps
P28.5Create, then search
How long each device takes to find the item, and whether the deleted item still appears in results.
5 steps
P28.6Filter counts
Whether counts exist, and whether they change when another filter is applied.
4 steps
P28.7Same query, two accounts
Whether the two lists hold the same items in the same order.
4 steps
P28.8Recent searches on a second device
Whether A's searches are listed on B, and whether the cleared one disappears from B.
3 steps
P28.9Voice search offline
Whether your words appear as text in the box with no network, whatever happens to the search afterwards.
3 steps

29. Personalization and on-device intelligence

P29.1Smart feature in airplane mode
Whether the feature works at all, and whether the result is as good as it was online.
3 steps
P29.2Response time online and offline
Whether the time depends on the network, and whether a first result is replaced by a different one a moment later.
3 steps
P29.3Storage after enabling a feature
How much the storage grew, and whether the feature showed a downloading or preparing state.
4 steps
P29.4New account against old
Whether the new account sees generic content, is asked for interests, or already sees content that fits you.
4 steps
P29.5Feedback delay
When the topic first becomes more common. While you scroll, on the refresh, or only the next day.
5 steps
P29.6Assistant response shape
Whether text appears progressively, whether it stalls unevenly on the weak connection, and what happens to the partial answer when the network is cut.
4 steps
P29.7Personalization switch
Whether the surface becomes generic, and how soon.
4 steps
P29.8Second device
Whether what the app has learned is present on the new device at once.
3 steps
P29.9First use after a fresh installChanges a setting
Whether the feature works immediately, or says it needs to download or prepare something.
4 steps

30. Remote config and experiments

P30.1Change without an update
Whether anything other than content changes while the version stays the same, and the moment at which the change arrives.
4 steps
P30.2An announced feature you do not have
Whether a feature the maker says exists is present on your current version, and if not, whether it arrives without an update.
4 steps
P30.3Two accounts side by side
Differences in which features exist, and in the order, wording or design of the same feature. Ignore content, recommendations and anything personalized.
4 steps
P30.4Two devices of one account
Whether the two devices agree, and whether a difference survives two fresh launches on each.
4 steps
P30.5First against second launchChanges a setting
Whether a tab, section, control or flow is absent on the first launch and present on the second, or changes during the first launch while you watch.
4 steps
P30.6First launch in airplane modeChanges a setting
Whether the app opens at all, and how the screens it shows offline differ from the same screens after it has fetched config.
4 steps
P30.7Reinstall and the variantChanges a setting
Whether the variant on signed-in screens is the same as before, and whether the screens before sign-in changed.
4 steps
P30.8Region settingChanges a setting
Whether whole features, tabs or payment and sign-in options appear or disappear, as opposed to content and language.
4 steps

31. Server-driven UI

P31.1Structure change without an update
Whether blocks you already know reorder, appear or vanish, and whether a kind of block you have never seen in this app appears, all while the version stays the same.
4 steps
P31.2Arrangement across refreshes
Whether the order and presence of blocks vary between refreshes within one session, vary only between days, or never vary.
4 steps
P31.3Shared quirks across screens
Whether unrelated screens are built from the same blocks with the same quirks, or whether each has its own design, loading state and error state.
4 steps
P31.4The screen in airplane modeChanges a setting
Whether the visited screen shows its last structure with content, shows a frame of its own with an error or empty state inside, or shows nothing that belongs to that screen.
4 steps
P31.5Where taps lead
Whether the same position leads to different kinds of destination over time, or always to the same kind of screen with different content.
3 steps
P31.6Interaction inside the screenChanges a setting
Whether the control responds at once, whether a loading state appears and a section or the whole screen redraws, and whether it works with no network.
4 steps
P31.7Embedded web tells
A thin progress bar while loading, text that can be selected where other screens do not allow it, scrolling and tap feedback that differ from the rest of the app, and whole-view reloads.
4 steps
P31.8Old version against new
Whether the old version shows the same structure, lacks some blocks, shows a placeholder or an update prompt in place of a block, or shows an older design altogether.
4 steps
P31.9Two platforms
Whether both platforms show the same blocks in the same order with the same wording, and whether details such as fonts, controls and scrolling follow each platform or are the same on both.
4 steps

32. UI technology: native, cross-platform and web

P32.1Long-press text
Whether labels can be selected, whether a menu about the link appears, and whether the selection handles and menu match the ones the system's own apps show.
5 steps
P32.2Raise the system text sizeChanges a setting
Which screens grow and which do not. The difference between screens matters more than the result on any one.
3 steps
P32.3Screen reader walkChanges a setting
Whether controls are announced one by one with a name, a role and a state. Whether web terms such as heading, link or landmark are announced. Whether the focus outline sits exactly on each control.
4 steps
P32.4Two platforms side by side
Whether the two screens differ in structure, share a structure with different controls, or match pixel for pixel.
4 steps
P32.5Each screen in airplane modeChanges a setting
Whether each screen still draws its own frame, such as title, tabs and empty layout, or whether the whole body is blank or shows a plain error unlike the app's other error states.
4 steps
P32.6Refresh and loading
Whether a thin progress bar runs under the title, whether the content area blanks and refills from the top, and whether content jumps as it arrives.
3 steps
P32.7Scroll to the edge and fling
Whether deceleration and the edge effect match the system's, and whether blank rows appear during a hard fling.
3 steps
P32.8The seam
Whether the screen knows who you are, whether it carries parts of the website, and whether back moves one step or leaves the whole screen.
4 steps
P32.9App size and startup time
Whether the app is much larger than peers of similar scope, and whether a cold start pauses on the splash before anything is drawn.
3 steps

33. Releases and compatibility

P33.1Release cadence
Whether the gaps are steady or irregular, how long they are, and whether quick follow-up versions occur.
4 steps
P33.2Release notes
Whether the notes are the same generic text each time, name specific changes, or say that a feature reaches users gradually. These are statements by the maker.
4 steps
P33.3A second version identifier
Whether an identifier in the app changes on a day when the store installed nothing, and whether the app ever shows a download step at launch without a store update.
4 steps
P33.4When the update is offered
Whether both devices are offered the new version on the same day or days apart.
4 steps
P33.5Update promptChanges a setting
Whether the app says anything about its own age, whether the message blocks use, and how often it comes back.
4 steps
P33.6Update flow
Whether the prompt sends you to the store listing, or whether the update downloads while you stay in the app and then asks to restart.
3 steps
P33.7First launch after the updateChanges a setting
Whether you are still signed in, whether the draft, the setting and the stored content are there before any network is available, and whether the launch is slow.
4 steps
P33.8What an old version can still doChanges a setting
Whether reading and writing still work, how newer content appears, and whether a failure comes with an explanation.
4 steps
P33.9A new feature on an old version
Whether the old version has no trace of the feature, shows it with a message about updating, or has it working.
4 steps

34. Observability

P34.1Diagnostics setting
Whether a control exists, what it says is collected, and whether crash reports and usage data have separate controls.
3 steps
P34.2Privacy listing
Which kinds of data are declared and for which purposes, such as analytics or app functionality.
3 steps
P34.3Consent choices
Whether analytics is a category you can refuse, and which category crash reports are placed in.
3 steps
P34.4Feedback form
What the form says it attaches, and whether you are given a choice.
4 steps
P34.5Report trigger
Whether the app offers to report a problem or share the screenshot.
3 steps
P34.6Idle day
How much data the app used while you did not open it.
4 steps
P34.7Offline session, then reconnectChanges a setting
Whether the app used data after reconnecting although you did not open it and had nothing of your own waiting to send.
5 steps
P34.8Launch after a crashChanges a setting
Whether the app asks to send a report, shows a message about the previous run, or returns you to where you were.
3 steps

35. Performance and resource budgets

P35.1App size
How the installed figure compares with the listed size, whether it grows when a feature is first opened, and whether a feature shows a download indicator on first use.
3 steps
P35.2Storage over a week
Whether the total keeps rising, or rises and then holds.
3 steps
P35.3Battery over a day
How large the background part is, and whether a feature you used explains it, such as playback, navigation or a call.
3 steps
P35.4Data over a day
Whether the total is in proportion to what you consumed, and how much was used in the background.
3 steps
P35.5Heavy list scroll
Whether the list follows your finger, what rows look like as they enter the screen, and whether the scroll gets worse the deeper you go.
3 steps
P35.6Leave and return
Whether the screen is exactly as you left it, or whether a splash appears first, and where you land.
5 steps
P35.7Low-power modeChanges a setting
Any difference in autoplay, animation, media quality, freshness on opening, or a message from the app about the mode.
3 steps
P35.8Sustained useChanges a setting
Whether the device grows warm, and whether the app's quality or smoothness changes over the fifteen minutes.
3 steps

36. Constrained devices and networks

P36.1Look for a small variant
Whether the same maker publishes a second, smaller app for the same product. Some variants are listed only in certain regions, so absence in your store is weak evidence.
4 steps
P36.2Compare the variant with the full app
The size ratio, which features are missing, whether your data appears in both, and whether the chosen feature works offline in one and not the other.
5 steps
P36.3In-app data controls
How many separate controls exist and how fine their choices are.
3 steps
P36.4Device data-saver modeChanges a setting
Whether images are lower in resolution or wait for a tap, whether autoplay stops, and whether the app mentions the mode.
3 steps
P36.5Weak connection
Whether text appears before media, whether images arrive blurred and then sharpen, and whether the app says anything about the connection.
4 steps
P36.6Storage controlsChanges a setting
Whether the app accounts for its own storage, and, only if the device is already low, whether a save fails cleanly.
3 steps
P36.7Fallback channels
Which tasks have a channel outside the app, and whether a text message has ever followed or replaced a notification.
4 steps
P36.8Two classes of device
Differences that follow the device and not the account or the network. Ignore plain slowness. Look for things that are absent or simplified.
4 steps
P36.9Old operating system
Whether the store offers the current version, an older version, a small variant, or nothing.
3 steps

37. Accessibility and global reach

P37.1Large textChanges a setting
Whether text grows, whether rows grow taller and labels wrap, and whether any text is clipped, overlapped or cut off with no way to read the rest.
4 steps
P37.2Screen reader taskChanges a setting
Whether every control is announced with a name and a role, whether list rows are one stop or many, and whether errors and loading results are announced.
5 steps
P37.3Dark appearanceChanges a setting
Whether the app switches at once, whether every screen switches, and whether any text becomes hard to read against its background.
4 steps
P37.4Reduced motionChanges a setting
Whether large movements are replaced by a fade or removed, and whether autoplay stops.
3 steps
P37.5Switch the languageChanges a setting
Three groups of text. What changed at once offline, what changed after a refresh, and what stayed in the old language.
5 steps
P37.6Right-to-leftChanges a setting
Whether the whole layout mirrors, and which elements stay on the side they were on.
4 steps
P37.7Change the regionChanges a setting
Whether formats change, whether they change before or after a refresh, and whether anything beyond formats changes.
4 steps
P37.8Change the time zoneChanges a setting
Whether past timestamps shift by the zone difference, whether they shift before or after a refresh, and whether an event at a place keeps its local time and says so.
4 steps
P37.9Rotate or resize
Whether the layout changes structure or only stretches, and whether your selection, scroll position and typed text survive each change.
3 steps
P37.10Read the regional terms
Whether the documents and controls are written for your region specifically, or are one global text.
4 steps

38. Modularity, SDKs and team scale

P38.1Read the licenses screen
How long the list is, which categories appear, and whether one category has two entries doing the same job.
4 steps
P38.2Read the store's privacy listing
Whether the declaration mentions tracking or third-party advertising, and whether it mentions diagnostics.
3 steps
P38.3Compare the look of each area
Button height and corner shape, typeface and text sizes, spacing, icon style, and how loading is drawn.
3 steps
P38.4Compare the behavior of each areaChanges a setting
Whether refresh, offline behavior, error wording and back behave the same in every area, and whether a change made in one area is visible in another.
5 steps
P38.5First use of a feature
Whether an indicator appears on the first open only, what its text says is being downloaded, and whether the app's own size grew.
5 steps
P38.6Read the version history
Whether the gaps are regular, whether the notes are specific, and whether both platforms release on the same days.
4 steps
P38.7App size against feature count
Whether the app is much larger or smaller than its peers for a similar feature count, and whether it grows with every release.
4 steps
P38.8Prompts at first launchChanges a setting
Which prompts appear before any feature is used, and whether a prompt for a capability appears only when you first use the feature that needs it.
4 steps
P38.9Parity across platforms
Whether both platforms have the same features at the same time, and whether edge cases and wording match exactly.
4 steps

39. Messaging

P39.1Status stages
How many distinct marks the message passes through on A, and which action on either device causes each change.
5 steps
P39.2Recipient switched off
Whether the mark on A changes while B's device is off, when it comes on, or only when B opens the app.
5 steps
P39.3Crossed messages
Whether both devices agree on the order, and whether "one" changes position on A after it is confirmed.
5 steps
P39.4New device history
How much history appears with the old device off, and what the app asks for before it shows more.
5 steps
P39.5Old conversation on a second device
Whether old messages are already on the device, load in pages while you scroll, or stop at a fixed point.
4 steps
P39.6Interrupted videoChanges a setting
Where the progress resumes from, whether you must tap to retry, and whether the text overtakes the video.
5 steps
P39.7Offline search
Which of the two words is found offline, and whether the old word is found online.
5 steps
P39.8Delete for everyone
What replaces the message on each device, and whether the device that was offline catches up.
5 steps
P39.9Phone off, companion on
Whether messages send and arrive without the phone, and whether the companion still shows its conversations after a reload.
5 steps

40. Social feed and stories

P40.1First screen after a gap
Whether the first thing drawn is the feed from your last visit, a skeleton, or items you have never seen, and whether anything appears in airplane mode.
4 steps
P40.2Like in airplane modeChanges a setting
Whether the like shows at once, whether it survives the force-quit, and whether it reaches the backend without another tap.
5 steps
P40.3Counter from a second accountChanges a setting
When B's like reaches the count on device 1, and how that compares with the instant change from A's own tap.
5 steps
P40.4Follow, then unfollowChanges a setting
Whether C's older posts enter the feed when you follow, and whether C's posts leave it at once when you unfollow.
5 steps
P40.5Publish and interruptChanges a setting
Whether the post shows in your own feed as pending, whether it survives the force-quit, and whether it completes without a tap.
5 steps
P40.6Stories in airplane mode
How many items play, across how many accounts, before a loading indicator appears.
4 steps
P40.7Seen-state on a second deviceChanges a setting
Whether device 2 marks B's story as seen by itself, after a refresh, or not at all.
5 steps
P40.8Story past its limitChanges a setting
Whether the expired story still plays on the offline device, and what changes when the device comes online.
5 steps

41. Video and short-video streaming

P41.1Swipe depth offline
How many clips start with no network, and how much of each one plays.
5 steps
P41.2Swipe depth on cellularChanges a setting
Whether the count of clips that start offline is lower on cellular data, and lower again under data-saver mode.
4 steps
P41.3The cost of skippingChanges a setting
The data used per minute while skipping, compared with the data used per minute while watching.
4 steps
P41.4First second on two networks
Whether the first second is soft or sharp on each network, and whether a sharp start on the weak network is followed by a stall.
4 steps
P41.5Download time limits
Whether the app states a limit, whether the limit shortens once playback has started, and whether the item still plays after a week.
5 steps
P41.6Position reported from offline
Whether B learns the position that A reached offline, and whether A had to be opened for that to happen.
5 steps
P41.7Upload to availabilityChanges a setting
The delay between the end of the upload and the first playback, and whether the highest quality level arrives later than the first.
5 steps
P41.8Reopen the swipe feed
Whether the feed starts where you left it, starts with clips you have not seen, or repeats the clips you already watched.
3 steps

42. Audio streaming and podcasts

P42.1Track boundary
Whether the sound is continuous at the boundary, and whether any silence has the same length each time.
4 steps
P42.2Queue on a second device
Whether B shows what A is playing, whether B shows the same queue in the same order, and whether a change on B reaches A.
4 steps
P42.3Hand playback over
Which device makes sound afterwards, whether the item continued or started again, and how long the change took.
4 steps
P42.4Offline queue meets a missing item
What the player does when the next item in the queue is not on the device.
4 steps
P42.5Downloads after sign-outChanges a setting
Whether the storage figure drops at sign-out, and whether the item is still listed and still plays offline.
4 steps
P42.6New episode while unopened
Whether the new episode is listed, whether it plays offline, and whether a notification announced it before you opened the app.
5 steps
P42.7Two positions for one episode
The position A offers. It held minute 30 and B last reported minute 11.
4 steps

43. Marketplace and e-commerce

P43.1Guest cart at sign-in
Which of the three items the cart holds after sign-in, and whether the app asks you anything.
5 steps
P43.2Cart on a second device
Whether the item reaches B, and whether it arrives untouched or only when the cart screen is opened again.
5 steps
P43.3Cart in airplane mode
Whether the cart draws offline, whether each change is refused or accepted, and whether an accepted change is still there after the force-quit.
6 steps
P43.4Cart total on a weak connection
Which of the three numbers changes at once, and which waits for the network.
5 steps
P43.5Quantity above stockChanges a setting
Where the limit is enforced. In the quantity control, in a message after a wait, or only at the checkout summary.
5 steps
P43.6Stale cartChanges a setting
Whether a price or an availability differs from your notes, where the difference first shows, and whether the app points it out.
5 steps
P43.7Interrupted checkoutChanges a setting
Which step you land on, and whether the address and delivery option you chose are still selected.
5 steps

44. On-demand services: rides and delivery

P44.1Quote before confirmingChanges a setting
Whether the price is one figure or a range, whether it changes or expires while you wait, and whether any price appears offline.
5 steps
P44.2Nearby markers before a requestChanges a setting
Whether markers glide, move in steps at a regular interval, or stand still, and what they do with no network.
4 steps
P44.3Leave during matchingChanges a setting
Whether you learn of the match while the app is in the background, and what the app shows when it returns.
4 steps
P44.4Force-quit during an active tripChanges a setting
Which screen appears first, how long the trip takes to appear, and whether its state has moved on.
4 steps
P44.5Network gap while trackingChanges a setting
What the marker does while offline, whether the app says it is offline, and how the marker gets to its new position afterwards.
3 steps
P44.6The same trip on a second deviceChanges a setting
Whether both devices show the same state and estimate, and how far apart in time a change appears on the two.
4 steps
P44.7Contacting the providerChanges a setting
Whether a call leaves the app, which number is dialed, and whether contact is still possible after the trip.
5 steps
P44.8Charge timing and final priceChanges a setting
When the first bank entry appears, whether a pending entry later changes or disappears, and how the final amount relates to the first price.
4 steps

45. Booking and reservations

P45.1Countdown after a force-quitChanges a setting
Whether the booking in progress can be found again, and whether the countdown lost exactly the time that passed.
5 steps
P45.2Held item seen from a second deviceChanges a setting
Whether B shows the item as taken, when, and what B is told if it tries to select it.
5 steps
P45.3Release on leavingChanges a setting
Whether the item becomes free soon after A leaves, or only when the countdown would have ended.
5 steps
P45.4Booking flow in airplane mode
How far the flow goes without a network, and at which step it refuses.
5 steps
P45.5Old search resultsChanges a setting
Whether the app lets you continue from the old list, and whether the summary price matches the price you noted.
5 steps
P45.6Ticket in airplane modeChanges a setting
Whether the ticket and its scannable code appear offline before you have ever opened it on this device, and after.
5 steps
P45.7Code over timeChanges a setting
Whether the code is fixed or changes, and whether a changing code keeps changing without a network.
5 steps
P45.8Booking on a second deviceChanges a setting
Whether the booking follows the account, and how a change made on one device reaches the other.
5 steps

46. Banking, payments and fintech

P46.1Balance in airplane mode
Whether a balance is shown at all without a network, and whether the app says how old the figure is.
4 steps
P46.2Gate on every return
How long the app may be out of sight before it asks you to prove you are present again.
5 steps
P46.3Idle inside the appChanges a setting
Whether the app ends or locks the session by itself, whether it warns first, and what the first tap afterwards leads to.
5 steps
P46.4Transfer form offlineChanges a setting
The first point at which the app refuses to go on, and the words it uses.
5 steps
P46.5Transfer up to reviewChanges a setting
Where the app places its proof of presence, what the review screen promises, and whether an unconfirmed attempt leaves a record.
5 steps
P46.6Pending and settled
Whether the app shows a transaction before it is final, and whether it shows one balance or two.
5 steps
P46.7Read the device bindingChanges a setting
Whether the account is tied to named devices, how many, and what a new device has to prove.
5 steps
P46.8Live price rhythm
Whether the price moves irregularly or on a beat, and what the app does to a price it can no longer update.
5 steps

47. Maps and navigation

P47.1Visited and unvisited areas offline
How much detail each area shows offline, and where the detail stops.
5 steps
P47.2Rotate and zoom
Whether labels stay upright while the map turns, and whether lines and text stay sharp at every moment of a zoom.
5 steps
P47.3Download a regionChanges a setting
Whether the map is detailed everywhere in the region, and whether a route can be computed with no network.
5 steps
P47.4Leave the route offlineChanges a setting
Whether a new route appears while offline, what the app says, and what happens when the network returns.
5 steps
P47.5Navigation with the screen lockedChanges a setting
Whether prompts are spoken on time while locked, what the system shows outside the app, and whether the app's position is current when it returns.
5 steps
P47.6Traffic layer offline
Whether the traffic colors and incidents stay, fade or disappear with no network, and whether the app says how old they are.
4 steps
P47.7Place search offline
Which of the three searches return results offline, and what detail the results carry.
5 steps
P47.8Storage and its controls
Whether downloads and cache are shown apart, whether downloads expire or update by themselves, and whether the cache figure levels off.
5 steps

48. Notes, documents and collaboration

P48.1Kill while typing
How much of the typed text is there, and whether the app shows any recovery notice.
4 steps
P48.2Two paragraphs, two devicesChanges a setting
Whether both changed words are in one note, and whether anything tells you that a conflict happened.
5 steps
P48.3One sentence, two devicesChanges a setting
Whether the sentence holds both inserted words, one of them, or appears twice.
5 steps
P48.4Live typing
The size of the pieces in which A's text reaches B, the delay, and whether you must do anything on B to see it.
4 steps
P48.5Cursor after disconnect
Whether B shows a mark for A at all, and how long the mark outlives A's connection.
4 steps
P48.6Attachment added offline
Whether the photo can be added offline, whether it survives the force-quit, and whether the sentence reaches B before the photo does.
4 steps
P48.7Remove access from an offline replicaChanges a setting
Whether the document leaves B's device, and what happens to the sentence B wrote after access was removed.
5 steps
P48.8First sync on a new deviceChanges a setting
What is on the device at the moment the list first appears. Titles, bodies and attachments are three separate answers.
5 steps

49. Meetings and calling

P49.1Answer on one device
Whether both devices ring, and how quickly the device you did not touch stops in each run.
5 steps
P49.2Join by link without an account
Whether B can enter with only a name, and where B lands after any sign-in the app demands.
4 steps
P49.3Join before the host
Whether B waits, what B can see or hear while waiting, and whether A has to act before B enters.
4 steps
P49.4Host mutes a participant
Whether B is silenced at once, whether B is told, and whether B can undo it.
4 steps
P49.5Host loses the app
Whether the meeting continues without A, for how long, and what role A has on return.
5 steps
P49.6Chat for a late joiner
Whether C sees messages from before it joined, whether C receives the messages and the reaction it missed while offline, and whether the chat outlives the meeting.
5 steps
P49.7Outage and return
What the other side sees about A during each outage, and whether A is back in the call without a tap after each one.
4 steps
P49.8Route change
Whether the sound follows each change by itself, how long any gap lasts, and who draws the route picker.
5 steps

50. AI assistants

P50.1Stop mid-answer
Whether the partial answer is kept on screen, and whether it is still there after the app has restarted.
4 steps
P50.2Leave mid-answer
Whether the answer is complete the moment you return, and whether the app announced it while you were away.
4 steps
P50.3Network drop mid-answer
What the client does with the partial text, and whether the rest of the answer arrives without a new request.
5 steps
P50.4Airplane-mode test
Whether any answer is produced with no network, and what happens to a prompt that cannot be answered.
5 steps
P50.5History on a second device
Whether old conversations follow the account, and whether a new one appears on the other device without a gesture.
5 steps
P50.6Regenerate
What happens to the first answer, and what the conversation looks like after it is reloaded.
4 steps
P50.7Attachment orderChanges a setting
Whether the file travels before you tap send or after, and how soon the first words of the answer appear after the tap.
5 steps
P50.8Read the usage limitsChanges a setting
Where the limit is stated, whether the app shows how much is left, and whether that figure needs the network.
4 steps

51. Health, fitness and connected devices

P51.1Kill mid-workoutChanges a setting
Whether the workout is still there, whether the app offers to continue it, and what it shows for the two minutes after the force-quit.
4 steps
P51.2Offline workout, end to end
Whether the workout can be recorded and saved offline, and what causes it to reach the second device.
5 steps
P51.3History from before the install
Whether days before the install have data, and whether today's figure matches the system's.
4 steps
P51.4Accessory away from the phoneChanges a setting
Whether the away period arrives with minute-by-minute detail, and whether it arrived before you opened the app.
5 steps
P51.5Workout on the watch alone
Whether the watch can record without the phone, and whether the workout reaches the backend before the phone returns.
4 steps
P51.6One workout, two sources
Whether the same walk appears once or twice in the list, and whether the day's totals count it once.
5 steps
P51.7Revoke health accessChanges a setting
What the screens show for data that came from the platform, whether the app says why, and whether its own recordings are still there.
4 steps
P51.8Leave during a firmware updateChanges a setting
Whether progress advanced while you were away, and whether it continued or started again when you returned.
4 steps

52. Games

P52.1First launch downloadChanges a setting
Whether a download with a progress indicator runs before the first play, and whether the figure keeps growing as you reach new content.
5 steps
P52.2Play in airplane mode
How far the game gets with no network, and which screens are missing or disabled.
4 steps
P52.3Offline progress after reconnectChanges a setting
Whether the level result and the rewards earned offline are still there once the backend has been reached.
5 steps
P52.4Progress on a second device
At which step your progress appears on the second device, if it appears at all.
5 steps
P52.5Two devices, two savesChanges a setting
Whether the game asks you to choose, and which device's session survives.
5 steps
P52.6An event begins
Which action makes the change appear, and whether a download step runs first.
5 steps
P52.7Movement on a weak connectionChanges a setting
Whether your own character still answers every touch at once, and what happens to it and to the others when the connection falters.
4 steps
P52.8Leave a match and returnChanges a setting
Whether the match went on without you, waited for you or ended.
4 steps

53. Super-apps and mini-programs

P53.1First open of a service
Whether a loading step with the service's own name or icon appears the first time only, every time or never, and what each service shows with no network.
4 steps
P53.2Identity across services
Whether the service already knows you, asks through a sheet in the host's style, or shows a sign-in form of its own.
4 steps
P53.3Payment sheet in two services
Whether both services end in the same payment sheet with the same wallet and saved methods, and who draws it.
4 steps
P53.4Location in two services
Whether the second service has your location without asking, and whether the host keeps a grant for each service.
4 steps
P53.5Home screen on two accounts
Whether the set of services, their order or neither differs, and whether a missing service can still be found by search.
4 steps
P53.6Leave a service and return
Whether the first service is exactly as you left it, restarts with your text, or restarts empty.
5 steps
P53.7Storage after exploring
How much the data figure grows per service, and whether the host accounts for storage per service.
5 steps
P53.8The frame around each service
Whether one fixed control set sits over content that differs in look, or the whole screen shares one look.
4 steps

54. Apps with no backend

P54.1Read the listing and the settings
Whether anything mentions an account or sync, and whose account it is.
4 steps
P54.2A week without a networkChanges a setting
Whether anything at all degrades as the days pass, and whether the app ever mentions the network.
4 steps
P54.3Data used after a week
Whether the app used the network at all, how much, and whether any of it was in the background.
4 steps
P54.4Kill during a writeChanges a setting
Whether the item exists, how much of what you entered it holds, and whether it opens without an error.
4 steps
P54.5Second device on the same platform account
Whether your data arrives, and what you had to do to bring it.
4 steps
P54.6Export and import round tripChanges a setting
Whether a person or another program could read the file, and whether anything is missing after the import.
5 steps
P54.7Two devices edit offlineChanges a setting
Which value each device ends with, whether the two devices agree, and whether an extra copy of the item appears.
5 steps
P54.8Purchase on a second deviceChanges a setting
What the app asks for before it unlocks, and whether the unlock holds without a network.
4 steps

55. The app that fits no archetype

P55.1Feature inventory
How many features remain after grouping, and whether each one resembles a known archetype.
4 steps
P55.2Airplane-mode tour, feature by featureChanges a setting
Which features show content, which accept a change, and which are blocked. Write one line per feature.
5 steps
P55.3Walk the seams
Whether any feature differs from the rest in look, loading, text behavior or failure.
4 steps
P55.4Physical step without a networkChanges a setting
Whether the step works without a network, how long it takes, and when the record of it appears elsewhere.
5 steps
P55.5One action, every feature
Which places update at once, which need a refresh, and whether anything arrives later as a message or a notification.
5 steps