Ask about behavior before preference
Have the person try a realistic task without teaching each action. Then ask what they expected, where they looked and how they decided the task was complete. Avoid leading wording such as ‘Was our simple onboarding easy?’ That wording contains the answer you hope to hear. Give the participant room to describe a different interpretation from the one the team intended.
Use follow-ups that narrow the uncertainty
When somebody says ‘confusing’, ask which label or state caused the hesitation. When they say ‘slow’, ask where the wait occurred and what they expected during it. Request build and device context for technical findings. Do not make the participant solve the implementation problem; their contribution is an observation that helps your team reproduce or understand the experience.
Keep the interview separate from public reviews
A research interview should not end with a required favorable store post. Approve paid private work using the agreed task and evidence criteria. Preserve criticism and contradictory observations in the summary. If you ask for an optional community rating, explain where it appears and that it does not affect compensation. Use results to choose the next test rather than claiming a tiny cohort represents all future users.
Working example
Question set: ‘What were you trying to do? Where did you look first? What did you expect after tapping? What actually happened? How did you know the task was finished? What would you do next?’ Add one question relevant to the product decision. Ask the same neutral questions across the cohort so the comparison is not driven by different coaching.
Your next steps
- Start with an attempted task.
- Avoid adjectives that suggest the desired answer.
- Ask for specific states and expectations.
- Preserve criticism and scope limits in the summary.
Turn the next test into something useful.
Publish a focused brief on RateMyApp. Credits fund approved private reports; public store reviews are voluntary and unrewarded.
List your app for feedback