Results to the hypotheses & Test:
Date picker for mood – adding animations and an arrow
Hypothesis: Adding a subtle animation and an arrow will show users that they can tap on it to change the date.
Result – People seem receptive to even the arrow to indicate being able to change the date.
Textboxes for tutorials – changing colour, animation and proximity.
Hypothesis: Lessening the animation, having a brighter colour and changing the location of the textboxes will allow users to understand what they’re doing in greater detail, and would be able to complete the tasks for making a to-do list with no problems
Result – Participants reacted well to the changes. No negative feedback, in the sense of criticism of animation, colour or proximity. When having to do their own to-do list without the walkthrough, almost all have been successful with the retention of information.
More gestures – Adding dragging and sliding
Hypothesis: People will use their mental models of how things work and bring it to the system and hopefully be more comfortable.
Result – I had to give more context about the hidden gestures, but people did seem to understand. However I think this would be reserved for people who would use this app a lot more frequently.
More animations – moving cards down
Hypothesis: Users will understand how much automation this app has and the importance of some tasks (especially when some are completed).
Result – The animation prompted people to understand that because tasks were done, there were new and other priorities - helping them organise their time!
Expanding and allowing to shrink cards – more efficient use of time and space
Hypothesis: Users will do things faster (esp the checking list off task)
Result – Participants just used the checklist right from the home screen
Some things I want to ask however it’s hard to emulate real life using the prototype
I think that a lot of the people that went through the onboarding/instructional sequence, they didn’t want to read it, which is probably realistic. But they still did well when they needed to go through the tutorial, or do tasks on their own.
Tutorial – did participants understand it?
Participants went through the walkthrough and I got them to also complete a task without a tutorial to test them whether they understood the tutorial. All the participants did well and were very receptive. However one participant was still was a bit unsure about what the checklist icon was and she had a hard time looking for it. But the proximity, colour and animations were received well by the participants.
Frustrating features of the app
The gestures were a bit confusing to the participants, especially because the gestures weren’t obvious.
There was one android user who used their mental model of android systems which didn’t translate well because the app I designed was for iOS. This is something I need to think about – whether to only get apple users to test for right now, or think of ways to cater to both types of users.
Note: there was another android user who did well with the tasks.
Participants didn’t really understand what the different dots on the graph meant which I had to explain further.
One participant mentioned that she did not understand the different style names (heading/title/body) and what they meant.
The participant wanted me to think about other operating systems.
Adding a key or something to increase the understanding
A participant didn’t understand what some of the moods meant.
All of the tasks were on the ‘easy’ part of the scale. The one task that was the most challenging is the ‘gestures’ task, which is understandable. A participant also told me that the tasks I got them to do are things she might not even do if she did want to use the app. And this made me think about the tasks I got participants to go through and how some of them were reserved for more expert/experienced users (gestures/more complex things). But overall, I still wanted to check if more complex tasks were easy to do for new users.
Compared to the last iteration, the score has improved by 0.5. Most of the statements have positively increased or decreased (depending on the statement), except for the statements about the app being complex. I think that most of this had to do with the questions that I asked (not necessarily tasks) – where participants had to think more deeply about the app.
Adding a more...robust... key for the graph
Adding more information about the moods
Refining the reminder based on location - some people didn’t get this right because they thought it referred to timezones.