User Evaluation Report

Brief Description of User

For Usability Evaluation of ReminderPro Android Mobile Application we have taken two different type of users that are using mobile applications in their life, one with more computer skills and have developing skills in mobile side and other on with normal mobile phone user experience. The one who is having more computer skills we called as the technical user and other one with normal mobile phone user experience we named as non-technical user.

As the non-technical user, we interviewed one of undergraduate student of Colombo Academy of Hospitality Management (CAHM), and the user is frequently using Android mobile platform. But this is the first time using ReminderPro Android Application.

As the technical user we also interviewed a one of our friend who use to create mobile application using Android platform and using Android mobile platform daily with higher skills. This was the first time of user that dealing with our ReminderPro Android Application.

Process Overview

1. Add new event
 Select birthday or anniversary
2. Selecting event
 How do you feel about this page?
3. Edit event
 What do you think about this page?
4. Make suggestions
5. Make a call
6. Make new message
7. Delete event
 What do you feel about the layout?
8. Ask for changes
9. Go to Birthday page.
10. Go to Anniversaries page.
11. Go to Settings.
12. Go to About Us page.

Paper Prototype - Technical User Review Transcript

As the technical user we also interviewed a one of our friend who use to create mobile application using Android platform and using Android mobile platform daily with higher skills. This was the first time of user that dealing with our ReminderPro Android Application.

Transcript for 2nd paper prototype 1


98
99
Interviewer: Ok Ashan go to ReminderPro Application (00:12-:00:15) 100
101
Interviewer: Now please add a new event(00:21-00.26) 102
103
Interviewer: Set a date, press edit (00:46-00:48) 104
User: (Get some time to think) 105
106
Interviewer: Click Set(00:58-00:59) 107
108
Interviewer: Now add the event you added.(01:06-01:08) 109
110
Interviewer: Now please to, please go to the event you added.(01:16-01:21) 111
112
Interviewer: Now Ashan try to make a call (01:24-01.30) 113
114
Interviewer: End the call (01:32-01:35) 115
116
Interviewer: Now create SMS (01:38-01:40) 117
118
Interviewer: Set a message.(01:46-01:49) 119
120
Interviewer: Click Send , this one(01:50-01:58) 121
User: (Get some time to think) 122
123
Interviewer: Now go back please.(02:01-02:03) 124
125
Interviewer: Now go to settings (02:07-02:11) 126
User: (make fast movement towards the settings button without wasting time) 127
128
User: In here this is not suitable for this ahh…mm(02:17-02:21) 129
Interviwer: You mean the color..?(02:22-02:23) 130
User: I mean the color, this is not good for this app.(02:24-02:26)
Page 8 of 13
Interviewer: What color do you suggest..?(02:27) 132
User: I suggest,ahh this have to….this have to paint like this color(02:28-02:36) 133
134
Interviewer: Now please schedule a message. (02:42-02:44) 135
User: Scheduled. (02:54-02:55) 136
137
Interviewer: Now edit the event (02:59-03:00) 138
User: (Think a little time and tap on edit) 139
140
Interviewer: Change the name,ahh and click update (03:10-03:12) 141
User: ok 142
143
Interviewer: Now delete the event.(03:18-03:20) 144
User: (Think little time and go to the settings and tap on delete) 145
In here,ahh I can’t see a confirmation for the event I previously added. You have to create that(03:40-03:47) 146
147
User: And ther is, this is not beautiful and not attractive for this app. You have to color ahh blue or some thing like that(03:58-04:02) 148
Interviewer: You mean same color..?(04:03) 149
User: Yeah. And this, this numbers are not important for this app.(04:09-04:15) 150
Interviewer: You mean you can’t understand what is….. 151
User: I mean I can understand, I also can’t understand what is this…(04:17-04:21) 152
Interviewer: ok. 153
154
Interviewer: Now go to tomorrow, this month (04:27-04:30) 155
User: ok, 156
157
Interviewer: Now try to go to birthdays. 158
User: ok, 159
160
User: In here , in this window, this birthday icons are not important for this… 161
Interviewer: you mean you already know these are birthdays..? 162
User: yes.(04:57-05:08) 163
164
Interviewer: Now scroll between today tomorrow and this month (05:10-05:11) 165
User:
168
Interviewer: Now go to anniversaries (05:25-05:26) 169
170
Interviewer: now go to today view.(05:40) 171
Interviewer: now go to tomorrow view.(05:41) 172
Interviewer: now go to this month view.(05:45) 173
174
Interviewer: Now try to go to settings. Now change the Remind Me On to ahh the day(05:50-06:12) 175
176
Interviewer: Now ahh turn on message delivered notification.(06:23-06:25) 177
178
Interviewer: Ok now ahh, try to go to about(06:23) 179
User: In here these text has to be justify.(06:47-06:49) 180
Interviewer: Ok. 181
182
Interviewer: Ok. Now go to all (06:50-06:52) 183
User : Ok In here this white space is very big. To this white space you have to add a picture or watermark (07:00-07:19) 184
Interviewer: ok. Now go to home. 185
186
Interviewer: Thank you.

Paper Prototype - Non Technical User Review Transcript

As the non-technical user, we interviewed one of undergraduate student of Colombo Academy of Hospitality Management (CAHM), and the user is frequently using Android mobile platform. But this is the first time using ReminderPro Android Application


Transcript for 1st paper prototype

Interviewer: hi Now we are going to do paper prototype for ReminderPro Android Mobile application, first you have to go to the 1 mobile application.(00:19 – 00:23) 2
User: Ok, I will click on Application Icon.(00:24 – 00:25) 3
4
Interviewer: ok, now please add an event.(00:26-00:28) 5
User: This one? (00:29-00:31) 6
7
Interviewer: Add details and click on edit to change the date.(00:34-0:40) 8
User: ok (Got some time to find) 9
10
Interviewer: Tap on add button.(00:48-00:50) 11
User: ahhh... ok.(00:54-00:55) 12
13
Interviewer: Now make a call.(01:01-01:03) 14
User: mmm….ok(Took some time)(01:04-01:07) 15
16
Interviewer: ok, now send a message(01:10-01:13) 17
User: ok (01:14-0114) 18
19
Interviewer: Add some test and click send.(01:18-01:19) 20
21
Interviewer: Now try to schedule a message to the event you created(01:34-01:35) 22
User: mmm……sorry I can’t find where to schedule a message.. (got some time)(01:36-01:38) 23
24
Interviewer: Click here…(01:37-01:38) 25
User: You need to change the color of this drop down, it’s not professional one, (01:39-01:47) 26
27
User: ahh is this app doesn’t showing that scheduling notification, it means there aren’t any showing after scheduling is done (02:06-28 02:14)

30
User: So you need to change it..ahh so..(02:20-02:22) 31
32
Interviewer: Ok, mmm now try to edit the event.(02:24-02:25) 33
User: mm edit..?(02:26-02:27) 34
35
Interviewer: yes, You can again click here(02:28) 36
User: ahhh in this edit window it’s also, this is already showing this is add event but the button is showing update. You have to change 37 it.(02:40-02:50) 38
Interviewer: ok, we are going to change it.(02:53) 39
40
Interviewer: Now again go to the event(03:00-03:02) 41
42
Interviewer: Now try to delete.(03:04) 43
User: This one..? (03:09-03:10) 44
Interviewer: yes. 45
46
User: actually this color is very bad.(03:14-03:16) 47
User: Doesn’t it showing a delete notification or any confirmation message..?(03:20-03:23) 48
Interviewer: mm currently it doesn’t showing it(03:24-03:25) 49
50
User: now what I’ve to do..?(03:43-03:45) 51
Interviewer: ahh now go to birthdays.(03:46-03:47) 52
53
Interviewer: here this is all birthdays. Try to scroll between Today Tomorrow and This month(03:50-03:56) 54
User: Today.(03:57) 55
56
Interviewer: Now, if you need to see anniversaries, click here(04:09-04:11) 57
User: mm ok(04:12) 58
59
Interviewer :Now click on anniversaries.(04:12-04:14) 60
User: again.. 61
62
Interviewer: Scroll between tabs.
Page 6 of 13
64
Interviewer: Now to go to settings, ahh you can again click here.(04:33-04:36) 65
66
Interviewer: Now change the Remind Me On,(04:46-04:47) 67
User: Actually you need to change these two words “The day before and The day”.these are not professional words. Mm I think you 68 need to change it.(04:48-04:55) 69
Interviewer: Ok now try to go to About.(05:05-05:09) 70
71
User: Yoy mean using this side bar..? mmm in this window you need to justify, do justification to the text ReminderPro and it’s 72 about(05:10-05:30) 73
Interviewer: Ok.(05:34) 74
75
Interviewer: ok now go to home screen. 76
Interviewer: Thank you for helping us to do this review.

Models

Flow Model

Artifact model

Design Rationale - ReminderPro

We have found some design errors using our customer review last. So we have rearranged the interfaces and come up with some other layouts to get rid of the design errors. For the first one we thought to re design the main layout, main page of the ReminderPro Android application.

This main layout having difficulty to identify, what is a birthday and an anniversary. so we designed these two layout designs to select one to further implementation.
In this modification, we have selected version 01 as our rearranged layout due to it give more graphical recognition for the user directly, but version 02 is shoving Birthday or anniversary words.
Graphical showing is better than the word use. Adding a heart to represent anniversaries and a candled cake to represent a birthday is our mission.

Using the last user review, we thought to change the following layouts too in the ReminderPro Android application,
                     01. Adding or editing window
                     02. Deletion, Edit and Schedule a message sub window

01. We have decide to remove unwanted white space as the user have requested in the user review as follows,

02. In ReminderPro Android applicaion, if a user need to delete, edit or need to schedule a message, user need to go for another window by tapping the event that he or she created. So we have come up with new design to add the functionality tap and hold to the event to get new pop up window besides of getting in to new window to edit,so we are going to design it as follows.

User Review

Transcript

00:12

Interviewer : - Good evening Prabhath, today we are going to do a customer review on a mobile application called Reminder pro. So now we are going to ask some questions from you.

00:21

Interviewer : - Now Prabhath, will you please open the reminder Pro application in your home screen.

Interviewee : - This one?

Interviewer : - Yeah.

00:32

Interviewee : - nice and beautiful one.

00:34

Interviewer : - in this application reminder pro, we can add ah… birthdays anniversaries such like things, so… you need to find the adding function of this application. So can add an event new event, birthday or an anniversary

00:49

Interviewee : - Ok, This is ah…, name Prabhath, Ok date ?

Interviewer : - you need to add the date according to your birthday or anniversary at the beginning one,

Interviewee : - beginning ..? I can’t add future..?

Interviewer : - No.

Interviewee : -  Ok.

01:18

Interviewee : - ah… when this phone number’s section, is it my number…?

Interviewer : - you gonna need to insert the phone number, it means maybe it’s your girlfriends number according to the reminder that you need to added. For an example, if you need to add your friend’s birthday, you need to add his number to send a message or a call.

Interviewee : - is it automatically goes,

Interviewer : - Yeah.

Interviewee : - Ok. Then add ok.

 01:46

Interviewer : - Now you need to go to the event you added.

Interviewee : - ok.

01:53

Interviewer : - What are the functions that you can see in your newly added event..?

Interviewee : - mmmm, I can see Birthday, anniversary, telephone button and the message button.

Interviewer : - any thing else..?

Interviewee : - mmm oh.. nice one… Schedule a message, edit and delete.

02:13

Interviewer : - Now prabhath, please do some modifications to your newly added event.

Interviewee : - Ok

Interviewer : - What are the thing that you can see in this window.

Interviewee : - Same thing thai I saw in the begging,

Interviewer : - ok , do some modifications. Change name, date and phone number.

Interviewee : -OK.

Interviewer : - I think now you can understand the date and what it will do.

Interviewee : - yes, can I update also the phone,

Interviewer : - Yes. Add my number 077 37 37 39.

Interviewee : - ok.

03:05

Interviewer : -Prabhath, now you need to add settings in this application reminder pro and you need to go for it and change reminder, daily reminder to 08.00 am.

Interviewee : - to 08.00 am.

Interviewee : - Settings, mm Remind me at 08.00 am, ok..

03:30

Interviewer : - now prabhath, please turn on message sent notification and turn off message delivered notification.

Interviewee : - ok

03:38

Interviewer : - Prabhath, now go back please.

Interviewee : - ok.

Interviewer : -Ok. Now you need to add a scheduled message for the event you added. 

Interviewee : - Scheduled message..?

Interviewer : - Not that one, the event you added.

Interviewee : - Scheduled message, ok. I can easily fing that one.

Interviewer : - You need to set the date time and the message you need to send.

Interviewee : - scheduled. Finally I’ve to press the Scheduled button..?

Interviewer : -You need to add the message first.

04:29

Interviewer : - Ok prabhath, now go back please. Now you need to check weather your scheduled message is in the pending list. So you need to go for the scheduled messages.

Interviewee : - Ok scheduled messages.

Interviewer : - Is that your messages that you added before.

Interviewee : - Yes.

04:54

Interviewer : - Now prabhath, please cancel the scheduled message you added.

Interviewee : - can I delete this or..

Interviewer : - Oh yeah.

Interviewer : - Prabhath, now go back and go to the event you created.

Interviewee : - ok.

Interviewer : - Now give a call to the number you added.

05:28

Interviewer : - now try to send a message.

Interviewee : -Send a message.

Interviewee : -  is it like normal messaging…?

Interviewer : - yes, just send a message.

05:55

Interviewer : - Now you need to delete the event you have created.

Interviewee : - yes.

Interviewer : - Simply go back, thouch up button and delete.

06:09

Interviewer : - Prabhath, so what is the idea of the design of this reminder pro application.

Interviewee : - mmm ok, firstly when I going to birthdays there is some lag in between this windows, and the other things are when I adding some thing, there’s a very huge white space. Other thing is I didn’t like this space, blank space under the banner. Those are the things that I can see.

Interviewer : - So do you like this design of application or not? Is there any suggestions that you need to tell for the developer of this reminder pro application. Any modification ?

Interviewee : - I can’t say weather I like tis or I don’t like this one, but I ahhh briefly I like this interface and but you have to do some modifications in some attractive way

07:13

Interviewer : - ok prabhath, is there any suggestions you like to share with us?

Interviewee : -okay, firstly I have to say in this all tab, I can’t recognize what is this event. Weather this one is a birthday or an anniversary. I can’t recognize it and the other one is when I go to settings, Remind me on section these words “The day before” and “the day” is not professional words to use.

Interviewer : - You mean, you need to change that word.?

Interviewee : - Yes, you have to change that one and when I click this back button, it really  goes to the home screen in this phone. You have to correct that thing also.

Interviewee : - ant the other thing is when I tap and hold this one I can’t delete or edit it, when I tap and hold this it’s coming up with delete button in another window, I think that also…

Interviewer : - needed to be changed..?

Interviewee : - yes that also needed to e changed.

08:28

Interviewer : - Ok prabhath, thank you for helping us to do this review.

Interviewee : - You are welcome.

Script

1. Can you please add a new event?
2. Now please go to the newly added event.
3. What are the functions you can see in this window?
4. Press 'Edit' and make a modification.
5. Set daily reminder time to 8.00 am.
6. Turn on message sent notifications and turn off message deliver notification.
7. Can you please schedule a message for the event you added?
8. Now check the pending scheduled messages to see whether your message is there.
9. Please cancel the message.
10. Now go to the event you created and make a call.
11. Try sending a message.
12. Delete the event you added.
13. Is there any suggestion that you can submit to the developer?
14. Please go to the Suggestion page and submit it.

Thank you...