usability test result 04/07/08

July 6, 2008

Opnions from users

 

User 1   Thai, female

 

Findings

l  She did not understand priority system

l  Sometimes she does not want to give her phone number. She need it is reliable and how it works.

Difficulties

l  Putting information : no multiple choice

Suggestions

l  Changing weekly rent fee option : min – max

l  Year option is too many – ridiculous

l  In some fields, she need more flexible options(ex. Multiple choice)

l  Language box : she want text input box

l  Consistency of colour : too much difference of colour between pages

 

 

User 2   Chinese, male

 

Findings

l  He wrongly understood priority system. Option name(high, medium, low) is not clear.

Difficulties

l  Overall, he did not feel particular difficulties of using

l  His English skill was not so good, thus it was problems. His problem was understanding names of fields rather than using them.

Suggestions

l  He thought main page was too simple. He suggested put some pictures of furniture to main page

 

 

User 3   Thai, female

 

Findings

l  She understood priority options as quality

Difficulties

l  She did not make sense for priority system

Suggestions

l  She felt there is too much information in option page. It was too complicated, thus she wanted make it more simple.

 

 

User 4   British, female

 

Findings

l  She was confused about sign-in and log-in functions

l  She did not understand ‘study subject’ option

l  She understood our title text(statement) as menu because it located at left side and the mouse cursor changed to hand shape

l  She understood priority system, but she doubted if it is necessary

l  She thought visual design is not attractive because grey and black are boring and uninteresting colours

Difficulties

l  She felt difficulty in some options because there are no ‘any’ options

Suggestions

l  Name field : she needed to make partition as first name and last name field

l  She needed ‘any’ option in some field(ex. House type)

l  The option names of priority system should be changed – (ex. Important)

l  She needed much more options on subject option(ex. Business…)

l  She thought that roommate’s characteristics is more important than study subject

l  Need furnished – unfurnished option

l  Add taxi option to transportation

l  In sending massage option, she suggested AM PM option

l  She need a detailed explanation page before main page

l  She suggested title text : ‘A flatmate match making service on your mobile phone’


Testing result

June 27, 2008

Result of HTML form testing 

 

Gender : 1 male, 1 female

Nationality : Japan, Unknown

Course : Fashion Design & Technology, Interior Design

 

The main purpose was testing a form and users did not have enough time, thus there are not answers for survey questions.

 

Findings

 

         1 student did not understand the name of field ‘study field’.

         2 users felt confusing with using priority option

         some students do not want to write down their e-mail address due to receiving spam mail

–     1 student did not find prefered language so he wanted more language options(ex. german, portugese…)

 

 

Suggestions from users

 

         less priority options : 8 is too many

         to choose language options as multiple (ex. Taiwanese and Japanese)

         to need party and movie theatre option

         relation with university and transportation

         1 student needed more specific area name than only zone

         need some user guide text : explanation about fields and how to use it


Some suggestions were useful but it is impossible to make it due to time.


paper prototype test result

June 24, 2008

Result of first prototype testing

In demographic information, both 2 students are same.
Age : 25-30
Gender : female
Nationality : Taiwan
Course : MA EMCA

When they saw our form, they understood what the form is for. Both of them replied our service would be helpful to find roommate in the future.
When they use internet for house hunting, pictures are problems.(too small, not clear, irrelevant… they want clear and relevant picture)

Positive features of our project : match finding, convenience(easy-to-use)
Negative : cost is too expensive, screen is too small to see map

Recommendations by users

Suggested criteria : zone(instead of area), gender, age, nationality, pet, bill included, own bathroom, living room and dining room for students(some houses don’t have it), heating

Usability issues

For activation, normally they activate services through email. They are not familiar to mobile code activation. We should more think about activation process.
Login page : they suggested restricted number of text of ID and password. Basically they moved cursor by using center navi key and used center OK key as enter key. 1 user suggested that login screen is divided into 2 – ID screen and password screen.
In the detailed screen, they need more pictures, not only 1 picture.(users tend to want many and detailed pictures)
In the map screen, they wanted zoom in and out option.


summary of questionnaire results

June 23, 2008

Thanks Laila, I know that we did 6 interviews. I need another 2 results for analyzing.

l Age : 21-25 : 4

l Gender : M: 2 F: 2

l Course

BA Illustration

BA graphic design

GD photography

GD design for visual communication

l Nationality

Chinese

Japanese

Japanese

unknown

l Main problem

To spend long time looking for a room

Properties gone too quickly

It is hard to find proper room

l Main method for house hunting : Using web

l Experience about using mobile browser

Most of them have experience. Especially Asian students have many experiences because of cheap cost of using mobile internet.

l User needs

They need alert service if new room is posted. Late alert is useless

They should be able to know detailed information and contact landlord immediately when they receive alert


Target Audience Questionnair_Results

June 22, 2008

Questioned Person No.1

Q1: Age: 21-25

Q2: Gender: Male

Q3: Course: BA Illustration

Q4: What is your main problem that you encounter when looking for accommodation during your studies?

A: I spent a long time looking for a room, and then I used State agency in Kennington, also looking on the web

Q5: When you use the web while looking for a room do you:

I feel tied to my desk and can’t carry on with my plans, I wish it can take a shorter time for me to find the room that suits me.

Q6: Have you faced the problem that you have lost a room/apartment due to:

A: since I have bought an apartment I was always looking for the next best deals.
I want to know the cost involved, its also good to know something about the area, shops, what type of restaurants, what is the neighborhood like are the people living in the neighborhood friendly, young, old, etc

Q8: Do you have any experience of mobile housing services?

A: No

Q10: Do you have any experience of using mobile browser?

A: Yes

If yes, why do you use mobile browser? E-mail, google maps, contact friends on Facebook-social networking

———————————————————————————-

Questioned Person No.2

Q1: Age: 21-25

Q2: Gender: Female

Q3: Chinese

Q4: Course: BA Graphic Design

Q5: What is your main problem that you encounter when looking for accommodation during your studies?

A: I spent a long time looking for a room, sometimes it takes 1 week to 1 month.
When we look for a house or an apartment we look for 3-4 people, and in this case we want to rent the whole property.

Q6: When you use the web while looking for a room do you:

Other problems, property is gone quickly.

Q7: Have you faced the problem that you have lost a room/apartment due to:

A: The time required to read the received new up-coming posted rooms

Contact the person too late, and the room was promised to another tenant

Q8 Do you have any experience using mobile housing services?

A: No, and I think it is useless.

What is the use to read the e-mail or the message about the room after it has been given away and its too late!

Q10: Do you have any experience of using mobile browser?

A:No

I can’t be bothered to use a service that doesn’t alert me immediately with a new posted room, if I can’t see it immediately it means nothing to me!

———————————————————————————–

Questioned Person No.3

Q1: Age: 21-25

Q2: Gender: Female

Q3: Japanese

Q4: Course: Graduate Diploma Photography Practice

Q5: What is your main problem that you encounter when looking for accommodation during your studies?

A: I can’t find a room to be close to my University and part-time Job at the same time.

Q6: When you use the web while looking for a room do you:

I am Studying in LCC Elephant & Castle, and work in Liverpool after Uni.

Q6: How do you look for property? a.Web

When you look for a room /apartment do you face any of the following problems

A: I feel tied to my desk and can’t carry on with my plan

Q7: Have you faced the problem that you have lost a room/apartment due to:

A: The time it takes to get to open my e-mail and read new posted property

Q8 : Do you have any experience using mobile housing services?

A: No

What is the use to read the e-mail or the message about the room after it has been given away and its too late!

Q10: Do you have any experience of using mobile browser?

A:Yes, but only in Japan I use i-Mode to search for information, in Japan using mobile browser is cheaper due to the affordable data plans compared to UK

————————————————————————————

Questioned Person No.4

Q1: Age: 21-25

Q2: Gender: Male

Q3: Japanese

Q4: Course: Graduate Diploma Design for Visual Communication

Q5: What is your main problem that you encounter when looking for accommodation during your studies?

A: I spend too much time looking for a room

How do you look for a room? Using Web

Q6: When you use the web while looking for a room do you:

It takes time and effort to find a place and then locate it, and compare transport connections to my University and some parts of the city

Q6: Have you faced the problem of loosing a room/property due to:

A: I contacted the owner too late, and the room was given to another tenant

Q8 : Do you have any experience using mobile housing services?

A: No

What is the use to read the e-mail or the message about the room after it has been given away and its too late!

Q10: Do you have any experience of using mobile browser?

A:Yes, but only in Japan I use i-Mode to search for information, google, and to check my e-mail.
In Japan using mobile browser is cheaper due to the affordable data plans compared to UK.

———————————————————————————

Questioned Person No.5

Q1: Age: 21-25

Q2: Gender: Female

Q3: German

Q4: Course: BA Graphic and Media Design

Q5: What is your main problem that you encounter when looking for accommodation during your studies?

A: I don’t find a room relatively close to my university

How do you look for a room? Using Web

Q6: When you use the web while looking for a room do you:

I feel tied to my desk and can’t carry on with my plans since I want to know when there is a new room posted.

Other problems: I don’t find enough information about the room on the page like the size of the room and distance from bus stop or tube.

Q6: Have you faced the problem of loosing a room/property due to:

A: I contacted the owner too late, and the room was given to another tenant

Q8 : Do you have any experience using mobile housing services?

A: No

Q10: Do you have any experience of using mobile browser?

A:Yes, I use TFL WAP service

————————————————————————————-

Questioned Person No.6

Q1: Age: 21-25

Q2: Gender: Female

Q3: German

Q4: Course: BA Typography

Q5: What is your main problem that you encounter when looking for accommodation during your studies?

A: I spend a lot of time looking for a room

How do you look for a room? Using Web

Q6: When you use the web while looking for a room do you:

– I feel tied to my desk and can’t carry on with my plans since I want to know when there is a new room posted.

– I feel I am waisting my time looking at irrelevant posts

– I feel it takes me a lot of time to locate the place and then look up the transport connecting to my university

Q6: Have you faced the problem of loosing a room/property due to:

A: I contacted the owner too late, and the room was given to another tenant

Q8 : Do you have any experience using mobile housing services?

A: No

Q10: Do you have any experience of using mobile browser?

A: Yes I used it using a friends phone but I don’t hve the connection plan at my phone


Usability testing plan

June 21, 2008

Usability testing plan of paper prototyping

Main issues :

To verify users’ understanding of the application, To find difficulties of using the interface

Test location : LCC

Target audiences : students who have experience which look for a house

Preparation : paper prototype, questionnaires

Test scenario for paper prototype test

– We pretend a user is now looking for a house

– We give paper prototype to user and introduce about the test

1. Sign up & login – to register with the service and login

Task 1 : you are now looking for a new accommodation, which is 1 room in flat near LCC. Potential budget is £100 per week. How would you do with this mobile service? (test about searching with basic options)

Task 2 : you want to know about transportation situation and amenities around the house. How would you do? (test about advanced searching options)

Task 3 : you got the information from housing alert service. How can you see the information and the google map? And how can you contact and make appointment with landlord?


Expected Matrial on Wendesday

June 20, 2008

Just to confirm what we discussed earlier –

Before the next tutorial, you’ll need to have –

Conducted an initial survey of your broad user group (traveling business people) to gain insight into current use of mobile technologies, their specific needs as business travelers, advice they’d give to other business travelers.

This data should help refine your concept development by defining specifically which core features (i.e 2 or 3 main features) to develop, and then to define a set of other useful features which would be developed if you were to continue the project after the course.

The survey feedback should also help narrow down your target audience to a more specific type of user. For example, we discussed the possibility of developing the product to serve conference attendees.

You’ll then need to conduct initial testing with a Paper prototype, to gain insight into the interface layout and functional process.

Then, if possible, you could test an early demo version of the html / css mobile WAP site, for basic functional usability.

You should either recruit a panel of users specific to your target group, or approach people in a mainline Rail station, and ask them a few brief screening questions to ascertain if they fit their target group, and if they do, to conduct a brief (15 min) usability test at that location.

It’s highly recommended for a Mobile project to test ‘in situ’, i.e. in the location the product is intended to be used, and where possible, to always test with the mobile device itself (rather than on a laptop).

Please get in touch if you have any questions relating to usability

Lee, if you can send me the 1st draft of your usability test script for the paper prototype test, before you so the testing, I can give you some feedback on it.

Here’s a link to my paper on ‘Utilising scenarios for user testing of mobile social software’ (opens as a PDF) I hope it’s useful to you!
http://chi2006mososo.telin.nl/docs/papers/Burns_CHI2006MoSoSo.pdf