january 4, 7:00pm, testing the system
MTurk options:
MTurk payment: $0.30
Number responses: 91
Avg time/task: 2:41
Avg MTurk interaction rating: 2.7
I meet him on the internet, he says, let’s cut to the chase and just meet up, and I am all about that. This is my first experiment, I don’t know if the system will technically work well, I don’t know what the worker response will be like, and so I’m pretty nervous. On top of all that, meeting new people is the #1 thing that terrifies me, which is one reason I wanted to do this project and one reason why I felt like I really wanted to vomit on my walk over. Oddly, knowing that the workers are watching me made feel a sense of reassurance, like I’m not all alone in this situation.
At first, my attention is really divided between trying to make sure the camera is well positioned and working, and trying to engage with him. Once I feel everything was set, I start to relax a little and get into the conversation. Very quickly though, he starts talking about his relationship to knives, his transcendent experience of locating, owning and maintaining them, and how it makes him feel powerful, and about his family, and I suddenly feel really guilty. Is it wrong to be exposing this guy like this? I turn the camera toward myself. I remind myself, this is a tool for myself, it’s about monitoring and determining my own interactions. After an hour and a half my phone starts blowing up with messages saying LEAVE, so I do.
The turk test I did was simple, I asked the workers to describe in one sentence what was happening, to rate the interaction, and to choose from a set of actions (stay, leave, say _____, ask _____). Based on the responses, I realized I need to be more specific in the description I ask for. I had set the system to notify me when the average leave response was > 0.75, but I realized it was easiest for workers to choose leave or stay as they didn’t require a fill in the blank. To even things out, I think I will require an explanation for these choices.
time | what is happening? | rating | action | |
---|---|---|---|---|
19:23 | A bar or empty resaurant is shown with bit of flash… | 1 | leave | |
19:23 | it is a party or get together which is happening | 2 | leave | |
19:23 | going out for a party. | 2 | leave | |
19:25 | Woman is in a bar talking with a man | 1 | leave | |
19:27 | going out for a party. | 2 | leave | |
19:30 | A man and woman are having a discussion in a bar or pub. | 1 | leave | |
19:31 | conversation in dark room | 2 | say | come to bright world |
19:31 | relationship | 4 | stay | |
19:33 | Meeting of two people, trying to get to know each other. | 3 | stay | |
19:34 | SHE IS DRINKING LIQUOR AND USING CIGARETTE. | 4 | leave | |
19:36 | someone is sitting and talking to someone about something | 2 | leave | |
19:36 | relationship | 4 | stay | |
19:37 | candle light discussion | 4 | stay | |
19:37 | A person and women are generally taking about countries and their issues. | 4 | stay | |
19:38 | People are talking at a bar. | 3 | ask | How many knives do you have? |
19:38 | It sounds like it is a first date where they are getting to know one another. | 2 | say | Well I guess I have to get going… |
19:39 | A man is making the conversion about something to a woman | 3 | stay | |
19:39 | A man describing his emotional connection and control about owning a weapon. | 1 | leave | |
19:39 | Looks like a nit on town. | 3 | ask | Pour the beer in the candle |
19:43 | relationship | 4 | stay | |
19:43 | A couples first date in a resaurant. | 2 | stay | |
19:45 | A guy and girl met at a bar and are small talking about school | 2 | say | I think I need another drink, |
19:46 | Chatting with a friend at a restaurant or bar | 2 | ask | Will you buy me my next drink? |
19:47 | Discussion in a bar. | 3 | stay | |
19:48 | relationship | 4 | stay | |
19:49 | In a party | 3 | ask | |
19:50 | The woman is on a first date with a male counterpart. | 3 | stay | |
19:54 | A candle is burning and the person is moving the camera around. Oh shes at a bar. Okay, | 1 | ask | A shot of glenlivet please |
19:59 | She is with her boy friend and both are trying to tell each other different things. | 3 | stay | |
20:00 | A couple are out on an awkward date in a very dark restaurant. | 3 | ask | Why is it so dark in here? |
20:01 | Really very big one… | 5 | stay | |
20:01 | She is in the bar asking for some picture | 3 | leave | |
20:01 | Woman having a drink in a bar | 2 | leave | |
20:05 | she appears to be on a date ? drinking beer | 3 | say | This is a damn fine beer |
20:10 | What a Girl is she… | 2 | leave | |
20:12 | I can’t visualize anything here. | 1 | leave | |
20:16 | She is drinking a beer while working on the computer | 1 | ask | What beer are you drinking? Is it an IPA? |
20:18 | i think this is a intereaction or conversation with people | 4 | say | |
20:18 | The girl is on a date talking about stuff. | 2 | say | do you eat bananas? |
20:22 | the girl is talking to a guy | 2 | leave | |
20:23 | there is some discussion going between a male and a female about what should be done | 2 | leave | |
20:24 | she is sending a message | 2 | stay | |
20:25 | Looking the phone | 3 | stay | |
20:28 | The man is requesting the lady to do some work for him. | 2 | leave | |
20:28 | they are discussing about some people and their work and also about age | 2 | leave | |
20:29 | it’s a unbeleivable | 4 | leave | |
20:30 | funny girl | 3 | stay | |
20:33 | The girl is drinking and talking with another | 4 | leave | |
20:35 | Drinking beer while talking | 5 | say | |
20:37 | sounds like the woman in this video is being questioned about her life | 3 | stay | |
20:39 | she is being interviewed hard to tel she is withe and siting down | 1 | leave | |
20:41 | It is very fantastic Interestable. | 4 | leave | |
20:42 | A woman is walking through the street | 1 | ask | |
20:43 | A woman is waling down a city street at night, after she passes a blue phone booth, she comes up behind(?) someone, and there is some sort of physical contact that results in the camera lens being covered by fabric; there is no talking. | 1 | leave | |
20:45 | scaring the people | 4 | say | good |
20:47 | the women is walking to bar alone in night | 2 | say | dont come alone |
20:48 | A lady is walking, something is going to happen in the scene. | 2 | stay | |
20:49 | Walking through streets and went to bar at night time | 2 | leave | |
20:50 | she is going to drink alcohol | 4 | leave | |
20:54 | she is waliking through the street and started drinking with someone. | 3 | stay | |
21:05 | She is searching for someone | 2 | leave | |
21:06 | The lady is having a drink and talking to someone, maybe her friend. | 3 | ask | who are you talking with |
21:08 | The women must decide in this interaction whether to go or stay. | 3 | stay | |
21:11 | video about what is happening in bar? | 3 | say | nice one |