User Testing
In order to test our hypotheses we conducted user testing.
Below are our findings and notes about those tests, written out per subject.
Low Fidelity #
Tests conducted: 2
Our low fidelity testing setup consisted of an object (tape roll) which acted as the throttle of the car they were 'driving'. Users were given the tape roll and instructed that keeping their hand above it meant going the same speed as they saw in the video, rolling forward meant accellerating and rolling backwards meant decelerating.
We created the following video simulations.
- Video 1 (short) - This simulates about 1 light in front of the car lighting up.
- Video 2 (long) - This simulates about 3-4 lights in front of the car lighting up.
They were also shown Video 3 (short-lights) but this video is meant more as a visualisation of how it would look like.
These videos were filmed with multiple requirements in mind. We wanted to test a lot of different circumstances in a relatively short (55 seconds) video.
The video contains:
- a straight with no obstacles
- a bridge, to test:
- accelleration going up
- deceleration going down
- limited vision when nearing the top
- a tight turn, to test limited vision and how lights react to turns
- an obstacle at the end of the road
Knowing this, the users were shown the video's in the same order as mentioned above.
Person 1 - Short light range #
- The user drove at an average speed during the straight
- They accellerated a bit while going up the bridge but slowed down when nearing the top
- They visibly slowed down while going down the bridge again and during the turn
- They slowed down a lot when on the second straight after the turn, before they noticed the obstacle at the end.
- When noticing the obstacle, they slowed down even more, rather quickly
Person 1 - Long light range #
- The user drove at an average speed, speeding up more when nearing the bridge
- Accelleration on the bridge was faster compared to the first video
- Going gown the bridge and taking the turn was similar to the first video.
- The user went faster towards the obstacle at the end and slowed down much later
Follow up interview #
After the testing was concluded, we followed up with a few questions about what they thought about the experience. What they would change and how they felt driving in both scenarios.
The subjects both liked the idea of these lights.
Their preference went towards the second video where 3-4 lights lit up ahead.
When asked about the idea of 3-4 lights lighting up when driving at or below the speed limit, but only one light when driving above the speed limit, the subjects expressed that they would feel uncomfortable with that change in lights and would slow down.
Subjects were also questioned about a hazard mode where the lights would light up around an accident and flash to alert other drivers nearby.
Subjects noted that they really liked that idea since you can see lights in the air much further than you can see them on the ground.
This would alert drivers much sooner and from further away.
High Fidelity #
Tests conducted: 4
Person 1 - Video 1 (short light range) #
- The user did not drive particularly fast, they were rather prudent.
- They did accelerate a bit at the beginning and slowed down quite a lot at the bridge but continued at a constant speed, until they reached the turn, they slowed down a bit there.
- At the sight of an obstacle they did brake quite harshly.
Person 1 - Video 2 (long light range) #
- They user did not accelerate at the start of the route, they continued at a pretty constant speed.
- When reaching the bridge they slowed down a bit but not as much as with the short light range.
- When reaching the obstacle they slowed down in a controlled, comfortable way.
Person 2 - Video 1 (short light range) #
- The user accelerated at the start of the route, but rather quickly slowed down again.
- At the bridge the user did not slow down until at the top of the bridge.
- They did not accelerate after the bridge, they continued at a somewhat slow pace.
- At the obstacle they braked rather quick and uncontrolled.
Person 2 - Video 2 (long light range) #
- The user didn't accelerate at the start anymore but continued at a constant, well paced speed.
- At the bridge they didn't slow down quite as much but they started slowing down sooner, a few meters before the bridge.
- After the bridge they continued at the same pace from before.
- When reaching the obstacle they slowed down sooner and in a more controlled manner.
Follow up interviews #
Interview 1 #
Do you have any specific things you noticed?
- The lights that went on were rather annoying, I would prefer something smoother.
What do you think about the 5G aspect?
- 5G is the future, I like how it's implemented. It might exclude some people though.
- 5G-radiation might have a bad effect on nature, I am not sure.
This person didn't mention anything about privacy worries surrounding 5G. I asked them about it when I was sure they weren't going to mention it anymore.
- I don't have any issues with my data being collected, I don't have anything to hide.
Interview 2 #
Do you have any specific things you noticed?
- In the first video I thought there was not enough light, There should be plenty of light to see anything on the road.
- The light popping on made me feel like I had to drive faster.
What do you think about the 5G aspect?
- 5G is a good new technology, I like that it's being used.
- Person is not sure if 5G is necessary, maybe motion-sensors could do the trick.
This person didn't mention anything about privacy worries surrounding 5G. I asked them about it when I was sure they weren't going to mention it anymore.
- I don't care about my data being collected.
Conclusion User Testing #
After testing our prototype we collected some important insights.
The short light range prototype resulted in a far less enjoyable and safe driving experience in comparison to the long light range. This means we should definitely continue the concept with a longer light range.
We also noticed that the lights snapping on was annoying, and distracted from the actual driving. We should definitely give the lights a fade, so people on the road can stay focused on the road and aren't distracted.
During post-test interviews we talked about 5G and we only received positive answers about this. People don't seem to be bothered about data collection. It is definitely the way to go for this project.