Thursday, November 29, 2007

Research Assistant update

This week I have been bringing together the last couple of weeks experiments, making a Flash movie that dynamically places a range of webcam movies, giving each webcam its own counter. Also randomly placed is the computers own webcam. When each counter reaches zero, the webcam freezes. There are a few outstanding technical quirks which I will iron out.

Wednesday, November 21, 2007

Research Assistant update

Today I have been working on the timecode element, randomly generating a time within limits imposed using actionscript. This is then added to each movieclip, counting down to zero.

IP address and Timecode

The grid will include details under each video element. Individual IP (Internet Protocol) addresses will be featured alongside a time code. Initial visual ideas suggest a dark grey grid and a slightly lighter grey treatment of the numerical data. Perhaps slightly differing between IP address and timecode. We will further experiment with colour and type direction.

IP addresses
Each clip will have an IP address e.g. 192.168.5.354. These can be fictitious but must all differ. They will be positioned under each video clip. The live video (the user) will have their actual IP address listed under their video. This will suggest a differing internet location, complementing the differing visual location shown by video. 

Timecode
Each clip will also have a timecode that behaves in differing ways depending on the state of the video character. The timecode will count down to zero.
a) the users video (the player) will have a timecode which starts at 30 minutes (00.30.00) which will relate to the timescale of the 'game'. If the timecode reaches 0 (zero) the video is 'locked-down' and the game ends.
b) most active characters will each have a differing timecode that counts down from greater than 30 minutes.
c) one character will show a starting timecode of of 00.04.00 (four minutes) and will introduce the user to the consequences of the timecode reaching zero, the locking-down of the video - a still, monochrome image.  
d) a further four characters will be randomly selected and timed so that they count down, locking-down at differing times during the 30 minute limit. This feature will hopefully suggest a level of urgency to the user in reaching a conclusion before the 3o minutes is up.

Friday, November 16, 2007

Camera settings

On testing prototypes on various computers, it is clear that appropriate camera configuration will be an important factor. If the camera is not correctly configured it will not display the live feed from the webcam. As our intention is to allow the user to discover that they are inside the narrative serendipitously we may need to build an initial configuation test which loads before the narrative.

On conclusion of the narrative ...

Story update
Once the user has successfully completed their tasks, the programme 'locks down' the live video, trapping rather than releasing the user. The interface animates to reveal the extent of the 'grid' before closing down. Storyboard below shows an incremental scaling of the grid.

Wednesday, November 14, 2007

research assistant update

Today I've been looking more closely at the potential of the webcam in Flash, taking stills from the webcam, and randomly positioning the webcam feed in the Flash window

Wednesday, November 7, 2007

research assistant update

I've spent today's research time developing my actionscript programming skills by looking at dynamically generated movieclips and their potential for this project. I have also started to learn about OOP programming and its capabilities.

Thursday, November 1, 2007

Initial ideas for Narrative

STORYLINE - initial concept
On loading the application/webpage, the computer user is confronted by a grid containing several video clips of similar users at their own computers, captured by webcam.

Video
One of the video clips is actually live captured by webcam which places the user within the narrative as a visual live element. It is expected that the user will discover this by themselves without prompting. The other video clips will use subtle rather than over-animated movement to enable action to occur at differing moments and differing positions across the screen. (See www.hillmancurtis.com/ to view subtle body movement in video.) As we have little control over the quality of webcam capture or lighting conditions on users machines, the quality of our video clips should vary in colour saturation and lighting conditions to avoid the users live video to stand out and be therefore too easily identifiable on loading.

Most video clips are in colour and playing in subtle loops but there are some that are monochrome and static. These are captured users who are no longer able to save themselves - or interact.

Other graphic elements may be introduced to lead the eye and to create a visual digital environment. e.g. The Matrix movies utilise greendigital rain which suggests a starting point for visual style and motion experiments appropriate for content.











The Narrator
A character in one of the video clips is more focussed than the others - focussed by looking directly at webcam and speaking to the user. The character makes a desperate plea to help them to not become captured by the camera into the machine/grid. The character is, however, an agent of the grid whose aim is to assist the grid to capture the user's image/soul?. Audio of the narrator will be heard by the user on rollover. The narrator will give the user tasks/challenges (to be devised) which will seemingly lead to freeing the narrator but which will, in fact, lead to the user's image becoming static and locked down within the grid with no further interaction possible (the end of the story).

Audio
Initial thoughts on audio suggest a single track as background ambient noise suggestive of a combination of audio from all playing clips. Any speech should be sufficiently distorted to avoid clarity. The narrator will become clearly audible on rollover as stated above.

Prototype 1.31.10.07
See the first online prototype at the following URL:

www.uwic.ac.uk/staff/mleighfield/gridlocked/grid.html

Proposed Research Activity Statement

Proposed Research activity
Ian Weir / Matt Leighfield

Department of Creative Communication
Cardiff School of Art & Design

First person immersive narrative
incorporating Webcam motion detection

Webcams have been around for some time as an external plug-in device. Many PC’s now have a built-in camera in their screen casing suggesting a developing universal familiarity and level of user comfort with this technology. This research aims to take a fresh look at these conventional tools in unconventional, original ways.

Questions
How can the ubiquitous webcam be used to allow the user, in the form of live video, to be included in the narrative of an interactive experience?
What are the characteristics of this experience?
Is the technique a gimmick or can a similar approach be repeated in differing narrative contexts to successfully immerse the user?


Methodology
We propose to explore the potential of the BitmapData API feature of Flash incorporating live video images within a narrative context. The BitmapData API allows developers to create and modify bitmaps captured by webcam feed at runtime using ActionScript. The API (application programming interface)—enables straightforward communication between Flash and external programs and devices such as webcams.

Website deliverable prototypes will be built to test initial reactions and to allow us to become established in an appropriate area of the research community. It is our intention to create experiences that can be viewed on standard equipment (accessed by many) – avoiding managed experiences which utilise expensive and technically demanding computer resources (and therefore more exclusive). The results of these initial reactions and our responses to them will be taken to a relevant conference in the summer of 2008.

A review of the literature relating to first person immersive (digital) narrative, human computer interaction and psychology will be undertaken to underpin the practical activity.

The research is outcome focussed and exploratory in nature and relates to the School and Departments strategic plan for both academic and support staff to be research active. The activity will directly relate to our specialist area of teaching. Interests and digital experiments developed during an MA in Interactive Communication completed by Ian Weir provide a stimulus for initial discussion.

Ian Weir
Matt Leighfield
October 2007