Generator multimedia project
3. DEVELOPMENT:
GENERATOR development is basically focused on the software development of the application that will be programmed in MAX/MSP/NATO/SPAT and will then run on an Apple PowerBook G4. The system will take advantage of several Apple software technologies such as QuickDraw (2D) and QuickTime (Video, 3D and VR) to render all the generated code.
Form more information on MAX/MSP/NATO/SPAT programming environment, please read the fourth topic named ” MAX/MSP/NATO/SPAT environment”.
3.1. GENERATOR System:
As explained before, GENERATOR works as system, this system is composed of four different layers each with its own particular function and position on the system.
3.1.1. Interface:
Interface is the first layer in GENERATOR, it provides a way for which users can interact with the system and tap into the flow of produced data and alter its course and shape regenerating new probabilities and possibilities.
This is made possible through the use of two different kind of physical controllers; the first, composed of a significant number of knobs and buttons with pre-defined actions, gives the user precise control over the system, and the second, similar to a Theremin (incorporating two antennas), enables the user to use gestures and movements to interact more freely and expressively with the system. The two controllers communicate through MIDI and every function is rooted to the software.
The first controller is a set of two IBK 10Control MIDI Controller, providing a total of 20 Rotary Encoders (continuous dials) plus 20 buttons. The user-defined labels of all 20 dials or buttons are simultaneously displayed with their values as a 30 segment bar on a backlit, alphanumeric LCD, providing excellent feedback even in low light situations.
The second controller is a Doepfer A-100 custom rack loaded with two Theremin modules for generating a variable control voltage (by approaching/removing hand to/from the antennas) and a Doepfer Module A-192, a CV-to-MIDI interface for converting control voltages into MIDI controller messages.
3.1.2. Generative Engine:
GENERATOR core is its Generative Engine, there’s where all the processing gets done. It has two matrixes, one for input and one for output, these matrixes work as traffic regulators and switching boards for all the incoming and outgoing data.
The Input Matrix takes care of all the data coming from the interface and sends it already formatted to the Graphics and Audio Control sectors, there, data is analyzed once again to decide which will be ultimately send to the Control Router that then routes data to the correspondent generative algorithms, there data is transformed into graphics and audio units that will again travel to a matrix, this time the Output Matrix. Then it flows through the Graphics and Audio Output pipelines, the ultimate stage inside the Generative Engine.
3.1.3. Graphics and Audio:
Graphics/Audio is the last layer before output. This is where all the data is ‘materialized’ into video and sound. Graphics will be output in 640×480 frame size, 24-bit color. Audio will be output in multi-channel 44.1Khz / 16-bit.
3.1.4. Output:
GENERATOR content will be output to video and audio. The video will be outputted by two sources, a Apple PowerBook G4 and a Sony Video Surveillance Camera. The audio will be output by a MOTU 828 Firewire connected to the Apple PowerBook G4. It will uses four output channels.
The video output by the Apple PowerBook G4 will be divided in two and amplified by a Kramer PT102V Distribution Amplifier connected to the two video projectors used for the retro projections. One of these projectors will have its image flipped horizontally.
The video outputted by the Sony Surveillance Camera will be connected directly to the video projector used for the frontal projection. The camera will be pointed to the Apple PowerBook G4 LCD, capturing the code/interfaced displayed. The Apple PowerBook G4 will be used in Grayscale Color mode and will be hacked by software to make it color inverted. This way making the imaged projected on the transparent projection screen to be very subtle. This effect could also be manipulated to become dynamic and related to the use of the physical interfaces, establishing a direct relation between the use and the visibility of the interface.
3.2. Set-up:
GENERATOR has two set-up modes, Performance and Installation. These two set-up modes are very flexible and allow GENERATOR to be presented in various physical configurations and in different locations.
In both set-up modes the public will be encouraged to use and be part of the performance/installation area. Logically the differences in the presentation format of the two set-ups will eventually lead people to sit and relax during the performance, and walk around while visiting the installation. For that matter the space should be arranged in order to be comfortable and friendly.
The system is composed of two projection surfaces, one frontal and one retro, being the last double, with two projections side by side (left projection flipped horizontally).
There will also be a working bench divided in two cubes that will be used to place a portable computer (processing unit) and a controller surface (interactive unit), as well as all the cables and other hardware used (stored inside the two cubes).
This setup is not rigid and intends to be modular as well as practical allowing it to adapt to different situations and locations.
The frontal projection will be used to display the video captured by the surveillance video camera, and because it’s a transparent projection screen, the light projected will pass through its surface and continue until it reaches the two retro projection surfaces composing with the two images being projected there. The images projected into the two retro projection surfaces will be outputted by the off-screen monitor of the PowerBook.
Both video sources will be connected to the video projectors directly, but in the case of the projectors used for the two retro projections a video distributor/amplifier will be used to boost the signal. Video Projector can be installed on the floor or on the ceiling.
3.3. GENERATOR Technical Requirements:
GENERATOR is not very demanding in terms of technical requirements, mainly because GENERATOR software takes cares of all the graphics and audio processing, leaving no need to use normally expensive hardware.
Hardware:
1 x Apple PowerBook G4 Ti
2 x IBK 10Control MIDI Controller
1 x MOTU TimePieceAV MIDI Interface
1 x Kramer PT102V Distribution Amplifier
1 x MOTU 828 Firewire audio interface
3 x Video Projectors (›1500 L)
1 x Sony Color Surveillance video camera
1 x Doepfer A-100 custom rack (includes two Theremin and one CV to MIDI modules)
1 x Sound System (capable of dealing with four independent audio channels)
Software:
1 x Apple MacOS 9.2
1 x MAX/MSP/NATO/SPAT
Other:
1 x USB cable (±3m)
3 x MIDI cable (±1m)
1 x Firewire cable (±1m)
2 x Video cable (±10m)
1 x Video cable (±5m)
4 x Audio cable (for connecting to the sound system)
1 x Frontal Transparent Projection Screen (PVC 4×3m)
1 x Retro Projection Screen (PVC 8×3m)
2 x Boxes (painted black, 0,8×0,8×0,8m)
