Use Your iPad and Kinect Control DMX Lighting Using the TUIO Protocol

TUIO: Enable Multi-Touch Interfaces to Control your Lighting

TUIO stands for Table-Top User Interfaces Objects and is becoming the standard protocol outputted by all kind of exotic multi-touch devices. It's a network protocol over OSC which is another more general way to exchange data. Multi-touch interfaces like the iPad and the Kinect offer extraordinary new ways for human and lighting interactions. Users are really amazed by these new interactive tables and image recognition devices.

The next video shows a dance experiment with the Kinect and Lightjams. A Kinect with the TUIOKinect application transmits the dancer position to Lightjams and the nearest lights are activated accordingly. The dancer can turn off the lights and "move in black" by stepping back of the tracking line. Thanks to Quixotic Fusion for another great rehearsal video.

Kinect

Thanks to the amazing developers of the OpenKinect community and to David Baird for creating the TUIO Kinect Complete application. Alternatively, you can look at the OSCeleton app to send the whole skeleton via OSC (use the -q option to send messages compatible with Lightjams). With these Windows apps you'll be able to output TUIO or OSC with your Kinect device and hook it to Lightjams. Lots of fun ahead!

iPad & iPhone & Android

Want to use your beloved iPad, iPhone or Android to control your DMX lighting in unusual ways? Have a look at these apps that outputs TUIO data: TUIODroid(need to turn off firewall on local network), TUIOPad, MSA Remote and OSCemote. You'll be up in a few minutes!

Up to 16 Cursors

Cursors represents active touches on the table-top interface. You may not have enough hands for this, but hey, you sure have friends willing to help you.

Up to 128 Objects

Objects have an id, a position and a rotation angle. Based on the id, you can trigger different lighting effects. Really cool.

Based on the OSC Protocol: Perfect for Inter-Application Communication

TUIO is based on the OSC protocol so you can use any OSC enabled application to send data to Lightjams.

See the www.tuio.org website for more information about TUIO.

Walkthrough

1. Global Configuration

Access the TUIO/OSC configuration by going to View/Configuration.

Lightjams automatically starts listening for TUIO/OSC messages at startup.

Network: You can change the default UDP TUIO port, which is 3333 and the network adapter if you have multiple. If you listen to OSC messages coming from an application running on the same computer, you can use the special loop-back adapter (127.0.0.1).

2. Link to any slider

Select any slider and click on the TUIO/OSC icon. Then you'll be able to play with all TUIO/OSC settings.

3. Play

Use the drop down control to select whether you want TUIO cursors or objects. Just click any TUIO value on the right side to select it.

Cursors: For each cursor, you see whether it is active (on), and its x and y position. A cursor represents a touch and its ID correspond to the order of appearance.

Objects: For each object, you see whether it is active (on), its x and y position and a rotation angle.

The "on" value is handy to activate/deactivate effects based on the presence of an item. For example, you can make a lighting parameter follow your finger on an iPad but only when your finger is actually pressed.

Idea box

Give the lighting crew an iPad or iPhone and see what happen. Use your iPhone as a remote control for your DMX lighting. Create an amazing motion activated store display with the Kinect: totally affordable. Just dance in front of your Kinect!

What's next? Try it for free!