• Switzerland's news in English

Giant green worm stalks city park in augmented reality experiment

Meritxell Mir · 25 Nov 2011, 15:00

Published: 25 Nov 2011 15:00 GMT+01:00

Facebook Twitter Google+ reddit

Strange fantasy animals invade Basel’s Sankt Johanns Park while the sky above becomes a multi-coloured canvas. Reporter Meritxell Mir is neither dreaming nor on drugs; she's just participating in a pioneering new project.

Using the name lifeClipper3, researchers at the Institute for Research in Art and Design in Basel have created a film-like immersive experience that mixes the real world with virtual reality.

Led by Swiss design researcher Jan Torpus, this outdoor walking experiment brings virtual elements to the landscape of Sankt Johanns Park on the banks of the Rhine. With the help of special equipment, users undergo an experience that changes character depending on the direction they take, what they look at, or even how they breathe.

As the user walks through the park, the grass turns into a desert, fish-like animals fly through the air, and lying in the middle of the meadow is a huge green worm into whose mouth participants can enter.

“It always makes me happy when people don’t know if something is real or not,” says Torpus.

“I want to take people out of what they take for granted. It’s like the Matrix idea that behind all you see around you, there is something that is reality.”

The dual experience of being in the park but feeling you are part of a movie is possible thanks to a sophisticated equipment set-up. It involves a laptop, a GPS receiver to locate the user, a video camera, a head-mounted display with goggles, 3D surround-sound headphones, a vision sensor that determines where the user is looking, and a biofeedback sensor that measures the user’s breathing.

A total of five software programs run at the same time, continually communicating with each other and allowing the user to interact with the park by means of position, vision and breathing.

The creators of lifeClipper3 scanned the whole park with an infrared camera before making a 3D model on a 1:1 scale, but overlapping the two datasets was tricky.

“The most difficult part was that the real and the virtual spaces always had to coincide, which is almost impossible,” says Torpus, who led a multidisciplinary team of engineers, IT specialists, musicians and new media artists.

And what’s the aim of such a creative and seemingly bizarre project? Torpus says that lifeClipper3 exists somewhere between art and research. It enables experimentation with new media design, but it also facilitates the examination of human perception and emotions in situations where people are taken away from their everyday lives and thrust into an augmented reality.

Torpus also believes that, like all new art forms, it will take time for augmented reality to be accepted.

“It’s like cinema. At the beginning no one respected it as art; it was just a new technical discovery, but today it is [art],” says Torpus.

But there are stumbling blocks. Often users have struggled to understand what they are viewing through the goggles or just can’t immerse themselves fully in the adventure.

“lifeClipper3 goes too far sometimes,” agrees Torpus, who insists that this element is part of the research project, which is not open to the public.

He adds that the experience does not work for people when scenes, elements or tricks stray too far from cultural norms or the best-known natural laws, or are too far divorced from the type of media literacy garnered from films or video games.

“The continuum between real and virtual is very different [from other experiences people may have had] because you don’t have that in movies or video games,” he explains. The trick is to avoid virtual unreality by finding a balance that allows users to fully immerse themselves in the scene to such an extent that they no longer know if what they are seeing or experiencing is real or virtual.

The equipment also needs to become less invasive. Carrying around 10 kilos of gear on your back gets tiring, while the head-mounted display offers limited vision. In order to avoid tripping or running into people, benches or trees, Torpus acts as a sort of Sherpa, a reminder to users that they are, after all, still in the real world.

lifeClipper 3 is the last of a series of augmented reality projects Jan Torpus has worked with for the last eight years. The two previous experiments dealt with the past and the future of the city of Basel. The projects were not unlike the plot of the novel ‘Virtual Light’ by famed American author William Gibson, with Basel stepping in for San Francisco. Torpus says they were better understood by participants because they were closer to their everyday lives.

Although Torpus admits it could be years before the new technology enjoys widespread use, he is confident of an eventual breakthrough.

“lifeClipper is the first sketch for a new medium,” he says. 

“These could be the immersive movies of tomorrow”.

Meritxell Mir (news@thelocal.ch)

Facebook Twitter Google+ reddit

Your comments about this article

Today's headlines
Illegal immigrant dies after setting himself on fire
The victim was treated at University Hospital Zurich. Photo: University Hospital Zurich

The 45-year-old Tunisian was threatened with deportation.

Swiss government rejects call for second immigration vote
Photo: Justus Blumer/Christophe G

The Swiss government has rejected a popular initiative calling for a revote on plans to limit immigration.

Bern: companies should report salary inequality by law
File photo: Fabrice Coffrini/AFP

The Swiss government wants to force small companies to examine their rates of pay every four years.

Husband in custody after Orbe body identified
File photo: Bas Leenders

The deceased is a 55-year-old woman who lived in the house with her husband.

Presented by MoneyPark
How to get a mortgage in Switzerland
Houses in Zürich. Photo: Pixabay.

Ready to buy? Here’s what you need to know as an expat about Swiss regulations, how to finance your purchase, and why you should use a broker.

Autumn in Switzerland: ten stunning Instagram photos
Photo: Swiss Tourism/Jan Geerk

Switzerland is beautiful in all seasons, but as these photos show, autumn is a special time in the alpine country.

Report: Swiss progress slows on gender equality
File photo: David Soulivet

Globally, it will take 170 years to achieve gender equality, according to the World Economic Forum.

Brothers go to court to stop suicide of sibling
File photo: Lisa Edmonds

Two men have filed a legal bid to prevent the Swiss assisted suicide association Exit from helping their older brother to kill himself.

Wawrinka snubs past form to reach Basel second round
Wawrinka beat local wildcard Marco Chiudinelli. Photo: Fabrice Coffrini/AFP

US Open champion Stan Wawrinka has reached the second round in Basel after going out in the first round for the past four years.

Villagers asked to help fund bridge renovations
The bridge links the two villages of Veltheim (pictured) and Holderbank. Photo: Lutz Fischer-Lamprecht

The crowdfunding campaign by the two communes is the first of its kind in Switzerland.

Photo: Unterirdisch Ueberleben
Inside Switzerland’s largest nuclear bunker – 40 years on
Sponsored Article
Last chance to vote absentee in the US elections
Photo: The Local
Ticino firefighters rescue cow from swimming pool
Photo: Antoni Da Campo
Vegan wins battle to be accepted by Swiss army
Photo: Swiss Tourism
Ten Swiss ski resorts named most expensive in Europe
Photo: Randy Kashka
Swiss women will ‘work for free’ for the rest of year
Photo: Swiss Tourism
Montreux throws hat in Olympic rings
Photo: Swiss Tourism
Seven things you’ll miss about Switzerland if you leave
Photo: Richard Juilliard/AFP
Man makes Geneva airport bomb threat ‘for a joke’
Photo: AFP
Solar Impulse team reveals plans for unmanned plane
File photo: Martin Abegglen
Swiss to vote on passport rules for 3rd gen foreigners
Photo: AFP
Swiss wingsuit hotspot Lauterbrunnen won’t impose ban
Photo: Swiss Tourism
Six reasons Switzerland isn’t as boring as you might think
Photo: Swiss Tourism
Report: Switzerland one of world’s best places for girls
Photo: The Local
Thief returns Swiss cow bells worth thousands
File photo: Wikimedia Commons
One in three rapists isn’t locked up: statistics
Photo: activistin.ch
Tampon-tax protest turns Zurich fountains red
Photo: AFP
Geneva police to lift ban on bearded officers
Photo: Marcel Gillieron/AFP
Suicide chef’s restaurant keeps Michelin stars
Photo: Lara de Salis
11 things the Swiss get tired of hearing abroad
Photo:  Ivo Scholz/Swiss-image.ch
Survey: expats in Switzerland have money but few friends
Photo: AFP
Swiss press criticize Bern’s 'capitulation' on immigration
Photo: Jura Trois Lacs tourism
German ex-policeman is Swiss city’s new hermit
Photo: Dmitry A. Mottl
Ticino votes to favour local workers over foreigners
jobs available