• Switzerland edition
Giant green worm stalks city park in augmented reality experiment
Jan Torpus & Robin Wenger 2011

Giant green worm stalks city park in augmented reality experiment

Published: 25 Nov 2011 15:00 GMT+01:00
Updated: 25 Nov 2011 15:00 GMT+01:00

Strange fantasy animals invade Basel’s Sankt Johanns Park while the sky above becomes a multi-coloured canvas. Reporter Meritxell Mir is neither dreaming nor on drugs; she's just participating in a pioneering new project.

Using the name lifeClipper3, researchers at the Institute for Research in Art and Design in Basel have created a film-like immersive experience that mixes the real world with virtual reality.

Led by Swiss design researcher Jan Torpus, this outdoor walking experiment brings virtual elements to the landscape of Sankt Johanns Park on the banks of the Rhine. With the help of special equipment, users undergo an experience that changes character depending on the direction they take, what they look at, or even how they breathe.

As the user walks through the park, the grass turns into a desert, fish-like animals fly through the air, and lying in the middle of the meadow is a huge green worm into whose mouth participants can enter.

“It always makes me happy when people don’t know if something is real or not,” says Torpus.

“I want to take people out of what they take for granted. It’s like the Matrix idea that behind all you see around you, there is something that is reality.”

The dual experience of being in the park but feeling you are part of a movie is possible thanks to a sophisticated equipment set-up. It involves a laptop, a GPS receiver to locate the user, a video camera, a head-mounted display with goggles, 3D surround-sound headphones, a vision sensor that determines where the user is looking, and a biofeedback sensor that measures the user’s breathing.

A total of five software programs run at the same time, continually communicating with each other and allowing the user to interact with the park by means of position, vision and breathing.

The creators of lifeClipper3 scanned the whole park with an infrared camera before making a 3D model on a 1:1 scale, but overlapping the two datasets was tricky.

“The most difficult part was that the real and the virtual spaces always had to coincide, which is almost impossible,” says Torpus, who led a multidisciplinary team of engineers, IT specialists, musicians and new media artists.

And what’s the aim of such a creative and seemingly bizarre project? Torpus says that lifeClipper3 exists somewhere between art and research. It enables experimentation with new media design, but it also facilitates the examination of human perception and emotions in situations where people are taken away from their everyday lives and thrust into an augmented reality.

Torpus also believes that, like all new art forms, it will take time for augmented reality to be accepted.

“It’s like cinema. At the beginning no one respected it as art; it was just a new technical discovery, but today it is [art],” says Torpus.

But there are stumbling blocks. Often users have struggled to understand what they are viewing through the goggles or just can’t immerse themselves fully in the adventure.

“lifeClipper3 goes too far sometimes,” agrees Torpus, who insists that this element is part of the research project, which is not open to the public.

He adds that the experience does not work for people when scenes, elements or tricks stray too far from cultural norms or the best-known natural laws, or are too far divorced from the type of media literacy garnered from films or video games.

“The continuum between real and virtual is very different [from other experiences people may have had] because you don’t have that in movies or video games,” he explains. The trick is to avoid virtual unreality by finding a balance that allows users to fully immerse themselves in the scene to such an extent that they no longer know if what they are seeing or experiencing is real or virtual.

The equipment also needs to become less invasive. Carrying around 10 kilos of gear on your back gets tiring, while the head-mounted display offers limited vision. In order to avoid tripping or running into people, benches or trees, Torpus acts as a sort of Sherpa, a reminder to users that they are, after all, still in the real world.

lifeClipper 3 is the last of a series of augmented reality projects Jan Torpus has worked with for the last eight years. The two previous experiments dealt with the past and the future of the city of Basel. The projects were not unlike the plot of the novel ‘Virtual Light’ by famed American author William Gibson, with Basel stepping in for San Francisco. Torpus says they were better understood by participants because they were closer to their everyday lives.

Although Torpus admits it could be years before the new technology enjoys widespread use, he is confident of an eventual breakthrough.

“lifeClipper is the first sketch for a new medium,” he says. 

“These could be the immersive movies of tomorrow”.

Meritxell Mir (news@thelocal.ch)

Don't miss...X
Left Right

Your comments about this article

Today's headlines
Swiss pays UK and Austria over tax dodging
Photo: Fabrice Coffrini/AFP

Swiss pays UK and Austria over tax dodging

Switzerland said on Monday that it had completed a programme to pay Britain and Austria hundreds of millions of euros in settlements for past tax-dodging by their citizens. READ  

Japan Novartis unit failed to report 'drug deaths'
Photo: Sebastien Bozon/AFP

Japan Novartis unit failed to report 'drug deaths'

The Japanese unit of Swiss pharma giant Novartis has admitted it did not report more than 2,500 cases of serious side effects in patients using its leukaemia and other cancer drugs, reportedly including some fatalities. READ  

Swiss health insurance premiums 'set to jump'
Federal Health Minister Alain Berset: set to release official figures later this month. Photo: Federal Assembly

Swiss health insurance premiums 'set to jump'

Swiss health insurance premiums are set to rise steeply overall next year, according to figures revealed by a Sunday newspaper. READ  

Presented by St Bernard Assure Limited
Car insurance made easy online with St Bernard
Photo: St Bernard Assure Limited

Car insurance made easy online with St Bernard

A new car insurance firm has ripped up the rule book when it comes to selling policies in Switzerland, by cutting out the middle-man and passing the savings onto their customers with its online only model. The Local finds out more. READ  

Bencic and Federer give Swiss double boost
Switzerland's Bencic celebrates at US Open. Photo: Mike Stobe/Getty Images North America/AFP

Bencic and Federer give Swiss double boost

Seventeen-year-old Belinda Bencic on Sunday became the youngest women's quarterfinalist at the US Open since 1997, giving Switzerland a double boost after Roger Federer moved into the last 16. READ  

Air show draws large crowds to Payerne
Patrouille Suisse in action. Photo: Matthias Kabel

Air show draws large crowds to Payerne

An estimated 160,000 people turned out for the opening weekend of Switzerland’s biggest air show at the Payerne military aerodrome in the canton of Vaud. READ  

Bolivian bus crash claims three Swiss lives
Route in the Uyuni region of Bolivia. Photo: Hermes Images/AFP

Bolivian bus crash claims three Swiss lives

A bus accident in Bolivia over the weekend claimed the lives of three Swiss citizens and at least six other people, according to press reports. READ  

Novartis heart drug billed 'blockbuster' after tests
Photo: Sebastien Bozon/AFP

Novartis heart drug billed 'blockbuster' after tests

An experimental drug from Swiss pharma giant Novartis reduced deaths from chronic heart failure by 20 percent compared with an existing treatment, according to the results of a vast new study. READ  

Kavcics's injury gives  Wawrinka US Open break
Wawrinka eases into fourth round. Photo: Don Emmert/AFP

Kavcics's injury gives Wawrinka US Open break

Switzerland's Stan Wawrinka reached the fourth round of the US Open tennis tournament by walkover on Saturday when Slovenian Blaz Kavcic withdrew from their third-round match with a right foot injury. READ  

Swiss baby dies after being left in parked car

Swiss baby dies after being left in parked car

A 16-month-old baby died in the canton of Neuchâtel after being forgotten by one of its parents who left the child behind in a company car park, a Swiss prosecutor said on Friday. READ  

Sponsored Article
Car insurance made easy online with St Bernard
Swiss residents pick Swedes as ideal European soul mates: survey
Zurich officials call project to move prostitutes to 'sex boxes' a success
Swiss gays recognized as parents of child born to surrogate mother
Increase in mountain bike accidents keeps Swiss hospitals busy
Swiss policeman belatedly honoured for saving Jews from Holocaust
'Suicide tourists' to Switzerland double in three years: study
Swiss Post SMS scheme gets stamp of approval after pilot project
Business & Money
American tax evasion crackdown hits Swiss private banks' bottom line
Woman accuses Swiss politician in nude selfies scandal of lying
Villagers in Graubünden valley reject hydro plant to protect vultures
Business & Money
Court rules against appellation for absinthe from Neuchâtel valley
Two hundred passengers rescued after landslide derails Swiss train
Switzerland remains world champion for per capita train travel
Social media backlash forces Polanski to bow out of Locarno film festival
Two policemen identified among three Israelis killed in train crash
Untouched Alps: The Local explores Switzerland's only national park
Swiss government secretary tweets nude ‘selfies’ taken at work
Swiss couples fined in Ibiza for making love in van without seatbelts
Schumacher medical record theft suspect hangs himself in Zurich cell
Thousands of motorists drive without permits in Switzerland: report
Switzerland celebrates the centennial of national park in Graubünden
Animal rights group protests over dead fish throwing at festival
Federer forced to tear down kids' play area at Graubünden holiday home
Latest news from The Local in Austria

More news from Austria at thelocal.at

Latest news from The Local in Germany

More news from Germany at thelocal.de

Latest news from The Local in Denmark

More news from Denmark at thelocal.dk

Latest news from The Local in Spain

More news from Spain at thelocal.es

Latest news from The Local in France

More news from France at thelocal.fr

Latest news from The Local in Italy

More news from Italy at thelocal.it

Latest news from The Local in Norway

More news from Norway at thelocal.no

Latest news from The Local in Sweden

More news from Sweden at thelocal.se

jobs available