A glimpse into the virtual world of the Joycestick gamification of James Joyces' Ulysses.
There鈥檚 art imitating life, and then there鈥檚 art taking on a virtual life of its own. That鈥檚 what鈥檚 happening with a Boston College academic project involving the unlikely pairing of an immersive virtual reality 3D game with one of the most important (and, arguably, the most difficult to read) English language novels of the 20th century: James Joyce鈥檚 Ulysses.
Dubbed 'Joycestick,' the virtual reality game mades its in Dublin as part of Bloomsday, the international festival named in honor of Ulysses protagonist Leopold Bloom, whose wanderings and activities on June 16, 1904 are chronicled in the book. Visitors to the Centre could test drive Joycestick, which also was featured at an event this week at the National Library of Ireland.
The Joycestick team also will introduce the game to the North American James Joyce Conference in Toronto and to the International Association for the Study of Irish Literature in Singapore.
The brings the book to life through "gamification." Users wear a virtual reality headset and headphones and walk around to explore in real space various scenes from the book, recreated from research into both the novel and the time period, and acquire points and rewards along the way.
鈥淚nstead of using virtual reality as just an extension of video games, we鈥檙e trying to use it as an entirely new medium of storytelling,鈥� said computer science major Ryan Reede '17, a Joycestick team member. 鈥淭here鈥檚 interactivity, there鈥檚 audio, there鈥檚 text, there鈥檚 music 鈥� there are all these different elements to Joycestick, but at the end of the day, it鈥檚 more of a new form of storytelling.鈥�
Sampling of Joycestick in the news: | Associated Press: | | | | | |
Joycestick trailer by project team member Liam Weir '18.
The project grew out of the Joyce and digital humanities classes of Boston College scholar Joseph Nugent, associate professor of the practice of English.The possibilities and challenges of this approach spark the kind of discussions that lie at the heart of liberal arts education, says Nugent, who has seen his vocation as a Joyce scholar metamorphose in a relatively brief period. He says Joycestick represents new ground for the teaching of literature.
鈥淔or me, Joycestick 鈥� and digital humanities 鈥� has entirely transformed my career, and led me to a whole area of creativity and possibility,鈥� says the native of Mullingar, Ireland, who came to 精东影业 in 2004 as a visiting instructor and joined the faculty the following year. 鈥淎s much as I love literature, my traditional training hadn鈥檛 offered me the kind of fulfillment that comes from the kind of cutting-edge research technology has made possible.鈥�
Joycestick is Nugent鈥檚 most recent excursion into digital humanities. In past years, he and his students have produced an e-book guide based on Joyce鈥檚 Dubliners, a multi-media tour depicting Dublin in 1922 also inspired by Ulysses, and an interactive digital guide to accompany an exhibition on Ireland鈥檚 Arts and Crafts movement at 精东影业's McMullen Museum of Art
Nugent lauds the students鈥� work on Joycestick with an almost Joycean-like pairing of adjectives, calling their level of commitment "ridiculous and wonderful," and noting that the team had to make it up as they went along ("it鈥檚 not like there鈥檚 a manual") which resulted in "some very serious, enjoyable discussions about the nature of this game.鈥�
鈥淲e look on VR as the ultimate empathy machine, in that we don鈥檛 simply want to excite the readers 鈥� the viewers 鈥� but to move them, to engage them with the emotions and events in the book.鈥�鈥揓oe Nugent
In spring 2016, he and Reede, a computer science major who had worked on the McMullen exhibition digital guide, talked about a VR adaptation of Ulysses. Nugent assembled a group of other students from fine arts, English and computer science disciplines (students from Berklee College of Music have helped with the project鈥檚 musical components), obtained grants from the University, and began the gamification process.
With its stream-of-consciousness technique and experimental prose, Ulysses presented an unlikely subject for a conventional game narrative. Nugent and the team decided to have Joycestick tell the story by recreating scenes from the book 鈥� such as the Martello Tower in Sandycove where the Ulysses character Stephen Dedalus lives (and where Joyce himself stayed for a few days) 鈥� and directing the user to certain objects in the scene: a bright red cricket ball, a bar of lemon soap, a telegram bearing sad news. Touching the object triggers a recorded narration from the book, along with other sounds, to explain its significance to the novel. The project is subtitled 鈥淭he Story of Ulysses in 100 Objects.鈥�
All the objects, Nugent points out, had to be researched, scaled and linked to the text of the book. Some of the work in creating the game involved filming and photographing sites in Ireland.
For Nugent, the concept of Joycestick is in keeping with the liberal arts mission: to challenge the individual to think outside his or her experience, and accept that the struggle to understand the unknown is meaningful in and of itself. Even as Joycestick might follow the computer game model 鈥� where users rack up points or other rewards as they go on 鈥� it also subverts the form, he says.
Meet the student team:
For Nugent, the concept of Joycestick is in keeping with the liberal arts mission: to challenge the individual to think outside his or her experience, and accept that the struggle to understand the unknown is meaningful in and of itself. Even as Joycestick might follow the computer game model 鈥� where users rack up points or other rewards as they go on 鈥� it also subverts the form, he says.
鈥淚t raises questions: From whose perspective is the story being told? How can you be sure of its veracity? What can you trust?鈥� Nugent explains. 鈥淲hat鈥檚 been fascinating is how the students have turned the argument around: What is the role of the user in this game? Is he or she simply an observer, or a character 鈥� and if so, who is this person and what are they doing there? Joyce wanted us to enmesh our thoughts with those of the characters in the book, so if you give yourself an identity, do you go against that?聽
鈥淲e look on VR as the ultimate empathy machine, in that we don鈥檛 simply want to excite the readers 鈥� the viewers 鈥� but to move them, to engage them with the emotions and events in the book.鈥�
In fact, Joycestick became a seminar of sorts for the student team, not all of whom were acquainted with Ulysses or, for that matter, any of Joyce鈥檚 writing. Freshman Emaad Ali, for example, was more interested in the opportunity to work with VR technology.
鈥淚 wanted to experiment with its potential and the possibilities it opens up for games like ours,鈥� he says. 鈥淰R gaming hasn鈥檛 become totally mainstream yet, so we think JoyceStick can really help define how people use VR technology in the future, both inside and outside academia.鈥�
But over time, Ali grew to appreciate the book. 鈥淥ne thing that鈥檚 really struck me is how innovative Joyce鈥檚 writing was. He dived into human consciousness and represented how ordinary people think in ways that nobody had done before, which is really inspiring for us as we innovate with VR. I think Joycestick is a great match for the spirit of Ulysses because we鈥檙e giving people a kind of experience they鈥檝e never had, which is exactly what Joyce did in his writing.鈥�
Says Reede, 鈥淚鈥檝e read every word, and to be honest, I鈥檓 still getting there. But working with Joe, I鈥檝e come to understand the magnitude and significance of it, and Joyce鈥檚 other books. I understand why this is worth doing.鈥�
Nugent freely acknowledges the varied reactions Ulysses can generate, and which to some extent Joycestick embodies. 鈥淚t鈥檚 a grand and preposterous undertaking,鈥� he says with a smile.
-adapted from an earlier article by Sean Smith | University Communications