October 31, 2024
NEM Summit 2024 in Brussels: The Future of XR, AI and Ethics in Virtual Worlds
At the annual NEM Summit – this year at VRT – experts from all over Europe gathered to discuss the latest trends and challenges in the media sector. This year, the world of extended reality (XR) and the metaverse was chosen as the focus. The event, which examined innovations and ethical problems within these rapidly developing technologies, yielded important insights. The integration of artificial intelligence (AI), the rise of always-on AI assistants, and the crucial role of ethics and accessibility were some of the major topics that were discussed. Below are the eight most significant insights from the conference.
What is NEM?
NEM (New European Media) is a European deliberative body that maps out research and innovation needs in Europe and gets policymakers, like those in the European Commission, talking about them. One of NEM’s major achievements is the creation of a strategic research and innovation agenda, which is regularly updated. In addition, NEM organizes an annual conference to bring the community together and facilitate discussion about current research topics within media. NEM brings the world of academic research and the industry’s innovation needs together. This year, the NEM Summit was held at VRT. VRT is also currently on the NEM Steering Board.
1. Virtual worlds as a reflection of European values
Anne Bajart from the European Commission emphasized the vision for virtual worlds that must reflect European values like privacy, transparency, and inclusivity, as an alternative to the big (non-European) platforms that are currently conquering the market. More than 200 European companies and organizations are working on an ecosystem in which 6G technology will play an important role in integrating physical and virtual worlds through “digital twins.” This innovative network should promote not only technology, but also social standards.
2. Generative AI as a catalyst in XR
According to Giuseppe Amato (CNR ISTI), generative AI can considerably accelerate the process of converting physical environments to digital representations. As such, virtual worlds can be made more dynamic, making it possible for physical events to realistically combine physical and digital aspects.
3. AI-based perception for XR applications
Dr. Jason Rambach of the German Research Center for Artificial Intelligence underscored the importance of AI-based perception to better understand the environment and user interactions. This technology makes it possible to realistically model the world and interactions in XR, considerably enhancing the range of application of XR.
4. The future of always-on AI assistants
A new wave of always-on AI assistants, often worn as wearables, was discussed as “the third computing wave” after the PC and smartphone. These AI applications give users the possibility to proactively interact with their environment and even predict and correct errors before they occur.
5. Regulation and ethics in an always-on world
During a panel debate, the importance of legislation in finding the balance between innovation and protection of privacy was discussed. The growing possibilities of always-on devices come with privacy challenges which, according to the speakers, demand a robust policy approach.
6. Research into digital twins for dynamic environments
The DidymosXR project is researching how digital representations of the physical world – known as digital twins – can be adjusted in real time. Take changes such as new seasons, objects, or buildings. AI and LiDAR technologies are being used to ensure that digital twins are always accurate, with the goal of improving applications like location-based data visualizations.
7. Cultural heritage in the XR world
The TransmiXR project is researching how immersive media can enhance cultural heritage with innovative storytelling formats. By making use of social XR, design studios and heritage organizations can work together to create innovative experiences that appeal to a wider audience.
8. Innovations in multicam 360° media through 3Cat
The Catalan public broadcaster 3Cat presented new technologies for multicam 360° recordings and a special web player, which offers viewers a completely immersive media experience. These technologies make new forms of content consumption possible and boost viewers’ involvement in live events.
9. Accessibility in virtual worlds
Of course, these new forms of content also present many challenges when it comes to making the content accessible. Research at various universities in Europe focuses on this problem and tries to offer solutions for making 3D content accessible by means of language technology and other AI tools.
Innovation as the key to a future-proof XR
The NEM Summit 2024 made clear that the technological progress within XR and the metaverse cannot be considered to be free of ethical problems. Dieter Boen, VRT Innovation Manager, emphasized that innovation with XR is not only about technological possibilities, but also supporting human stories: “Innovation in XR is about discovering new knowledge and techniques to bring stories to life in a very innovative way.”
In line with this vision, NEM is working together with various experts and policymakers to explore both the opportunities and challenges that come with these rising technologies. With the combination of XR, AI, and strong ethical guidelines, Europe hopes to play a trendsetting role in the development of virtual worlds that are not only technologically advanced, but also ethically and socially responsible. The European Commission recently called for companies to help work on building a partnership around virtual worlds, as well. The summit concluded with an open discussion about how such a partnership can be achieved.
