Thesis: Spatial Awareness for AI Avatars in Virtual Worlds

At Fraunhofer IEM in Paderborn, we are researching what the engineering of the future will look like – together with strong partners and a passion for technology. Our teams develop solutions that are actually put into practice: from smart products and networked production systems to digital services and modern software. We think about innovation from the initial concept to implementation. And this is where you come in!

What you will do

Intelligent virtual agents and AI avatars are increasingly being used in immersive XR applications – from interactive museum guides to digital assistants and trainers in industrial environments. However, to interact credibly with humans in 3D spaces, these avatars need more than just language: they must "understand" their surroundings, orient themselves spatially, and communicate appropriately based on the situation.

This thesis investigates how AI-driven avatars can be equipped with a spatial understanding of their (virtual) environment. Modern research approaches such as semantic 3D representations, scene graphs, or multimodal LLM interfaces can be analyzed and tested. The goal is to design a conceptual framework and implement a prototype solution that demonstrates how spatial awareness for digital avatars can be realized and used for interaction – for example, for navigation, object referencing, or spatial explanations. Tasks include:

Research on spatial awareness and multimodal LLMs etc.

Conceptualization of a solution for spatial awareness in AI avatars

Prototypical implementation of the concept

Evaluation in a specific application scenario

What you bring to the table

You are studying computer science, computer engineering, computer visualization or a similar field

You are interested in interactive 3D and AI-based systems and ideally have experience with Unity

You have programming experience (e.g., C#, Python)

You are motivated and work independently and reliably

What you can expect

A position where you can drive tomorrow's innovations

Professional guidance and technical support in writing your thesis

Flexible working hours that are compatible with your studies

Opportunity to contribute your own ideas and work at the interface between research and industry

This position is unpaid.

We value and promote the diversity of our employees' skills and therefore welcome all applications - regardless of age, gender, nationality, ethnic and social origin, religion, ideology, disability, sexual orientation and identity. Severely disabled persons are given preference in the event of equal suitability. Appointment, remuneration and social security benefits based on the public-sector collective wage agreement (TVöD). Additionally Fraunhofer may grant performance-based variable remuneration components.

With its focus on developing key technologies that are vital for the future and enabling the commercial utilization of this work by business and industry, Fraunhofer plays a central role in the innovation process. As a pioneer and catalyst for groundbreaking developments and scientific excellence, Fraunhofer helps shape society now and in the future.

Interested? Apply online now. We look forward to getting to know you!

If you have any questions about this thesis, please feel free to contact

Daniel Eckertz

Fraunhofer Institute for Mechatronic Systems Design IEM

Tel.:

Fraunhofer Institute for Mechatronic Systems Design IEM

Requisition Number: 81804 Application Deadline: