Interactive Virtual AI Agent

This project was undertaken as part of my work at T-Systems International in 2024, where I developed MAIA, an interactive application featuring virtual AI agents with customizable avatars. These agents can take on roles such as salesmen, saleswomen, or event assistants, operating seamlessly across multiple platforms, including Web, VR, and tablets. They can be programmed to answer diverse questions on a wide range of topics and events. Internally, the WebGL version was used during various internal events to provide explanations and share information about those events effectively.

Haptics for Social Touch Interactions in VR

As part of my master’s thesis in 2024, I developed Greeter, an innovative arm-worn haptic device designed to simulate realistic social touch interactions in virtual reality, such as handshakes, fist-bumps, and high-fives. I designed, 3D-printed, and built the device's electronics to provide force feedback and grasping capabilities, addressing the limitations of commercial VR controllers. A user study was conducted to compare Greeter's force feedback with the vibrotactile feedback of the HTC Index Controller. The results highlighted Greeter's superior effectiveness in enhancing immersion and perceived realism in social VR interactions.

Sign Language Perfomer in AR

In 2023, I developed an AR-based social agent capable of performing sign language on HoloLens and iPhone, aimed at enhancing accessibility and communication through immersive AR experiences. I implemented a real-time server-client communication system to receive motion capture data of a person performing the requested sign language sentence and convert it into Unity-based rotational data, ensuring accurate and responsive animations. The iOS version allows users to place the agent on a plane, scale it, and request predefined sign language animation files from the server in real time. In contrast, the HoloLens version enables users to move around the agent, scale it, place it on various surfaces, and request additional animation files, offering a highly interactive experience.

Object tracking for BMW cars for Quality Assurance

Developed an object tracking system for BMW vehicles in 2022, that overlays virtual measurement points to assist with quality assurance. These virtual points enable physical or virtual measurements of various car parts, ensuring accuracy and efficiency in the inspection process.

Training application for grasping virtual car parts

Developed a training application prototype for BMW Group in 2022, enabling users to grasp virtual car parts using a haptic feedback glove. The application allows users to manipulate car parts and position them into a highlighted area where the part should be placed. The prototype, streamed using Cloud XR software (ISAR Streaming) and explored Microsoft Holographics Streaming. This project was used in a study to compare the impact of haptic feedback versus no feedback on user performance, specifically measuring the time taken to complete the training tasks.

Python in Blender effects

Developed five distinct visual effects in 2021 during an Animation Lab course using Blender. Programmed all effects in Python to function in real-time, showcasing advanced scripting and animation techniques.

Image based markers in Web-AR

Developed a web-based application featuring augmented reality, enabling users to scan a QR code that redirects to a website. The website accesses the device camera and overlays virtual content (Videos, Images, Social media buttons, or 3D objects) onto business cards, flyers or any physical image marker

Object Detection and Translation in AR

Developed an augmented reality side project in 2020, aimed at recognizing objects and translating their labels into multiple languages, designed as a language learning tool. The application places a fixed anchor with a label above detected objects, allowing users to translate these labels dynamically. This replaces the traditional approach of using sticky notes for vocabulary learning, enabling users to scan objects with their phone and instantly view translated labels. The demo showcased translating labels from English to French and then to German, demonstrating its effectiveness as an interactive learning solution.

GPS-Based AR

This is a real-time demo of anchoring 3D objects In augmented reality using GPS-coordinates. When a GPS location is found the 3D object is downloaded from an online server in real-time and then instantiated in-front of the camera.

Word puzzle game

As part of my work with Yugilo in 2020, I designed and developed the core interaction mechanics for 'Zarzura' an engaging Arabic word puzzle game.

Circuits in AR

Developed as a group project for a Bachelor human computer interaction (HCI) course in 2019, Circuits AR leverages physical markers to overlay virtual electrical components in augmented reality. Users can interact with these components to virtually design and create circuits without the need for physical implementation. This approach offers a risk-free and resource-efficient way to learn about circuits, enhancing the educational experience through immersive technology.

View Historical Artifacts in AR

Developed during an online 2020 hackathon, this platform connects travel enthusiasts to global artifacts through a mobile app and a content managment system (CMS). Users can explore artifacts in AR, view detailed descriptions with real-time translations, watch videos, and share experiences. The CMS supports content management, artifact requests, and serves as the app's backend, offering a unique way to explore and learn from home.

Interactive Filters in AR

This side project showcases various AR filter effects, developed in 2021, featuring an interactive retro TV-inspired pixelated filter. The filter includes facial segmentation, allowing users to change the background seamlessly. Additionally, users can experiment with how the pixels disperse off the TV.

Manipulating Objects in AR

As part of my Bachelor’s thesis in 2019, this project explored the use of haptic feedback to enhance object manipulation in Augmented Reality (AR). The system utilized a tactile feedback glove to control a remote gripper with a fork-like shape . Haptic feedback was designed to simulate touch interactions: when the right part of the fork was touched, feedback was provided to the index finger; the left part triggered feedback for the thumb; and the base of the fork vibrated the palm. The AR environment was visualized using the deprecated Meta 2 glasses. Statistical analyses for our user study demonstrated that haptic feedback significantly improves precision and effectiveness in manipulating objects at a distance.

Games Concepts

1) A university project VR game set in a post-apocalyptic world, developed in 2022, featuring hand recognition technology that allows players to cast magical spells through hand gestures to combat enemies, creating an immersive and dynamic gaming experience.

2) Developed as a team of three for the Run Double Jump Hackathon 2017, this game allows players to step into the shoes of a blue-collar worker and visualize themselves in real-life scenarios. Players are presented with 20 situational questions designed to evaluate personal qualities such as honesty, independence, respectfulness, ambition, and collaboration. Based on their answers, a dynamic star plot adjusts in real-time to reflect their traits. After every set of five questions, players engage in a mini math game, adding an interactive and engaging element to the overall experience.

3) Developed a freelance project featuring a yoga teacher, where players control the character by tapping the screen to change poses and catch falling vases. As the game progresses, the vases fall faster, increasing the challenge. The game ends if a vase is missed.

4) Developed a small concept game in 2019 that brings golf into the world of Augmented Reality.

5) Designed and developed five hyper-casual game concepts between 2015 and 2017 as part of my journey to learn Unity. These games used timing-based mechanics, where players controlled 3D geometric objects to avoid obstacles.

Path finding algorithms AR Visualizer

Created as a side project in 2020, this tool visualizes path finding algorithms such as BFS, DFS, Dijkstra, and A-Star in real-time with adjustable speeds (time per step). Users can customize grid sizes and generate random obstacles, offering an interactive and dynamic way to explore and understand algorithmic behavior.

AR Bank

Created during a 2022 hackathon, this project reimagined banking apps for kids by introducing an engaging AR interface for managing finances. The AR app, designed for children, allows them to view their balance, set saving goals, and interact with financial data in a fun, gamified environment. A connected parent app provides oversight, enabling parents to monitor spending and manage allowances.