top of page

Child-Protection Project

Cooperate with Zurich University of Applied Science

A paid academic research in collaboration with the Zurich University of Applied Sciences. Exploring the possibility of using VR technology to reduce intimate partner violence phenomenon, 3D ScanningMotion Capture and Facial Expression capture are used as technical support.

Brief

In domestic violence interventions, professionals tend to direct most of their attention to the parents, the mother or the father that are involved, and they tend not to actively to not to actively explore the situation of children and not to ask the question about a child. A basic challenges that known from research in most cases of child abuse and neglect are never identified, so they are never known to people outside of the family system and they do not get addressed by professionals who might provide help. 

Target Group

Social Workers specializing in domestic violence

Method

Since the use of Virtual Reality technology allows for the simulation of a sufficiently realistic virtual world and the simulation of various events, which will have different psychological and psychological effects on the participants, in recent years this technology is also often used to try to solve different problems, such as racial discrimination and medical treatment rehabilitation.

In this case, a VR scenario that simulate intimate partners violence was created and then experiment was conducted by putting Social Workers in a child's perspective experiencing that situation through VR and observing whether they afterward make more child-oriented decisions.

Technical Implementation

3D ScanningMotion Capture and Facial Expression capture are used as technical support.

3D Scanning

For this Project, '3d Scanner App' based on the iPad pro with an optical radar camera was used to scan the target scene and then rebuild this scenario in unity.

Clip__7_edited.png
Clip__8_edited.jpg
after.png

Motion Capture

Using motion capture to record body movement animations, And in post, import these animation files into unity to complete the virtual character animation by using timeline and avatar mask.

be45ebcdf621054bb758920305ef635_edited.jpg
IMG_7529_edited.jpg

Facial Expression Capture

Recording the facial expressions of the avatar based on iPhone with AR Kit supply, followed by applying this facial animation file to the blendershape of the virtual characters.

IMG_7545_edited.jpg
IMG_7468.jpg

Avatar Controls

In pursuit of the best immersion in the body, the user is given the authority to control the body to build a relationship with the avatar to develop the embodiment illusion.

VR Perspective

This application is built on oculus and supports 6dof movement.

Clip__14.gif
Clip__6.gif
Clip__17.gif

Demo Video

Songkai Jia. Creative XR designer

bottom of page