Enhancing Zoom with AR

Since the outbreak of the Corona crisis we're forced to work from home, using tools like Zoom to connect. As a replacement of a physical gathering of people, something is missing. Online meetings are efficient, but they are very goal-driven and they lack the informal aspects.

Why enhance your Zoom session with Snap filters? >

This series of Zoom experiments are focussed on finding out how Zoom session can be enhanced with meaningful augmented reality filters. Nowadays, there's much more these filters can do besides applying a facefilter, such as mouse ears or a funny hat.



Foreground / background

How to split your background in half?


Abstract Presence: dynamic pixelation

This 'abstract presence' filter-effect for Teams/Zoom allows you to change the level of detail of your visual appearance . By moving to the side, so you can temporarily escape from the webcam. But your fellow participants will know you're still there



Link to copy/paste:
´╗┐https://www.snapchat.com/unlock/?type=SNAPCODE&uuid=7b7dec769483457798f5a8d4e4fda0e7&metadata=01 Classrooms / boardmeetings

Use a hand movement to change the shape of a chart:



Copy this link below into the 'search' field of the Snap Camera program:

https://www.snapchat.com/unlock/?type=SNAPCODE&uuid=af2d05dc283744f5aa10015850f52b82&metadata=01

Zoom screensaver and interactive 'away' controls


If you don't want to interupt your fellow videoconference participants with an explanation why you're leaving the chat for a moment, use this filter. Exit the screen on the top left or top right, bottom left or bottom right to trigger an icon indicating where you are. Just searching a pen, getting your charger. Getting coffee of handling the DHL guy at the door.

COPY THIS LINK and paste it into SnapCamera (see explanation here >)
Art class

Beyond the regular ways of interacting, such as hand gestures or blinking an eye, there are numerous alternative ways to interact with the virtual surrounding or layers in front of you or in the back.


Instant 5 sec recording

Need a break? A coffee? Pick your nose? With this 'instant replacement' filter you can make a short recording of yourself that will be put on repeat. To activate the filter: tilt your head to a 30 degree angle. Wait until the 3 dots ... count down, then sit still for 5 seconds. Your video is now being played in a loop. Make sure to wink your eyes at least once! You can step away from the screen, and do your thing. To deactivate the loop, use the same head gesture again.



Copy/paste this url into Snap Camera: https://www.snapchat.com/unlock/?type=SNAPCODE&uuid=644db72eeffa413f8830654f809a682b&metadata=01
Abstract presence



This filter can be used to open up Zoom and feel connected to other people, but without the need to be aware of the webcam peeking into your room. You're an abstract avatar, nothing fancy. But that's not the aim of this filter. It's not asking you to waste time configuring your virtual outfit and choosing the color of your hair. This filter just broadcasts your presence, or your temporary absence.

Copy this link below into the 'search' field of the Snap Camera program:

https://www.snapchat.com/unlock/?type=SNAPCODE&uuid=64984c01b4eb464eaafc766021bccf56&metadata=01

These are some more filters to try:

Multitasking



While in a Zoom session, these 'subtle games' help you stay focussed. By subtly moving your head you can control the games, but for other participants it will hardly be noticeable that you're multitasking.

Subtle AR filters >
The filters presented in this research are privacy safe. When activating facefilters in Zoom the output is generated locally within the SnapCamera program based on input from the webcam. No data or images are collected and nothing is sent to any online server, except for the filtered output which is visible for all of the participants.



More filters of various kinds:




HOW?
Use an external application to add AR effects in Zoom:

A) first install the
"Snap Camera" program on your computer

B) choose "Snap camera" in the settings of your videochat tool



C) copy+paste the snapcode-links below into the searchbox of the Snap Camera app :



*) In a recent blog-post Zoom announced that they're offering an integrated set of filters too. Let's see if the interactive features are as rich as the ones offered by Lens Studio (used to create Snap filters)