The Neural Aesthetic - Runway + Processing Exercise

final_working.gif

This week I was experimenting with the compatibility between Processing and Runway. I settled on building a project using PoseNet since it is a model that can run locally and it allowed me to really experiment and play around freely. Using it, I decided it would be fun to make a simple “face filter”.

initial_track.gif

The first thing I did was follow this example for accessing Runway in Processing using OSC. I then imported a video capture of my webcam to essentially recreate in Processing the video preview offered in the Runway app.

swirl.gif

Finally, I imported a fun ‘swirl’ PNG and centered and rotated it on the eye data points created by the PoseNet Runway model to create this fun “dizzy” effect.