As a class, we are working towards March 7th, where everyone will share a project that applies concepts from the first half of the semester (pre-trained models with ml5.js, TensorFlow.js, transformers.js). While training your own model is not required for this project, this week's assignment asks you to imagine an application that would.

“In Tandem” Mid-term Project Idea

What is the input?

A webcam or other camera, using ml5’s BodyPose and BodySegmentation to detect when, at least two people are present in the frame and whether they’re interacting or not.

• BodyPose Skeletal Connections to identify two bodies and their key points in space
• BodySegmentation Mask Body Parts

What is the output?

Audio / visual effects when

1. There are two people in the frame vs. one
2. The two people are detected to be touching body parts in some way

Visual output ideas …

• Some kinds of “aura” effect surrounding bodies that change when they interact
• A way to visualize some kind of “electrifying” or “energy” transfer
• More effects the longer the two bodies are intersecting