Home Artists Posts Import Register

Content


Link to the original video tutorial walking through the component

New features

  • Smooth Pose Tracking with MediaPipe update to 0.10.7. no more jittery poses
  • Camera flip toggle on MediaPipe component flips the camera + output
  • Face mesh example using the source video as texture
  • Easily track pinch gestures with the new hand_tracking pinch midpoint, position, rotation and distance

Updates

  • Update to MediaPipe 0.10.7 - now with smoother pose tracking!
  • Websocket and web server components combined to use a single network port
  • Results-processing components (e.g. hand_tracking, face_detector, etc.) are now embedded in main toe file so changes will be saved with the main project - no external tox saves required any more
  • MediaPipe tox file is still external as it's so big and will make save files huge if embedded.

Image examples below of the new features + some nightmare fuel for the face mesh example. 

Also huge shoutout to Dom Scott for all their help on this project!


Files

GitHub - torinmb/mediapipe-touchdesigner: GPU Accelerated MediaPipe Plugin for TouchDesigner

GPU Accelerated MediaPipe Plugin for TouchDesigner - GitHub - torinmb/mediapipe-touchdesigner: GPU Accelerated MediaPipe Plugin for TouchDesigner

Comments

Augusta Wicht

I have no idea how to use this to update my plugin?

Tyche Tech

Hi Torin. I've been following your creations and posts for a while now and last week subscribed to your top level. I'm working on an exhibition that is pushing my skills to the limit. I think the TD-mediapipe asset is a great tool and may help me solve some of the interactivity I'm wanting to program in TD using several OAK-Ds. I have been looking at maybe integrating TD MediaPipe plugin with OAK-D by saving out some TOXs from the TD OakSample project and import them into MediaPipe might work. But unsure which components would be best to achieve this or if this is a sensible approach. Maybe there's an easier way....any clues...?