This week I started my last project of this unit. This week I experimented with using HandPose model from the ml5.js website. I experimented with using a face tracking model from the same website, however, after some testing I was more drawn towards the handPose tracking model.
At this week, I mainly focused on working around how my hand keypoints worked. I was confused at one point with how to use the handtracking function to single out one specific keypoint,
function handTracking() {
// Draw all the tracked hand points
for (let i = 0; i < hands.length; i++) {
let hand = hands[i];
for (let j = 0; j < hand.keypoints.length; j++) {
let keypoint = hand.keypoints[j];
Using the documentation, I managed to figure it out.
let indextip = keypoint.name === “index_finger_tip”;
if (indextip) {
indexx = keypoint.x;
indexy = keypoint.y;
I also created a circle that can be dragged by the specific finger keypoint i’ve chosen to use, (my index finger tip). This worked quite well, however tracking wasn’t very good at times. I figured out that the tracking works better if the user’s palm is visable on screen.
The camera was also flipped incorrectly, so I flipped it back to its original position.
As well as this, I worked on trying to wrap up some of my work, such as my essay and personal planning folder, as well as looking at and touching up on some of my previous feedback that I had been given previously.