Robotics
The Robotics project focused on developing a robotic hand controlled via computer vision, integrating machine learning and image processing. A novel approach was proposed to improve the efficiency of vision-based finger motion control. The work has been submitted for a patent and is set for publication as a research article.
In the Robotics project (Feb 2022 – June 2022), I collaborated with a team to develop an advanced robotic hand controlled using computer vision,
powered by machine learning and image processing techniques. The goal was to create an intuitive system that allowed the robotic hand to replicate human gestures based on real-time visual input.
My role focused on implementing the machine learning algorithms that processed visual data from cameras and translated it into motor commands for the robotic fingers.
We utilized a variety of hardware components, including servo motors, an Arduino microcontroller, and other sensors, to facilitate precise movements and control of the robotic hand.
The integration of these hardware components was critical for ensuring smooth, accurate motion and responsiveness to the computer vision system.
A key innovation in this project was the introduction of a novel interaction approach to improve the efficiency of translating vision inputs into robotic finger movements.
We combined different machine learning models to ensure seamless integration between visual detection and robotic motion, improving response time and system accuracy.
The project led to a patent application submission and we are currently preparing a research article for publication. This experience provided me with valuable hands-on exposure to robotics,
servo control, Arduino programming, and machine learning, while enhancing my teamwork, problem-solving, and practical application skills in a multidisciplinary setting.
Here are some videos of the project:
Demo 1:
Demo 2:
In addition to the project development, our research paper on this work was presented at ISB JSB Fukuoka 2023, detailing our advancements in vision-based robotic hand control. Below is a snapshot of the published paper.
This is the research paper we presented at ISB JSB Fukuoka 2023, where we introduced our approach to robotic hand control using computer vision and machine learning. More papers related to this project will be shared in the future. Since the official event proceedings are not currently available online, you can view the full collection of published papers from the conference here.