Intelligent Automation & Soft Computing Tech Science Press DOI:10.32604/iasc.2021.015482 Article Computer Vision Based Robotic Arm Controlled Using Interactive GUI Muhatasim Intisar1, Mohammad Monirujjaman Khan1,*, Mohammad Rezaul Islam1 and Mehedi Masud2 1Department of Electrical and Computer Engineering, North South University, Bashundhara, Dhaka-1229, Bangladesh 2Department of Computer Science, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia ÃCorresponding Author: Mohammad Monirujjaman Khan. Email:
[email protected] Received: 24 November 2020; Accepted: 19 December 2020 Abstract: This paper presents the design and implementation of a robotic vision system operated using an interactive Graphical User Interface (GUI) application. As robotics continue to become a more integral part of the industrial complex, there is a need for automated systems that require minimal to no user training to operate. With this motivation in mind, the system is designed so that a beginner user can operate the device with very little instruction. The application allows users to determine their desired object, which will be picked up and placed by a robotic arm into the target location. The application allows users to filter objects based on color, shape, and size. The filtering along the three parameters is done by employing a Hue-Saturation-Value (HSV) mode color detection algorithm, shape detection algorithm, size determining algorithm. Once the target object is identi- fied, a centroid detection algorithm is employed to find the object’s center coor- dinates. An inverse kinematic algorithm is used to ascertain the robotic arm’sjoint positions for picking the object. The arm then goes through a set of preset posi- tions to pick up the object, place the object, and then return the arm to the initial position.