Hand gesture recognition embedded system can be used as an interfacing medium between the computer and human using different hand gestures in order to control the computer. In this proposed system, a real-time vision based hand gesture interaction prototype which depends upon finger gestures using color markers is designed. The objective is to develop an embedded system by which one can communicate with any digital device with less hardware requirements and using an external camera to capture the gestures.