Mobile Apps·527 discussions

Emotion recognition mobile app

Tags: Cloud

Hello,

I am new to programming and I want to build a mobile app that can recognise emotions through facial expression.

What do you think are the best technologies and tools I can use and why?

Thank you in advance!

Topic

Mobile app

In reply to Emotion recognition mobile app

Emotion-aware mobile applications have been increasing due to their smart features and user acceptability. To realize such an application, an emotion recognition system should be in real-time and highly accurate. As a mobile device has the limited processing power, the algorithm in the emotion recognition system should be implemented using less computation. In this paper, we propose an emotion recognition with high performance for mobile applications. In the proposed system, facial video is captured by an embedded camera of a smartphone. Some representative frames are extracted from the video, and a face detection module is applied to extract the face regions in the frames. The Bandlet transform is realized on the face regions, and the resultant subband is divided into non-overlapping blocks. Local binary patterns’ histograms are calculated for each block and then are concatenated over all the blocks. The Kruskal-Wallis feature selection is applied to select the most dominant bins of the concatenated histograms. The dominant bins are then fed into a Gaussian mixture model-based classifier to classify the emotion. Experimental results show that the proposed system achieves high recognition accuracy in a reasonable time.
There exist a number of emotion recognition systems in the literature. The emotion can be recognized from speech, image, video, or text. There are many applications of emotion recognition in mobile platforms. In mobile applications, for example, the text of the SMS can be analyzed to detect the mood or the emotion of the users. Once the emotion is detected, the system can automatically put a corresponding ‘emoji’ in the SMS. By analyzing a video in the context of emotion, a smartphone can automatically change the wallpaper, or play some favorite songs to coop with the emotion of the user. The same can be applied using oral conversation through a smartphone; an emotion can be detected from the conversational speech, and appropriate filtering can be applied to the speech.

[Author]

Replies