Facial Emotion Recognition Systems

Facial Emotion Recognition Systems CHAPTER-1 INTRODUCTION 1.1: Introduction Face plays important role in social communication. This is a window to human character, reactions and ideas. the psychological research shown that nonverbal part is the most enlightening channel in social communication. Verbal part offers about 7% of the message, vocal 34% and facial expression about 55%. Due to that, face is a theme of study in many areas of science such as psychology, behavioral science, medicine and finally computer science. In the field of computer science much effort is put to discover the ways of automation the process of face detection and segmentation. Several methods addressing the problem of facial feature extraction have been proposed. The key problem is to provide suitable face representation, which leftovers robust with respect to diversity of facial appearances. The method of face recognition plays an important role in peoples life ranging from commercial to law enforcement applications, such as real time surveillance, biometric personal identification and information security. It is one of the most challenging topics in the interface of computer vision and cognitive science. Over past years, extensive research on face recognition has been conducted by many psychophysicists, neuroscientists and engineers. In general views, the definition of face recognition can be formulated as follows Different faces in a static image can be identified using a database of stored faces. Available collateral information like facial expression may enhance the recognition rate. Generally speaking, if the face images are sufficiently provided, the quality of face recognition will be mainly related to feature extraction and recognition modeling. Facial emotion recognition in uncontrolled environments is a very challenging task due to large intra-class variations caused by factors such as illumination and pose changes, occlusion, and head movement. The accuracy of a facial emotion recognition system generally depends on two critical factors: (i) extraction of facial features that are robust under intra-class variations (e.g. pose changes), but are distinctive for various emotions, and (ii) design of a classifier that is capable of distinguishing different facial emotions based on noisy and imperfect data (e.g., illumination changes and occlusion). For recognition modeling, lots of researchers usually evaluate the performance of model by recognition rate instead of computational cost. Recently, Wright and Mare ported their work called the sparse representation based classification (SRC). To be more specific, it can represent the testing image sparsely using training samples via norm minimization which can be solved by balancing the minimum reconstructed error and the sparse coefficients. The recognition rate of SRC is much higher than that of classical algorithms such as Nearest Neighbor, Nearest Subspace and Linear Support Vector Machine (SVM). However, there are three drawbacks behind the SRC. First, SRC is based on the holistic features, which cannot exactly capture the partial deformation of the face images. Second, regularized SRC usually runs slowly for high dimensional face images. Third in the presence of occluded face images, Wright et al introduce an occlusion dictionary to sparsely code the occluded components in face images. However, the computational cost of SRC increase drastically because of large number of elements in the occlusion dictionary. Therefore, the computational cost of SRC limits it s application in real time area, which increasingly attracts researchers attention to solve this issue. 1.2: Psychological Background In 1978, Ekman et al. [2] introduced the system for measuring facial expressions called FACS Facial Action Coding System. FACS was developed by analysis of the relations between muscle(s) contraction and changes in the face appearance caused by them. Contractions of muscles responsible for the same action are marked as an Action Unit (AU). The task of expression analysis with use of FACS is based on decomposing observed expression into the set of Action Units. There are 46 AUs that represent changes in facial expression and 12 AUs connected with eye gaze direction and head orientation. Action Units are highly descriptive in terms of facial movements, however, they do not provide any information about the message they represent. AUs are labeled with the description of the action (Fig.1). Fig. 1: Examples of Action Units Facial expression described by Action Units can be then analyzed on the semantic level in order to find the meaning of particular actions. According to the Ekmans theory [2], there are six basic emotion expressions that are universal for people of different nations and cultures. Those basic emotions are joy, sadness, anger, fear, disgust and surprise (Fig. 2). Fig. 2: Six universal emotions The Facial Action Coding System was developed to help psychologists with face behavior analysis. Facial image was studied to detect the Action Units occurrences and then AU combinations were translated into emotion categories. This procedure required much effort, not only because the analysis was done manually, but also because about 100 hours of training were needed to become a FACS coder. That is why; FACS was quickly automated and replaced by different types of computer software solutions. 1.3: Facial emotion recognition systems The aim of FERS is to replicate the human visual system in the most analogous way. This is very thought-provoking job in the area of computer vision because not only it needs effective image/video analysis methods but also well-matched feature vector used in machine learning process. The primary principle of FER system is that it would be easy and effective. That relates to full automation, so that no extra manual effort is obligatory. It is also chosen for such system to be real-time which is particularly significant in both: human-computer interaction and human-robot interaction applications. Besides, the theme of study should be permitted to act impulsively while data is being captured for examination. System should be intended to evade limitations on body and head movements which could also be an important source of data about shown emotion. The limitations about facial hair, glasses or extra make-up should be reduced to lowest. Furthermore, handling the occlusions problem looks to be a test for a system and it should be also considered. Other significant features that are wanted in FER system are user and environment independence. The prior means that, any user should be permissible to work with the system, regardless of of skin color, oldness, gender or state. The latter relates to conduct the complex background and diversity in lightning conditions. Further advantage could be the view independence in FERS, which is likely in systems based on 3D vision. Face Detection As it was stated earlier, FER system comprises of 3 steps. In the first step, system takes input image and does some image processing methods on it, to detect the face region. System can function on static images, where this process is called face localization or videos where we are working with face tracking. Main problems which can be come across at this step are different scales and orientations of face. They are generally produced by subject movements or changes in remoteness from camera. Substantial body actions can also reason for severe changes in position of face in successive frames what makes tracking tougher. What is more, difficulty of background and variety of lightning circumstances can be also quite puzzling in tracking. For example, when there is more than one face in the image, system should be able to differentiate which one is being tracked. Finally, obstructions which usually give the impression in impulsive reactions need to be handled as well. Problems stated overhead were a challenge to hunt for methods which would crack them. Among the methods for face detection, we can differentiate two groups: holistic where face is treated as a whole unit and analytic where co-occurrence of characteristic facial elements is considered. 1.3.2. Feature Extraction Afterward the face has been situated in the image or video frame, it can be examined in terms of facial action occurrence. There are two types of features that are frequently used to define facial expression: geometric features and appearance features. Geometric features quantity the displacements of certain parts of the face such as brows or mouth corners, while appearance features define the variation in face texture when specific action is done. Apart from feature type, FER systems can be separated by the input which could be static images or image sequences. The job of geometric feature measurement is generally connected with face region analysis, exclusively finding and tracking vital points in the face region. Possible problems that arise in face decomposition job could be obstructions and incidences of facial hair or glasses. Besides, defining the feature set is tough, because features should be expressive and possibly not interrelated. Recognition of Expression The latter part of the FER system is based on machine learning theory; exactly it is the classification job. The input to the classifier is a set of features which were recovered from face region in the previous stage. The set of features is designed to describe the facial expression. Classification needs supervised training, so the training set should consist of labeled data. Once the classifier is trained, it can distinguish input images by assigning them a specific class label. The most usually used facial expressions classification is finished both in terms of Action Units, proposed in Facial Action Coding System and in terms of common emotions: happiness, unhappiness, fury, surprise, disgust and fear. There are a lot of different machine learning methods for classification job, viz.: K-Nearest Neighbors, Artificial Neural Networks, Support Vector Machines, Hidden Markov Models, Expert Systems with rule based classifier, Bayesian Networks or Boosting Techniques (Adaboost, Gentleboost). Three major problems in classification job are: picking good feature set, effective machine learning method and diverse database for training. Feature set should be composed of features that are discriminative and characteristic for expression. Machine learning method is chosen usually by the sort of a feature set. In conclusion, database used as a training set should be adequate and contain various data. Methods described in the literature are presented by categories of classification output. 1.4: Applications Enormous amount of different information is encoded in facial movements. Perceiving someones face we can absorb about his/her: †¢ Affective state, connected with emotions like fear, anger and joy and moods such as euphoria or irritation †¢ Cognitive activity (brain activity), which can be seeming as attentiveness or boredom †¢ Personality features like sociability, nervousness or unfriendliness †¢ Honesty using analysis of micro-expressions to disclose hidden emotions †¢ Psychological state giving information about illnesses helpful with diagnosis of depression, mania or schizophrenia. Due to the variety of information visible on human face, facial expression analysis has applications in various fields of science and life. Primarily, teachers use facial expression investigation to correct the struggle of the exercise and learning pace on a base of reaction visible on students faces. Virtual tutor in e-learning planned by Amelsvoort and Krahmer [26] offers student with suitable content and alters the complexity of courses or tasks by the information attained from students face. Additional application of FERS is in the field of business where the measurement of peoples fulfilment or disappointment is very important. Usage of this application can be found in many marketing methods where information is collected from customers by surveys. The great chance to conduct the surveys in the automatic way could be able by using customers facial expressions as a level of their satisfaction or dissatisfaction . Furthermore, prototype of Computerized Sales Assistant, proposed by Shergill et al.   chooses the appropriate marketing and sales methods by the response taken from customers facial expressions. Facial behavior is also studied in medicine not only for psychological disorder diagnosis but also to help people with some disabilities. Example of it could be the system proposed by Pioggial et al.   that aids autistic children to progress their social skills by learning how to recognize emotions. Facial expressions could be also used for surveillance purposes like in prototype developed by Hazel hoff et al.. Suggested system automatically perceives uneasiness of newborn babies by recognition of 3 behavioral states: sleep, awake and cry. Furthermore, facial expression recognition is broadly used in human robot and human computer interaction Smart Robotic Assistant for people with disabilities based on multimodal HCI. Another example of human computer interaction systems could be system developed for automatic update of avatar in multiplayer online games. 1.5: Thesis Organization The thesis is organized as follows: The thesis is opened with an introduction i.e., Chapter 1, in which it is discussed about the introduction, physiological background and facial emotion recognition systems along with the Thesis organization and the Tools used for the whole project. Chapter 2 discussed about the literature survey in which the brief explanation of previous works is given and explained. Chapter 3 discussed about the proposed system in which the each part of the face was detected and the emotion of the person is detected based on extreme sparse learning. Here we use the spatial-temporal descriptor and optimal flow method to recognize the emotion. Chapter 4 plays key role in this project which gives the information of software that used for the project i.e. MATLAB. The results and discussions are presented in Chapter 5. This chapter describes the results that are obtained for the proposed system. Chapter 6 discussed about the advantages of the proposed system and disadvantages of the existing systems. Hence the conclusion and future work, references are presented in chapter 7. Then the references are mentioned in the chapter8. 1.6: Tools Used Image processing toolbox MATLAB R2013a(version 8)

Evaluating Internet Sources Essay

The Internet is a great place, especially for students, because it has a vast number of information that can be used for academic purposes. Young people are very much updated when it comes to technology and prefers to do things with their gadgets and computers. Due to this, most companies and organizations have put up a website over the Internet so that they can reach out to everyone, anywhere in the world. However, putting up websites is not only for legitimate companies and organizations. As a matter of fact, anyone can create a website about anything if they know how to read and click a mouse. There are numerous websites over the Internet that are created by people who pose as someone who is knowledgeable about a certain topic but is completely the opposite when looked at closely. It is therefore important for students to learn how to evaluate Internet sources if they are valid and credible to be used for academic purposes. Robert Harris from the website Virtual Salt has come up with ways on how to evaluate Internet sources properly. He first advises researchers to determine what kind of information they are looking for because this way, it would be easier for them to screen the data that websites provide. He then goes on to say that researchers should always look out for important information that websites should provide including the author, author’s title or position, author’s organizational affiliation, date of page creation or version, and author’s contact information (Harris, 2007). These would tell a researcher if the data posted on the website is valid and accurate enough to be trusted and used. Another important thing that students need to remember is the CARS checklist, which stands for credibility, accuracy, reasonableness, and support (Harris, 2007). While credibility seems very hard to check, Harris provides ways to know if a particular source is credible. First, the author of the website or of a certain work should have his or her credentials posted on the website. Contact information should also be included. This way, people who want to communicate with the author would not have much difficulty trying to locate the author. A website can also be credible by undergoing quality control. Errors, either grammatical or technical, should make a person suspicious of the website’ credibility. Researchers should also make sure that the information on the website is accurate and up-to-date. Thus, it is very important for authors and webmasters to constantly update their websites and see if changes should be made. They should indicate when a particular site was updated and created so that researchers would know if the whole website is still being monitored by the authors. All websites that tries to provide information to the public should never be biased. Content should be written with fairness and moderateness, according to Harris. He indicates that if there is some hint of one-sidedness, researchers should think twice whether they should trust the website or not. Finally, information is always better if there are evidences that can support it. This is not to say that every website should have supporting material just for them to be considered â€Å"valid† in terms of evaluating them. However, there are some things that need support including statistical data or current events and certain things that people say should be documented especially if they are known people. Many students are not aware that there are websites and other electronic types of information that should not be used for academic works. Some professors do not even allow their students to lift material from the Internet because of the damage it brings to their works. Still, it is hard for them to restrict students from Internet usage and this is why students and other researchers should learn how to evaluate Internet sources properly. Reference Harris, R. (2007, June 15). Evaluating Internet Research Sources. Retrieved September 15, 2008, from http://www. virtualsalt. com/evalu8it. htm

High School and Best Possible Education Essay

Constant: A situation or state of affairs that doesn’t change. [1] When I think constants, I think of things that might not come to the mind of the â€Å"average person† (if there truly is such a thing). These things include the speed of light, gravitational acceleration on Earth, and, as a teenage boy, my desire for food.| [2] The concept of constants really fascinates me because they provide a surefire way of knowing, and I look to incorporate constants into my life for that very reason.| [3] I never outgrew the curiosity I possessed in the first few years of life. Although now a bit more sophisticated and focused, my curiosity is still as exuberant as the days before I could even say the word constant. Education is the one thing that satisfies this unconquerable hunger for information, a hunger that parallels my constant appetite. Constantly satisfying this hunger is just one of many constants I wish to pursue in life.| Growing up, there weren’t many constants in my life. My parents divorced when I was three, ensuing a custody battle that left my older brother, younger sister, and I in the care of a foster home. [4] Eventually we landed in my dad’s parent’s house where we lived for two years until finally reuniting with my dad. I’d visit my mom every other weekend, continuing that for a couple years until my dad decided we were making a journey across the country, twenty-one hundred miles from Phoenix, Arizona, to the heart of the south; Charleston, South Carolina.| [5] After having spent the first eight years of my life virtually nomadic, this was just another adventure. Also, changes of scenery always fascinated me.| Dinner at La Hacienda transformed into Sunday morning breakfast at Granny’s, a small diner run by elderly women in the community, famous for authentic soul food and southern hospitality. (New Paragraph)After a brief year situated in a thriving suburb of Charleston, I moved forty-five minutes away to North Charleston; a much different environment. [6] I stayed for three years and attended third to fifth grade with the friends I made. These were the first real relationships I had formed with people my age and they helped open my eyes to an entirely new culture.| [7] I recently discovered statistics regarding the school I attended and they were quite shocking. My memory doesn’t match the way the rankings portray the school. After all, I had many memorable experiences there and never a negative thought about the place. Of the 224 middle schools ranked in the South Carolina, Morningside Middle School was 224th. 86% of the students were black, 8% were Hispanic, and the remaining 6% white. The change in diversity opened my eyes and mind to an equally fascinating way of life.| (New Paragraph) [8] After a small taste of establishment, it was time to move yet again. My dad, looking to start a business, led us to a suburb south of Jacksonville, Florida. Just as with South Carolina, we didn’t settle long upon arriving in Florida. After moving twice in the first two years, we settled into the house I have lived for four years now, in a suburb south of Jacksonville.| I started taking classes deemed â€Å"gifted† in the 2nd grade, and continued them until I entered high school. [9] I enjoyed the small classes of students like me, thriving to learn and truly enjoying the process.| In the array of schools I attended, these classes all had a unique approach to education, which really helped feed my curiosity accompanying the introduction of all these new concepts. [10] After excelling throughout schooling, my education became my number one priority. I desired to learn and to go wherever to receive the best possible education. This led me to Ridgeview High School, the only school in the area offering the International Baccalaureate program. Here, I was certain I could receive an education that would prepare me for my next level of education (hopefully just one of many more). | Attending the same school for a fourth consecutive year is the closest I’ve come to a constant in my life, and it’s something that I would never dream of experiencing any other way. However, there’s still that part of me, that curious little boy, itching for adventure and a new environment to develop in and explore. [11] And in the process, fulfilling my priority of receiving the best possible education? That’s a dream come true. This opportunity is the stability I crave in life; places where I can thrive and pursue my dreams. These places are new maps, unlocked in the game of life, open for me to fully submerge myself. It’s a constant where I know I will be settled and form new friendships, equally as strong as the ones I have now. I know my education is not only my own priority, but the priority of those providing me with it. I couldn’t envision a better environment to take the next step in life.|

American Auto Industry The American Automobile Industry

American Auto Industry The American Auto Industry began in the late 1800 s and grew to be one of the largest of it s kind in the world. The industry also encompasses many global automobile and auto parts manufacturers across the country. Production rise and fall over the past decade has dropped the American Automobile Industry into the number two spot in the global market just behind China. The Big Three,comprised of General Motors, Ford Motor Company, and FCA US(formally known as Chrysler), were the primary owners of most of the manufacturing facilities in the United States. Competition in the automobile industry is hard to distinguish since most all of the major global automotive makers have and do produce their vehicles in U.S.†¦show more content†¦Working together, the â€Å"cobots† can help it s human counterparts with tasks like lifting, assembling, painting and even seeing. â€Å" The laser and camera placing in an array on the robot wrist, are able to see ex actly where to install the parts on the car body.†(Bà ©langer-Barrette, 2016) Technology has made the assembly line flow faster and more efficient. Computer assistance in the auto industry doesn t stop there. A car designer uses a program to design a concept for the car they want to make. That design is approved and sent to the next computer program which tells the machine all the information it needs to know to build the car. The assembly line is programmed to follow the directions and help humans produce the finished product. Computers are in every aspect of an automobile, from conception to production, all the way to computers helping you use the car and even driving the car for you. Cars come equipped with smart dashboards that respond like smart phones to read your texts to you, answer the phone for you, retrieving road maps and finding the best route to take on your destination, and playing music. Cars that drive themselves can remotely sense it surroundings, have laser range finders, and generate 3-D maps to navigate it s environment. Also, stop-start technology, or Idle Start and Stop Systems helps with reduce fuel consumption by shutting the car off when the engine is idling. This is a