Interview

Diversified Academic Knowledge Essential in Research Linking Facial Expression and Emotion

サムネイル

Zhang, Junyao

Department of Intelligence Science and Technology
Graduate School of Informatics

Outline

—Why did you choose to pursue platform studies?

I believe that facial expressions play a vital role resembling that of the impact that road signs have on traffic. Facial expressions convey the types of emotions that people possess at particular points in time, indicating what they want to do under the existing social conditions. These expressions thereby fulfill an essential role in the interaction of human emotions. I also presume that, even when efforts are made to intentionally conceal them, facial expressions inevitably sustain certain ties with people’s internal states. This, in turn, makes it possible to mobilize facial expression recognition to surmise internal feelings. Technologies capable of automatic detection and analysis of such human inner states have yet to truly mature. In view of this, there is a need to gather more extensive examples of how outward appearances shift relative to our internal states, followed by the addition of accurate annotations to the assembled data. As the world gears up for the arrival of the so-called Society 5.0, demands are emerging for research and serious consideration of how to best deal with the social issues expected to occur. Taking my research theme as an example, for data analysis, it is not sufficient to use the deep learning method alone. There is a crucial need, rather, to obtain extensive knowledge from other areas of study. For instance, my theme requires me to study psychology and clinical medicine. Working through this process, it will become possible to achieve more detailed interpretations and analysis. Such interpretations and analysis, meanwhile, will combine to comprise a critical outcome in the quest for more comprehensive understanding. This conviction is also the reason that I have chosen to enroll in the School of Platforms program.

—What research themes are you currently working on?

I am exploring the linkage of people’s facial expressions capable of being observed externally and other information with their internal states. The aim is to define the correlation and causal relationships between people’s emotions and psychological states and the results of facial expression recognition, thereby exploring the suitability and limitations of such knowledge.

—What have you gained through the School of Platforms program?

In terms of my research, I still have a considerable way to go to achieve actual platform building. Nevertheless, working through the lectures and seminars of this program, I have learned about the combinations between different fields and platforms. A recent seminar, for example, furnished considerable knowledge about the metaverse. In the virtual world, it is possible to build communities, conduct transactions, and engage in other endeavors resembling those of the real world. While this is extremely interesting, in moving to realize such platforms we face the initial need to collect and analyze user information. Thanks to the presence of such support, however, I believe that users will be satisfied with the services that platforms supply, and enjoy putting them into use. Through this program, therefore, I have been able to expand my perspective, while learning about the building of comprehensive systems.

—What is the platform to you (ideal situations, desirable future, etc.)?

What I hope to create in connection with my research is a platform capable of detecting people’s internal states. Mobilizing tools equipped with camera functions, at times when permission is granted we will monitor the external behavior of users for 24 hours, then convey the information concerning their expressions, postures, conversational give-and-take, and other areas to the platform engine as data. I am confident that generating feedback comprised of objective and specialized analysis will enable us to achieve a more precision grasp of the state of our own bodies. I believe that such a platform will also be able to be used in mobile phones, tablets, laptop computers, and other devices, supporting the pursuit of more human-friendly designs enabling ready use by disabled persons as well. This is the type of platform that I want to build, which will hopefully support people’s needs in the true sense of the word.

—If the goal is to improve the world just a little from where it stands today, what do you think is needed, or what would you like to do?

I once heard words to the effect that “every person is a uniquely valuable individual with special aptitudes capable of being conveyed to the world.” Over the years to come, I intend to devote my life to discovering where my own aptitudes lie, and freely share those aspects with others.

back to Interview
back