"EMUI 9" and the UI that Huawei Wang Chenglu talks about

　The Huawei Mate 20 series of Huawei flagship model, which will be announced in Japan tomorrow on November 28, is the latest AI compatible chipset and triple camera, and the voices of users are used.The unique user interface "EMUI", which reflects and focuses on ease of use, is one of the attractions.

　Huawei Consumer Business Group's Software Engineering Department, President, has the opportunity to interview a group at Headquarters in Shenzhen.

――Ai speakers, etc. have appeared, and audio operations are increasing, but how do you capture the possibility of audio operation on your smartphone?

Wang Chenglu AI is provided in China using the cloud.However, it is provided in cooperation with Google Assistant overseas.Voice operation requires cooperation with the cloud, but in China, Google cannot be used, so in China provides clouds and terminals together.Overseas, we do not have a cloud in our company, so we are providing in cooperation with Google Assistants.

――What is technically difficult to actually put a voice UI?

Wang Chenglu First recognize on the terminal side.If the network is good, we use the cloud model on the network, but if it is not, we will expand the same model on the terminal side and recognize it.Since EMUI 9 comes out, more than 10 % of the overall users are using audio operation in Mate 20.Although the usage rate is still low, we believe that it is a reasonable achievement as a new function.This is because users need a process of adapting.This cloud is identified, but it can be used not only for smartphones but also for speakers.We also launched a new speaker a month ago and still sells very well.

―― As long as you use Android for OS, it is impossible to control the Huawei from hardware to UI like iPhone.How do you want to differentiate from other companies while working on EMUI?

Wang Chenglu Huawei has the strengths of hardware and software that can work closely.This can be achieved because it has adopted a high siricon chipset.The current EMUI is a complete OS based on Android.We optimize and modify various things from drivers to Linux kernels, hardware abstraction layers, middleware and frameworks.File systems and garbage collections have also been improved.We also optimize middleware such as image engines and communication engines.We also integrate the framework.

　I took the EMUI decuber (disassembly) for three years.As a result, it became powerful in applying by changing the module or changing the combination even for different models.For the first time in the world, a hot patch technology has been realized on the software stack.This can be solved quickly when something goes wrong, and you can respond quickly when new needs occur.This is something that cannot be realized with iOS.This improves the quality of our products, the speed of delivery is faster, and you will have a stronger strength than competitors.

――It means that EMUI 9 has been adopted based on Android 9, but if the previous terminal such as P20 is set to Android 9, will it be EMUI 9 in the same way?

Wang Chenglu, of course, is impossible, but 5.From the time of 0, we can go back to the old model.9.As for 0, we want to support more than 30 models.When the latest EMUI comes out, we want existing users to be able to use the latest functions as soon as possible, and we want them to have a new and better experience.If you introduce specific numbers, 5.At the time of 0, a new user and an existing user are used by one and more.8.1 at 0.600 million people, 9.0 is 2.It is expected that 200 million will be used.

――How do you want to balance the difference between standard Android?

Wang Chenglu Pure Android is a design reference. How to select this. This is decided by looking at the feedback and rechargement from consumers. To give a specific example, I tried to substitute three virtual buttons with one physical button at the time of P10. In the voices of consumers, there were many complicated things that had three, and there were many opinions that would take up space on the screen, so let's talk with the Android team and try to create a P10 Chinese version. Thats how its going to be. That was very popular. Starting with that, Google has come to take this kind of consultation very well. Through that matter, we were recognized as understanding Chinese consumers. Therefore, the criteria for the selection are determined by consumer's understanding and needs based on consumer understanding.

　The more accurate and deeper the understanding of consumers, the higher the contribution of Google's ecosystem.For example, full -is play navigation, file system, performance and battery mochi, which was customized by our company and had a good consumer reaction, so it was incorporated into a new Android version.There are various ways of thinking from various manufacturers, and verification can be obtained by giving it to consumers as a product.The result of the verification, and being incorporated into Android, the ecosystem grows healthy.

――I feel the battery is better than the terminal of another company with the same battery capacity.Instead, the notification may be stopped when the screen is turned off.What are you doing?What do you think of the balance with convenience?

Wang Chenglu There are two things about the battery.The first is to clarify the characteristics of power consumption of all parts of smartphone hardware.The power consumption of each part does not mean that lines so much, but you have to find the most efficient point.The second is to clarify the characteristics of what kind of hardware resources the app are looking for in the system.For example, Wi-Fi scan.I scan frequently for the first 5 minutes, but after 5 minutes, I will open the interval at the time.So, clarify these two and use the algorithm to make them match well.

　It means that you will not be notified of your question, but I think this is what you need to increase the accuracy of the algorithm.For example, you use AI to determine which app will be launched next and how much time you use the app, but the accuracy is 5..86 % for 0, 8.95 % for 0, 9.0 was 99 %.I want to reach 100 % by combining algorithms and apps, and the functions of AI.We want to realize the use of the user's experience and improve the battery.

――Do you have two to three cameras and have become more difficult as software?

Wang Chenglu There is always something wrong.When using a camera, all stacks, from hardware to software, are involved.First, very detailed tuning is required with the chipset.When the camera lens is two to three, how to synthesize the original data of the images incorporated there is also a very large number of operational abilities.It was the world's first, so there was no other industry data that could be referenced, and very large design, development and tuning, especially tuning, had to be done in large quantities.That's where it was hard.

――The smartphone is getting larger and long, and it becomes vertical, but what is the best UI?It is remarkable in Japan, but how do you meet the needs of wanting to operate with one hand?

Wang Chenglu is difficult to say which UI is the best.In the first place, the user's use is different, so it is not easy to say which is the best.Of course, I think there are various directions whether the screen size is large, small, curved, or folded, but the final goal is to simplify the UI.。I think the entire screen should be used by users.That's because the user experience is the best.

　We incorporated gesture navigation.When this was adopted, I very referring to human engineering.For example, when I started operating an app such as an album, I moved down the various operation menus above.Regarding the navigation to return, so that both right -handed people or left -handed people can use it without any problems, you can return from the right side or swipe from the left.

　My dream is that when AI technology becomes perfect, people and machine interactions will not only touch machines.Just as people are interacting, you will be able to interact with voices and eyes.I think the real innovation is only after AI has mature.I believe it is embodied by the way of people and machines.So, for that, we have been studying and have a lot of track record.It's very exciting just to think.

―― In emui 9, various operation modes are proposed as an option.As a Huawei, do you still recommend gestures?

Wang Chenglu Yes.The most recommended gesture is.Gesture navigation usage is 86 %.The popularity rate is 90 % or more.In addition, some other options can move round buttons, and depending on your preference, you can set three virtual buttons under the screen as before.

――If you actually use a gesture navigation, you often return to the platform if you try to enter the flick of “n” with a numeric keypad.

It is called a hot zone that Wang Chenglu touches, but this hot zone is learning with algorithm.There was a numeric keypad, and I touched this place and returned to the home.Then, we will learn that the user has launched the keyboard immediately.In addition, such learning, tuning, and optimization are required.We are now working on these things with the University of Carnegie Melon and the University of Toronto.

――Is there any functions that can be realized by the evolution of hardware?

Wang Chenglu First of all, it was NPU, but for the first time in Kirin 970, it was equipped with a neuron processor.The biggest value of this NPU is that it has high computational skills and low power consumption.In addition, there is an operation suitable for neurons.Especially suitable for matrix operations.There is a possibility of translation.

　If the camera has an AI function, you can identify the object by holding the camera in front of the object. I would like to introduce one application using this function. I have just participated in a meeting called Green Alliance in Android in Beijing, but it is an event where developers interact. Among them, there was a person born after 1990 from Wuhan, and the person used one day to develop a very wonderful app. It is mainly developed for visually impaired and people with disabilities. It makes full use of the camera identification ability of the camera, and if you hang your smartphone camera in front of your chest, it will tell you in real time that you can identify with the camera. When talking to people, if you turn in the direction of a person's voice, let me tell you that the other person is a woman in your twenties, or if the direction is out of the direction, please tell me a little more left. increase.

　Our hardware and software are just platforms.I want to make it as a highly capable platform.Various innovation is what developers do.I was very impressed when I knew this.It has just started, but various developers will think about great applications.By the way, this platform is called "Hi-AI".A platform open to a third party.

　As for the app I mentioned earlier, why this young man wanted to make this app in the first place, as he shifts into a digital society, the weak people who are weak can not enjoy the benefits.He felt that he was there.Living with the visually impaired at the visually impaired center in Beijing, he understood what he had and what he was in trouble before, and started developing.That's right.We felt that we had to fully know this hardware and software abilities.Developing various apps on top of that and making them rich, gives consumers a better experience.By the way, the name of this app is "Hitomi Keimei" (Cay Mate).

――The audio recognition is processed in the cloud, but when the NPU evolves, it seems that it can be processed on the terminal side.What will the role sharing between the cloud and terminals in the future?

Wang Chenglu I would like to share my views on this theme with you.It is our dream to realize the entire AI function and voice recognition function on the terminal side.Compared to the cloud, if you complete everything on the terminal side, it can be processed in real time and protects privacy.We would like to realize all the apps in our efforts in the form of a closed loop on the terminal side.

　However, when it comes to 5G, I don't think it's just a mobile network upgrade.The main feature is that the latency is very short.In the 5G era, the boundary between the terminal and the network becomes very ambiguous.It feels as if you are in the same system.In the 5G era, the difference between the cloud and the terminal is only the high computational ability.If the 5G network has distribution -type capabilities, all apps will follow the terminal.You can get a very good experience with any gadget or any device.

　We have launched a cloud business, which allows you to make three architectures: terminals, chipsets, and cloud.That way, you will be able to provide distribution terminals and services, and you will be able to achieve good experiences.For example, when a person rides in a car, if you want to listen to music at that time, you are in the car if you want to listen to music at that time.This music will be regenerated from in -vehicle speakers because it is automatically recognized.This is the so -called distribution concept.If you can do this, I think it will be a big turning point, singularity.Infinite possibilities are hidden, and this story makes me excited.

――Is the PC mode defined as EMUI?In Huawei, Windows PCs have recently been created, but will it begin to be equipped with EMUI to make it easier to use?Or will EMUI be used in areas such as smart speakers and smart homes?

What I would like to explain to avoid misunderstanding Wang Chenglu is that changing PC mode and PC OS is different.EMUI 8 for PC mode.Starting from 0, I needed a cable at that time.At that time, it was just like reflecting the smartphone screen on a large screen monitor.Emui 9.0 corresponds to wireless.However, there is no idea to make EMUI a PC OS.The only thing that is reflected without a cable is to have a Miracast protocol on the display side.If not, there is also a USB dongle sold separately, so you can do the same by inserting it.The PC mode is actually incorporated into Android 9 as part of the solution.That is also the contribution of our company.I think this is also a good example of innovation based on Android.

　EMUI is used in smart home.

--thank you very much.