A Brief Explanation Of How Deep Fusion Works On Photos

Aadhya Khatri - Jan 22, 2020


A Brief Explanation Of How Deep Fusion Works On Photos

Like Smart HDR of Apple, Deep Fusion works based on scene and object recognition, and the eight pictures taken before the user capture the scene

Deep Fusion has stirred people’s curiosity even before it is released in iOS 13.2. Now, when users have had some time familiarized themselves with it, let’s look at some of the tech’s underlying features.

Deep Fusion Is Not So Complicated

Like Smart HDR of Apple, Deep Fusion works based on scene and object recognition, and the eight pictures taken before the user capture the scene.

Now let’s talk about the eight images. Four of them are taken with a short exposure and the others are captured with a standard exposure. When users trigger the shutter button, the ninth picture is captured with long exposure.

Deep-fusion-apple-iphone-11
Four of the eight images are taken with a short exposure and the others are captured with a standard exposure. When users trigger the shutter button, the ninth picture is captured with long exposure

Since the short exposure can create the time-freezing effect and support details with high frequency, the sharpest of these images is picked for the next step.

The three pictures taken with the standard exposure usually yield the best tones, colors, and other data of low frequency. They are then fused with the images with long exposure to make one single photo with the best features.

This image and the one with the sharpest of the short exposure shots are then sent to a neural network, which picks out the best pixel and then represents one final picture to the user.

This approach can help to eliminate noise, make the colors look accurately, and sharpen the details.

The processing is done behind the scene so it will have minimal impact on your capture time, meaning you can shoot as fast as on any other phone on an iPhone 11 lineup with Deep Fusion. The only thing you will notice is that there are some more pictures in the camera roll and a photo with a lot higher quality.

According to Apple, sometimes you may see a picture being processed for about a second. Deep Fusion is not available for burst mode and only users of the iPhone 11 and 11 Pro have access to it.

It Just Works

Users do not have the choice to turn the feature on or off. Deep Fusion will be at work whenever possible.

The feature will be of no use when users use Apple’s ultrawide-angle lens. With the main lens on, the company said that the feature will kick in under indoor light, in case the phone does not offers the night mode.

With the telephoto lens, you can have the feature when taking pictures of something that is not too dark or too bright. These situations usually call for the work of the main sensor, not the telephoto camera.

The Results

So far, many users have reported that the effect of Deep Fusion has been subtle on iPhone 11 lineup. In a test of an iPhone 11 with iOS 13.2 against another one running iOS 13.1, which means it has no Deep Fusion, the difference is hard to notice.

Deep-Fusion-Comparison
In a test of an iPhone 11 with iOS 13.2 against another one running iOS 13.1, which means it has no Deep Fusion, the difference is hard to notice

However, when zoomed in, users may notice finer details, which is not something you will be impressed at the first look, especially when you view the photo on the phone. What we most appreciate about it is that it can only improve the image, not make it worse.

While it is only possible to see the influence of Deep Fusion when you look really hard, it is still a nice addition to have. Even if it does not work magic like the night mode.

Comments

Sort by Newest | Popular

Next Story

Read more

Twitter Promotes Shocking Ads For Human Organs, Making A Profit In The Most Disturbing Way

ICT News- Feb 17, 2020

Twitter Promotes Shocking Ads For Human Organs, Making A Profit In The Most Disturbing Way

Twitter has both human and machine review, which is hard to understand why inappropriate content still slip through despite this level of meticulousness

Durability Test Shows That Galaxy Z Flip's Screen Is As Fragile As That Of Galaxy Fold

Mobile- Feb 17, 2020

Durability Test Shows That Galaxy Z Flip's Screen Is As Fragile As That Of Galaxy Fold

The screen of Galaxy Z Flip is so fragile that even a fingernail can leave a mark. This performance is no better than that of the Galaxy Fold

iQOO 3 Leaked Photos Show Rear Design, 4,440mAh Battery, 55W Fast Charging

Mobile- Feb 15, 2020

iQOO 3 Leaked Photos Show Rear Design, 4,440mAh Battery, 55W Fast Charging

The iQOO 3, which is expected to arrive in India on 25 February, will come with a 4,440 mAh battery, 55W fast charging support, and 48MP quad rear cameras, as per new teaser posters.

The Best Personal Flying Vehicle Will Get $1 Million Sponsor From Boeing

Features- Feb 17, 2020

The Best Personal Flying Vehicle Will Get $1 Million Sponsor From Boeing

Boeing said it had over 850 teams participated in GoFly. It has chosen five finalists for the grand prize and 20 contestants for additional prizes

The Coronavirus Could Infect 2/3 Of The World's Population, According To Experts

Features- Feb 17, 2020

The Coronavirus Could Infect 2/3 Of The World's Population, According To Experts

As stated by a leading public health epidemiologist, the Coronavirus could infect around two-thirds of the world’s population if we fail to control it

We Just Experienced The Hottest January Ever Since 11,700 Years Ago

Features- Feb 17, 2020

We Just Experienced The Hottest January Ever Since 11,700 Years Ago

Pollution and global warming have caused the temperature of Mother Earth to constantly rise. And we just experienced the hottest January ever.