A Brief Explanation Of How Deep Fusion Works On Photos

Aadhya Khatri - Jan 22, 2020


A Brief Explanation Of How Deep Fusion Works On Photos

Like Smart HDR of Apple, Deep Fusion works based on scene and object recognition, and the eight pictures taken before the user capture the scene

Deep Fusion had stirred people’s curiosity even before it is released in iOS 13.2. Now, when users have some time familiarized themselves with the tech, let’s look at some of its underlying features.

Deep Fusion Is Not So Complicated

Like Apple's Smart HDR, Deep Fusion works based on scene and object recognition, and the eight pictures taken right before the user capture the scene.

Now let’s talk about the eight images. Four of them are taken with a short exposure and the others are captured with the standard exposure. When users press the shutter button, the ninth picture is captured with a long exposure.

Deep-fusion-apple-iphone-11
Four of the eight images are taken with a short exposure and the others are captured with a standard exposure. When users trigger the shutter button, the ninth picture is captured with long exposure

Since the short exposure can create the time-freezing effect and support details with high frequency, the sharpest of these images taken with it is picked for the next step.

The three pictures taken with the standard exposure usually yield the best tones, colors, and other data in low frequency. They are then fused with the images with long exposure to make one single photo with the best features.

This image and the one with the sharpest of the short exposure shots are then sent to a neural network, which picks out the best pixel and then represents the final image to the user. This approach can help eliminate noise, make the colors look accurate, and sharpen details.

The processing is done behind the scene so it will have minimal impact on your capture time.

According to Apple, sometimes you may see a picture being processed for about a second. Deep Fusion is not available for burst mode and only users of the iPhone 11 and 11 Pro have access to it.

It Just Works

Users do not have the choice to turn the feature on or off - Deep Fusion will be at work whenever possible.

It will be of no use when users use Apple’s ultrawide-angle lens. With the main lens at work, the company said that the feature will kick in under indoor light, in case the phone does not automatically offer the night mode.

With the telephoto lens, you can have Deep Fusion when taking pictures of something that is not too dark or too bright. These situations usually call for the work of the main sensor, not the telephoto camera.

The Results

Many users reported that the effect of Deep Fusion has been subtle on iPhone 11 lineup. In a test of an iPhone 11 with iOS 13.2 against another one running iOS 13.1 with no Deep Fusion on board, the difference is hard to notice.

Deep-Fusion-Comparison
In a test of an iPhone 11 with iOS 13.2 against another one running iOS 13.1, which means it has no Deep Fusion, the difference is hard to notice

However, when zooming in, users may notice finer details, not something you will be impressed at the first look, especially when you view the photo on the phone. What we most appreciate about it is that it can only improve the image, not make it worse.

Comments

Sort by Newest | Popular

Next Story

Read more

Upcoming 5.4-Inch iPhone Will Reportedly Be Called iPhone 12 Mini

Mobile- Sep 22, 2020

Upcoming 5.4-Inch iPhone Will Reportedly Be Called iPhone 12 Mini

If this news is to be believed, the iPhone 12 mini will be the first iPhone with the "mini" suffix in the name, similar to the iPad mini, Mac mini, and iPod mini.

Vistara Becomes First Airline In India To Offer Free In-Flight WiFi

Features- Sep 22, 2020

Vistara Becomes First Airline In India To Offer Free In-Flight WiFi

Passengers who travel on Vistara's new Boeing 787 Dreamliners on the Delhi-London route can access internet connectivity.

14 Surgeons And A Robot Carried Out 3 Stages Of A Surgery At The Same Time

Features- Sep 23, 2020

14 Surgeons And A Robot Carried Out 3 Stages Of A Surgery At The Same Time

Robots have assisted doctors and surgeons for a while now. But this is the first time a robot and surgeons have worked alongside to reduce surgery time.

Microsoft Mocked Sony For Confusing Fans About PS5 Preorder Details

ICT News- Sep 22, 2020

Microsoft Mocked Sony For Confusing Fans About PS5 Preorder Details

Sony said it would post details about PS5 preorders but fans ended up confused. Microsoft didn't miss the chance to mock Sony and promote its console.

Trump Wants $5 Billion From TikTok Deal, Regret Not Asking For More

ICT News- Sep 21, 2020

Trump Wants $5 Billion From TikTok Deal, Regret Not Asking For More

The president wants to raise $5 billion for an education fund from the TikTok deal. However, it isn’t clear who will pay such a huge amount of money

World's First Bionic Eye To Help Blind People Restore Their Vision

Features- Sep 21, 2020

World's First Bionic Eye To Help Blind People Restore Their Vision

Researchers from Melbourne-based Monash University in Australia have developed a bionic eye that uses a brain implant to bring back vision to blind people.