Why Mirrorless Autofocus Means Trade-Offs

Why Mirrorless Autofocus Means Trade-Offs

Mirrorless cameras like the Sony A7 don’t use a traditional phase detect autofocus. While this enables popular features like eye tracking autofocus, it brings a number of tradeoffs, which could be a deal-breaker for certain applications.

Two Systems Enter

The phase detect system, typically used in DSLRs, works by directing a small portion of the light which enters the lens away from the viewfinder and into a separate autofocus sensor array. After many years of development and refinement, this system is very polished. Cameras like the Nikon D5 and Canon 1D X Mark II can feature 50+ autofocus points and advanced tracking at high frame rates. This makes these systems the gold standard for sports and action photography, particularly when combined with the high framerates these cameras are capable of.

Mirrorless cameras can use a number of different methods, including on-sensor phase detection, contrast-based autofocus, and a novel twist on contrast AF called depth-from-defocus. Each offers different performance characteristics, but all rely on information from the camera’s sensor. This can enable better autofocus performance during video, face/eye detect autofocus, and a reduction in alignment issues. Most mirrorless cameras will use phase detect points built into the sensor, with contrast AF supplementing it. Depth from defocus is a particular implementation from Panasonic which relies on already known information about lenses characteristics to supplement contrast AF techniques.

With that overview of the different AF systems out of the way, I’d like to focus on the tradeoffs present in the two current, leading implementations: phase detect and on-sensor phase detection.

Under the Glass

The phase detection points on a mirrorless camera’s sensor sit, as indicated by the name, right on the sensor. This means they are underneath the filter stack, which includes an IR filter. This filter, which cuts out infrared wavelengths, is necessary for accurate colors, but causes the first major issue for low light use. In low light, AF performance drops regardless of system, since the sensors have less light and contrast to work with.

Wedding and event photographers have had the luxury of using AF assist, a feature that projects a mostly-infrared grid of lines onto the subject, typically from a portable flash. Since their mirrorless camera’s AF sensors sit below the IR filter, that grid is no longer visible to the system, unlike in a traditional phase detect system. Speedlights, like Nikon's SB-5000 prominently feature the AF assist light. Others, like Godox X1T-S, have an assist lamp closer to the visible spectrum, meaning better performance with mirrorless cameras.

Under that red plastic sits the AF assist emitters, which create a grid of points to help the camera focus in low light

This means mirrorless cameras are further disadvantaged in one of the most challenging AF scenarios, owing to the low light and fast movement. Some assist lamps rely on a more prominent visible light, which can be distracting to subjects, and still doesn't offer the same grid that phase detect systems can grab onto.

While some DSLRs combine information from their metering sensors with the AF sensors to provide face tracking or scene recognition, mirrorless cameras have access to all the information coming off the sensor. This is most recognizably implemented in eye AF, a mirrorless feature that enables precise focus on a subject's eye across the frame.

One advantage of sitting under the filter stack is how much easier it is to retain AF performance with less maintenance. Since the sensor and AF system are on the exact same plane, alignment shifts are much less of an issue. On traditional systems, the PD sensors are an additional location that could gather dust, while on mirrorless, cleaning the sensor also cleans the PD points. This can also mean greater reliability as the camera ages, since the sensor can't move independent of the PD points.

One last advantage is in the number of points. Nikon’s flagship D5 offers 153 AF points, while their mirrorless flagship has 493 AF points. These can’t be compared apples to apples, but a greater number of points spread further across the sensor means good things for landscape, still life, and portrait photographers. They can select the exact focus point across almost the entire sensor, preventing the need to focus and recompose. This is especially important with high megapixel bodies, as even slight focus shifts can show up in the final image.

The mature nature of the DSLR’s phase detect systems means they’re a virtual jack of all trades. While mirrorless cameras are catching up to flagship DSLR AF systems, particularly in cameras like the Sony A9, they are still typified by tradeoffs.

What’s the Right System for Me?

While I imagine few photographers will base their system choice entirely around autofocus, knowing the tradeoffs, benefits, and downsides to each AF implementation can be useful.

Phase detect in DSLRs:

  • Leading performance at high frame rates
  • Mature implementations with well established modes
  • Quicker initial response and confirmation
  • Smaller area of the total image covered by AF points
  • Alignment issues can require repair or recalibration
  • Potentially less information available for features like eye AF

On sensor phase detect

  • Near DSLR levels of performance, particularly in bright light and with cameras like Sony’s a9
  • Higher accuracy for still subjects
  • Face/eye recognition means easier use with human subjects
  • Inability to use IR AF assist
  • System may fail to find focus, falling back to slow contrast AF
  • DSLR AF features and modes may be missing

With the newest generation of mirrorless cameras, the gap in AF performance has definitely closed. What still remains, however, are a number of key differences. Depending on your subjects of choice, mirrorless cameras may be a perfect fit. The consistency and accuracy of the system, combined with the higher number of selectable points and new features like eye AF are a natural fit for landscapes and portraiture. Meanwhile, action and event photographers who rely on tracking and AF assist devices may need to hold off.

Have you found your perfect match in an AF system? For what I shoot, I've been very happy with the performance of my Nikon Z7, but I definitely can see a step back in tracking compared to my past DSLRs.

Lead image courtesy of Tom Pumford

Alex Coleman's picture

Alex Coleman is a travel and landscape photographer. He teaches workshops in the American Southwest, with an emphasis on blending the artistic and technical sides of photography.

Log in or register to post comments
66 Comments

Very Interesting..
FWIW I often AF twice on my 5D.
Pre focus by half way pressing the shutter and then repeat with fully pressing.

The worst picture you can take is OFF (Out of Freaking Focus).

Mirrorless is infinitely better in this regard, because, as stated in the article, the imaging plane and focus plane are the same singular part. As opposed to DSLRs that use two separate parts at different angles, using mirrors to reflect light at the AF sensor, which creates alignment issues. You never have to AF twice on most OSPDAF cameras to get it right the first time. The biggest reason I switched from DSLR to mirrorless, and I'm still amazed how accurate these cameras are.

Have you tried back button autofocus? I've found that it is easier to control than that half-press option. https://fstoppers.com/originals/back-button-focus-what-it-and-why-you-sh...

Although this is personal preference, I don't see the point configuring my camera for *constant* focus & recompose (back button focus) rather than using the default for *ocassional* focus and recompose (configuring focus hold). Back button focus actually slows you down considerably in sports/wildlife photography since you have to press two buttons within short period of time to take a picture in focus, whereas with focus on shutter button definitely reduces response time.

Yes I have used back focus but as above user says ... it slows you down.
I m old school and have done half press then full press many many years.
We all have preferred work flows and where we want to put our fingers.
Focus Twice .. Expose Once is my long term words of wisdom.
It’s kinda like Measure Twice and Cut Once.

Funny how some in this thread disagree with your statements about Mirrorless Focus ..
I m under the impression that double focus and expose once is improved and more accurate but has less effect these days than the old days of auto focus lenses.
It is still valid for exposure and re comp.
You need to write more on this.

You have this completely backwards, back-button focus speeds things up. It's how most pro sports and wild-life shooters operate. It allows them to separate AF and shutter into 2 independent operations. Activating the AF button eliminates the half-press operation, which allows you to operate the shutter instantly when a minor delay can be the difference in capturing the moment or losing it. The other way works fine for portraits or landscapes, but really slows you down in high-speed situations.

Just because you shoot a certain way doesn't mean it's the only use-case scenario.

It took me time to learn back button focus but you set your camera to constantly focus.

It's less stressful as your not doing a micro adjustment on your index finger for the half press.

Some can argue, it is more stressful having to press two buttons instead of one..

Can you back your statement "It's how most pro sports and wild-life shooters operate" up ? Because I don't trust it. Pressing two buttons instead of one will slow you down most definitely. Also, there is certain latency when pressing shutter button and not using the half press at all, since you STILL have to get through the half press anyway.. just think about it, instead of following some trends online.
Check this reasoning out - https://www.essence-of-light.com/debunking-back-button-autofocus/

Peter, back button focus does not slow you down at all. What it does it allows you to select a focus by pressing a thumb on the back of camera and lock an that subject part precisely. Then you simply wait for right moment and action happening within your frame and if your most important part of the frame is still where you back button focussed you can simply keep holding your thumb on AF ON and fire with your other finger shutter single or multiple times... For predictive actions in sport wildlife weddings etc... this is a must and it saves you lots of missed shots :) you do not need to believe it but when you try and learn it you will be amazed how things change in your favour :) happy shooting guys... and yes I find Z7 focus more precise in AFS, but AFC still does not compare to D4s or D850 IMO :) cheers

How does pressing 2 buttons simultaneously slow you down? Back button focus is the best thing since sliced bread lol. So many people get stuck in learning one method of things and cling to it with such a narrow mind. I've used a 1dx a d5 an a7iii an neither one of those cameras leave me wanting to use it over my a7iii not even the a9. " Pro's "only use dslrs because they either work for a company not willing to reinvest in upgrading gear, dont know about cameras just know photography and will repeat "its all about the photographer not the camera" or someone who's personally invested in thousands of dollars of high end glass that have no need to upgrade their gear absed on what they shoot. The DSLR is dead... i really wish people would just let it go... this is the same thing as people making an argument for a flip nokia after the iphone 3gs has come out... times change.. tech evolves lets stop the dslr vs mirrorless .. it's realllllllyyyy not honest for those who are looking for information on cameras. Nobody buying a camera in 2019 needs to buy a dslr over a mirrorless camera. Theres no justification what so ever... this isnt 2012

Muscle memory can definitely make switching to back button a trade off. If you're happy with your current technique, keep it up!

With BBF you set the camera to continuous focus and hold the back button down. If you want to focus and recompose you simply release the back button. In general your finger is always pressed and you simply press the shutter button at the correct moment. This in no way slows you down. It takes a bit to get used to but I find it vastly superior. Additionally most of the time I am half pressing the Shutter button. It is also nice when you are shooting a still subject as half press will activate IS without changing your focus.

Interesting post. I have a fujifilm XH-1 I bought the godox camera flash to use. I find the flash will fire when not pressed at times and when I use manual mode, the godox sometimes does not sync with camera, and when I use TTL, I don’t get an accurate TTL , mostly overexposed. Perhaps this is some of what you are saying...I know I am in a quandary for predicable results

With your Godox while using TTL have you changed your metering modes at all? I steer away from using TTL 90% of the time now but found that unless I was using spot metering my results would be fluctuating drastically.

Good info, did not know this....so your saying if I use spot metering when going TTL? I have the same thing happen when I use manual mode. Godox does not always duplicate the manual settings or read properly. Can’t figure out if the body or Gordon unit, Ken thanks for the tip

Yes, metering modes can throw your TTL into WTF very quickly which may be why you’re experiencing problems.

If it’s metering across the entire frame instead of just for your subject your results will be all over the place.

As for the unit not “duplicating settings” I’m not sure what you mean by that.

I am no expert but here is how it works (somewhat); When you are on TTL and you press the shutter, the flash shoots twice, once to illuminate the scene -for the camera to read- and one to actually light the scene after the camera "told" the flash how much light is needed.

The camera reads the first 'flash' and determines how much light is needed to have perfect exposure, relates it to the flash and the flash shoots a second time.

This happens so fast that for our eyes it looks like one flash. But it is actually two.

Therefore, when the flash goes off the first time - so the camera can read the (and calculates) how much light is needed - it is better if the camera reads the light reflected from ONE SPOT. If the camera relays the information it reads from a few spots, like a white shirt, a black-tie or a dark red dress, the flash has no idea how to translate it and that's why it's different each time.

I personally almost never work in TTL, for that reason and also because A) It drains the battery quicker B) Recycle time is way longer and C) The flash heats up faster. All because it actually shoots twice for every time you press the shutter.

I hope I was accurate in my explanation :-). Any input is welcome.

I heard from some Sony and Fuji users that the flash is not consistent. I use Nikon (D750) and a colleague of mine uses Canon (D5 Mark IV), we both use the V860 II and either TTL or manual, it is extremely accurate. But it could be the flash unit itself.

Might just be poor firmware. No issues on my Sonys with the TT685S flashes except a bit of lag before the camera shoots (TTL preshot metering).

Interesting issue. It could be a firmware problem, given the different brands involved. I've been happy with TTL when using Nikon speedlights with my Nikon cameras, but I've found manual to always be consistent.

In bright light the a9 definitely beats any DSLR on the market today by a good margin in AF speed, accuracy, and tracking so it's not "near DSLR performance", but rather above DSLR performance in that scenario. Low light performance has gotten a lot better, but it is still an issue for most MILC's so that would be the DSLR's primary strength at this point although the difference isn't nearly what it used to be.

If the a9, a6400 and a7r4 didn't exist this article might have a point. But they do, and the a9 has a faster, better af system than top of the line dslrs for almost every situation.

Umm, yes. I sold my D5 and D4s and bought 2x A9s when they were released. I compared them side by side in a number of scenarios, including low light and found the A9 AF to be as good as the D5. The AF has now improved to better the 3D tracking on the D5.

Pat as someone who shot with the a9 and top-end nikon dslrs prior to that, I can tell you for a fact the a9 is superior. And that was before the real-time tracking update. Now? It's not even a contest

Pat OConnor

Well, I owned a D5 with super fast XQD cards and had one in my D4s.
The 3D tracking for fast moving sports was sometimes hit and miss with the D5.

With the A9, it nailed fast action every time.
I was shooting full contact karate tournaments and the action comes very fast, so you need to be ready and have a camera that will get the shot on focus, otherwise you missed it.
There is no second take!

Manual focus is a great option and mirrorless makes accurate MF even easier via the emphasis on "live view" inherent to the camera.

One prominent landscape example is that classic foreground flowers with a mountain background - that shot is made easier by the wider spread of AF points across the frame.

If you're guessing and are stopped down enough that everything will be within your DOF (or diffraction area), then AF at all doesn't provide a benefit. What's going to most help you here will be an accurate focus scale, on the lens, or in the camera.

Where AF at the sensor makes a big difference is in short DOF scenarios, where microfocus adjustment would be an issue. Even in landscape shooting, not every shot will have infinite DOF. Sometimes you'll want to isolate a subject.

For near DSLR levels of performance, read 'exceeds DSLR levels of performance like for like in most cases when we'll implememted.

For accuracy, mirrorless has won in my experience. But for tracking or low light with assist, DSLRs still win. That's really the basis behind this article: for certain applications, one type of camera provides better results.

I was insanely tired when I wrote that, sorry. But I think the two first lines for each system are still a little skewed.

FOR DSLRs you've got said they're still best at high frame rates, which I don't really agree with. Sonny's Alpha range for example, especially with the new firmware, is insanely accurate at high frame rates, especially compared with DSLR counterparts, who can't even hit the same heights of speed. Fuji's Sports Finder and new PDAF system are very good too, even in the X-T30.

You then say that CSCs offer near DSLR quality focus M, even in bright light. I'd argue that, although not quite there in low-light (and I mostly agree with that), in bright light the benefits elevate a good mirrorless AF system beyond DSLRs in almost every other area. They're often quicker, just as if not more accurate and things like Eye AF are built natively into the system.

Even the EOS R, which has problems, says it focuses to - 6EV (with a lens caveat). And on static subjects (wouldn't dare try it in low-light), I found that was pretty accurate.

I just don't think it's as black and white as it seems.

It isn't black and white, and a single article over the two main camera systems can not cover every minor detail. This is more a roundup of potential pros and cons of the two systems.

Each of these are generalizations. While some mirrorless cameras are in the top group for continuous/tracking, DSLRs typically beat their comparable mirrorless, excluding something like the A9. Haven't tried Fuji's sports finder yet, so I can't speak to it.

I distinguish between performance and accuracy for mirrorless, based on my experience with them, so for your last two major paragraphs, I think we agree. Mirrorless in good light is the best AF experience for most subjects, especially at high MP.

I think for me, the biggest pro has to be adapting the entire frame into AF points. It's eradicated the focus and recompile issue that leaves people wondering why they're OOF below F4. Game changer. The acquisition is generally better in my experience, and usually because you're not confined to central points.

The Sports Finder is okay, Fuji has come a long way, even since the X-T2, and it works well with the limited testing I did. Obviously sky you've still got some contrast detect systems that struggle in low light, and others are just below the pay grade of pro cameras. The Nikon Z's struggled at launch for low-light, but they've been given an extra EV rating. Haven't tried the Z6 yet, but getting the Z7 in for work tomorrow, so will see how it handles compared to launch.

Generally, I agree with low-light, though don't think that'll be an issue for long. And in the grand scheme of things, I'd have to give like for like at the top end a mirrorless win for benefits compared to equivalent DSLRs. I know there will be a few A9s at the Olympics for sure.

Next article: "Why Reflex Autofocus Involves Tradeoffs". Front/back-focus, dontcha know.

Mentioned that as part of alignment issues :)

That was actually one of my biggest issues before I switched to mirrorless, since a number of my lenses needed AF calibration.

So why the headline singling out mirrorless as somehow hobbled? Happens a lot around here, and it's annoying.

This article evolved out of a discussion among writers regarding AF assist lights on mirrorless. It's positioned as looking at mirrorless since more photographers will already understand the experience with DSLR AF systems, which can provide a frame of reference.

My issue is with the headline and its singling out of mirrorless as having AF issues. The implication is that mirrorless is somehow more, or even uniquely, compromised. A layman who reads only the headline will conclude that mirrorless is to be avoided.

To Alex Coleman , I have a few basic questions:
1) What is the purpose of AF, that you're looking for ? Are you looking for speed ? Are you looking for accuracy or are you looking for low-light ?
-Answering this would define what you're inherently going to give up.
2) How would you be using this AF for ? I.e. in what condition and environment would u be mainly using AF for ? If you're a landscape photographer, AF pretty much isn't even a main or crucial "thing" for your camera body that you would considered to be important.
3) Have you use a A9 before ?
4) Have you done extensive review between the A9 vs. D5 vs. 1D ?
5) Have you use and done reviews on Panasonic S1R or the Fujifilm GFX100R? These are mirrorless too which uses mirrorless AF as u spoke, but it seems that you haven't thought much about them. They should be just as relevant talking point about ur post title.
6) Z7 is still new, and it's probably too early to judge or generalized all other mirrorless AF inferior to that of traditional DSLRs. Perhaps you're one of the many disgruntled Nikon users? (No offense) Then try switching to others.

Remember, photography is an art, camera and lens are TOOLs. If it's preventing you from creating your art. Then switch it, it's just a tool after all.

In conclusion, technology advancement would nearly always be an improvement over older tech. I.e. driving a stick shift vs. fully automatic vs. paddleshift drivetrain cars. Are there any trade-offs? Certainly. But the gains outweighs them; that overtime it'll be a non-issue.

A fairly complicated article which I only partly understood, but thanks for the explanation.

The main thing that strikes me is the technical differences may or may not be meaningful. The real test is...a real test putting cameras side by side to see how they perform in the real world. What does all this mean in practice?

Hi Rod- I'm happy you found the article useful.

The big two differences I think you'll see in the real world have to do with the AF assist light and the number/spread of AF points. Both of those will be clear even without side by side comparisons.

I'm sure you are aware of this but both of the Olympus OMD EM1 cameras have both phase and contrast autofocus and with the latest firmware both of these cameras autofocus to -6 EV. It is a delight to use, fast, accurate, includes continuous with tracking and continuous during video.

That hybrid process seems like the best approach. I'm seeing it implemented in more mirrorless cameras, to good results.

I noticed that the Canon DPAF was purposely ignored that on the R can AF just fine in -6 EV.
Why was this ignored?

Hi Lawrence- DPAF is on-sensor phase detect, which was the main focus of the article.

In really low light conditions, there are more impactful considerations than the EV spec of the AF system, such as the contrast in the subject. Top cameras can do -4, -5 or -6 EV, but the inability to use IR AF assist lamps is a more significant differentiation.

Why do you and other writers here insist that AF aid lights must be IR? The IR grid lights are visible. Red-eye-reduction and TTL preflashes are plenty distracting. And, at a wedding, the video light is way more distracting than an AF aid light from a mirrorless camera. Setting aside the question of whether IR grids are more effective than visible-light spots, I just don't see a big "distraction" issue with the built-in lights on my mirrorless cameras in my low-light corporate event work.

I'm not insisting that they "must" be IR.

Most assist lamps are primarily IR, while I even mention by name the one that is less skewed towards IR.

A visible light assist lamp faces two issues:
1) for the same AF-apparent brightness as IR, it will be much more visible to people
2) depending on how the on sensor phase detect pixels are setup, they may be under the Bayer array, which will only let particular colors through and therefore require a further brightness increase

Note that there's an asterisk that should be added to the EOS R's -6 EV, in that it's only possible with the 50/1.2. A 2.8 lens will bring that to -3.5 EV. Not sure exactly what the standard F-stop is for measuring AF sensitivity, but it's not 1.2, as not all systems have one of those lenses, nor have they really been considered good at actually AFing (speed and/or accuracy) until maybe the RF one (in accuracy, at least, being mirrorless).

Exactly. More is better, but low light AF involves way too many factors to say that -6 makes the EOS R the best for low light. For some photographers, missing AF assist is way more important. Goes back to the tradeoffs inherent to mirrorless vs DSLR AF :)

Not bad. A few other differences to consider, though:

1. Off-sensor PDAF normally has at least one, and usually several, cross-type sensels, that are either vertical and horizontal, or two diagonals. Some PDAF arrays include single diagonals as well. Mirrorless PDAF implementations pretty much all use only horizontal sensels, which can result in difficulty in acquiring focus on certain types of patterns, like horizontal lines.

2. Mirrorless cameras typically autofocus at taking aperture. This is not a requirement, but it is the way these systems usually work. This can result in less light for focusing in dim conditions, but it has the benefit of avoiding focus shift that can occur when stopping down from wide open to take a shot.

3. In the case of infrared conversions, mirrorless cameras gain a clear advantage over DSLRs. In DSLRs, an infrared converted camera has to be adjusted, normally being matched to a single lens, since IR and visible light focus in different planes. However, for a mirrorless camera, which focuses at the sensor, focusing IR is the same as focusing visible light, and no adjustment is needed.

4. Mirror shock and the need for mirror lockup, and the (admittedly small) amount of time it takes the mirror to flip and return, are all not issues with mirrorless. This is why the Sony A9 is able to achieve higher framerates than the legacy "gold standards" of sports shooting, continuously tracking at 20 FPS, and without intraframe blackout.

Hi Paul. Interesting points.

1) The newest implementations of mirrorless will supplement with a contrast detect step for these subjects.

2) This behavior varies based on camera, making it tough to generalize, but only reiterates the disadvantage in fast moving, low light situations.

3) I haven't shot an IR converted mirrorless, but I can definitely see how that would come in handy. Interesting to think about!

4) Good to point out! Tried to keep this general for mirrorless, as the A9 is in a pretty unique spot, but good to mention.

More comments