Full text
APL Photonics ARTICLE scitation.org/journal/app Single-shot super-resolution quantitative phase imaging allowed by coherence gate shaping Cite as: APL Photon. 8, 046103 (2023); doi: 10.1063/5.0127950 Submitted: 25 September 2022 •Accepted: 10 March 2023 • Published Online: 3 April 2023 Miroslav ˇ Duriˇ s,1,a) Petr Bouchal,1,2 and Radim Chmelík1,2 AFFILIATIONS 1CEITEC–Central European Institute of Technology, Brno University of Technology, Purkyˇ nova 656/123, 61200 Brno, Czech Republic 2Institute of Physical Engineering, Faculty of Mechanical Engineering, Brno University of Technology, Technická 2896/2, 61669 Brno, Czech Republic a)Author to whom correspondence should be addressed: [email protected] ABSTRACT Biomedical and metasurface researchers repeatedly reach for quantitative phase imaging (QPI) as their primary imaging technique due to its high-throughput,label-free,quantitativenature.Sofar,verylittleprogresshasbeenmadetowardachievingsuper-resolutioninQPI.However, thepossiblesuper-resolvingQPIwouldsatisfytheneedforquantitativeobservationofpreviouslyunresolvedbiologicalspecimenfeaturesand allow unprecedented throughputs in the imaging of dielectric metasurfaces. Here we present a method capable of real-time super-resolution QPI, which we achieve by shaping the coherence gate in the holographic microscope with partially coherent illumination. Our approach is based on the fact that the point spread function (PSF) of such a system is a product of the diffraction-limited spot and the coherence-gating function, which is shaped similarly to the superoscillatory hotspot. The product simultaneously produces the PSF with a super-resolution centralpeakandminimizessidelobeeffectscommonlydevaluatingthesuperoscillatoryimaging.Theminimizationofsidelobesandresolution improvement co-occur in the entire field of view. Therefore, for the first time, we achieve a single-shot widefield super-resolution QPI. We demonstratehereresolutionimprovementonsimulatedas wellas experimentaldata.Aphaseresolutiontargetimage showsa resolvingpower improvement of 19%. Finally, we show the practical feasibility by applying the proposed method to the imaging of biological specimens. ©2023 Author(s). All article content, except where otherwise noted, is licensed under a Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). https://doi.org/10.1063/5.0127950 I. INTRODUCTION Far-field fluorescent super-resolution techniques such as stimulated emission depletion,1structured illumination microscopy,2 photoactivated localization microscopy,3and stochastic optical reconstruction microscopy4have become, over recent years, a standard in biomedical imaging. These methods produce images with spatial resolution reaching values way below the diffraction limit of light. The techniques mentioned above exploit sub-diffraction limitedimaging ofnon-linearspecimen responsesachieved by labeling with fluorescent dyes or quantum dots. Artificial labeling is also popular for providing a high degree of specificity. However, several studies have shown that labeling changes the behavior of the studied biological specimen.5,6 Therefore, label-free imaging techniques are a more appropriate choice in many biomedical applications. No need for labeling also allows for studying artificial micro and nanostructures.7,8 Nonetheless, breaking the diffraction limit in label-free imaging techniques is more challenging because of the missing non-linear specimen response.9 Quantitative phase imaging (QPI) has established an irreplaceable role among label-free imaging techniques thanks to its capability to quantitatively measure morphology and intrinsic specimen contrast with nanoscale sensitivity.10 The possible superresolution QPI will satisfy the need for quantitative observation of previously unresolved specimen features and allow increasing the space-bandwidth product (SBP),11 crucial for high-throughput studies. High SBP is important in identifying rare events, for example, in drug discovery,12 cancer-cell biology,13,14 or stem-cell APL Photon. 8, 046103 (2023); doi: 10.1063/5.0127950 8, 046103-1 © Author(s) 2023 Downloaded from http://pubs.aip.org/aip/app/article-pdf/doi/10.1063/5.0127950/16821927/046103_1_5.0127950.pdf
APL Photonics ARTICLE scitation.org/journal/app research.15 The recent development of automated data analysis and classification by artificial intelligence16,17 exaggerates this everincreasing demand for high-resolution quantitative data. So far, the proposed approaches to QPI super-resolution are based on oblique illumination,18,19 structured illumination,20 and speckle illumination,21,22 which, combined with post-processing, provide synthetic images with an effectively enlarged numerical aperture (NA).Thesesyntheticaperturemethodsenhanceresolvingpowerby essentially multiplexing the spatial-frequency content of the object spectrum into an unused degree of freedom in the system, sacrificing acquisition speed, quantitative information accuracy, or a field of view (FOV). Recent advances in superoscillatory hotspot creation23–25 that allowed the development of novel approaches to coherent labelfree super-resolution microscopy could also be adopted for QPI. However,current implementationsof superoscillationsalso sacrifice some of the valuable microscope properties similar to the synthetic aperture methods. Band-limited fields containing superoscillations oscillate locally faster than the highest Fourier component. When carried over to optical imaging, this means that the focal spot can be made much smaller than allowed by the Abbe–Rayleigh limit. This was first investigated in 1952 by di Francia,26 but only recently have these principles been applied to practical microscopy.27,28 A superoscillatory sub-diffraction limited focal hotspot can be produced, for example, by coherently illuminating a specially designed mask of concentric annuli of varying complex transmission and widths.27 The concentric annuli mask design can push the central hotspot radius significantly beyond the diffraction limit, but at the cost of high-intensity sidelobes,27 which degrade the image quality in standard wide-field imaging. An alternative approach to amplitude and phase modulation is the application of light states with spatially structured polarization, such as the focusing of radially and azimuthally polarized Laguerre–Gaussian beams.29,30 The pioneering experimental research utilizing superoscillations initially demonstrated the super-resolution imaging only in a very small FOV27 dictated by the distance of the first high-intensity sidelobe. To remove the FOV constraint, Rogers et al.28 combined confocal detection with superoscillatory illumination. They create the super-resolution image thanks to the coherent illumination pattern with a sub-diffraction limited central hotspot and strong sidelobes. Subsequently, confocal detection eliminates the image distorting sidelobe effects at the cost of scanning the illumination pattern. Despite the great potential for resolution improvement, intensity imaging does not apply to most biological and other weakly scatteringspecimens and lacksquantitative information. Implementation of similar principles in QPI is thus a desirable yet challenging task due to the complexity and susceptibility of interferometric systems. In this paper, we propose a method that does not have to sacrificeanyofthefavorablemicroscopepropertiestoachievesuperresolved QPI. To the best of our knowledge, we show for the first time that partially coherent broad-source interferometers are capableofsingle-shotwidefieldsuper-resolutionimagingbyshaping the so-called coherence gate.31 Our approach is based on the fact that the point spread function (PSF) of the partially coherent system is a product of the shaped coherence-gating function19 (CGF) and the function describing the diffraction-limited image spot (Airy pattern). We shape the CGF by manipulating the illumination in the conjugated source plane similarly to the superoscillatory hotspot creation techniques. The product of the superoscillatory CGF with the Airy spot created by the objective in the object arm minimizes the sidelobes in the unbounded region while the CGF central peak delivers the super-resolving power. The minimization of sidelobes and resolution improvement co-occur in the entire field of view and allow single-shot widefield imaging. The imaging thus resembles confocal detection but with parallel filtration of all image points in the field of view. The images maintain quantitative phase information and extend the potential of superoscillations toward the QPI. We first demonstrate the effects of the superoscillatory CGF using simulated data. Then, due to the highly aberrated pupil plane of our experimental setup, we focus in the experimental part on a limiting case between the superoscillatory and super-resolution CGF. In both situations, the hotspot width is below the Rayleigh criterion. The distinction criterion between the super-resolution functionandthesuperoscillatoryonewasproposedbyHuangetal.24 (we provide more details on the definition of the superoscillatory and super-resolution focal spot in the supplementary material). We create the CGF in this limiting case by using a simple amplitude annular mask, which proves experimentally robust. We demonstrate experimentally QPI resolution enhancement using only the limiting case, but the principle of our method is extendable to the superoscillatory focal spot region, promising higher resolution improvement. An experiment with a phase resolution target shows a resolving power improvement of 19%, and we show practical feasibility by applying the proposed method to the imaging of biological specimens. II. OPTICAL SETUP DESCRIPTION The proposed principles generally apply to various partially coherent interferometric systems. Without loss of generality, we will further describe the optical setup and theoretical framework of the used coherence-controlled holographic microscope32 (CCHM), commercially available as the Telight Q-Phase. The optical setup (see Fig. 1) is an adaptation of the Mach–Zehnder interferometer. It consists of an object and reference arm containing two optically equivalent microscope systems. This holographic setup guarantees off-axis hologram formation in the interference plane (IP) for broad sources of an arbitrary degree of coherence. The possibility of using FIG. 1. Optical setup of the coherence-controlled holographic microscope: S, light source; IF, interference filter; L, relay lens; BS, beam splitters; M, mirrors; Mm, movable mirrors; C, condensers; O, objective lenses; TL, tube lenses; DG, diffraction grating; OL, output lenses; IP, interference plane. APL Photon. 8, 046103 (2023); doi: 10.1063/5.0127950 8, 046103-2 © Author(s) 2023 Downloaded from http://pubs.aip.org/aip/app/article-pdf/doi/10.1063/5.0127950/16821927/046103_1_5.0127950.pdf
APL Photonics ARTICLE scitation.org/journal/app partially coherent sources is provided by the diffraction grating (DG; transmission phase grating with groove frequency 150 mm−1, blazed at 760 nm for the first diffraction order) implemented in the reference arm according to principles proposed by Leith and Upatnieks.33 In our system, an LED (LED Engin LZ4-00R208, peak wavelength at 660 nm, power up to 2.9 W) is used for illumination to provide a spatially broad incoherent source, and the illuminating lightismadequasi-monochromaticafterpassingtheinterferencefilter (IF) with a central wavelength of 660 and 10 nm full width at half maximum. The source is imaged by a pair of achromatic doublets (simplified as L in Fig. 1; focal lengths 63.5 and 350 mm) through a beam splitter (BS) to the front focal planes of the condensers (C;NikonLWDcondenser lenses, 0.52 NA, with adjustable aperture stop). This plane in object and reference arms and respective condenser properties can be described according to Ref. 34 by the pupil functions PCo(Kt)and PCr(Kt), respectively, where Kt=(Kx,Ky)is the transverse wave vector of a plane wave behind condensers. The coordinates of Ktare proportional to the respective source point (pupil-plane) coordinates. For this reason, pupil properties can be characterized by a function of Kt. We use reduced wave vector notation ∣K∣=1/λ, where λis the wavelength of light, and K=(Kt,Kz) =(Kx,Ky,Kz), where Kz=√∣K∣2−∣Kt∣2. We modulate the condenserpupilplanes toproducethe sub-diffractionlimitedcoherence gate, as explained in Sec. III. The fundamental image properties also depend on the parameters of the object and reference arm objective lenses (O; Nikon Plan Fluorite Objectives, 10x/0.3 NA/16 mm WD) in combination with tube lenses (TL; Nikon, focal length 200 mm), characterized by the pupil functions POo(Kt)and POr(Kt). Stepper and piezo motors provide fine adjustment of the microscope optical components, which we use for the measurement of the coherencegating function. The holograms are recorded in IP using an Andor Zyla 4.2 sCMOS camera. As shown in Fig. 1, we place the phase or amplitude mask in one or both of the front focal planes of the condensers. We designed the masks to shape the CGF when imaging with 10x/0.3 NA objective lenses. In simulations, we assume the phase mask is composedofconcentric annuli, with thephaseshiftbeing either 0 or πradians. We also carried out simulations with the amplitude mask subsequently used in experiments. The amplitude mask is a single annulus cut by a laser cutter into a metal sheet. An inner circle of the annulus has a diameter of 16.4 mm. The outer circle diameter is about 18 mm, but more importantly, the pupil diameter in the front focal plane of the condensers is limited by the aperture stop to ∼17.3 mm (corresponding to 0.30 condenser NA). III. THEORY Quantitative phase information can be extracted from the measured holograms. As we work with the off-axis holographic setup, we reconstruct holograms by carrier removal in the Fourier plane.32 In partially coherent systems, the hologram cross-correlation term depends on the transversal displacement Δq=(Δx,Δy)and relative time-delay τof the object-scattered and reference fields. The cross-correlation function is conveniently described by a mutual coherence function31 (MCF) Γ(q,q−Δq,τ)of the two fields, where q=(x,y)isthepositionofapointintheimageplanespecifiedbythe coordinatesoftheopticallyconjugated pointintheobjectplane. The modulusand phaseimage forparticularΔqand τareobtained asthe modulus and argument of Γ, respectively. The interferometric imaging for a given time-delay τand transverse displacement Δqcan be called a partial MCF measurement.31 The complete MCF is acquired bymeasuringandreconstructinghologramsforallaccessibleΔqand τ. In this work, we use in experiments quasi-monochromatic illumination. Therefore, the influence of temporal coherence is minimal and manifests mainly as a speckle noise reduction. We set τ=0 at the beginning of each experiment. The standard imaging conditions in low-coherence interferometers are when Δq=(0,0). We use this setting for the majority of our experiments. However, as we show further, the complete MCF measurement and hence the manipulation with Δqis crucial for a measurement of the coherence-gating function. Our further analysis will stay within the limits of scalar wave approximation. More detailed mathematical derivations of the following equations are provided in the supplementary material. If we assume complete spatial source incoherence, τ=0, and Δqas a parameter, the expression for the measured MCF, has according to Ref. 19, the form Γ(q;Δq)=t(q)⊗h(q;Δq),(1) where t(q)is a complex transmission of the specimen, the symbol ⊗ denotes convolution, and h(q;Δq)=po(q)G∗(q−Δq)is a PSF of the imaging system, where po(q)=∬POo(Kt)exp(2πiKt⋅q)d2Kt and G(q)=∬P∗ Co(Kt)PCr(Kt)POr(Kt)exp(2πiKt⋅q)d2Kt. (2) We call function G(q)the coherence-gating function19,31 (CGF). The integration regions in po(q)and G(q)are given by the extent ofthe pupil functions POo(Kt)andP∗ Co(Kt)PCr(Kt)POr(Kt), respectively. These boundaries define the band-limit of po(q)and G(q). The CGF provides filtering of multiply scattered light when imaging through turbid media.31,32 Here we do not intend to use the coherence gate to mitigate unwanted scattering effects, but we unconventionally shape the coherence gate to obtain sub-diffraction limited PSF.Forcircularapertures,wecandescribetheCGFG(q)andpo(q) using the Bessel function of the first kind as G(q)=2J1(μ)/(μ) andpo(q)=2J1(ν)/(ν), where μ=2πKNAC∣q∣andν=2πKNAO∣q∣, with NAC≤NAO. To obtain the sub-diffraction limited resolution of QPI arg{Γ[q;Δq=(0,0)]}, systems’s PSF h(q)=po(q)G∗(q)must have the central peak radius below the diffraction limit. To maintain quantitative phase information in the image, the sidelobes of the PSF must also be negligible. Numerous studies24,26,27,35 have shown that a superoscillatory focal spot can be created by coherently illuminating a phase or amplitude mask composed of concentric annuli of different widths and complex transmission. Superoscillations are then formed by constructive and destructive interference near the focal spot. As we use partially coherent illumination in our microscope system, it is not possible to create the superoscillatory focal spot observable in the field’s intensity by interference as proposed for coherent light. However, we can adopt the principles normally applied to coherent systems and shape the system’s PSF, the product of G∗(q−Δq)and po(q), by altering one or both of these functions. By modulating the pupil function POo(Kt)of APL Photon. 8, 046103 (2023); doi: 10.1063/5.0127950 8, 046103-3 © Author(s) 2023 Downloaded from http://pubs.aip.org/aip/app/article-pdf/doi/10.1063/5.0127950/16821927/046103_1_5.0127950.pdf
APL Photonics ARTICLE scitation.org/journal/app the object-arm objective, we can affect po(q), but as Eq. (2) suggests, we have more options for G(q), because this function can be shapedbymodulatingoneormorepupilfunctionsPCo(Kt),PCr(Kt) and POr(Kt)of the condensers and the reference-arm objective, respectively. It is also experimentally easier to modulate the condenser pupil planes. Therefore, we will focus on shaping the CGF. However, similar results can be achieved by shaping po(q), or both at the same time. Equation (2) describing CGF formation shows that G(q)can be shaped similarly to coherent imaging even though the plane waves exp(2πiKt⋅q)superposed in Eq. (2) are mutually incoherent. The P∗ Co(Kt)PCr(Kt)POr(Kt)dictates whether these plane waves are constructively or destructively superposed. This allows us to use approaches designed for coherent imaging even in a system operating with partially coherent light. The expression in Eq. (2) is in fact van Cittert–Zernike theorem,36 which describes the relationship between the mutual coherence function (CGFin our case)andthe modulation ofthepupil plane forpartially coherent broad source illumination. As we can control the constructivenessoftheplanewavesuperposition,theoretically,itshould be possible to create observable superoscillations in partially coherent systems. However, not in the field’s intensity but in the mutual coherence of two fields (in our case, the CGF), hence the need for the interferometric system. For demonstration, we simulate the imaging and calculate the PSFs for three cases with different CGF shapes: first, the diffraction-limited case, when a full unmodulated condenser aperture is assumed; second, the limiting case of the superoscillation, when the amplitude mask with narrow annulus is used and the CGF is represented by the Bessel function J0(2πKNAC∣q∣); and third, the case with a superoscillatory CGF produced by three-zone phase modulation. For all three cases, we assume that the po(q)function is the Airy pattern for NAO=NAC=0.30, and this function is represented in Figs. 2(a)–2(c) by yellow dashed curves. The CGF G(q)for the diffraction limited case is also the Airy pattern [see the red dashed curve in Fig. 2(a)]. The CCHM PSF [the product of po(q)and G(q)] is in Figs. 2(a)–2(c) depicted by solid purple curves. The CGF described by J0(2πKNAC∣q∣), shown in Fig. 2(b), can be produced in the Köhler arrangement by an annular incoherent source with an infinitesimally narrow annulus and a radius correspondingtothe condensernumericalaperture NAC.Ourphase modulation approach [Fig. 2(c)] to the creation of superoscillatory CGF is inspired by the results from Ref. 35. We assume modulation of PCr(Kt)by concentric annuli with phase modulation being either 0 or π. We have found by a few adjustments and visual evaluation that a superoscillatory CGF can be created by a three-zone annular modulationproducedinthefollowingmanner:twocircleswithradii corresponding to 0.35NACand 0.72NACdefine the geometry of the three zones, while the phase modulation is 0 for the inner-most and outer-most zones, and the middle annulus has the phase shift of π radians. The full width at half maximum of the central peak and the first zero value of the PSF define the system’s resolving power. The three-zone phase modulation and annular amplitude modulation (annular source) of the pupil function PCr(Kt)produce the CGF with the sub-diffraction limited central peak at the cost of stronger sidelobes [see the red dashed curves in Figs. 2(b) and 2(c)]. It is important to note that even though these functions themselves are superoscillatory, if the PSF with such strong sidelobes is used directly for imaging, it produces unwanted image artifacts that corrupt the improved resolving power.37 However, as we demonstrate, thepartiallycoherentsystemsprovidean elegantwayto suppressthe sidelobe effects. The Airy spot created by the objective in the object arm has a broadcentralpeakwithweaksidelobes.Asshowninthissection,the PSF of the system (the solid purple curves in Fig. 2) is the product of theCGFandtheAiry pattern. In both annular source [Fig. 2(b)] and phase-modulated [Fig. 2(b)] condenser pupil cases, the CGF central peak dictates the sub-diffraction limited properties of the focal spot, and sidelobes are attenuated by weak sidelobes of the Airy pattern distribution. Therefore, these approaches should provide subdiffraction limited powers and deliver single-shot super-resolution images. We performed imaging simulations comparing three cases corresponding to Figs. 2(a)–2(c) to evaluate the phase imaging performance. We simulated the phase resolution target imaging as a coherent convolution of its complex transmission function by the calculated PSFs, and the simulated phase images are shown in Figs. 3(a)–3(c). The insets in Figs. 3(b) and 3(c) show the potential experimental design of the masks producing the simulated modulation corresponding to Figs. 2(b) and 2(c). The smallest resolved element in the diffraction-limited case is element 5 from group −2. In the superoscillatory case [Fig. 3(c)], the smallest resolved element is number 1 from group −1, and for the annular pupil [Fig. 3(b)], thiselement canbe consideredresolvedwithverypoor contrast.The cross-sectionsof the featuresofelement 6fromgroup −2inFig.3(d) show that this element is not resolved in a diffraction-limited image but well resolved in both the annular pupil and superoscillatory cases. However, the superoscillatory PSF produces an image with significantly better contrast. The feature width of element 1 from FIG. 2. The point spread function (PSF) is the product of the coherence-gating function (CGF) and the Airy pattern. (a) The standard imaging condition with a full aperture condenser. (b) An annular pupil condenser produces sub-diffraction limited CGF. (c) Phase modulated pupil plane delivers superoscillatory CGF and super-resolution PSF. APL Photon. 8, 046103 (2023); doi: 10.1063/5.0127950 8, 046103-4 © Author(s) 2023 Downloaded from http://pubs.aip.org/aip/app/article-pdf/doi/10.1063/5.0127950/16821927/046103_1_5.0127950.pdf
APL Photonics ARTICLE scitation.org/journal/app FIG. 3. Numerical simulations of phase resolution target imaging show that the superoscillatory coherence-gating function (CGF) created by phase modulation provides higher resolving powers, but amplitude modulation is more robust in experimental situations. (a) Diffraction-limited quantitative phase image (QPI) of the phase resolution target computed for the full aperture condenser pupil. (b) QPI of the resolution target for amplitude-modulated condenser pupil plane. (c) QPI of the resolution target corresponding to the case of superoscillatory CGF created by phase modulation. (d) and (e) Profiles of cross-sections through element 6 of group −2 and element 1 of group −1, respectively. More details about our simulations can be found in the supplementary material. group −1 is ∼20% lower than the feature width of element 5 from group −2. We can conclude that the resolution improvement is slightly less than 20% because the lines of element 1 from group −1 have very poor contrast. As can be seen by comparing Figs. 3(b) and 3(c) and the cross-sections in Fig. 3(e), the contrast is better in the superoscillatory case. We expected the resolution for the case with superoscillatory CGF to be better because the annular pupil produces the limiting case CGF between superoscillatory and subdiffraction limited ones. Even though we achieve higher resolving power with superoscillatory CGF, the overall image quality of the superoscillatory case is lower due to incomplete sidelobe attenuation. It is important to note that, for simplicity of demonstration, we have not used any sophisticated methods to optimize the condenser pupil function. Generation of superoscillatory hotspots with state-of-the-art parameters usually employs iterative and computationally expensive procedures such as particle swarm,27 genetic algorithm,38 orphaseretrieval39 optimizations.Weexpect toachieve higher resolution improvement and better phase image quality by employing one of these methods. Additionally to spot size, the superoscillatory focal spot design always involves optimizing the ratio of the central peak and the sidelobe intensities.29 Without taking this into account, practical applicationsofsuperoscillatoryfocusingforimagingarenotpossible due to the poor signal-to-noise ratio. A similar principle applies also to optimizing the parameters of the CGF. To reconstruct QPI from holograms with reasonable phase quality, the hologram contrast must be higher than the noise levels. When phase modulation of the pupil planes is used, the amplitude of the CGF is redistributed from the central peak to the sidelobes due to the destructive interference of light from the object and reference arm. The hologram contrast is proportional to the central peak amplitude of the PSF h(q). Therefore, one must consider the achievable hologram contrast when designing the superoscillatory CGF. We have discovered that for the combination of high-quality phase and highest resolution improvement, it is important to optimize the whole product of po(q)and G(q), not only CGF G(q). Consequently, the objective function for an optimization procedure must be defined differently than for a standard intensity imaging system. One can easily deduce that the optimal solutions found for fluorescence and confocal microscopy do not apply to the proposed case. Thecreation ofthe superoscillatoryCGF requiresaveryprecise design of the phase modulation of PCr(Kt). This is easily achieved in simulations when unaberrated pupils are assumed. However, we have to account for aberrations in real experimental systems and compensate for them while also providing the modulation for CGF shaping. Aberrations can be perceived in the context of the theory outlined in this section as modulations of pupil functions PCo(Kt), PCr(Kt), and POr(Kt)in Eq. (2). As the creation of superoscillations is very susceptible to even subtle deviations from the designed phase shift provided by the phase mask, the aberrations prevent us from using simple symmetric phase masks in real systems. Due to the difficulty of measuring and compensating for aberration in our system, we chose to utilize the amplitude mask in experiments instead of the phase mask. As Fig. 3 shows, the effect of the modulation by the mask can beassessed indirectlyfrom thesystem’simagingperformance.However, we can directly measure the shape of the CGF. When no specimen is present in the object arm, and we assume that the objective APL Photon. 8, 046103 (2023); doi: 10.1063/5.0127950 8, 046103-5 © Author(s) 2023 Downloaded from http://pubs.aip.org/aip/app/article-pdf/doi/10.1063/5.0127950/16821927/046103_1_5.0127950.pdf
APL Photonics ARTICLE scitation.org/journal/app lens in the object arm has negligible aberrations, then we get from Eq. (1) the following expression: ΓB(Δq)=G∗(Δq).(3) This equation shows that the complete MCF measurement ΓB(Δq)with no objects present in both arms provides us with information about the CGF as a function of Δq. Therefore, we will use the measurement described by Eq. (3) to directly evaluate the CGF shape created by the designed mask. IV. EXPERIMENTAL RESULTS We experimentally demonstrate the feasibility of the principles proposed in Sec. III utilizing the optical setup with 10x/NAO=0.30 objectives and the condenser aperture set to NAC=0.30. Our initial efforts to take advantage of the phase modulation provided by simple phase masks similar to the one in the inset of Fig. 3(c) have shown that aberrations in our system prevent the CGF from being shaped as designed. However, amplitude modulation by an annular mask [shown in Fig. 3(b) and the design parameters in Sec. II] has proven relatively robust to the aberrated pupils. Therefore, we used it in the presented experiments. We placed two identical amplitude masks into the reference and object arms to balance the light powers in the arms in order to achieve a better contrast of holographic fringes. The total power fraction that is transmitted to the specimen throughthemaskcanbecalculatedasaratioofthetransparentmask area to the full aperture area. As stated in Sec. II, the diameter of the inner circle of the amplitude annulus is 16.4 mm, and the effective condenser aperture diameter in the front focal plane of the condenseris 17.3mm.Therefore, theratio ofthelight transmittedtothe light incident on the mask is ∼0.1. Even though 90% light loss seems significant, our LED source is powerful enough to compensate for that. In experiments with the amplitude mask, we operated the source at about 10% of its maximum power, while the camera exposure times did not exceed tens of milliseconds. First, we evaluate whether the amplitude modulation provides uswithaCGFresemblingthedesignedshapeofJ0(2πKNAC∣q∣).We measured the complete MCF for a case with [Fig. 4(b)] and without [Fig. 4(a)] the mask placed in the front focal plane of condensers, i.e., for annular and full aperture. We measured the complete MCF by acquiring and reconstructing a hologram for each reference arm objective position from a predefined grid. The grid of Δqpositions for each CGF measurement was the same, and we used a 41 ×41 grid centered at Δq=0 with a 0.3 μm spacing. We display in Fig. 4 the normalized modulus of the MCF for a FOV point q=(0,0)μm. Comparing the measured CGF in Figs. 4(a) and 4(b) with the corresponding simulated CGF in Figs. 4(c) and 4(d), we see the effects of the aberrated pupils (mainly due to the off-axis holographic setup). The measurement with full condenser apertures in Fig. 4(a) shows clear signs of a primary coma aberration. We can conclude that the annular aperture is not very susceptible to aberrations, as there is a notable agreement between the measured [Fig. 4(b)] and simulated [Fig. 4(d)] CGF profiles. We have fitted the Airy function to the measured CGF amplitude, shown in Fig. 4(a), with significantlybettersampling thanthemeasured data.Then,we determined the full width at half maximum (FWHM) of the central peak to be 1.60 μm. Similarly, we fitted the data obtained for the case with FIG. 4. Comparison of the measured and simulated coherence-gating function (CGF) shows the effects of optical aberrations in the experimental setup on CGF. (a) Measured CGF for full condenser aperture. (b) Measured sub-diffraction limited CGF for annular condenser aperture. (c) Simulated CGF for full condenser aperture. (d) Simulated CGF for annular condenser aperture. the annular aperture, shown in Fig. 4(b), with the J0function and determined the FWHM to be 1.08 μm. The measurement in Fig. 4(b) and the FWHM values show that the CGF created by the amplitude mask has a central peak narrower than the one of the Airy pattern. Therefore, the CGF is, in this sense, sub-diffraction limited. The complete measurement of the MCF, as shown in Fig. 4, can be used to assess the optical system aberrations. This indicates that we could design and manufacture a phase mask that would simultaneously compensate for aberrations and provide the modulation needed for superoscillatory CGF. However, we decided to postpone these efforts for follow-up work as the current experimental setup limits the practical feasibility of this approach. To obtain FIG. 5. Comparison of (a) the diffraction-limited image (obtained with the full aperture condenser) and (b) the super-resolution image (obtained with the annular mask) of the phase resolution target. APL Photon. 8, 046103 (2023); doi: 10.1063/5.0127950 8, 046103-6 © Author(s) 2023 Downloaded from http://pubs.aip.org/aip/app/article-pdf/doi/10.1063/5.0127950/16821927/046103_1_5.0127950.pdf
APL Photonics ARTICLE scitation.org/journal/app FIG.6. Results of theproposedmethodforimaging rat embryo fibroblasts. (a)FullFOVsuper-resolution QPI obtained with sub-diffractionlimited CGF.(b)Asection[marked by the yellow dashed line in (a)] of the diffraction-limited image. (c) A section [the same as in (b)] of the super-resolution image. (d)A section [marked by the red dashed line in (a)] of the diffraction-limited image. (e) A section [the same as in (d)] of the super-resolution image. the superoscillatory response provided by a specifically manufactured asymmetric mask, one must place it precisely in the correct position. Several degrees of freedom (parameters) must be set to optimize the phase mask position: axial, x-y transversal, and two angularpositions.Forthis,wewouldneedautomaticalignmentwith a feedback loop. The amplitude mask is easier to align as we can partially see its effect in the intensity image formed by light from a single microscope arm. However, the phase mask effect is not visible in the intensity image. We can take advantage of the complete MCF measurement described by Eq. (3) to assess the phase mask effect and its position. Unfortunately, this measurement in the current setup takes tens of minutes. Therefore, it is currently unsuitable for implementing it into a necessary automatic alignment procedure with a feedback loop. We imaged a phase resolution target with both the full and annular condenser apertures to assess the improvement in the resolving power. The full (unmodulated) aperture phase image in Fig. 5(a) represents the diffraction-limited image. The phase image in Fig. 5(b) is obtained using the amplitude mask, which we refer to as a super-resolution image. The insets in both images show details of the smallest resolved features in each image. A visual comparison of Fig. 5(a) with Fig. 5(b) shows a clear resolution improvement. The smallest resolvable features in the diffractionlimited image [Fig. 5(a)] marked by the number 20 are 0.65 μm wide. This means the resolution with the full aperture is ∼1.3 μm. Whereas the smallest resolvable features in the super-resolution image[Fig.5(b)]aremarkedbythenumber22andare0.53μmwide. The improvement of the spatial resolution to about 1.06 μm is a gain of ∼19%. Next, we show the performance of our method when used to image complex specimens such as rat embryo fibroblasts in Fig. 6. The presented experiment involved LW13K2 cells from a cell line of spontaneously transformed rat embryo fibroblasts LW13 of the inbred strain Lewis. Cells were cultivated at 37○C in a humidified incubator with 3.5% CO2in standard Minimum Essential Medium Eagle with Hanks’ salts supplemented with 10% fetal bovine serum, 20 μM gentamicin, and 2 mM L-glutamine. Subsequently, the cells were fixed using 4% formaldehyde in phosphate-buffered saline for 20 min, then washed and incubated in phosphate-buffered saline. Again,we imagedthe specimenwith andwithout theannular amplitude masks in the front focal condenser planes. The QPI in Fig. 6(a) experiences super-resolution throughout the entire FOV and can be obtained from a single hologram measurement. Having a large FOV and sufficient resolution for cell segmentation or even observation of intracellular processes is crucial when monitoring, for example, the motility of live cancer cells.40 Comparing the sections of diffraction-limited [Figs. 6(b) and 6(d)] and super-resolution [Figs. 6(c) and 6(e)] images, we see that our method provides the improved resolution required in many applications in addition to the large FOV. V. CONCLUSION In this paper, we have presented a method for single-shot labelfree super-resolution QPI in holographic microscopes with partially coherent illumination. Our solution to overcoming the diffraction limitis straightforwardtoimplement becauseit doesnotrequire any changes to the microscope’s optical system. The proposed method relies on the intrinsic partially coherent illumination properties giving rise to the coherence-gating. We propose that by introducing a phase or amplitude modulation of the planes conjugated with the light source, e.g., the front focal plane of the condenser, we can generate sub-diffraction limited CGF. We demonstrate for the first time theoretically and in numerical simulations a superoscillatory CGF shaped by phase and amplitude modulation. Due to experimental challenges, we chose to experimentally show the proposed principles using modulation provided by an amplitude mask, which has APL Photon. 8, 046103 (2023); doi: 10.1063/5.0127950 8, 046103-7 © Author(s) 2023 Downloaded from http://pubs.aip.org/aip/app/article-pdf/doi/10.1063/5.0127950/16821927/046103_1_5.0127950.pdf
APL Photonics ARTICLE scitation.org/journal/app proven more robust to optical aberrations than phase masks. We demonstrated almost 20% resolving power improvement in phase imaging of the model specimen and complex objects such as cancer cells. However, the theoretical spatial resolution improvement is not in principle limited, and we expect to obtain significantly over 20% resolution gain with more sophisticated modulation techniques. For example, a spatial light modulator can be introduced into the opticalsetuptoprovidesimultaneouscompensationofpupilaberrations and the modulation needed to create the superoscillatory CGF. We envision our method delivering an easily implementable super-resolution QPI, particularly suitable for high-throughput biomedical applications. Further extension of the CGF shaping theorybeyondthe limitsofthescalarapproximationwillallowreaching an unprecedented spatial resolution of QPI. The possibility to monitor a large FOV in real-time with spatial super-resolution and very highquantitativeinformationqualitycansignificantlyimpactcancer research,14,41 aspreviouslyunseenintracellularprocessescannowbe observed. Furthermore, our work satisfies the need for time-series high-quality datasets required for rapidly developing automated analysis using artificial intelligence.16,42 SUPPLEMENTARY MATERIAL See the supplementary material for a detailed derivation of the equations in Sec. III, a definition of the superoscillatory and superresolution focal spot that is assumed throughout this article, and additional information about simulations producing some of the presented data. ACKNOWLEDGMENTS The work was supported by the Grant Agency of the Czech Republic(Grant No.21-01953S),the specificresearchgrants ofBrno University of Technology (Grant Nos. FSI-S-20-6353 and FSI-S23-8389), and the MEYS CR (Large RI Project No. LM2023050 Czech-BioImaging). We thank Veronika J˚ uzová for help in the preparation of biological samples. AUTHOR DECLARATIONS Conflict of Interest R.C.isa co-author of patentscoveringQ-Phase (EA 018804 B1, US8526003B2,JP5510676B2,CN102279555A,EP2378244B1,and CZ302491) and a recipient of related royalties from Telight. Author Contributions Miroslav ˇ Duriˇ s: Conceptualization (equal); Data curation (lead); Formal analysis (lead); Investigation (lead); Methodology (equal); Software (lead); Visualization (lead); Writing – original draft (lead); Writing – review & editing (equal). Petr Bouchal: Conceptualization (equal); Funding acquisition (equal); Investigation (equal); Methodology (equal); Supervision (equal); Validation (equal); Writing – review & editing (equal). Radim Chmelík: Conceptualization (equal); Formal analysis (equal); Funding acquisition (equal); Project administration (equal); Resources (equal); Supervision (equal); Writing – review & editing (equal). DATA AVAILABILITY The data that support the findings of this study are available from the corresponding author upon reasonable request. REFERENCES 1S. W. Hell and J. Wichmann, “Breaking the diffraction resolution limit by stimulated emission: Stimulated-emission-depletion fluorescence microscopy,” Opt. Lett. 19(11), 780–782 (1994). 2R. Heintzmann and T. Huser, “Super-resolution structured illumination microscopy,” Chem. Rev. 117(23), 13890–13908 (2017). 3S. Manley, J. M. Gillette, G. H. Patterson, H. Shroff, H. F. Hess, E. Betzig, and J. Lippincott-Schwartz, “High-density mapping of single-molecule trajectories withphotoactivatedlocalizationmicroscopy,”Nat.Methods 5(2),155–157(2008). 4M. J. Rust, M. Bates, and X. Zhuang, “Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM),” Nat. Methods 3(10), 793–796 (2006). 5U. Schnell, F. Dijk, K. A. Sjollema, and B. N. G. Giepmans, “Immunolabeling artifacts and the need for live-cell imaging,” Nat. Methods 9(2), 152–158 (2012). 6Z. Xiaoling, L. Yuchi, Z. Meirong, N. Xiaobing, and H. Yinguo, “Calibration of a fringe projection profilometry system using virtual phase calibrating model planes,” J. Opt. A: Pure Appl. Opt. 7(4), 192–197 (2005). 7P. Bouchal, P. Dvoˇ rák, J. Babocký, Z. Bouchal, F. Ligmajer, M. Hrtoˇ n, V. Kˇ rápek, A. Faßbender, S. Linden, R. Chmelík, and T. Šikola, “High-resolution quantitative phase imaging of plasmonic metasurfaces with sensitivity down to a single nanoantenna,” Nano Lett. 19(2), 1242–1250 (2019). 8T. Fordey, P. Bouchal, P. Schovánek, M. Baránek, Z. Bouchal, P. Dvoˇ rák, M. Hrtoˇ n, K. Rovenská, F. Ligmajer, R. Chmelík, and T. Šikola, “Single-shot three-dimensional orientation imaging of nanorods using spin to orbital angular momentum conversion,” Nano Lett. 21(17), 7244–7251 (2021). 9K. Wicker and R. Heintzmann, “Resolving a misconception about structured illumination,” Nat. Photonics 8(5), 342–344 (2014). 10Y. Park, C. Depeursinge, and G. Popescu, “Quantitative phase imaging in biomedicine,” Nat. Photonics 12(10), 578–589 (2018). 11A. W. Lohmann, R. G. Dorsch, D. Mendlovic, C. Ferreira, and Z. Zalevsky, “Space–bandwidth product of optical signals and systems,” J. Opt. Soc. Am. A 13(3), 470 (1996). 12P. Lang, K. Yeow, A. Nichols, and A. Scheer, “Cellular imaging in drug discovery,” Nat. Rev. Drug Discovery 5(4), 343–356 (2006). 13B. Gál, M. Veselý, J. ˇ Colláková, M. Nekulová, V. J˚ uzová, R. Chmelík, and P. Veselý, “Distinctive behaviour of live biopsy-derived carcinoma cells unveiled using coherence-controlled holographic microscopy,” PLoS One 12(8), e0183399 (2017). 14O. Tolde, A. Gandaloviˇ cová, A. Kˇ ríˇ zová, P. Veselý, R. Chmelík, D. Rosel, and J. Brábek, “Quantitative phase imaging unravels new insight into dynamics of mesenchymal and amoeboid cancer cell invasion,” Sci. Rep. 8(1), 012020 (2018). 15M. R. Costa, F. Ortega, M. S. Brill, R. Beckervordersandforth, C. Petrone, T. Schroeder, M. Götz, and B. Berninger, “Continuous live imaging of adult neural stem cell division and lineage progression in vitro,” Development 138(6), 1057–1068 (2011). 16L. Strbkova, D. Zicha, P. Vesely, and R. Chmelik, “Automated classification of cell morphology by coherence-controlled holographic microscopy,” J. Biomed. Opt. 22(8), 1–9 (2017). 17Y. Jo, H. Cho, S. Y. Lee, G. Choi, G. Kim, H.-s. Min, and Y. Park, “Quantitative phase imaging and artificial intelligence: A review,” IEEE J. Sel. Top. Quantum Electron. 25(1), 1–14 (2019). APL Photon. 8, 046103 (2023); doi: 10.1063/5.0127950 8, 046103-8 © Author(s) 2023 Downloaded from http://pubs.aip.org/aip/app/article-pdf/doi/10.1063/5.0127950/16821927/046103_1_5.0127950.pdf
APL Photonics ARTICLE scitation.org/journal/app 18V. Micó, Z. Zalevsky, C. Ferreira, and J. García, “Superresolution digital holographic microscopy for three-dimensional samples,” Opt. Express 16(23), 19260–19270 (2008). 19M. ˇ Duriˇ s, P. Bouchal, K. Rovenská, and R. Chmelík, “Coherence-encoded synthetic aperture for super-resolution quantitative phase imaging,” APL Photonics 7(4), 046105 (2022). 20S. Chowdhury, W. J. Eldridge, A. Wax, and J. A. Izatt, “Structured illumination multimodal 3D-resolved quantitative phase and fluorescence sub-diffraction microscopy,” Biomed. Opt. Express 8(5), 2496–2518 (2017). 21Y. Park, W. Choi, Z. Yaqoob, R. Dasari, K. Badizadegan, and M. S. Feld, “Speckle-fielddigitalholographic microscopy,” Opt. Express 17(15),12285–12292 (2009). 22Y. Baek, K. Lee, and Y. Park, “High-resolution holographic microscopy exploiting speckle-correlation scattering matrix,” Phys. Rev. Appl. 10(2), 024053 (2018). 23F. M. Huang and N. I. Zheludev, “Super-resolution without evanescent waves,” Nano Lett. 9(3), 1249–1254 (2009). 24K. Huang, H. Ye, J. Teng, S. P. Yeo, B. Luk’yanchuk, and C.-W. Qiu, “Optimization-freesuperoscillatory lens using phase and amplitude masks,”Laser Photonics Rev. 8(1), 152–157 (2014). 25G. Chen, Z.-Q. Wen, and C.-W. Qiu, “Superoscillation: From physics to optical applications,” Light: Sci. Appl. 8(1), 56 (2019). 26G. T. di Francia, “Super-gain antennas and optical resolving power,” Il Nuovo Cimento 9(3), 426–438 (1952). 27E. T. F. Rogers, J. Lindberg, T. Roy, S. Savo, J. E. Chad, M. R. Dennis, and N. I. Zheludev, “A super-oscillatory lens optical microscope for subwavelength imaging,” Nat. Mater. 11(5), 432–435 (2012). 28E. T. F. Rogers, S. Quraishe, K. S. Rogers, T. A. Newman, P. J. S. Smith, and N. I. Zheludev, “Far-field unlabeled super-resolution imaging with superoscillatory illumination,” APL Photonics 5(6), 066107 (2020). 29Y. Kozawa, D. Matsunaga, and S. Sato, “Superresolution imaging via superoscillation focusing of a radially polarized beam,” Optica 5(2), 86–92 (2018). 30X. Liu, W. Yan, Z. Nie, Y. Liang, Y. Wang, Z. Jiang, Y. Song, and X. Zhang, “Longitudinal magnetization superoscillation enabled by high-order azimuthally polarized Laguerre-Gaussian vortex modes,” Opt. Express 29(16), 26137–26149 (2021). 31M. ˇ Duriˇ s and R. Chmelík, “Coherence gate manipulation for enhanced imaging through scattering media by non-ballistic light in partially coherent interferometric systems,” Opt. Lett. 46(18), 4486–4489 (2021). 32T. Slabý, P. Kolman, Z. Dostál, M. Antoˇ s, M. Loˇ st’ák, and R. Chmelík, “Off-axis setup taking full advantage of incoherent illumination in coherence-controlled holographic microscope,” Opt. Express 21(12), 14747–14762 (2013). 33E. N. Leith and J. Upatnieks, “Holography with achromatic-fringe systems,” J. Opt. Soc. Am. 57(8), 975 (1967). 34R. Chmelik, M. Slaba, V. Kollarova, T. Slaby, M. Lostak, J. Collakova, and Z. Dostal, “The role of coherence in image formation in holographic microscopy,” Prog. Opt. 59, 267–335 (2014). 35N. Reza and L. Hazra, “Toraldo filters with concentric unequal annuli of fixed phase by evolutionary programming,” J. Opt. Soc. Am. A 30(2), 189–195 (2013). 36L. Mandel and E. Wolf, Optical Coherence and Quantum Optics (Cambridge University Press, 1995). 37C.SnoeyinkandS.Wereley,“Single-imagefar-fieldsubdiffractionlimitimaging with axicon,” Opt. Lett. 38(5), 625–627 (2013). 38K. S. Rogers, K. N. Bourdakos, G. H. Yuan, S. Mahajan, and E. T. F. Rogers, “Optimising superoscillatory spots for far-field super-resolution imaging,” Opt. Express 26(7), 8095–8112 (2018). 39A. Sanjeev, N. Shabairou, A. Attar, D. Scherbaum, Y. Kapellner, M. Sinvani, and Z. Zalevsky, “Generation and manipulation of superoscillatory hotspots using virtual fourier filtering and CTF shaping,” Sci. Rep. 10(1), 4755 (2020). 40C. D. Paul, P. Mistriotis, and K. Konstantopoulos, “Cancer cell motility: Lessons from migration in confined spaces,” Nat. Rev. Cancer 17(2), 131–140 (2017). 41J. Balvan, A. Krizova, J. Gumulec, M. Raudenska, Z. Sladek, M. Sedlackova, P. Babula, M. Sztalmachova, R. Kizek, R. Chmelik, and M. Masarik, “Multimodal holographic microscopy: Distinction between apoptosis and oncosis,” PLoS One 10(3), e0121674 (2015). 42L. Strbkova, B. B. Carson, T. Vincent, P. Vesely, and R. Chmelik, “Automated interpretationoftime-lapsequantitativephaseimagebymachinelearningtostudy cellular dynamics during epithelial–mesenchymal transition,” J. Biomed. Opt. 25(8), 086502 (2020). APL Photon. 8, 046103 (2023); doi: 10.1063/5.0127950 8, 046103-9 © Author(s) 2023 Downloaded from http://pubs.aip.org/aip/app/article-pdf/doi/10.1063/5.0127950/16821927/046103_1_5.0127950.pdf