Abstract

Purpose. To evaluate the agreement and repeatability between a new commercially available binocular open-field wavefront autorefractor, as part of the Eye Refract system, and a monocular closed-field wavefront autorefractor (VX110). Methods. A cross-sectional, randomized, and single-masked study was performed. Ninety-nine eyes of 99 healthy participants (37.22 ± 18.04 years, range 8 to 69 years) were randomly analyzed. Three measurements with the Eye Refract and the VX110 were taken on three different days, under noncycloplegic conditions. Mean spherical equivalent (MSE), cylindrical vectors (J0 and J45), and binocular corrected distance visual acuity (BCDVA) were compared between both autorefractors. An intersession repeatability analysis was done considering the values of repeatability (Sr) and its 95% limit (r). Results. The VX110 showed more negative values () in terms of MSE in comparison with the Eye Refract (0.20 D). Regarding cylindrical vectors, J45 showed statistically significant differences () between both wavefront autorefractors, but they were not clinically relevant (<0.05 D). In BCDVA, there were no statistically significant differences () between both wavefront autorefractors. Additionally, the Eye Refract was more repeatable than the VX110 in terms of both MSE (SrEYE REFRACT = 0.21 D, SrVX110 = 0.53 D) and J0 (SrEYE REFRACT = 0.12 D, SrVX110 = 0.35 D). Conclusions. The Eye Refract provided enough accuracy and reliability to estimate refractive errors in different age groups, achieving better results than the VX110. Therefore, the Eye Refract proved to be a useful autorefractor to be incorporated into clinical practice.

1. Introduction

Subjective refraction is the gold standard method to assess the refractive error because it considers both optical and neural factors of visual perception. Nevertheless, autorefractors provide objective refraction as a starting point to facilitate subjective refraction.

Based on the current ways to measure objective refraction, autorefractors can be classified as monocular or binocular, closed- or open-field, and traditional or wavefront-based [14]. Binocular or monocular indicates if the binocularity is present or not during the measurement, while closed- or open-field alludes to whether the image of fixation is virtual or real.

Besides autorefractors that use traditional methods to measure objective refraction, wavefront autorefractors have been developed to become a usual device in clinical practice, especially during the last decade [5]. The main limitation of wavefront autorefractors is an overestimation of myopia or underestimation of hyperopia [68]. This issue is also important for traditional autorefractors, both monocular closed-field [3, 912] and binocular closed-field [9, 13]. Despite this limitation, some models of wavefront autorefractors demonstrated a good agreement with subjective refraction in terms of spherical and cylindrical refractive errors [2, 1418].

Binocular open-field traditional autorefractors were developed to avoid myopia that a monocular closed-field environment may be generated without cycloplegia [19]. This idea is supported by different studies that showed similar results between these autorefractors and subjective refraction in terms of spherical refractive error [1, 4, 2023].

In the case of wavefront autorefractors, all the commercially available models are monocular closed-field, except a new binocular open-field wavefront autorefractor, as part of the Eye Refract system (Luneau Technology; Chartres, France). The clinical implications and limitations of the Eye Refract are still unknown.

For this reason, the purpose of the current study was to evaluate the agreement and repeatability between this new binocular open-field wavefront autorefractor (Eye Refract) and a monocular closed-field wavefront autorefractor (VX110). Both systems are commercially distributed by Luneau Technology (Chartres, France).

2. Methods

2.1. Design of the Study

A cross-sectional, randomized, and single-masked study was performed. The study was conducted in compliance with good clinical practice guidelines and institutional review board regulations and following the tenets of the Declaration of Helsinki, revised and actualized in 2013 [24]. All trials were performed in the University Clinic of Optometry of the Universidad Complutense de Madrid (Madrid, Spain). All participants were voluntarily included in the study after signing a written informed consent, where the procedure of all the trials and the purpose of the study were explained. Participants were free to leave the study at any time.

Three measurements of the objective refraction with two wavefront autorefractors (Eye Refract and VX110) were taken. One of the autorefractors was used randomly in first place and the other in second place. All the measurements were performed on three different days (one measurement with each wavefront autorefractor per day) in the morning by the same optometrist, under noncycloplegic conditions. All visits of each participant were done during a maximum period of two weeks based on their availability. Refractive parameters (MSE, J0, and J45) and binocular corrected distance visual acuity (BCDVA) were compared between both wavefront autorefractors.

2.2. Sample

Ninety-nine eyes of 99 healthy participants (37.22 ± 18.04 years, range 8 to 69 years) were evaluated, considering one eye per participant randomly. The recruitment was made to obtain the most heterogeneous sample as possible concerning the age of participants, trying to involve the same number of participants in each decade of life. The participants were classified into four groups (total, teenagers, adults, and presbyopes), whose demographic characteristics are detailed in Table 1.

Inclusion criteria were as follows: aged between 7 and 69 years and understanding and signing the informed consent (by the legal tutors, in case of participants under 18 years). Exclusion criteria were amblyopia, strabismus, or other ocular dysfunction affecting the binocular autorefraction, the presence of any ocular disease, surgery or traumatism, and the use of systemic or ocular drugs that could affect the results.

2.3. Eye Refract System

The Eye Refract system (Luneau Technology; Chartres, France) is a binocular open-field aberrometer combined with a phoropter. The Eye Refract incorporates two Hartmann–Shack sensors that perform objective refraction in both eyes at the same time. The wavefront metric used for the objective refraction determination is based on the principle of equivalent quadratic, using the method of paraxial curvature matching proposed by Thibos et al. [25] This method considers the high-order aberrations analysis up to 4th order, using the Zernike coefficients and for MSE determination, and for J0 determination, and and for J45 determination The Eye Refract measures the wavefront under physiological pupil conditions, and it recalculates the refractive parameters for 3 mm. If pupil size is equal to or less than 3 mm, the Eye Refract provides the values for its exact size. The Hartmann–Shack sensors use a near-infrared light of 800 nm, and the pitch of the microlens array is 0.1 mm.

Since the Eye Refract is an aberrometer combined with a phoropter, it provides both objective and subjective refraction. The results of its efficacy to perform aberrometry-based subjective refraction in comparison with conventional subjective refraction were already published [26]. In the current manuscript, we only report on the results of objective refraction.

Following the manufacturer instructions, subjects were instructed to put their chin and forehead on the chinrest and to look ahead to a test of fixation on the digital screen set at 4 m distance. Then, binocular wavefront aberrometry was measured.

2.4. VX110 System

The VX110 system (Luneau Technology; Chartres, France) is a multidiagnostic platform that incorporates an aberrometer [2]. The VX110 has a Hartmann–Shack sensor that performs a monocular and closed-field objective refraction. The wavefront metric used for the objective refraction determination is also based on the principle of equivalent quadratic, using the method of paraxial curvature matching proposed by Thibos et al. [25] All the refractive variables were considered for a pupil size of 3 mm. If pupil size is equal to or less than 3 mm, the VX110 provides the values for its exact size. The Hartmann–Shack sensor also uses a near-infrared light of 800 nm, and it measures 1500 points for a pupil diameter of 7 mm.

Following the manufacturer instructions, subjects were instructed to put their chin and forehead on the chinrest and to look ahead to a virtual image of fixation at infinity. Then, monocular wavefront aberrometry was performed in each eye consecutively.

2.5. Refractive Parameters

Refractive parameters were analyzed in terms of mean spherical equivalent (MSE) and vertical and oblique cylindrical vectors (J0 and J45) with the method proposed by Thibos et al. [27]. The following expressions were used to calculate MSE, J0, and J45:MSE = sphere + cylinder/2J0 = −(cylinder/2) × cos (2 x axis)J45 = −(cylinder/2) × sin (2 x axis)

2.6. Visual Acuity Measurement

Binocular corrected distance visual acuity (BCDVA) was immediately measured after finishing each objective refraction. BCDVA was assessed through the oculars of the Eye Refract, in the case of the objective refraction with this system, and with trial frame, in the case of the objective refraction with the VX110. The high-contrast (100%) ETDRS chart of the digital screen set at 4 meters of distance was used to measure the BCDVA.

2.7. Statistical Analysis

Statistical analysis was performed using the SPSS Statistics 23 software (IBM, Chicago, Illinois, USA). Sample size calculations were performed with statistical software Granmo 6.0 (Institut Municipal d’Investigació Mèdica, Barcelona, Spain). A statistical significance of 95% was established (). Results are shown as mean ± standard deviation.

The normality of the variables (MSE, J0, J45, and BCDVA) was assessed using the Shapiro–Wilk test. A statistical comparison between the values of both wavefront autorefractors inside each group (total, teenagers, adults, presbyopes) was done. Once the normal distribution of all the variables was confirmed, Student’s t test for paired samples was chosen for this statistical comparison. Additionally, a Bland–Altman plot analysis was done to assess the agreement between both wavefront autorefractors [28].

An intersession repeatability analysis was done considering the following variables: mean difference between sessions (bias), its standard deviation (SD), repeatability (Sr), and its 95% limit (r). Sr is defined as the square root of the mean square within-subject standard deviation. r is mathematically defined as 2.77 × Sr, and it represents the limit value within which 95% of measurements should be [29]. The one-way analysis of variance (ANOVA) for paired samples with Bonferroni correction was done to assess the statistical differences between sessions.

3. Results

Table 2 summarizes the mean values of the different variables under study (MSE, J0, J45, and BCDVA) for both wavefront autorefractors and their statistical comparison.

In relation to MSE, the VX110 showed more negative values () in comparison with the Eye Refract for all groups, except teenagers. Figure 1 shows the Bland–Altman plot for both objective refractions in terms of MSE. Mean difference (VX110-Eye Refract) and limits of agreement [upper, lower] were −0.20 [0.59, −0.99] D for total group, −0.30 [1.06, −1.66] D for teenagers, −0.24 [0.22, −0.70] D for adults, and −0.13 [0.50, −0.76] D for presbyopes.

In relation to J0, there were no statistically significant differences () between both wavefront autorefractors. Figure 2 shows the Bland–Altman plot for both objective refractions in terms of J0. Mean difference (VX110-Eye Refract) and limits of agreement [upper, lower] were −0.02 [0.22, −0.24] D for total group, 0.00 [0.10, −0.10] D for teenagers, 0.00 [0.18, −0.18] D for adults, and −0.03 [0.27, −0.33] D for presbyopes.

In relation to J45, there were statistically significant differences () between both wavefront autorefractors for total group and adults. Figure 3 shows the Bland–Altman plot for both objective refractions in terms of J45. Mean difference (VX110-Eye Refract) and limits of agreement [upper, lower] were 0.02 [0.13, −0.09] D for total group, 0.01 [0.11, −0.09] D for teenagers, 0.04 [0.14, −0.06] D for adults, and 0.00 [0.12, −0.12] D for presbyopes.

In relation to BCDVA, there were no statistically significant differences () between both wavefront autorefractors. Figure 4 shows the Bland–Altman plot for both objective refractions in terms of J45. Mean difference (VX110-Eye Refract) and limits of agreement [upper, lower] were 0.00 [0.12, −0.12] D for total group, 0.02 [0.21, −0.17] D for teenagers, 0.00 [0.08, −0.08] D for adults, and 0.00 [0.10, −0.10] D for presbyopes.

Tables 35 summarize the intersession repeatability analyses of the refractive variables (MSE, J0, and J45, respectively) for both wavefront autorefractors and the statistical comparison between sessions.

The intersession repeatability analysis of MSE showed no statistically significant differences () between sessions with both wavefront autorefractors. The Eye Refract was more repeatable than the VX110 for all the groups, especially for teenagers (SrEYE REFRACT = 0.14 D, SrVX110 = 0.92 D). In total group, the values of Sr were 0.21 D with the Eye Refract and 0.53 D with the VX110.

The intersession repeatability analysis of J0 only showed statistically significant differences () between session 1 and session 3 for adults with the Eye Refract. The Eye Refract was also more repeatable than the VX110 for all the groups. In total group, the values of Sr were 0.12 D with the Eye Refract and 0.35 D with the VX110.

The intersession repeatability analysis of J45 showed statistically significant differences () between session 1 and session 3 for total group and presbyopes with the VX110. The VX110 was more repeatable than the Eye Refract for all the groups, especially for presbyopes (SrEYE REFRACT = 0.15 D, SrVX110 = 0.08 D). In the total group, the values of Sr were 0.11 D with the Eye Refract and 0.06 D with the VX110.

4. Discussion

The current study is the first to evaluate the performance of a binocular open-field autorefractor (Eye Refract) based on wavefront analysis. The performance of the Eye Refract was compared with the VX110, a monocular closed-field autorefractor. The results showed that the objective refraction performed by the VX110 was more negative in terms of MSE than the Eye Refract for all groups, except teenagers. Additionally, the Eye refract was more repeatable in terms of both MSE and J0 than the VX110 for all groups, but the VX110 was more repeatable in terms of J45.

Overestimation of myopia or underestimation of hyperopia has been the main limitation of wavefront autorefractors since they appeared on the market until nowadays [68], but this issue also affects traditional autorefractors, both monocular closed-field [3, 912] and binocular open-field [9, 13]. More negative values in the sphere are associated with the stimulation of the accommodation during the measurement process. For the total group of the current study, the VX110 showed more negative values in terms of MSE in comparison with the Eye Refract (0.20 D) (see Table 2). These differences could be considered clinically relevant since they were close to 0.25 D, values which could be affecting vision [30]. Additionally, the Bland–Altman plot for both objective refractions (Figure 1) showed more negative values with the VX110 in most of the participants. This trend was continued in all age groups. Also, teenagers were the only group that did not have statistical differences in MSE between both wavefront autorefractors (Table 2). Nevertheless, the difference for teenagers was maximum (0.30 D) in comparison with the rest of the groups. This maximum difference without statistical significance was associated with a single participant who obtained more negative values (around 3.00 D) with the VX110 (Figure 1(b)).

As explained above, the overestimation of myopia with the VX110 could be associated with higher stimulation of accommodation [68]. However, it seems that this problem could also affect to open-field autorefractors [21], which would not explain the differences between both wavefront autorefractors. Besides, this overestimation with the VX110 only affected adults and presbyopes who are supposed to be the groups of age with lower accommodation.

Considering that accommodative response was not evaluated, it is necessary to explore other theories that could explain the differences found in MSE between both wavefront autorefractors. The results of Elsner et al. [31] and Teel et al. [32] suggested that the differences in the sphere could be associated with the infrared light of the wavefront sensors reflecting off in external retinal layers. However, this theory would not explain the differences in the sphere between both wavefront refractors since they use the same near-infrared light of 800 nm. The fact that the Eye Refract measured the refraction with a test of fixation at 4 m and the VX110 with a virtual image of fixation at infinity would not support the differences in MSE either since the Eye Refract uses a fogging with positive lenses before measuring objective refraction.

On the other hand, it is known that convergence is accompanied by accommodation [33]. By this, it could be thought that the differences in MSE between both wavefront autorefractors were related to the fact that both measurements were performed under binocular and monocular conditions. Despite this, it would be necessary for an additional study about the influence of the vergence and accommodation in both wavefront autorefractors to confirm this theory.

The authors of the current study reported the values of MSE obtained with conventional subjective refraction [26]. The values of MSE were −0.86 D for the total group, −0.63 D for teenagers, −2.08 D for adults, and +0.25 D for presbyopes. Comparing these values with the current study (Table 2), it can be observed that the Eye Refract only showed an overestimation of myopia superior to 0.25 D for presbyopes (). However, the VX110 showed an overestimation of myopia superior to 0.25 D for adults and presbyopes () [26]. This overestimation of myopia found with the VX110 contrast with the results of Gordon-Shaag et al. [2]. They found no differences in MSE with the same wavefront autorefractor in comparison with the subjective refraction performed by a single optometrist. These differences between both studies could be explained considering that they only performed one refraction by the same optometrist who could have its prescription criteria. The results of the current study concerning the VX110 also contrast with other authors that did not report differences in the spherical refraction between the newest wavefront autorefractors and subjective refraction [2, 1518]. Nevertheless, some authors reported more negative sphere values with different wavefront aberrometers in comparison with subjective refraction during the last decade [8, 32, 3436], coinciding with the results obtained with the VX110 in the current study. No studies assessing the performance of commercial open-field wavefront autorefractors were found in the scientific literature.

In terms of intersession repeatability of MSE, the Eye Refract was more repeatable than the VX110 for all the groups and sessions (Table 3), but both autorefractors were very similar for adults. The major benefit of the Eye Refract was for teenagers since its value of Sr (0.14 D) was 6.5 times lower than the Sr of the VX110 (0.92 D). However, this affirmation should be carefully interpreted because the sample of teenagers was inferior to the rest of the groups (Table 1).

Other studies analyzed the intersession repeatability of MSE with different wavefront autorefractors. In adults, several authors reported values of r between 0.28 D and 0.53 D [2, 16, 23, 37, 38], which agrees with the adults of the current study (Table 3). All these wavefront autorefractors keep their differences within a range of ±0.25 D. No studies assessing the intersession repeatability with wavefront autorefractors in other age groups were found in the scientific literature.

Astigmatism is a parameter that wavefront autorefractors offer properly [7, 8, 1418]. Only a few studies reported differences when comparing cylinder between wavefront autorefractors and subjective refraction [2, 6], but these differences were approximate of 0.25 D, which is a value well tolerated by the human eye [39]. In the current study, despite there were statistically significant differences in cylindrical component J45 between both wavefront autorefractors for some groups, they could not be considered clinically relevant since the mean differences only reached a maximum value of 0.04 D (Table 2). Therefore, it could be affirmed that both wavefront autorefractors have the accuracy to properly determine astigmatism for all age groups since they did not show higher differences in comparison with conventional subjective refraction () [26].

The intersession repeatability of astigmatism showed that the Eye Refract was more repeatable than the VX110 (Table 4) for all age groups, while the VX110 was more repeatable than the Eye Refract in terms of J45 (Table 5). In J45, since the differences between both wavefront autorefractors in terms of r were inferior to 0.25 D (except for presbyopes) and that the magnitude of J45 obtained with both wavefront autorefractors was substantially lower than MSE and J0 (Table 2), the improvement in J45 repeatability with the VX110 was not considered clinically relevant. In adults, other studies reported similar values of r in terms of J0 and J45 with different wavefront autorefractors [2, 16, 23, 37, 38].

In terms of BCDVA, there were no statistical differences between both wavefront autorefractors for all age groups (Table 2). In the case of the VX110, it is logical to think that BCDVA is not affected although it seems to overestimate myopia in comparison with the Eye Refract. This is due to the capacity of the lens to compensate for a negative overcorrection, especially in teenagers and adults. Presbyopes would have more difficulty to accommodate, but their negative overcorrection was not higher to 0.75 D in any participant (Figure 1(d)). In comparison with conventional subjective refraction [26], both wavefront autorefractors showed a statistically significant deterioration () of BCDVA for all the groups, except with the Eye Refract for teenagers (). In total group, this deterioration was only 0.02 logMAR (1 letter), which is not considered clinically relevant [40].

The current study had some limitations that could be improved upon in future studies. Visual acuity was measured under unmasked conditions and using trial frame with the VX110 and through the oculars with the Eye Refract. A study of Ohlendorf et al. [41] showed that phoropter could induce more negative spherical values than trial frame. On the other hand, all the objective refractions should have been performed under cycloplegic conditions to prove that the VX110 measurement is not influencing the accommodation stimulus because it is thought that a closed-field environment could overestimate myopia [19]. Also, it is necessary to check if these autorefractors could replace conventional subjective refraction since the objective refraction of the Eye Refract presented similar efficacy to subjective refraction [26]. Finally, more studies would be necessary for understanding the efficacy, applications, and limitations of open-field binocular wavefront autorefractors.

5. Conclusions

In conclusion, the VX110 showed more negative values in terms of MSE than the Eye Refract. Besides, the Eye Refract was more repeatable in terms of both MSE and J0 than the VX110. Both wavefront autorefractors showed similar results in terms of J45 and BCDVA.

The Eye Refract provided enough accuracy and reliability to estimate refractive errors in different age groups, achieving better results than the VX110. Therefore, the Eye Refract proved to be a useful autorefractor to be incorporated into clinical practice.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

The authors want to thank Luneau Technology (Chartres, France) for providing the Eye Refract system during the conduct of the study. Gonzalo Carracedo received a personal grant from Luneau Technology for the performance of the study with the Eye Refract system at the Universidad Complutense de Madrid.