Tailored displays to compensate for visual aberrations

Abstract

We introduce tailored displays that enhance visual acuity by decomposing virtual objects and placing the resulting anisotropic pieces into the subject's focal range. The goal is to free the viewer from needing wearable optical corrections when looking at displays. Our tailoring process uses aberration and scattering maps to account for refractive errors and cataracts. It splits an object's light field into multiple instances that are each in-focus for a given eye sub-aperture. Their integration onto the retina leads to a quality improvement of perceived images when observing the display with naked eyes. The use of multiple depths to render each point of focus on the retina creates multi-focus, multi-depth displays. User evaluations and validation with modified camera optics are performed. We propose tailored displays for daily tasks where using eyeglasses are unfeasible or inconvenient (e.g., on head-mounted displays, e-readers, as well as for games); when a multi-focus function is required but undoable (e.g., driving for farsighted individuals, checking a portable device while doing physical activities); or for correcting the visual distortions produced by high-order aberrations that eyeglasses are not able to.

References

1. Akeley, K., Watt, S. J., Girshick, A. R., and Banks, M. S. 2004. A stereo display prototype with multiple focal distances. In SIGGRAPH 2004, I804--813.
2. Alonso Jr., M., Barreto, A., and Adjouadi, M. 2007. Development and evaluation of a custom display compensation method for computer users based on individual visual characteristics. In 16th Int. Conf. Comp.
3. Barsky, B. A. 2004. Vision-realistic rendering. In APGV, 73--81.
4. Camp, J., Maguire, L., and Robb, R. 1990. An efficient ray tracing algorithm for modeling visual performance from corneal topography. In Proc. Vis. in Bio. Comp., 278--285.
5. Campbell, C. 2010. Relative importance of sources of chromatic refractive error in the human eye. J. Opt. Soc. Am. A 27(4).
6. Charman, W., and Heron, G. 2000. On the linearity of accommodation dynamics. Vision Research 40(15), 2057--2066.
7. Damera-Venkata, N., and Chang, N. L. 2009. Display supersampling. ACM TOG 28, 9:1--19.
8. Deering, M. F. 2005. A photon accurate model of the human eye. In SIGGRAPH 2005, vol. 24(3), 649--658.
9. Didyk, P., Eisemann, E., Ritschel, T., Myszkowski, K., and Seidel, H.-P. 2010. Apparent display resolution enhancement for moving images. In SIGGRAPH 2010, 113:1--8.
10. Dodgson, N. 2009. Analysis of the viewing zone of multi-view autostereoscopic displays. In SPIE SD&A, vol. 4660, 254--265.
11. Donnelly, W., Pesudovs, K., Marsack, J., Sarver, E., and Applegate, R. 2004. Quantifying scatter in Shack-Hartmann images to evaluate nuclear cataract. J Refract Surg 20(5), S515--S522.
12. Douali, M. G., and Silver, J. D. 2004. Self-optimised vision correction with adaptive spectacle lenses in developing countries. Ophthal Physiol Opt 24.
13. EDPRG. 2004. Prevalence of cataract and pseudophakia/aphakia among adults in the united states. Arch Ophthalmol 122.
14. Goldring, E., Cain, J., Larson, K., Price, L., Smith, L., Rayej, S., and Cavallerano, J. 2006. Enhanced visual experiences and seeing hardware for reduced vision. Optom. 77(2).
15. Hoffman, D. M., Girshick, A. R., Akeley, K., and Banks, M. S. 2005. Vergence--accommodation conflicts hinder visual performance and cause visual fatigue. J. Vis. 5, 10, 834--862.
16. Huang, F.-C., and Barsk, B. A. 2011. A framework for aberration compensated displays. Tech. Rep. UCB/EECS-2011-16.
17. Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In SIGGRAPH 2000.
18. Isono, H., Yasuda, M., and Sasazawa, H. 1993. Autostereoscopic 3-D display using LCD-generated parallax barrier. Electr. Comm. Japan 76(7), 77--84.
19. Ives, F. E., 1903. Parallax stereogram & process of making same. US Patent 725567.
20. Jaynes, C., and Ramakrishnan, D. 2003. Super-resolution composition in multi-projector displays. In IEEE ProCams.
21. Jeong, T. M., Ko, D.-K., and Lee, J. 2005. Generalized ray-transfer matrix for an optical element having an arbitrary wave-front aberration. Opt. Lett. 30(22), 3009--11.
22. Lanman, D., Hirsch, M., Kim, Y., and Raskar, R. 2010. Content-adaptive parallax barriers. ACM TOG 29(6), 163:1--10.
23. Levoy, M., Chen, B., Vaish, V., Horowitz, M., McDowall, I., and Bolas, M. 2004. Synthetic aperture confocal imaging. ACM TOG 23, 825--834.
24. Levoy, M., Zhang, Z., and McDowall, I. 2009. Recording and controlling the 4D light field in a microscope using microlens arrays. J Microsc 235(2), 144--162.
25. Liang, J., Grimm, B., Goelz, S., and Bille, J. 1994. Objective measurement of wave aberrations of the human eye with a Hartmann-Shack sensor. JOSA A 11(7), 1949--1957.
26. Liang, J., Williams, D. R., and Miller, D. T. 1997. Super-normal vision & high-resolution retinal imaging through adaptive optics. JOSA A 14(11), 2884--2892.
27. Lippmann, G. 1908. épreuves réversibles donnant la sensation du relief. J Phys 7, 821--825.
28. Liu, S., and Hua, H. 2009. Time-multiplexed dual-focal plane head-mounted display with a liquid lens. Opt. Lett. 34(11), 1642.
29. Machado, G. M., Oliveira, M. M., and Fernandes, L. A. F. 2009. A physiologically-based model for simulation of color vision deficiency. IEEE Trans. Vis. Comp. Graph. 15(6).
30. Maddox, E. E. 1886. Investigations in the relation between convergence and accommodation of the eyes. J Anat Physiol 20(3).
31. ming Dai, G., Campbell, C. E., Chen, L., Zhao, H., and Chernyak, D. 2009. Wavefront propagation from one plane to another with the use of zernike polynomials and taylor mono-mials. Appl Opt 48(3), 477--488.
32. Morgan, I. G., Ohno-Matsui, K., and Saw, S.-M. 2012. Myopia. The Lancet 379: 1739--48.
33. Ng, R., and Hanrahan, P. 2006. Digital correction of lens aberrations in light field photography. In SPIE IODC, vol. 6342.
34. Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a hand-held plenoptic camera. Tech. Rep. CTSR 2005--02.
35. Ng, R. 2005. Fourier slice photography. ACM TOG 24, 735--744.
36. Pamplona, V. F., Oliveira, M. M., and Baranoski, G. 2009. Photorealistic models for pupil light reflex and iridal pattern deformation. ACM TOG 28(4), 106.
37. Pamplona, V. F., Mohan, A., Oliveira, M. M., and Raskar, R. 2010. NETRA: interactive display for estimating refractive errors and focal range. In SIGGRAPH 2010, 77:1--8.
38. Pamplona, V. F., Passos, E. B., Zizka, J., Oliveira, M. M., Lawson, E., Clua, E., and Raskar, R. 2011. CATRA: interactive measuring and modeling of cataracts. In SIGGRAPH 2011, 47:1--8.
39. Porterfield, W. 1759. A Treatise on the Eye: the manner & phenomena of vision.
40. Rolland, J. P., Krueger, M. W., and Goon, A. 2000. Multi-focal planes head-mounted displays. Appl Opt 39(19), 3209--15.
41. Rozema, J. J., Dyck, D. E. V., and Tassignon, M.-J. 2005. Clinical comparison of 6 aberrometers. part 1: Technical specifications. JCRS 31, 6, 1114--1127.
42. Rucker, F. J., and Kruger, P. B. 2006. Cone contributions to signals for accommodation and the relationship to refractive error. Vision Research 46, 3079--3089.
43. Schaeffel, F. 2006. Myopia: The importance of seeing fine detail. Curr. Biol. 16(7), R257--R259.
44. Schwiegerling, J. 2000. Theoretical limits to visual performance. Surv Ophthalmol 45(2), 139--146.
45. Schwiegerling, J. 2004. Field guide to visual and ophthalmic optics. SPIE.
46. Sugiura, N., and Morita, S. 1993. Variable-focus liquid-filled optical lens. Appl Opt. 32(22).
47. Thibos, L., Qi, X., and Miller, D. T. 1999. Vision through a liquid-crystal spatial light modulator. In Adaptive Optics for Industry and Medicine.
48. Vaish, V., Wilburn, B., Joshi, N., and Levoy, M. 2004. Using plane + parallax for calibrating dense camera arrays. In IEEE CVPR, 2--9.
49. Wetzstein, G., Lanman, D., Heidrich, W., and Raskar, R. 2011. Layered 3D: Tomographic image synthesis for attenuation-based light field and high dynamic range displays. ACM TOG 30, 4.
50. WHO, 2005. State of the world's sight. vision 2020: the right to sight 1999--2005.
51. Yu, N., Genevet, P., Kats, M. A., Aieta, F., Tetienne, J.-P., Capasso, F., and Gaburro, Z. 2011. Light propagation with phase discontinuities. Science 334 (6054), 333--337.

Index Terms

• Computing methodologies

  • Computer graphics

    • Image manipulation

    • Rendering