Resolution enhancement by vibrating displays

Abstract

We present a method that makes use of the retinal integration time in the human visual system for increasing the resolution of displays. Given an input image with a resolution higher than the display resolution, we compute several images that match the display's native resolution. We then render these low-resolution images in a sequence that repeats itself on a high refresh-rate display. The period of the sequence falls below the retinal integration time and therefore the eye integrates the images temporally and perceives them as one image. In order to achieve resolution enhancement we apply small-amplitude vibrations to the display panel and synchronize them with the screen refresh cycles. We derive the perceived image model and use it to compute the low-resolution images that are optimized to enhance the apparent resolution of the perceived image. This approach achieves resolution enhancement without having to move the displayed content across the screen and hence offers a more practical solution than existing approaches. Moreover, we use our model to establish limitations on the amount of resolution enhancement achievable by such display systems. In this analysis we draw a formal connection between our display and super-resolution techniques and find that both methods share the same limitation, yet this limitation stems from different sources. Finally, we describe in detail a simple physical realization of our display system and demonstrate its ability to match most of the spectrum displayable on a screen with twice the resolution.

References

1. Agranat, A., Gumennik, A., and Ilan, H. 2010. Refractive index engineering by fast ion implantations: A generic method for constructing multi-components electro-optical circuits. Proc. SPIE, vol. 7604.
2. Allen, W. and Ulichney, R. 2005. Wobulation: Doubling the addressed resolution of projection displays. In Proceedings of SID Symposium Digest of Technical Papers. Vol. 47.
3. Baker, S. and Kanade, T. 2000. Limits on super-resolution and how to break them. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'00). IEEE Computer Society, 2372.
4. Ben-Ezra, M., Zomet, A., and Nayar, S. 2004. Jitter camera: High resolution video from a low resolution detector. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'04). Vol. 2, IEEE Computer Society.
5. Damera-Venkata, N. 2009. Displaying sub-frames at spatially offset positions on a circle. United States Patent 7483044 B2.
6. Damera-Venkata, N. and Chang, N. 2007a. On the resolution limits of superimposed projection. In Proceedings of the International Conference on Image Processing (ICIP'07). Vol. 5, IEEE Computer Society.
7. Damera-Venkata, N. and Chang, N. 2007b. Realizing super-resolution with superimposed projection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07). 1--8.
8. Damera-Venkata, N. and Chang, N. 2009. Display supersampling. ACM Trans. Graph. 28, 1, 1--19.
9. Didyk, P., Eisemann, E., Ritschel, T., Myszkowski, K., and Seidel, H.-P. 2010a. Apparent display resolution enhancement for moving images. ACM Trans. Graph. 29, 3.
10. Didyk, P., Eisemann, E., Ritschel, T., Myszkowski, K., and Seidel, H.-P. 2010b. Perceptually-Motivated real-time temporal upsampling of 3D content for high-refresh-rate displays. Comput. Graph. Forum 29, 2, 713--722.
11. Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. In Proceedings of the ACM SIGGRAPH'02 Conference. ACM Press, New York, 249--256.
12. Hardie, R. 2007. A fast image super-resolution algorithm using an adaptive Wiener filter. IEEE Trans. Image Process. 16, 12, 2953--2964.
13. Irani, M. and Peleg, S. 1990. Super resolution from image sequences. In Proceedings of the International Conference on Pattern Recognition. Vol. 2, 115--120.
14. Jaynes, C. and Ramakrishnan, D. 2003. Super-Resolution composition in multi-projector displays. In Proceedings of the IEEE International Workshop on Projector-Camera Systems (ProCams'03).
15. Kalloniatis, M. and Luu, C. 2009. Temporal resolution. www.webvision.med.utah.edu/temporal.html.
16. Lin, Z. and Shum, H. 2001. On the fundamental limits of reconstruction-based algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 26, 1, 83--97.
17. Mäkelä, P., Rovamo, J., and Whitaker, D. 1994. Effects of luminance and external temporal noise on flicker sensitivity as a function of stimulus size at various eccentricities. Vis. Res. 34, 15, 1981--1991.
18. McKee, S. and Taylor, D. 1984. Discrimination of time: Comparison of foveal and peripheral sensitivity. J. Optical Soc. Amer. A1, 6, 620--628.
19. Napoli, J., Dey, S., Stutsman, S., Cossairt, O., Purtell II, T., Hill, S., and Favalora, G. 2008. Imaging artifact precompensation for spatially multiplexed 3D displays. Proc. SPIE, vol. 6803, 680304.
20. Norwich, K. 1993. Information, Sensation, and Perception. Academic Press, San Diego, CA.
21. Park, S. C., Park, M. K., and Kang, M. G. 2003. Super-Resolution image reconstruction: A technical overview. IEEE Signal Process. Mag. 20, 3, 21--36.
22. Platt, J. 2002. Optimal filtering for patterned displays. IEEE Signal Process. Lett. 7, 7, 179--181.
23. Saad, Y. 2003. Iterative Methods for Sparse Linear Systems 2nd Ed. Society for Industrial and Applied Mathematics, Philadelphia, PA.
24. Templin, K., Didyk, P., Ritschel, T., Eisemann, E., Myszkowski, K., and Seidel, H.-P. 2011. Apparent resolution enhancement for animations. In Proceedings of the 27th Spring Conference on Computer Graphics. 85--92.
25. Youla, D. 1978. Generalized image restoration by the method of alternating orthogonal projections. IEEE Trans. Circ. Syst. 25, 9, 694--702.

Index Terms

• Computing methodologies

  • Computer graphics

    • Image manipulation

    • Rendering