Perceptual Analysis and Simulation of Real-World Materials Appearance

EC Marie-Curie European Reintegration Grant No 239294 (2010-2012)

Principal investigator: Jiří Filip

Institute of Information Theory and Automation of the AS CR

Project Goals

     The main goal of this project is to identify relationships between human perception of real-world materials properties and corresponding computational features. We will use Bidirectional Texture Functions as state-of-the-art digital representation of illumination and view dependent real-world material appearance as an initial data for our analysis. We believe that rigorous analysis of human perception of individual visual effects in different material samples will allow us not only understand principles of human perception of real material surfaces but also to develop a more efficient acquisition, modelling, and editing methods of this type of massive but very accurate data. The observed material properties are surface specularity, translucency, roughness, anisotropy, directionality, back-scattering, among others. We will study the perceptual importance of these properties as well as their mutual dependency and dependency on type of material and illumination and viewing conditions. We will use established models of low-level human perception, however, we will also exploit psychophysical studies as a main source of knowledge about the way how human observers perceive more complex material surface properties. We will use real-time renderings of visually rich view and illumination dependent material measurements as test stimuli allowing the observer to freely control lighting and viewing conditions during the experiment. As an input data we are going to use publicly available view and illumination dependent surface texture samples, however, our long-term goal is a development of flexible and efficient sample measurement setup that does not sample the space of view and illumination directions uniformly as it is common in the previous setups, but rather takes advantage of obtained knowledge about human perception of individual types of real-materials to produce their very accurate but significantly reduced and thus easily applicable digital representation.


Publications in publications.bib [rss]
[15] Visual Texture (M. Haindl, J. Filip), Springer-Verlag, 2013. [bib] [pdf]
[14] Fast Method of Sparse Acquisition and Reconstruction of View and Illumination Dependent Datasets (J. Filip, R. Vávra), In To appear in Computer and Graphics, Elsevier, 2013. [bib]
[13] BRDF Slices: Accurate Adaptive Anisotropic Appearance Acquisition (J. Filip, R. Vavra, M. Haindl, V. Havran, P. Krupicka M. Zid), In To appear in proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2013, 2013. [bib] [pdf]
[12] Registration of Multi-View Images of Planar Surfaces (R. Vávra, J. Filip), In Proceedings of the 11th Asian Conference on Computer Vision, ACCV, 2012. [bib] [pdf]
[11] Digital Material Appearance: the Curse of Tera-Bytes (M. Haindl, J. Filip, R. Vávra), In ERCIM News, No. 90, 2012. [bib] [pdf]
[10] User Study of Viewing and Illumination Dependent Material Appearance (J. Filip, M. Haindl), In In proceedings of Predicting Perceptions 2012 - the 3rd International Conference on Appearance, 2012. [bib] [pdf]
[9] Restoring Illumination and View Dependent Data from Sparse Samples (J. Filip), In Proceedings of the 21th International Conference on Pattern Recognition, ICPR 2012, 2012. [bib] [pdf]
[8] Predicting Environment Illumination Effects on Material Appearance (J. Filip, M. Haindl, J. Stancik), In Proceedings of the 21th International Conference on Pattern Recognition, ICPR 2012, 2012. [bib] [pdf]
[7] Advanced textural representation of materials appearance (M. Haindl, J. Filip), In Proceedings of SA '11 SIGGRAPH Asia 2011 Courses , Eds: Sander P., SIGGRAPH Asia 2011, (Hong Kong, CN, 12.12.2011-15.12.2011), 2011. [bib] [pdf]
[6] Analysis of Human Gaze Interactions with Texture and Shape (J. Filip, P. Vacha, M. Haindl), In In proceedings of the MUSCLE International Workshop on Computational Intelligence for Multimedia Understanding, Springer LNCS 7252, 2011. [bib] [pdf]
[5] Towards Effective Measurement and Interpolation of Bidirectional Texture Functions (J. Filip), Technical report, UTIA AS CR, 2011. [bib] [pdf]
[4] Bidirectional Texture Function Compression based on the Multilevel Vector Quantization (V. Havran, J. Filip, K. Myszkowski), In Computer Graphics Forum, The Eurographics Association and Blackwell Publishing, volume 29, 2010. (project page) [bib] [pdf]
[3] A Psychophysical Evaluation of Texture Degradation Descriptors (J. Filip, P. Vacha, M. Haindl, P.R. Green), In Proceedings of IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition (SSPR & SPR 2010), LNCS 6218, 2010. [bib] [pdf]
[2] Gaze-Motivated Compression of Illumination and View Dependent Textures (J. Filip, M. Haindl, M.J. Chantler), In In proceedings of the 20th International Conference on Pattern Recognition (ICPR), 2010. [bib] [pdf]
[1] Realistic Material Appearance Modelling (Filip J. Hatka M. Haindl M.), In ERCIM News, 2010. [bib] [pdf]
Powered by bibtexbrowser

Tutorials/Courses Presented

  • Haindl M., Filip J.: Advanced Nature Exteriors Modelling (half-day tutorial). Presented at conference ICPR 2012, Tsukuba, Japan, November 2012.

  • Haindl M., Filip J.: Advanced Textural Representation of Materials Appearance (half-day course). Presented at conference SIGGRAPH Asia 2011, Hong Kong, China, December 2011. [pdf]

  • Haindl M., Filip J.: Advanced Material Appearance Modelling (half-day tutorial). Presented at conference SCIA 2011, Ystad, Sweden, May 2011.

  • Haindl M., Filip J.: Bidirectional Texture Function Modeling (half-day tutorial). Presented at conference CVPR 2010, San Francisco, USA, August 2010.

    Last update 22/02/2013