A system and method are provided for compressing a graphical representation that describes the appearance of an object from a plurality of viewing directions. Compressing includes accessing the graphical representation, removing redundant descriptive information from the graphical representation using sign consistent matrix factorization and approximation techniques, and representing the remaining information for efficient rendering, such as rendering with hardware-assisted computation.