• A-
  • A+

We investigate how stylization of the faces of virtual characters can influence the categorization of emotions by children and adolescents with ASD and ADHD. To that end, our partners at the University of Konstanz developed non-photorealistic rendering (NPR) algorithms that are not only parameterizable, but also abstract the geometry of our characters in real-time. The implementation was done using Frapper.

Styles

Image Abstraction This style is inspired by paintings and painting-like...

Coherent Line Drawing Line drawing effectively conveys shapes and outlines...

Pencil Drawing This is one of the most fundamental techniques in visual...

Watercolors Watercolor painting is an artistic style that creates the...

Loose & Sketchy (not tested in SARA) Another algorithm initially...

Characters

Hank, Nikita, Sara and Gunnar
In addition to the already existing...

Image Abstraction

This style is inspired by paintings and painting-like images, where absence of fine-grained texture details and increased sharpness of edges are two relevant visual characteristics.

Up: Hank (medium & high abstraction). Down: Nikita (medium & high abstraction)

Coherent Line Drawing

Line drawing effectively conveys shapes and outlines to the viewer with simple primitives: lines. We use the algorithm of Kang et al. [2007] which creates coherent and artistic-looking lines.

Up: Hank (medium & high abstraction). Down: Nikita (medium & high abstraction)

Pencil Drawing

This is one of the most fundamental techniques in visual arts to abstract human perception of natural scenes. By converting input scenes into just lines and shading, a great number of details are removed, while keeping the object boundaries and plasticity of the rendered objects by preserving their shading.

Up: Hank (medium & high abstraction). Down: Nikita (medium & high abstraction)

Watercolors

Watercolor painting is an artistic style that creates the effect of water dissolved colors on paper, or similar surfaces. We decided to use this style not only for the abstraction it provides, but also because it is used by many individuals with ASD to express themselves through painting, or during therapies that introduce artistic elements [Tataroglu 2013].Our algorithm is based on the work of Luft et al. [2006] whose approach simplifies the visual complexity and imitates the natural effects of watercolor.

Up: Hank (medium & high abstraction). Down: Nikita (medium & high abstraction)

Loose & Sketchy (not tested in SARA)

Another algorithm initially implemented as a collaboration between Filmakademie Baden-Württemberg and University of Konstanz, and recently improved by the latter was Loose & Sketchy.

To improve the visual quality, instead of drawing thin lines from the seed points along the vector field, real strokes are generated. For this, the geometry shader stage in GL3+ is used to create a quad-strip with texture coordinates and apply a real stroke texture. This is done is 2 steps: once from the seed position in direction along the vector field and once from the seed point against the direction of the vector field. This is still work-in-progress.

Down: Nikita (medium & high abstraction)

Hank, Nikita, Sara and Gunnar

In addition to the already existing characters (Nikita - a young female, and Hank - an elderly male), we created counterparts that would give more validity (Gunnar- a young male character, and Sara - an elderly female character). All characters' rigs have been created using the Facial Animation Toolset (FAT).

In order to harmonize the visual appearance of the four characters, an artist was in charged of creating light conditions and adapting the existing shaders for all the characters. All this was carried out in our development software Frapper, which was enhanced to support the new shading and lighting functionalities.

Thanks to our supporting team: Kai Götz (creator of Sara), Solveigh Jäger (creator of Gunnar), Steven Stahlberg (creator of the original Nikita), Leszek Plichta (visual harmonization of the characters), Markus Rapp (real-time hair generation), Simon Spielmann (lead software developer Frapper) and Nils Zweiling (external software developer Frapper).

The characters are distributed as part of our Frapper software deploy under the Creative Commons Attribution Non Commercial Share Alike 3.0 Unported License.

New characters appearance (from left to right): Nikita, Gunnar, Hank, Sara.