Disney researchers create computer models that capture style and process of portrait artists

Data-driven approach can be used to synthesize sketches in original artist's style

2013-07-19

(Press-News.org) By monitoring artists as they sketch human faces, stroke by stroke, scientists at Disney Research, Pittsburgh, have built computer models that learn each artist's drawing style, how they use strokes and how they select features to highlight as they interpret a face into a portrait.

A better understanding of this abstraction process, the researchers stated, not only is interesting from an artistic point of view, but also can help in developing artificial drawing tools.

"There's something about an artist's interpretation of a subject that people find compelling," said Moshe Mahler, a digital artist at Disney Research, Pittsburgh. "We're trying to capture that – to create a computer model of it – in a way that no one has done before."

Mahler, along with Itamar Berger and Ariel Shamir of the Interdisciplinary Center Herzliya, Israel, will present the findings at ACM SIGGRAPH 2013, the International Conference on Computer Graphics and Interactive Techniques, July 21-25 in Anaheim, Calif. Jessica Hodgins, Vice President of Disney Research, and Elizabeth Carter, a Disney Research, Pittsburgh associate, also were part of the research team.

Other computer programs can create line drawings from photos and some can mimic certain stroke styles. The Disney Research, Pittsburgh approach, by contrast, is built on a database representing abstractions of a set of artists.

To create the database, the researchers recruited seven artists. Each sketched portraits based on 24 photographs of male and female faces using a stylus pen that enabled the researchers to record each stroke. The artists created four sketches of each photo, with decreasing time intervals allowed for each – 270, 90, 30 and 15 seconds. The result was a dataset of 672 sketches at four abstraction levels.

The dataset contains about 8,000 strokes for each artist, with each stroke categorized as shading strokes or contour strokes, with contour strokes subdivided into complex and simple strokes.

"Watching these strokes accumulate was an interesting part of this project," Berger said. Some artists started with the eyes, others with the outlines of the face. One of the artists had no discernible pattern, starting "wherever."

The analysis did not only focus on strokes style but also on the geometric interpretation of the face by the artist and how it is conveyed in the drawing. For instance, one artist consistently spaced eyes closer together in the sketches than they appear in reality, while another tended to draw wide jaws. Identifying these tendencies may help artists correct bad habits, Shamir said, though in other cases these variations may simply be recognized as artistic tendencies or style.

The researchers also used their system to synthesize sketches based on new face photos. In a perceptual study, test subjects were then asked to match sketches based on style, to match synthesized sketches with those of the actual artist and to try to identify which sketches were real and which were synthesized. The results demonstrated that the sketch generation method produced multiple, distinct styles that are similar to hand-drawn sketches.

What the program can't do, Mahler emphasized, is replicate the spontaneity of an artist and their ability to balance the drawing as they work. "Our approach only understands the trends of how an artist might work," he added. And, because all of the artists based their work on photos, even the hand-drawn sketches were more constrained and reflected less personality than would have been the case if based on living, breathing subjects.

Future work could extend these techniques to subjects beyond faces or people, to other drawing techniques and might also include time-based animation, Shamir said.

### This project was partly supported by the Israel Science Foundation. For more information and a video, visit the project website at http://www.disneyresearch.com/project/portraitsketching/. About Disney Research Disney Research is a network of research laboratories supporting The Walt Disney Company. Its purpose is to pursue scientific and technological innovation to advance the company's broad media and entertainment efforts. Disney Research is managed by an internal Disney Research Council co-chaired by Disney-Pixar's Ed Catmull and Walt Disney Imagineering's Bruce Vaughn, and including the directors of the individual labs. It has facilities in Los Angeles, San Francisco, Pittsburgh, Boston and Zürich. Research topics include computer graphics, video processing, computer vision, robotics, radio and antennas, wireless communications, human-computer interaction, displays, data mining, machine learning and behavioral sciences.

ELSE PRESS RELEASES FROM THIS DATE:

The genetic key to conquering cholera

2013-07-19

Researchers have long understood that genetics can play a role in how susceptible people are to contracting cholera, but a team of Harvard scientists is now uncovering evidence of genetic changes that might also help protect some people from contracting the deadly disease. Based on genetic data gathered from hundreds of people in Bangladesh, a research team made up of Harvard faculty and scientists from the Broad Institute and Massachusetts General Hospital were able to a number of areas in the genome – some of which are responsible for certain immune system functions, ...

Black bears return to Missouri indicates healthy forests

2013-07-19

For nearly a century, the only bears known to reside in Missouri were on the state flag or in captivity. Unregulated hunting and habitat loss had wiped out most black bears in Missouri, Arkansas and Oklahoma by the 1920s. Now, thanks to a reintroduction program in Arkansas during the 50s and 60s, hundreds of bears amble through the forests of southern Missouri, according to a joint study by University of Missouri, Mississippi State University, and Missouri Department of Conservation biologists, who warn that although the bear population is still small, outdoor recreationists ...

Stanford expert says Internet's backbone can readily be made more sustainable

2013-07-19

Most big data centers, the global backbone of the Internet, could slash their greenhouse gas emissions by 88 percent by switching to efficient, off-the-shelf equipment and improving energy management, according to new research. The carbon emissions generated by a search on Google or a post on Facebook are related mostly to three things: the computing efficiency of IT (information technology) data center equipment, like servers, storage and network switches; the amount of electricity a data center's building uses for things other than computing, primarily cooling; and ...

Rice researchers part of new LHC discovery

2013-07-19

HOUSTON – (July 19, 2013) – A discovery facilitated by Rice University's contribution to the Large Hadron Collider (LHC) will impact scientists' search for dark matter in the universe. CERN, the European Organization for Nuclear Research, announced in Switzerland this morning that researchers on two separate LHC experiments have succeeded in measuring "one of the rarest measurable processes in physics," the decay of B-subscript-s mesons into two muons. The evidence, which scientists have been seeking for 25 years, matches predictions made using the Standard Model of ...

California's Mountain Fire

2013-07-19

NASA's Aqua satellite captured an image of California's Mountain Fire on July 18 as the satellite passed overhead in space. The Moderate Resolution Imaging Spectroradiometer (MODIS) instrument that flies aboard Aqua captured an image of the smoke and heat from California's Mountain Fire on July 18 at 21:00 UTC (5 p.m. EDT/2 p.m. PDT). MODIS has the ability to detect hot spots or fires and they appear red in the image. At the time of the image, the light brown smoke plume was blowing west-northwest. The Mountain Fire started on July 15 at 1:43 p.m. near the junction ...

Regenstrief, IU study: Caregivers open to stopping cancer screening as dementia progresses

2013-07-19

INDIANAPOLIS -- Research from the Regenstrief Institute and the Indiana University Center for Aging Research has found that many family caregivers of older adults with dementia are willing to consider stopping cancer screening of the elderly individual; they are also relieved when the older adult's physician brings it up. "This openness of dementia caregivers to considering cancer screening cessation for older adults provides potential to reduce both patient burden and health care costs as well as family caregiver distress, while improving the overall quality of care ...

Purple sunlight eaters

2013-07-19

ARGONNE, Ill. – A protein found in the membranes of ancient microorganisms that live in desert salt flats could offer a new way of using sunlight to generate environmentally friendly hydrogen fuel, according to a new study by researchers at the U.S. Department of Energy's Argonne National Laboratory. Argonne nanoscientist Elena Rozhkova and her colleagues combined a pigment called bacteriorhodopsin with semiconducting nanoparticles to create a system that uses light to spark a catalytic process that creates hydrogen fuel. Scientists have been aware of the potential ...

Toronto researchers part of international team that caught neutrinos in the act

2013-07-19

TORONTO -- Today TRIUMF, a Canadian laboratory for nuclear and particle physics that works in partnership with York University and University of Toronto, announced a new breakthrough in understanding neutrinos -- nature's most elusive particles. The international Tokai to Kamioka (T2K) collaboration designed an experiment to investigate how neutrinos change from one form to another as they travel. TRIUMF researcher Michael Wilking spoke at the prestigious European Physical Society meeting in Stockholm, Sweden, confirming definitive proof of a new type of neutrino oscillation ...

Childhood abuse raises drug users' suicide risk

2013-07-19

PROVIDENCE, R.I. [Brown University] — For health professionals, the message from a new study in the American Journal of Public Health is clear: Asking patients about a history of childhood abuse can directly help assess their risk of attempting suicide. The evidence, authors say, shows that childhood abuse can have life-and-death consequences for the rest of a person's life. The longitudinal study of more than 1,600 drug users in Vancouver, Canada, found that "severe-to-extreme" abuse – particularly emotional or sexual – contributed significantly to the risk of future ...

Most people with moderate kidney disease have medication-resistant hypertension

2013-07-19

Researchers found a strong, graded association between worse kidney function and the presence of hypertension that is resistant to medications. More than 50% of individuals with moderate CKD had resistant hypertension. Among people with CKD, blacks and those with a larger waist circumference, diabetes, and a history of heart attacks or strokes were more likely to have resistant hypertension. 60 million people globally have chronic kidney disease. Washington, DC (July 18, 2013) — More than 50% of individuals with moderate kidney disease have hypertension that is ...

LAST 30 PRESS RELEASES:

Printed skin to replace animal testing

Precision medicine could be possible in the fight against antibiotic resistance

Researchers at the Lewis Katz School of Medicine at Temple University identify new targeted approach to protect neurons against degeneration

Scientists uncover the first clear evidence of air sacs in the fossilized bones of alvarezsaurian dinosaurs: the "hollow bones" which help modern day birds to fly

[Press-News.org] Disney researchers create computer models that capture style and process of portrait artists
Data-driven approach can be used to synthesize sketches in original artist's style