Deep Video Portraits

Deep Video Portraits
Deep Video Portraits
Deep Video Portraits
Deep Video Portraits

Deep Video Portraits

Graphics research from Stanford University et al is the latest development in facial expression transfer visual puppetry, offering photorealistic and editable results:

We present a novel approach that enables photo-realistic re-animation of portrait videos using only an input video. In contrast to existing approaches that are restricted to manipulations of facial expressions only, we are the first to transfer the full 3D head position, head rotation, face expression, eye gaze, and eye blinking from a source actor to a portrait video of a target actor. The core of our approach is a generative neural network with a novel space-time architecture. The network takes as input synthetic renderings of a parametric face model, based on which it predicts photo-realistic video frames for a given target actor. The realism in this rendering-to-video transfer is achieved by careful adversarial training, and as a result, we can create modified target videos that mimic the behavior of the synthetically-created input. In order to enable source-to-target video re-animation, we render a synthetic target video with the reconstructed head animation parameters from a source video, and feed it into the trained network – thus taking full control of the target. With the ability to freely recombine source and target parameters, we are able to demonstrate a large variety of video rewrite applications without explicitly modeling hair, body or background. For instance, we can reenact the full head using interactive user-controlled editing, and realize high-fidelity visual dubbing. To demonstrate the high quality of our output, we conduct an extensive series of experiments and evaluations, where for instance a user study shows that our video edits are hard to detect. 

More Here

More Posts from Laossj and Others

7 years ago
Machine Learning With Python: Easy And Robust Method To Fit Nonlinear Data ☞ Https://towardsdatascience.com/machine-learning-with-python-easy-and-robust-method-to-fit-nonlinear-data-19e8a1ddbd49

Machine Learning with Python: Easy and robust method to fit nonlinear data ☞ https://towardsdatascience.com/machine-learning-with-python-easy-and-robust-method-to-fit-nonlinear-data-19e8a1ddbd49

7 years ago

What's Inside SOFIA? High Flying Instruments

image

Our flying observatory, called SOFIA, carries a 100-inch telescope inside a Boeing 747SP aircraft. Having an airborne observatory provides many benefits.

image

It flies at 38,000-45,000 feet – above 99% of the water vapor in Earth’s atmosphere that blocks infrared light from reaching the ground! 

image

It is also mobile! We can fly to the best vantage point for viewing the cosmos. We go to Christchurch, New Zealand, nearly every year to study objects best observed from the Southern Hemisphere. And last year we went to Daytona Beach, FL, to study the atmosphere of Neptune’s moon Triton while flying over the Atlantic Ocean.

image

SOFIA’s telescope has a large primary mirror – about the same size as the Hubble Space Telescope’s mirror. Large telescopes let us gather a lot of light to make high-resolution images!

image

But unlike a space-based observatory, SOFIA returns to our base every morning.

image

Which means that we can change the instruments we use to analyze the light from the telescope to make many different types of scientific observations. We currently have seven instruments, and new ones are now being developed to incorporate new technologies.

So what is inside SOFIA? The existing instruments include:

image

Infrared cameras that can peer inside celestial clouds of dust and gas to see stars forming inside. They can also study molecules in a nebula that may offer clues to the building blocks of life…

image

…A polarimeter, a device that measures the alignment of incoming light waves, that we use to study magnetic fields. The left image reveals that hot dust in the starburst galaxy M82 is magnetically aligned with the gas flowing out of it, shown in blue on the right image from our Chandra X-ray Observatory. This can help us understand how magnetic fields affect how stars form.

image

…A tracking camera that we used to study New Horizon’s post-Pluto flyby target and found that it may have its own moon…

image

…A spectrograph that spreads light into its component colors. We’re using one to search for signs of water plumes on Jupiter’s icy moon Europa and to search for signs of water on Venus to learn about how it lost its oceans…

image

…An instrument that studies high energy terahertz radiation with 14 detectors. It’s so efficient that we made this map of Orion’s Horsehead Nebula in only four hours! The map is made of 100 separate views of the nebula, each mapping carbon atoms at different velocities.

image

…And we have an instrument under construction that will soon let us study how water vapor, ice and oxygen combine at different times during planet formation, to better understand how these elements combine with dust to form a mass that can become a planet.

image

Our airborne telescope has already revealed so much about the universe around us! Now we’re looking for the next idea to help us use SOFIA in even more new ways. 

Discover more about our SOFIA flying observatory HERE. 

Make sure to follow us on Tumblr for your regular dose of space: http://nasa.tumblr.com.

7 years ago

Ever wished you could have a few more arms to get stuff done? Researchers at the University of Tokyo have developed Metalimbs. They’re strap-on robotic arms controlled by the lower body.

follow @the-future-now

7 years ago
I Can Not Argue With That
I Can Not Argue With That
I Can Not Argue With That
I Can Not Argue With That
I Can Not Argue With That
I Can Not Argue With That
I Can Not Argue With That
I Can Not Argue With That

I can not argue with that

7 years ago

Holographic Cortana Appliance

7 years ago
“ Promise You Won’t Leave Without Me.”
“ Promise You Won’t Leave Without Me.”
“ Promise You Won’t Leave Without Me.”
“ Promise You Won’t Leave Without Me.”
“ Promise You Won’t Leave Without Me.”
“ Promise You Won’t Leave Without Me.”
“ Promise You Won’t Leave Without Me.”
“ Promise You Won’t Leave Without Me.”
“ Promise You Won’t Leave Without Me.”

“ Promise you won’t leave without me.”

7 years ago
Cassies Take A Tour Of Agility Robotics
Cassies Take A Tour Of Agility Robotics

Cassies Take a Tour of Agility Robotics

Meet Cassie, a sleek bi-pedal robot made by Agility Robotics

Two Cassies decide to take a walking tour of our office. No CG: 100% actual robots.

More Here

7 years ago

IT’S OUT!!!

7 years ago
Your Order Is Processing 💿 For Super Deluxe

Your order is processing 💿 for Super Deluxe

8 years ago
Machine Learning And Big Data Know It Wasn’t You Who Just Swiped Your Credit Card

Machine Learning and Big Data Know it Wasn’t You Who Just Swiped Your Credit Card

by Jungwoo Ryoo, The Conversation

You’re sitting at home minding your own business when you get a call from your credit card’s fraud detection unit asking if you’ve just made a purchase at a department store in your city. It wasn’t you who bought expensive electronics using your credit card – in fact, it’s been in your pocket all afternoon. So how did the bank know to flag this single purchase as most likely fraudulent?

继续阅读

  • themagiclantern
    themagiclantern liked this · 4 years ago
  • dejavu-ai
    dejavu-ai liked this · 4 years ago
  • thamoobilla
    thamoobilla liked this · 5 years ago
  • plumplumplum
    plumplumplum liked this · 6 years ago
  • rareclarity
    rareclarity liked this · 6 years ago
  • chris0390
    chris0390 liked this · 6 years ago
  • jwitha-blog
    jwitha-blog liked this · 6 years ago
  • bobbyluvladyboy
    bobbyluvladyboy liked this · 6 years ago
  • addictiontothings-blog
    addictiontothings-blog liked this · 6 years ago
  • jackpollard-blog1
    jackpollard-blog1 liked this · 6 years ago
  • turtlecudller
    turtlecudller reblogged this · 6 years ago
  • lovingcopbakeryathlete
    lovingcopbakeryathlete liked this · 6 years ago
  • apetesecond
    apetesecond liked this · 6 years ago
  • twistedsquid
    twistedsquid liked this · 6 years ago
  • cosmor
    cosmor liked this · 6 years ago
  • eleganttrashtyphoon
    eleganttrashtyphoon liked this · 6 years ago
  • 12jorge23
    12jorge23 liked this · 6 years ago
  • thecuriositychronicle
    thecuriositychronicle reblogged this · 6 years ago
  • gamesboobsandothergoodies
    gamesboobsandothergoodies liked this · 6 years ago
  • nerevarine12345
    nerevarine12345 liked this · 7 years ago
  • wdmu3e
    wdmu3e liked this · 7 years ago
  • lelerreur
    lelerreur liked this · 7 years ago
  • 4kerr-blog
    4kerr-blog liked this · 7 years ago
  • yaaadhu-blog
    yaaadhu-blog liked this · 7 years ago
  • zanycloudwombatalmond
    zanycloudwombatalmond liked this · 7 years ago
  • blushagua
    blushagua liked this · 7 years ago
  • imjjaayy
    imjjaayy reblogged this · 7 years ago
  • timetobedownunder
    timetobedownunder liked this · 7 years ago
  • i-got-dis-174
    i-got-dis-174 liked this · 7 years ago
  • senseful-void
    senseful-void reblogged this · 7 years ago
  • maxout97-blog
    maxout97-blog liked this · 7 years ago
laossj - 无标题
无标题

295 posts

Explore Tumblr Blog
Search Through Tumblr Tags