Creating Face-Based AR Experiences

Creating Face-Based AR Experiences
Creating Face-Based AR Experiences

Creating Face-Based AR Experiences

Apple have just published an example for developers on how to use their front facing camera on the iPhone X for AR apps:

This sample app presents a simple interface allowing you to choose between four augmented reality (AR) visualizations on devices with a TrueDepth front-facing camera (see iOS Device Compatibility Reference).

The camera view alone, without any AR content.

The face mesh provided by ARKit, with automatic estimation of the real-world directional lighting environment.

Virtual 3D content that appears to attach to (and be obscured by parts of) the user’s real face.

A simple robot character whose facial expression is animated to match that of the user.

Link

An intro video can be found here

More Posts from Laossj and Others

7 years ago
AYA-BAMBI - Slic + Style2paint
AYA-BAMBI - Slic + Style2paint
AYA-BAMBI - Slic + Style2paint
AYA-BAMBI - Slic + Style2paint

AYA-BAMBI - slic + style2paint

Another experiment from LuluXXX exploring Machine Learning visual outputs, combining black and white image colourization, slic superpixels image segmentation and style2paint manga colourization on footage of Aya-Bambi dancing:

mixing slic superpixels and style2paint. starts with version2 than version4 plus a little breakdown at the end and all 4 versions of the algorithm. music : Spettro from NadjaLind mix - https://soundcloud.com/nadjalind/nadja-lind-pres-new-lucidflow-and-sofa-sessions-meowsic-mix original footage : https://www.youtube.com/watch?v=N2YhzBjiYUg 

Link

7 years ago

“Job Done” - RTS Prototype

Worked on the basics of a Real Time Strategy game prototype today, with selecting and commanding units, and worker units automatically searching for resources on the map, mining them, and returning to their base to store the resources gathered.

“Job Done” - RTS Prototype

继续阅读

7 years ago
I…I Think I’m In Love?

I…I think I’m in love?

7 years ago
When Ur In Public And Have To Pretend Not To Be Anxious 
When Ur In Public And Have To Pretend Not To Be Anxious 

When ur in public and have to pretend not to be anxious 

7 years ago
Bitcoin And Ether Mining In Guizhou, China

Bitcoin and Ether mining in Guizhou, China

7 years ago
Standard Beaverette Light Armoured Car MkI/II
Standard Beaverette Light Armoured Car MkI/II
Standard Beaverette Light Armoured Car MkI/II
Standard Beaverette Light Armoured Car MkI/II

Standard Beaverette Light Armoured Car MkI/II

Built by the Standard Motor Company at the order of Lord Beaverbrook, the then Minister of Aircraft Production, the Car Armoured Light Standard or ‘Beaverette’ was intended as a stopgap measure to help with airfield and local defence. Essentially built onto the chassis of Standard’s pre-war commercial models it had thin riveted steel armour, backed by 3-inch oak reinforcement planks, to its front and sides, the MkII added all around armour but remained open topped. 

The Beaverette was typically armed with either a Bren light machine gun or a Boys anti-tank rifle and was crewed by three men - driver, observer, gunner. Weighing two tonnes the vehicle could reputedly reach up to 60mph, however, given its weight this seems optimistic. The weight of the armour was said to quickly fatigue the chassis and suspension. 

Standard Beaverette Light Armoured Car MkI/II

Side view of some Beaverette MkII’s (source)

They were never cleared for foreign service and spent the war helping to train crews and patrolling the British Isles with regular army units (including the The Reconnaissance Corps and Royal Armoured Corp), the RAF Regiment and the Home Guard. Principally, the Beaverette was a stopgap measure, similar to the Armadillo, to supplement Universal Carriers when following the evacuation of Dunkirk the British Army was desperately in need of vehicles.

The Beaverette provided a propaganda boost with many photographs and newsreels filmed of them in action patrolling, this helped to boost civilian morale and prove Britain was not defenceless and that British ingenuity would help turn the tide. Later MkIII and MkIV Beaverette’s added roofs and turrets but remained in limited defensive service. 

Sources:

Images: 1 2 3 4 5

Standard Beaverette, Tank Encyclopedia, (source)

If you enjoy the content please consider supporting Historical Firearms through Patreon!

7 years ago

Harry Potter and the Neural Network fan fiction

Or, what happens if you train a neural network on the titles and plot summaries of over 100,000 works of Harry Potter fan fiction.

In the decades since the Harry Potter books were published, fans have written literally hundreds of thousands of Harry Potter stories of their own, and shared them online. Can a neural network join in on the fun?

In a way, everything a recurrent neural network writes is fan fiction. A recurrent neural network looks at an example dataset (such as the complete Sherlock Holmes stories) and teaches itself the patterns and conventions that it sees. So, if it’s given Sherlock Holmes stories, it will become obsessed with Holmes and Watson, and if it’s given knock-knock jokes, it will spend all day telling awful knock-knock jokes of its own.

image

Thanks to an idea by a couple of readers, some heroic work by @b8horpet in scraping (with permission) hundreds of thousands of Harry Potter fan fiction titles and summaries from AO3, and a flexible new recurrent neural network implementation by Chen Liang, the neural network’s latest obsession is Harry Potter.

The Perfect Party by iamisaac Draco has been left alone, and Ginny confused must learn and who has his best friend. They were breathed by a love that didn’t become his grounds and the flowers begin.

This is a typical example of the neural network’s fan fiction - romantic pairings of two or more Harry Potter characters (called “ships” in fan fiction-speak). In this case, it even has chosen a plausible author: iamisaac is a real and fairly prolific fan fiction author whose works do tend to be of the “romantic” variety. 

The Garden by perverse_idyll for lexigilite Ron and Hermione move after a man party. What did her best things go and has to deal with people she loves? How many imperfect love really belonges them and needs to be a person? Or will they learn and more than the war? Mirror Thing by Queen_Elexhan “Are you there for a relationship? I was a sad future for your love.”  Harry and Ginny find out the meaning is.

Shatters by Kis [archived by TheHexFiles_archivist ] Based on the Spot Are It Falls Into A Heir by NextrangeOnTheThree Draco and Hermione share a whole indescribbening.

Again, “perverse_idyll” and “TheHexFiles_archivist” are fairly active authors. (Hi, if you’re reading! The neural network seems to like your writing, and is writing fan fiction of your fan fiction!) Those familiar with Harry Potter fan fiction will not be surprised to learn that the neural network really likes to generate ships; pretty much every combination of characters is represented (some of the more unusual combinations being “The Snow/Voldemort”, “The Ministry/Draco Malfoy”, and “Voldemort/Random Quidditch Child”).

By turning down the neural network’s creativity setting to near-zero, we arrive at its vision of what the quintessential Harry Potter fan fiction would be like - and we also learn its favorite ship:

Persuading by theladyblack Harry and Draco are still a second chance at the end of the war.  Will they be able to do with the fairy tale of the first time they were a strange stranger to the street of the war and the war is over?

It turns out the neural network is obsessed with Harry/Draco, although in a pinch, Sirius/Remus will also do.

The neural network also seems to really like stories about Professor Snape trying to do rather ordinary things:

New Moon Boys by Dungoonke for Loki_Kukaka Severus Snape comes back to a night’s politics.

In the Reason Is Blinders by LittleRoma Severus has been through his lost remote.

In The Alteri Silence by Forest_of_Holly for roscreens41 Snape receives life after plants to do by work over whether they get into. Just Hell.

A Second Chance by DarkCorgi Snape had a second thing, and that is better than anything for for the rest of his life.

Mirror by orphan_account Severus Snape tries to get a lot of dragons and that was to be more than he didn’t expect to continue. He has always been a bit of an old and a baby to stay the way he’d been the brother at Hogwarts and he keeps the chance of meeting… Deception by FlyingEyes Snape is a British Robes of interesting things and worrys like a little fun and sees the pretty battle for a while.

Another thing that happened, which is pretty much my favorite thing ever, is that the neural network apparently encountered some fan fiction stories that were not in English. As a result, it learned to do this from time to time:

The Secretary Of the World  Challenge inspired by GoF and la mating resigns de la mill colors per mereple beruit carteur la pelete el wert rardo completing and herillo intus den una a des rush sentines kelta an transoles… 

Between by Cheyangel13 A series of fivers are unexpectedly depressed and controlled by the bed, with least more from una perfemale erpensa de the maesse akai suidadium dela vida call de la los se terriuus do form en sou dies de fasurard il resisted de for dogs la sementu sein prong colors itu dee adte se sige natard…

The neural network has also learned to employ capital letters:

Les finds love by violet_quill for starstruck1986 Severus Snape wanted him to be more and she likes Draco.  The person he wants an energy to him.  WHALIDE NO GEATIRE SOURR INSPE AHARMANABLISH ALL SOME TO VERY THE RERIDE!!!!!!!

secret Quidditch by snapsleert Collapse and find the second worst and very different. See Gain and Descent motivate surprising death. Unbusing one of the months: should make more bumo.choooshots. HUGULATED

And the neural network occasionally uses content warnings, although it seems to have a rather fuzzy idea about what to warn its readers about:

Better With The Broom Complicate by Margyn_Black Tonks gets more than the best girl of creation. (Rated Maturisle, mark, a violence, contract) (slash] part of themes) ferret.

Art for the Sun a Scary by disillusionist9 A collection of warnings: characters and situations of silence.

Some of the neural network’s stories, though, are just plain weird.

Harry Potter and the Painful Eyes by dark_pook A Birthday drabble about the problems and a woman who shows up a lot less than she checks at Hogwarts in the destiny to the infamous adventure of control of the Art of The Good Boy Kings With Hermione. Harry and the Blue Special Delicious by apolavia_scg An unexpected potions messaged in the world their lives are to find friendship following the day of different pagers. James and Lily come to the summer before the war.

The Perfect Cow by alafaye Severus and Hermione start a horcruxes

Art: Let Draco roll the light of the moon, and means. by Dangelanne What happens after the war. Not drawn to Draco Malfoy jumpers. Originally written in 2008.

Birds of a Saturday by SasuNarufan13 Harry Potter is drunk and discovers he is an alternate universe.

Holly theody by yesIpxdishoftlyGrinli What would be dangerous! Side Voldemort Jones does all lord off the sunshine show.

Lily Evans and the Ravenclaw of a Christmas Surprise by ci Severus angst the truth of a frighten situation for the wink.

Persuasion by Samanthian The Sorting Hat is fighting in one of the houses.

lily’s family by sharkle Harry woke up in searching after a werewolf Sherlock’s picnic. He is furious.

As a bonus, I leave you with some fairly-plausible screennames the neural network invented, which appear not to be taken (yet):

desire_at_the_malfoy SeverelyAshed fishlingthelovely thedarklyblue phantombeers captainingthetrain siriusly_harry DarkVoldember ChildOfAtSperble all_frogs BelladonnaLeek Sneaking_UnicornWitch bluemelooppiesweatled

7 years ago

Timelapse of Star Trails over Sparks Lake, Oregon

7 years ago
Tele-present Wind
Tele-present Wind
Tele-present Wind
Tele-present Wind

tele-present wind

Installation by David Bowen reproduces realtime wind data with a collection of mechanized stalks:

This installation consists of a series of 126 x/y tilting mechanical devices connected to thin dried plant stalks installed in a gallery and a dried plant stalk connected to an accelerometer installed outdoors. When the wind blows it causes the stalk outside to sway. The accelerometer detects this movement transmitting the motion to the grouping of devices in the gallery. Therefore the stalks in the gallery space move in real-time and in unison based on the movement of the wind outside.

May-September 2018 a newly expanded version of tele-present wind was installed at Azkuna Zentroa, Bilbao and the sensor was installed in an outdoor location adjacent to the Visualization and Digital Imaging Lab at the University of Minnesota. Thus the individual components of the installation in Spain moved in unison as they mimicked the direction and intensity of the wind halfway around the world. As it monitored and collected real-time data from this remote and distant location, the system relayed a physical representation of the dynamic and fluid environmental conditions.

More Here

Related: Another project by David from 2012 did something similar with ‘Tele-Present Water’ [Link]

7 years ago
Example-based Face Stylization - Web Demo
Example-based Face Stylization - Web Demo

Example-based Face Stylization - Web Demo

DCGI and Adobe Research have put up an online interactive demo of their stylized facial animation paper.

Just drag and drop an image with a face into it, select one of the styles on the right, hit ‘Submit’ and see what happens …

Try it out for yourself here

  • bachatanero
    bachatanero liked this · 7 years ago
  • danysterkhov
    danysterkhov liked this · 7 years ago
  • itokani
    itokani liked this · 7 years ago
  • designazach
    designazach liked this · 7 years ago
  • laossj
    laossj reblogged this · 7 years ago
  • laossj
    laossj liked this · 7 years ago
  • sun-on-the-ceiling
    sun-on-the-ceiling reblogged this · 7 years ago
  • dragunyash
    dragunyash liked this · 7 years ago
  • triakis
    triakis liked this · 7 years ago
  • hsmt
    hsmt reblogged this · 7 years ago
  • lawnmowermetaverse
    lawnmowermetaverse reblogged this · 7 years ago
  • lawnmowermetaverse
    lawnmowermetaverse liked this · 7 years ago
  • sinnephi
    sinnephi liked this · 7 years ago
  • virtual-reality-dimensions
    virtual-reality-dimensions reblogged this · 7 years ago
  • g-dub-interactive
    g-dub-interactive liked this · 7 years ago
  • paranoid-jomel
    paranoid-jomel reblogged this · 7 years ago
  • paranoid-jomel
    paranoid-jomel liked this · 7 years ago
  • arghsea45-blog
    arghsea45-blog liked this · 7 years ago
  • hellaqueenforlife
    hellaqueenforlife reblogged this · 7 years ago
  • hellaqueenforlife
    hellaqueenforlife liked this · 7 years ago
  • tiger-child
    tiger-child reblogged this · 7 years ago
  • tiger-child
    tiger-child liked this · 7 years ago
  • sward
    sward liked this · 7 years ago
  • kanvassdk
    kanvassdk reblogged this · 7 years ago
  • leftfootism
    leftfootism liked this · 7 years ago
  • dongshicaa
    dongshicaa liked this · 7 years ago
  • jacetestkitchen
    jacetestkitchen reblogged this · 7 years ago
  • crashlandia
    crashlandia liked this · 7 years ago
  • left-luggage
    left-luggage reblogged this · 7 years ago
  • left-luggage
    left-luggage liked this · 7 years ago
  • e0en
    e0en liked this · 7 years ago
  • akawizzard
    akawizzard liked this · 7 years ago
  • shryggur
    shryggur liked this · 7 years ago
  • oraclesofnorway
    oraclesofnorway reblogged this · 7 years ago
  • oraclesofnorway
    oraclesofnorway liked this · 7 years ago
  • slcr303
    slcr303 liked this · 7 years ago
  • solsmed
    solsmed liked this · 7 years ago
  • romtheworld
    romtheworld liked this · 7 years ago
  • thatoneozellot
    thatoneozellot liked this · 7 years ago
  • 31-44
    31-44 reblogged this · 7 years ago
laossj - 无标题
无标题

295 posts

Explore Tumblr Blog
Search Through Tumblr Tags