Hammer & Tusk

VR Mastery

[hammerandtusk]

Visit Original Link

Join us to Make a Splash by taking a 360 video at 10am July 16th. Google adds a VR shell, mixed reality vs augmented reality, Steven Spielberg signs on, Weather Channel toys with AR, and a new AR helmet lets pilots see through fog.

[hammerandtusk]

Make a Splash, Win a Homido-Mini!

Issue #66

Last week we wrote a review of the new app Splash, which lets iPhone users create short 360 videos. Well, now we're giving you the chance to try it out for yourself! We're going to make a global splash, each of us taking photos of our neighbourhood at exactly the same time and posting them all to Twitter using the hashtag #HTSplash. We'll pick our favourite to win their very own Homido-Mini mobile VR headset! (We saw one of these at So/VR and immediately started salivating.) To get in on the action, just send your tweet on Saturday, July 16 at 10am PST. Porn is often seen as one of the main drivers of technological adoption, and people look to gaming and pornography to decide whether new technology has the staying power it needs. Well, porn has yet to have its (pun intended) come to Jesus moment. Read on for a slightly NSFW review of the current 360 porn offerings. Plus, mixed reality is just AR with good publicity, Spielberg comes to Jesus, and AlphaGo doesn't know when to stop thinking. Love,

Mack and the H&T Team

Find us on Facebook and Twitter.

If you haven't subscribed yet, you can sign up for Hammer & Tusk.

Take a Sip

Google is Adding a VR Shell to Chrome to Let You Browse the Entire Web in VR

One step closer to Stephenson's idea of the multiverse.

Google is working add fully immersive browsing capability to Chrome, allowing users to browse any part of the web in VR.

Mixed Reality Is the Latest Thing in Virtual Reality. Or Is it?

While mixed reality is arguably a more advanced version of AR, where the holograms can interact with their environments, you could also just call that... AR that works well.

Magic Leap and Microsoft insist that mixed reality is better than augmented reality. Branding experts say it's all about sounding cool and sci-fi.

Why Steven Spielberg's Approach Could Crack VR Filmmaking

After sounding lukewarm on VR in the past, turns out Spielberg is developing a series. 

VR is a cross-pollination between what you might consider a live performance and cinematic storytelling.

Weather Channel turns to augmented reality for 2016 hurricane season coverage

Newsrooms have a bad habit of using technology for no good reason, and here's another example in the making. Do people need to be encouraged to flee devastating hurricanes?

This hurricane season, the Weather Channel intends to virtually flood its studio in order to encourage people in harms' way to evacuate from an approaching hurricane.

The 'X-ray' top gun helmet: Augmented reality display lets pilots see through clouds

Industry is once again driving innovation in AR.

A new helmet-mounted display could be a pilot's 'eye in the sky', as it has the ability to see through even the thickest fog and create digital images of on coming obstacles.

Quick Links

When the headline is all the news you need.

Starbreeze bolsters VR & AR team with $1.6M acquisition of ePawn.

Sony Pictures appoints VR point person.

Meta closes $50M funding round with Lenovo and Comcast among funders.

Like what you read? Don’t forget to check out the latest issue of Hammer & Tusk! 

[hammerandtusk]

VR Porn is Supposed to Drive Industry, But it’s Just Awkward

The adult entertainment industry is often cited as a driver of technology adoption - not only did pornography create users for the early Internet, it then pioneered streaming video, tracking devices, and internet cash transactions. Biofeedback, 3D video, virtual worlds, and lobbying for anti-piracy legislation are all areas where adult entertainment has made huge headway, allowing technology to trickle down to more mainstream industries. Many people argue that virtual reality won’t achieve mass adoption unless it can crack the twin vaults of gaming and porn.

So how’s porn doing?

There have been a few reaction videos that suggest that while the adult entertainment industry is on board, consumers aren’t there yet. I set out to find out why - is VR porn too hard to find? Is it not well-made? Or is there something else keeping the normally active market from amorously embracing VR porn?

I was using the iPhone 6 Plus and a Google Cardboard headset. My first step was literally to pull up Chrome and type in “vr porn.” The first three sites that came up were Pornhub, VR Smash, and Virtual Real Porn. I’d heard of Pornhub (we’ve covered the launch of their free VR section), so that was where I decided to start.

I clicked on the site, and then selected the first video I came across. When I hit play, the double images were stacked one on top of the other instead of being side to side. I rotated my phone a few times trying to figure out if I was doing something wrong, with no luck. Investigation revealed a small note: “must have VR viewer.” The note was a clickable link to the app store. I wasn’t thrilled that I would have to download a prioritary app just to view the video (I don’t usually trust developers I don’t know), but journalistic curiosity had to be satisfied. I downloaded the app that was recommended (Free VR Viewer by Ginger Monkey) and I was on my way.

Except I wasn’t.

It still didn’t work. Nothing was happening. After I downloaded the app it didn’t direct me back to the website, and when I navigated back to it and clicked play on the video, it was identical - stacked instead of side to side, and with the same note about needing a VR viewer. I was starting to think a casual user would have given up; but I was determined. I tried downloading the video, thinking maybe I needed to watch it from my phone. The download link didn’t seem to work. I tried the next one, which read “Download iOS app.” Weirdly, that was the link I needed to play it (as far as I could tell it didn’t download anything to my phone, despite the clearly labelled misnomer.) If this hadn’t been a work experiment on my work phone, nothing would have made me click a suspicious download link on a porn site.

Okay, so I was past the unintuitive hurdle which seemed designed as some culling ritual to remove the unworthy. Now that I had accessed the video that was expressly designed for Cardboard - it still didn’t work! At least here the interface was intuitive for anyone who’s used Cardboard on Youtube. I clicked the little viewer symbol and finally, I was cooking with gas.

Or at least I was watching VR porn.

Bad, bad VR porn.

The video was super low resolution, and the guy had his face blanked out like some kind of defendant on Cops. Everything was hard to see, and all of the action was taking place to my right so I had to turn awkwardly to the side to watch it. (I later realized there was a button that I could use to recentre the view, but again, it was hard to find and I couldn’t access it while in Cardboard view, so I kept being tossed out, adjusting it, and then firing it back up.)

Okay, one bad video does not a bad platform make. I tried a second one. This one was a point-of-view video, which I later discovered is basically all you can find, despite my initial offering. The resolution was a lot better and things weren’t quite as fuzzy, but instead of a person there was just a large black fuzzy hole (pun not intended). The actress leaned down and in a sultry voice murmured, “Feel my toes wrapped around your ****.” I looked down at said toes - but they had vanished into the darkness. Any sense of immersion was gone, and her interacting with my invisible body was off putting. I clicked away.

The third video was as fuzzy and indistinct as the first. This POV video had a male body laying flat on a bed like a creepy bearskin rug. Something about the angle made the body look eerily flat, and the background had been stitched together to remove the head, so I was sitting with my head on top of some kind of weird supernatural headless horseman bearskin rug. Needless to say, it was a little distracting. The terrible acting going on in front of me didn’t help matters. I moved on.

I clicked through video after video. A bunch of them were doubled - there was no way to calibrate for the viewer I was using, so the display was off for most of them - and the ones that weren’t doubled were painfully low resolution. I had heard that the female POV videos were even more disconcerting than the male ones, but I couldn’t find any. I gave up and headed over to VR Smash to see if their offerings were any better.

VR Smash didn’t require me to sign up for a third party viewer, which was good. I still couldn’t calibrate for my viewer, but I did realize I could change the size of the image between two options, which helped a lot. So I found a clip that wasn’t POV (I have firmly decided that those are creepy and I didn’t want to see one more bearskin rug man) and clicked the cardboard symbol. I turned my head - nothing happened. I dipped and turned again. Nope. It was fake VR. I tried two more clips. They were the same. Sort of 3D, but not 360. I headed back to Pornhub - at least their bad VR porn was actually VR porn.

I had pretty much given up on the notion that there was ANY good VR porn when I stumbled across a video that managed to do it well. The picture quality was a lot higher than other videos, with no blurring or obvious pixels. The conceit was that the viewer was on the other side of a webcam, and the girl was talking to her computer. You could look around 180 degrees, about what a webcam would show, and the girl was very close to the camera. The sense of presence was incredible - I felt like she was really talking to me. My only issue was that I wasn’t sure what the clip gained from being in VR. Since she was talking to a webcam, it would have made more sense to watch on a computer. Then again, I’m not sure I would have been as transported inside the scene if it hadn’t been in VR. There were moments when I forgot she wasn’t sitting on the bed across from me.

Right now, VR porn is hard to find and badly made. The free stuff isn’t driving anyone beyond the paywall, and having the technical know-how to access content is a huge barrier (one of my friends tried and gave up as soon as it asked her to download software). Until the quality gets better, VR porn is going to stay where it is - as a novelty.

[hammerandtusk]

Visit Original Link

We discuss Magic Leap and whether they’ll want to sell, Yahoo’s Tiles ad platform, Stereolabs position tracking for mobile, the VR film Notes on Blindness, Rolls-Royce’s jump into AR drone ships, and storytelling in VR.

[hammerandtusk]

Journalism is the Future of VR, if Journalists Have Anything to Say About It

Issue #65

Our symposium on virtual reality journalism went off on Saturday with a bang. Attendees were treated to a group of incredibly well-informed and thoughtful speakers who dove deep into relevant subjects, including thought-provoking conversation about the differences between documentaries and news, lectures on the challenges of creating 360 content, and demos of award-winning 360 docs and features. Video of the event will follow, and for now treat yourself to a FOMO-inducing recap of the festivities. In other news, the start-up Splash has announced $2.5M in funding for their 360 video app, which lets iPhone users create their own videos with nothing but a smartphone. We gave it a whirl and created a cool Splash of our local Terry Fox memorial. Plus, filmmakers discuss how to rethink storytelling in VR, Rolls Royce develops a fleet of drone ships that rely on AR, Yahoo gets into 360 ads, and we weigh a prediction that Disney will buy Magic Leap.

Love,

Mack and the H&T Team

Find us on Facebook and Twitter.

If you haven't subscribed yet, you can sign up for Hammer & Tusk.

Take a Sip

Prediction - Disney Will Buy Magic Leap

This article sparked some fantastic argument in our Facebook group. Agree or disagree?

I am making a bold prediction - that Disney will buy Magic Leap by the end of 2017 for upwards of $25 billion.

Yahoo Introduces new mobile ad format Tiles, focused on 360 images, video

Marketers all want a slice of the VR pie, and Yahoo is about to make that a lot easier for them.

“Yahoo Tiles”...offers 360-degree imagery and video on the Yahoo Gemini and BrightRoll ad platforms.

Mobile Virtual Reality Breakthrough Means Gear VR Could Soon Be As Powerful As Oculus Rift

How much do you want to bet that Daydream will incorporate similar technology?

Positional tracking on mobile VR headsets has been seen as one of the holy grails for those involved in developing virtual reality technology.

Understanding Blindness through Virtual Reality

If you haven't been particularly impressed with 360 films, this is apparently the one that will change your mind.

Notes on Blindness is a new film and virtual reality experience simulating how people who are blind use sound to recognize spaces and form mental maps.

Rolls-Royce's Vision Of The Future: A Fleet Of Drone Ships Controlled By Augmented Reality

Forget self-driving cars: self driving boats is the way of the future.

It’s unlikely then that you’ll think of a drone as a 600-feet tanker, slowly crawling over thousands of miles of ocean. Well Rolls-Royce thinks of them as just that.

Article of the Week

The struggle to adapt storytelling for virtual reality

The question isn't whether VR film will work, but whether current filmmakers will be able to make the transition.

Can filmmakers turn into VR makers? Will they infuse this immersive format with dramatic storytelling? Or will it remain a simulated world that's best suited for interactive gaming?

Quick Links

When the headline is all the news you need.

OSVR fires back with no-strings attached development fund for VR.

Twitter hires ex-Apple designer to lead new VR/AR team.

Like what you read? Don’t forget to check out the latest issue of Hammer & Tusk! 

[hammerandtusk]

Journalism is the Next Frontier in Virtual Reality

Virtual Reality has been described as the next platform shift, and its applications in journalism are wide-reaching. The New York Times has invested in both 360 video and immersive films in its partnership with Google Cardboard, shipping 1.2 million viewers to their subscribers. The Associated Press has launched their own VR/360 channel in collaboration with AMD to feature the news organization's latest advances in immersive journalism. Even the The Des Moines Register has created a VR experience, a tour of a family farm in Iowa.

The technology is here to stay, and learning how to use it as more than just a gimmick will be a key to content creation in the field of journalism in coming years. At the Symposium on Virtual Reality Journalism that took place in Vancouver this past Saturday, attendees sat down to learn how virtual footage is created, the strengths and weaknesses of the medium, and what the first steps are towards adoption of this burgeoning technology.

Key Takeaways

1. Journalistic Integrity Faces New Challenges

Integrity is the cornerstone of great journalism. Facts cannot be tarnished with opinion, the truth must be delivered directly to the audience, and the journalist cannot interfere with their subjects. Some of these are harder to adhere to than others, and a commitment to each needs to be reaffirmed in the face of this new medium.

RYOT’s Tyson Sadler explained that not affecting the subject matter is a difficult one with 360 content. Because directors and camera operators can’t be near the equipment when filming (or they would be visible in the shots), there’s a lot less control than there was with traditional film. That can lead to a temptation to reclaim that control by setting up shots, or taking shots over again if they don’t suit. There’s also a lot of re-creation that goes on with 360; getting interactive footage is challenging and expensive, and there often isn’t enough footage to build an entire story around. So many directors fill in 360 videos with 160 video, still images, and picture-in-picture interviews. Emblematic, for instance, uses crime scene footage and real 911 audio files to create digital representations of past events. That can be a problem if documentary makers aren’t differentiating for the audience, something Emblematic is always careful to do.

There was a lively debate on the differences between documentary and journalism, with AP’s Paul Cheung arguing that documentary is always more staged than on-the-ground reporting, while Emblematic’s Cassandra Herrman felt that documentary’s responsibility to portray truth is just as far-reaching as that of more traditional coverage. Both agreed that not everyone (on both sides of the journalism spectrum) are as conscientious as they need to be, especially with VR’s more immersive properties on the table.

2. The Eye Can Wander

Refah Mahmoud of Dryft Digital started the conversation about directing. Famous directors like Spielberg have come out against virtual reality (though Spielberg himself has done an about-face, signing up for a VR scripted series), afraid that without the frame their role is meaningless. Directors decide where you should look; their entire purpose is to frame the story, and that relationship is so fundamental that one of the first things we think of visually is a director holding their hands up in a rectangle to simulate the camera’s gaze.

With virtual reality, that relationship changes completely. The audience’s interaction is better likened to theatre, where the director must consider every part of the landscape where the viewer’s eye might stray, and use tricks and techniques to draw the gaze where they want it. In theatre that can mean placing the action closer to the front, changing the lighting, and having the speakers as focus. In VR that means visual movement that will draw the eye to the next moment (animals work really well), audio cues (for devices that support spatialized audio), and leaving off a scene on the same angle you start the next one on.

If a theatre director fails to keep the audience’s eye where it’s supposed to be, the consequence might be that they miss some of the plot. But because VR is still such a nascent technology, the consequences of losing a viewer might mean they never try another experience, not realizing the problem wasn’t with the platform itself. Because of that, putting out quality content now has to be at the forefront of every creator’s mind, and making sure the audience doesn’t feel like they’re “missing” the show is integral to that success.

3. The Empathy Machine

“I asked my staff to go film some fireworks,” Paul Cheung said, referring to his complaint that right now, virtual reality seems to be the sole domain of depressing stories. VR is often described as an empathy engine, and filmmakers have seen huge success in bringing light to important stories of hardship around the world. As Taylor Owen of UBC’s digital journalism program explained, virtual reality “presents a new means for representation: evoking emotion & empathy.” Immersive experiences have the ability to connect with the viewer more deeply than traditional documentaries - and truly interactive VR brings an element that even 360 cannot. It digs into emotions, the sense of presence making the viewer feel like part of the experience.

From the Ebola outbreak to Syrian refugees, all of the docs demoed at So/VR were about very weighty subject matter. The use of the empathy engine in this way has positive effects - after watching Clouds over Sidra (a film about Syrian refugees) doubled the donations the charity received. And while those tear-jerking experiences are contrasted with nature stories and sporting events, there’s still a lot of room for positive human interest stories in the VR world.

One of the highlights of So/VR was the chance for journalists to get hands-on with the technology. Many had never experienced the HTC Vive, HoloLens, or Samsung Gear, and one or two had no familiarity with even Cardboard. Understanding it from the user’s perspective is critically important to creating content, so the chance to get hands-on had many attendees singing the technology’s praises. If there had been an HTC Vive booth, several would have walked away $1000 poorer.

If there was one lesson learned over the course of the day, it was that the appetite for virtual reality is real, powerful, and growing. It will only be a matter of time before this nascent medium takes its place on the stage, and reporters will be there - talking about the story, and making it.

Hammer & Tusk would like to thank our amazing sponsors for helping make So/VR possible.

[hammerandtusk]

Splash is Vine meets Snapchat, for VR Videos

Backed by $2.5 million in funding, Splash has just released a new app that allows anyone with an iPhone to create their own 360 videos.

The app lets users take a short video with their phone, and then fill in the environment with snapshots which it quick-stitches together. The result is a slightly jerky pastiche, but for a casual user who just wants to share videos with friends, the results are great. (Don’t expect to be the next Spielberg - the video length is short, and the stitch lines are very visible.)

The UX is slick (it highly resembles Instagram), but possibly too slick. There are very few buttons or menus, and no built-in tutorial to help you figure out the different screens. The first time I used it I tried to take videos of my entire environment, lining each shot up perfectly, which took forever. The second time around I realized I could take a video of my subject matter and then “fill” the environment by quickly snapping all around me, which was way faster (and way more fun). Once I got that down, I splashed out a bunch of videos with no problem at all.

Speaking of Instagram, Splash users have profiles and can follow or be followed by both friends and strangers. The app doesn’t offer a native search function to add your friends, which is an oversight, but you can “share your profile” through text or email. Once Splashes are made they can be shared through pretty much every social media channel you can think of, and the process was dead easy. My only complaint is that when I first tried to share it on Youtube I thought the video was flat; but it just took awhile to load, and looks great now. Facebook also supports the full 360 experience.

This offering is a step up from Android’s native ability to take 360 photos, adding both movement and sound. I could see a great partnership between Splash and Snapchat, or Splash and Vine, both of which have similar concepts for a 2 dimensional world.

The next time I go hiking, there won’t be a Facebook album full of still pictures of mountains and trees - there will be Splashes.

----

Written by Wren Handman

[hammerandtusk]

Visit Original Link

This week we prepare for our Symposium on VR Journalism, which will feature conversations with Emblematic, Associated Press, RYOT, and more! Plus, we break down peripherals for VR, talk therapy, and bring you the latest pretty infographics.

[hammerandtusk]

Symposium on Virtual Reality Journalism

Issue #64

Will YOU be at So/VR? Virtual reality has been described as the next platform shift. The technology is here to stay, and learning how to use it as more than just a gimmick will be a key to content creation in the field of journalism in coming years. That's why Hammer & Tusk is presenting a symposium for journalists and documentarians. There will be lectures, panels, demos - and of course free lunch and drinks! THIS Saturday, June 25, at the Pacific Rim hotel. Want to attend but haven't picked up a ticket yet? Using the hashtag #SoVR, tweet us your favourite VR experience. We'll pick one winner and give them 2 free tickets to the symposium! Plus, we've got a really interesting blog for you this week about 3D audio. It's an often over-looking part of creating for virtual and augmented reality, but it can radically alter the immersive quality of an experience. Give it a read and let us know what you think. Meanwhile, we list some game-changing companies, scientists come up with a potential nausea cure for VR, and theatre provides lessons in directing for VR.

Love,

Mack and the H&T Team

Find us on Facebook and Twitter.

If you haven't subscribed yet, you can sign up for Hammer & Tusk.

Take a Sip

Technology Startups: The Game-changers of Virtual and Augmented Reality

Great infographics about the biggest players in VR and AR, and where they are differentiating themselves.

It has become important to disambiguate VR from AR in order to clearly understand their individual pathways, future, and inclination of the markets.

Designing Virtual Reality for Pain Reduction

Distraction therapy is a well-known treatment for pain relief, and VR brings that to another level.

Virtual reality is not widely used in clinical practice outside of research studies, because many of these systems are customized and expensive.

Virtual Reality Will Open the Door to Incredibly Intimate Surveillance

People got really upset when they first read the Oculus privacy guide, and calmed down when they realized Facebook already collects most of that information. But the fact remains, headsets let you capture a degree of information we've never seen before.

Virtual reality analytics could become the most pervasive form of mass surveillance ever, allowing advertisers to mine people’s very bodies for information that could be used to manipulate them.

Leap Motion Shows How We'll Interact With Our Hands in Virtual Reality

It'll be interesting to see whether we want to toss the controllers; for some games, having a physical thing in your hand actually increases immersion.

Leap Motion showed off three impressive new dazzling videos this week that will make you want to toss out those Vive motion controllers and Xbox controllers and simply use your hands in virtual reality.

Fighting Virtual Reality Sickness

If this works, it's a much simpler solution than other proposed fixes.

The study showed that by strategically and automatically manipulating FOV, the degree of VR sickness experienced by participants can be significantly reduced.

Article of the Week

4 Lessons VR and 360 Video Filmmakers Can Learn From the Theater

Many directors have cited VR as the death of the director, but this article makes a strong point that theatre has many of the same hurdles.

Theater calls for each character on stage to have a full storyline... since during a play the director cannot control where the audience will choose to look.

Quick Links

When the headline is all the news you need.

Case Western & Cleveland Clinic to use AR for medical education.

VR Therapy and Counseling Center wins startup prize for PTSD treatment.

Comcast Corp. leads $6.8M investment round in Felix & Paul Studios.

Lumus secures $15M to expand AR optical display capabilities.

Like what you read? Don’t forget to check out the latest issue of Hammer & Tusk! 

[hammerandtusk]

Listen to the Third Dimension

When we step into a virtual experience we’re trained to examine the physical characteristics of what we’re seeing. We talk about pixel density and whether the graphics are convincing; we discuss blur and lag. But going on all around us, unnoticed by most but integral to the quality of the experience, is sound.

Audio is a fascinating and complicated aspect of VR. We tend to think of audio as being either mono or stereo and assume that’s enough, but spatialized audio is an important factor to realistic immersion in virtual environments. Is that bird a foot away, or ten feet away? It is swooping closer and farther away? Does it dip higher or lower? Accurate sound helps our eyes believe what’s in front of them, and can make the difference between a mediocre and amazing experience in VR.

Hammer & Tusk sat down with the founders of Superpowered, a developer of low latency mobile audio technologies which will soon release their 3D spatializer tech, to learn about the challenges and innovations in the field today.

One of the most important factors for providing spatialized sound is the Head Related Transfer Function (HRTF). HRTF is a mathematical function describing the frequency response of a person’s ear. By creating a dummy head and inserting microphones into the ear, researchers (mostly working out of universities) could see how sound was distorted by the ear canal. They took measurements of sound coming from every conceivable angle, and from that data created the HRTF. Spatializer software checks which angle sound should come from and compares it to HRTF measurements to design 3D sound.

The challenge is that every person’s ear is different, and often in significant ways. The frequency response of your ear can be radically different from that of your parents, and even things like how you wear your hair or what clothing you have on can have a huge impact on how you perceive 3D audio. (Because your brain quickly adapts to “normal” changes you don’t perceive a difference if you wear your hair differently, but it’s there.) Despite this, all of the measurements on which the HRTF was built were taken either using artificial heads, or with a very small number of real human ears. The result is that spatialized audio has been unintentionally built for silicon heads, which works well for some, but provides a subpar experience for others.

The second most important factor in 3D audio spatialization is whether the company uses object based audio or cinematic based audio.

Imagine a virtual reality game where every object has a sound source attached. If there are twenty birds flying around your head, each one has a separate audio source, emitting sound from a different direction and distance. That is object based spatialization. If you have twenty birds, it requires much more CPU processing power than if you have five birds. This is the best approach for the highest audio quality, but it can be extremely problematic for mobile VR, where your CPU capabilities are quite limited.

Cinematic audio is completely different. If you have a recording in the real world, a spatialized recording, or if you have a movie with 3D sound, then you don’t have all the audio sources sound separately, because the microphone picks up everything all at once - all the ambience, the speech of the actors, car noises, everything. You may have four or six microphones, but there’s no ability to parse those audio streams for greater clarity. This is how live scene are recorded, and movies with 3D audio.

Once you have that audio, you have to translate it to a three dimensional world, and this is done with a metaphorical ‘sound wall.’ Audio designers create what is essentially a sphere of speakers around the user. The position of those speakers can’t change or move; they’re set.  If a bird flies across the scene the speakers don’t change position; rather, the sound tracks through to be emitted by different speakers based on its location. So if there is one speaker to the left and one to the right and the bird flies between, the sound fades out of one and comes up in the other.

Generally speaking, game designers build with object based VR, but when designing for mobile they’re forced to resort to tricks to get the soundscape to work without throttling the CPU. For instance, a designer might choose two birds that interact closely with the player, and then the other eighteen birds will be processed as a single sound source. That can be a serious detriment to audio immersion, but it’s what Oculus uses for its spatializer software.

The other tactic for reducing CPU consumption is commonly used for Google Cardboard apps, and it called a fixed cinematic setup. Rather than being object based, it maps each bird to a specific speaker. Essentially, this allows them to convert a game created with object-based audio into a game that’s cinematic audio, so it can run comfortably on mobile. But this results in the same audio quality as every other cinematic-based system.

Gabor Szanto, CTO of Superpowered, explained their unique solution to this problem. Advanced audio algorithms for processing on resource constrained devices let them provide the benefit of object-based audio without the drawbacks. By being incredibly efficient with regards to CPU, they allow more spatialized sound for the same output, outperforming Google and Oculus by as much as twenty times. That’s a significant difference on a mobile device - Oculus allows 10 distinct spatialized sounds, whereas Superpowered allows 60.

Rendering on mobile devices is computationally very expensive, and unlike desktop, mobile has resource-limited processing. Most people believe the way to solve this is to invent better hardware - bigger, faster chips and more memory. But that takes a long time to develop, and meanwhile users are left with a non-ideal experience. Solutions like this provide immediate relief for developers who need a solution today - not in Q4 of 2020.

Many people believe that mobile will be the future of VR. Google is certainly putting their money behind it, and others aren’t far behind. Facebook is creating 360 content for their news feed, Samsung is betting big on the Gear system, and even Apple is rumoured to be getting ready to dip their toes into the virtual reality market. But if we’re going to bet on the horse, we have to make sure we’re putting the best product forward. Experiences have to be created with mobile in mind, and that means finding solutions to make 3D audio work - and make it as immersive as it can be.

--

Written by Wren Handman

[hammerandtusk]

Visit Original Link

The first episode of Hammer & Tusk’s revised weekly podcast. We chat about VR sex, Bjork, curing arachnophobia using VR, stitching, Lenovo, and Draw Your Blade.

[hammerandtusk]

Draw Your Blade and Kill Pornography

Issue #63

You've probably noticed that part of Hammer & Tusk's format is a persistent interest in adaptation and evolution. This is an emerging field, and since everything is always changing, we like to change with it! Recently you've probably noticed our adoption of the "Quick Links" format to bring you news you might care about, but you don't want to read about.  

We're poking at the edges again, and this time we're looking for partners who might be interested in riding a little bit of the wind beneath our wings. If you're curious about being a Hammer & Tusk sponsor, drop us a line and let's talk about why you're interested in getting involved with H&T, and what you love about this community. 

Last week saw 4,000 folks attend the largest ever AWE, and the biggest takeaways were how AR and VR really intersect when it comes to enterprise and B2B applications. Check out our blog and read this attendee's thoughts on the matter. 

Plus, Lenovo has finally unveiled the Phab 2 Pro, Björk is better in VR than she is live, and VR struggles to find price points for new services.

Love,

Mack and the H&T Team

Find us on Facebook and Twitter.

If you haven't subscribed yet, you can sign up for Hammer & Tusk.

Take a Sip

Why Virtual Reality Sex is More Likely to Kill Pornography Than Monogamy

People talk about porn as a driver of technological adoption, but some experts believe VR could create a seismic shift in porn, to the degree where the industry would be almost unrecognizable.

Because of the VR interface — images, voices, movements — the contours of real world relationships can penetrate virtual space.

Björk's New Virtual Reality Experience May be Better than Björk in Real Life

The joy of a live concert is seeing the artist in the flesh, but in a large arena show the artist is too far removed; VR could let every fan feel like they're front and centre.

The difficulty of catching a glimpse of Björk, further shielded behind a jewel-studded mask, prompted rumours in the crowd she was not present at all.

Virtual Reality Arachnophobia Therapy Is A Definite Nope

We've posted a lot of articles about the success of VR in treating mental illness. This reporter tried it out for himself, and he was NOT impressed.

Can a virtual reality application help me overcome my fear of spiders? Not like this it can’t.

Virtual Reality Stitching Can Cost $10,000 Per Finished Minute

This price-tag might seem hefty, but consider the amount of work that can go into stitching. When you break it down by the hour, it isn't so staggering.

As a fledgling market, VR content creators are still trying to figure out how to make VR experiences — and how to monetize them. 

Lenovo’s Phab 2 Pro: Here’s How the Google Project Tango Smartphone Works

We've been looking forward to Tango since Google first announced they were working on it. The foldable phone (sadly only a prototype) would make this technology even more accessible.

Lenovo Phab 2 Pro will enable augmented reality (AR) experiences, and relies on a set of sensors and software to map its surroundings.

Article of the Week

You can Literally Draw Your Own Weapons in this Virtual Reality Prototype

I tried this game thinking it would be fun to draw my blade, but it turns out the best part is being bombarded on all sides by enemies. I have never been so simultaneously stressed and happy.

Things like this are the first step toward truly being able to shape our own reality.

Quick Links

When the headline is all the news you need. 

Tencent Holdings and Lenovo join $50M round of funding for Meta.

Spielberg-backed Virtual Reality Co. secures $23M.

Limitless has raised close to $1M in seed funding.

Like what you read? Don’t forget to check out the latest issue of Hammer & Tusk! 

[hammerandtusk]

Enterprise Dominates AWE

In its seventh year, Augmented World Expo 2016 saw over 4,000 people attended, ranging from CEOs to investors to creative agencies. The convention’s demo floor was split in two, with augmented reality on one side and virtual reality on the other. Walking around the convention centre, I noticed something very different from other mixed reality conferences I’ve attended: there were many companies demonstrating the enterprise and business use cases of AR and VR. For many people, VR and AR are going to be the new way to experience games, films, and entertainment; but immersive technologies have much wider applications. Although VR gaming is the near-term opportunity, with consumer VR headsets already available and more coming this year, the AWE demo floors were overwhelmingly full of commercial and enterprise use cases for both VR and AR.

In the press, VR and AR are often mentioned separately, and this conference really unified the two types of mixed realities via enterprise use cases. 

Below are some CB Insights data I pulled using their Trends feature on how often the two terms are mentioned in the press:

Now, look at CB Insights Trends on how VR and AR are mentioned in relation to gaming and enterprise:

When AR and VR are mentioned in tandem with gaming, VR dominates the conversation; however, when AR and VR are combined with the term enterprise, they are almost on par. This mirrored what I saw at AWE.

I saw representatives from various aerospace, defense, manufacturing, marketing, and logistics companies walking around the demo floor. At one of the talks, the CEO of APX Labs (makers of an enterprise smart glass platform) talked about the business impacts of smart glasses for work.  The company’s survey shows that 93% of companies are exploring wearables (wearables include heads up displays, smart watches, smart glasses etc.), 83% use multiple wearable devices, and 79% of started using wearables in the last 18 months. A representative from Boeing discussed how using smart glasses with voice command reduces the amount of time between intent and action, thus speeding up its assembly of a wire harness. As a former engineer at an aerospace company, having spent time as both as a manufacturing engineer on the production floor and within a supply chain capacity, I could see AR’s potential impacts on a production line.

At AWE 2015, another Boeing presentation talked about the results of an internal study on how trainees performed when assembling a mock wing and found that a group using an AR enabled tablet assembled the wing 30% faster and 90% more accurately on their first try than the groups using traditional methods.

While many of the AR devices are considered “immature” for consumer adoption, manufacturers are already experimenting, and in Boeing’s case, already using AR devices in production hardware. Osterhout Design Group (ODG) had a large booth showcasing how companies are already using its smart glasses. I had seen a demo by EON Reality where using ODG’s glasses, I could see pipes and troubleshoot them by moving the gauges just by looking up or down left or right.

Marketing, sales, and commerce use cases were also shown at the conference. It was evident how mixed reality can be used as a new purchase path and how better visualization can reduce returns. Augment, an AR company focused on sales, e-commerce, and communication, demonstrated how sales teams can display products for customers in the store. It showed how Coca-Cola uses the platform and how it is linked to Salesforce’s CRM to help drive sales. Virtuality uses VR to create a shopping experience by essentially placing products in VR where users can interact with them. A virtual shopping experience could reduce costs by reducing the need for physical store space and increase sales by analyzing consumers’ interaction with virtual products. We’re already seeing brands considering this - a recent Wall Street Journal article reported how Cadillac is replacing a portion of its physical stores with virtual showrooms.

As the hardware devices and software for mixed reality get more advanced, enterprise applications will get better and companies will find more interesting and creative ways to incorporate mixed reality into their business operations. The applications I saw at AWE included marketing, entertainment, medical, manufacturing and more. I can’t wait to see what’s coming next.

----

Written by Mark Linao. Find him on Twitter or LinkedIn.

[hammerandtusk]

The Best Thing About VR

Issue #62

Last week we talked about VR's issues with reporting, but something we didn't touch on is how often people report on demos as if they're experiences, leading to consumer frustration and disappointment. Has it happened to you? 

This week the Navy is developing AR diving rigs, brothel owners are shaking their fists at VR porn, and the consensus seems to be that the best part of VR is still showing it to other people. 

Plus, we've got a deep-dive how to about building a VR app in just 14 days. And surviving! 

Love,

Mack and the H&T Team

Find us on Facebook and Twitter.

If you haven't subscribed yet, you can sign up for Hammer & Tusk.

Take a Sip

The Best Thing About Virtual Reality Is Showing Other People

There's nothing like the light of joy on someone's face when they try it for the first time. Who wouldn't want to spread that around?

I’m enjoying virtual reality. Immensely. But it hasn’t stopped me playing Dark Souls 3... In fact, my favourite thing about Virtual Reality so far has been introducing it to other people. 

Can Virtual Reality Threaten the Brothel Industry?

It seems unlikely that virtual porn will replace the immersion of presence, but could it impact the bottom line? Absolutely.

Sheri’s Ranch wrote that the VR devices displayed at CES “may be one of the biggest challenges to the future of the legal prostitution industry.”

Windows Holographic: Enabling a World of Mixed Reality

This is the vision Microsoft sees for the future of mixed reality - I wouldn't mind living there! 

Windows Holographic enables a world of mixed reality – where devices work together – regardless of whether they are developed for VR, AR, or MR.

Navy Engineers Develop Futuristic Next Generation HUD for Diving Helmets

The military is one of the biggest drivers of new technological innovations, and here again we see that playing out, as they implement what are still demos to the rest of us.

Naval Surface Warfare Center Panama City Division engineer Dennis Gallagher and his team are developing future Navy diving systems.

Virtual Reality Could Give PC Sales A Shot In The Arm

Not only is VR driving desktop sales, but companies are now manufacturing notebooks capable of running VR.

The virtual reality boom could provide personal computer sales with a badly needed boost.

Article of the Week

Building a VR App in 14 Days

Interested in developing your own VR app? This has a lot of good tips and lessons learned.

I quickly found that the realm of VR is like the wild west — it lacks rules, structure, and most of all, information.

Like what you read? Don’t forget to check out the latest issue of Hammer & Tusk! 

[hammerandtusk]

VR Is Really Cool, But You Can’t Have It

We’re starting to see a lot of articles about how VR has a content problem, but if you scan the web it seems like every other article is about some really cool content the reviewer just tried. That’s because VR reporting spends all of its time talking about the cool new thing that’s coming, when the reality is that the majority of demos never turn into consumer products. From rescuing cats from ledges to using your breath in VR, here are some of the experiences I have been inspired by - only to find out that I’ll never get to try them.

1. Save That Cat!

If you’re at all interested in virtual reality, you’ve probably watched hilarious videos of people crawling across a board on the floor, trying to rescue a cat that’s stranded at the end of the beam on the top of a giant skyscraper. If you Google “save a cat in VR” every page is a new story about this “game.” The first result I got proudly declared “You Can Now Save a Kitten in Virtual Reality!” The only problem?

You can’t.

The article mentioned above made the rounds at our office, and someone asked if we could try it out. “Sure!”I cheerfully told everyone who asked. How hard can it be? All I need is a long thin board and a stuffed animal. We’ve got room to set this up in our VR room! I thought. I jumped online and started scanning through the articles, trying to figure out where to download the experience. “Take my money!” I screamed at the screen. But no one would.

The experience is only available to try live at the VR Zone Project i Can, in Tokyo. If you happen to be in the area, feel free to try it out and post yet another video to Youtube in order to mock us with all of the cool stuff that we’ll never be able to do!

2. Breathe Deep

Image this: using only your breath, you can control your journey through a fantastical landscape, playing a simple game while learning the tricks and techniques of deep breathing meditation. Sounds great, right?

NO VR FOR YOU!

DEEP is a meditative VR game controlled by breathing. Players don a headset and a custom controller (basically a fancy belt that goes across your ribcage) to explore an underwater world. The game teaches players yogic breathing techniques that can alleviate stress, anxiety, and mild depression. If you think that sounds cool, you would not be alone. The first two pages on a Google search for “vr breathing meditation” are nothing but articles about this amazing game. GAME. Not one of the articles I read called it a ‘demo,’ and none mentioned that it wasn’t available to consumers. Even the website was confusingly blank of purchasing details; it took me ten minutes of concerted searching to realize I couldn’t find a purchase link because it wasn’t available to purchase.

That sure didn’t help my breathing.

3. Geographic Content

It’s not exactly uncommon for the internet to be American-centric, but it IS uncommon for that to be such a problem (unless your American friends constantly post Daily Show clips that you can’t watch because the content is locked for their region). Pages and pages of internet ‘ink’ have been spilled lauding The Walk, a terrorizing 360 video of walking on a tightrope between New York’s Twin Towers. Sounds great, right? Apparently it is. If you live in the US, feel free to tell me all about it.

Then there’s the lack of non-English (or non-language based) content. One developer in South Korea bemoaned that even when a game doesn’t require language to play, all of the instructions for how to play are in English, and right now very few games have the capital to translate into multiple languages.

For consumers outside of the US, figuring out what they can actually play can be a huge headache.

4. Cat Petting Simulator

There’s only one problem with the adorable cat petting simulator that has everyone talking - it isn’t real. Someone made it as a joke, but unlike joke games like Desert Bus, which went on to raise more than $2.5 million for charity, the creator of this internet meme has no plans (thus far) to turn the single gif into an actual VR experience.

Some people are concerned by the apparent violence against animals, though I maintain that the clumsy hands are like that of a three year old and can’t really be blamed, and anyway the cat is fine. It shook it off, and in the future it will avoid your brother’s friend because he only has dogs and doesn’t understand that cats don’t like to wrestle.

[hammerandtusk]

Knock, Knock: Industry Is Here

Issue #61

Overall, conversation in the immersive technology space is generally positive; and while that can be a good thing, we're wondering at what point VR reporters need to take the kid gloves off. The technology is improving every day, and as consumers enter the ecosystem they want a more balanced, and less blindly enthusiastic, review system. 

Plus, we talk narrative techniques in VR, follow the money and predict where it's coming from, and explore some new hardware that's making waves.

Love,

Mack and the H&T Team

Find us on Facebook and Twitter.

If you haven't subscribed yet, you can sign up for Hammer & Tusk.

Take a Sip

Steven Spielberg Is Wrong About Virtual Reality

VR doesn't let you tell the viewer where to look, and that means completely rethinking how you tell stories - if you want to get it right.

With VR, it may be possible to tell a more subtle, a more immersive story.

ARM Will Give Smartphones More Power for Virtual and Augmented Reality

Google wants every Android phone to be VR compatible. ARM wants the same for every smartphone.

ARM is preparing to unleash new chip designs which will redefine smartphones and make virtual reality and augmented reality apps an, er, reality.

Will This Augmented Reality Machine Really Replace Your PC?

The Meta 2 is still tethered, but then, so is your computer.

"We’re excited to remove the start menu—all of these metaphors and buttons and icons that take your brain extra steps to decode.”

Report Claims First Xbox One Virtual Reality Game is Coming in 2017

It's a smart move to bring console gamers into the fold, as they're a natural market for VR.

Rumors from earlier this week suggest that Microsoft is planning to introduce Oculus Rift compatibility when revised Xbox One hardware hits retail in 2017.

Augmented Reality Visor Lets Firefighters See Through The Smoke

Consumers might not be ready for devices like the HoloLens, but industry definitely is, and it's leading the way.

Researchers...invented a visor that lets firefighters see through smoky dark conditions using a thermal camera.

Article of the Week

The Reality of Augmented and Virtual Reality Venture Capital

Projections for how VR will sell and who is investing in what.

While there is huge long-term potential for AR/VR, there could be just a few billion dollars of revenue this year, a progressive ramp in 2017 and a hoped-for inflection point in 2018

Like what you read? Don’t forget to check out the latest issue of Hammer & Tusk! 

[hammerandtusk]

When Does VR Reporting Take the Kid Gloves Off?

My friends and I like to follow the same tv shows - it gives us something to text about when we’re stuck on the bus. Recently, one of my friends texted me to say that the finale of one of our shows was godawful. On a scale from 1-10, she gave it a 3.5. That night I fired it up with trepidation, and I was surprised to find that I enjoyed it. It was by no means a great episode, but wasn’t painful - maybe a 5 or 6 out of ten. When I texted her, she laughed and said, ‘You’re welcome, I tempered your expectations.’

The part that expectation serves in our enjoyment of media cannot be overstressed. I have seen major blockbusters that were so talked up that by the time I got around to watching them, nothing could have met my expectations. I hated Inside Out not because it wasn’t a good movie, but because it was just a good movie, and I had been expecting the Second Coming of Pixar. If I had gone into it blind, I might have enjoyed it as much as, say, Big Hero 6, which I saw without so much as having watched a trailer (and now I want a Baymax pillow so bad).

Right now, VR is all about expectations.

Most people agree that VR is more about what it will become than what it currently is. The potential is there, so close we can almost touch it, but while current experiences can be incredibly immersive, most of them feel more like demos than polished consumer experiences. Take a game like Job Simulator. It captures a player’s attention because it let us toy with the interface of touch controllers; but at the end of the day, you spend more time seeing what different things you can set on fire in the frying pan than trying to “win” the game. Job Simulator was one of the best reviewed launch games for the Vive, not because people think we’ll still be playing it ten years from now, but because it shows you what VR could become.

In this environment, the role of a reporter and reviewer is complicated. Games can’t be judged on the promise of what VR might one day be - but that means that any flaws are considered, perhaps rightly so, as flaws in what VR is currently capable of, not as flaws in the game. Take Call of the Starseed. It hasn’t gotten a single bad review - people are engrossed by its gorgeous graphics, its engaging story, and the smart way it uses VR to create an immersive mystery. Not a single review mentions the very long periods of blackness as you “blink” from one spot to the next. Motion is an ongoing problem in VR, as it tends to be a trigger for simulator sickness. One solution to eliminate movement is to make the world disappear and then have it reform a second later - “blinking.” The practice is unfortunately cruel to immersion, and becomes a challenge as gameplay progresses. But reviews don’t mention it because everyone knows that moving around in VR makes users sick. I’d much rather blink than vomit.

But the decision to leave the kid gloves on can do a disservice to the consumer. Take as another example Hover Junkers, also one of the highest-rated Vive games. Instead of employing a “blink” to stop motion from making anyone sick, Hover Junkers has decided not to cater to users who can’t handle motion. I played the game for roughly a minute and a half before I declared it too horrifyingly nauseating to continue; I passed the controls over to a colleague, who gleefully took over. Reviews haven’t mentioned Hover Junkers nausea index because getting sick is such a common problem in VR, but that isn’t fair. Games like Call of the Starseed have ensured that I can still play them; I deserve to know that Hover Junkers hasn’t done the same. Similarly, if you were the kind of person who got really claustrophobic, those periods of blackness might be a hard no, whereas Hover Junkers’ zooming motion might not pose a problem.

It seems clear that it isn’t fair to developers to criticize something that no one else can do better. On the other hand, artificially inflated reviews can bring consumer expectations too high.  I don’t want to be told that each new game is the Second Coming of VR; I want to know what it will really be like to play, warts and all, so I can appreciate the game for what it is.

So is it time to take the kid gloves off? No. The technology is still new - things don’t work very well. A lot of games are still functioning mostly as demos - I know for my part, the things I get the most excited to show people are Tilt Brush and Irrational Exuberance. But do we need to inject a little more grounded commentary into our boundless enthusiasm?

Unquestionably yes. Because my artificially inflated expectations are doomed to fall, and it’s a long way to the ground.