A Blog by Jonathan Low


Jun 12, 2017

How Augmented Reality Could Save Tech From Itself

Apple CEO gave the graduation address at MIT last week. Instead of mouthing platitudes, he spoke about  how technology must better serve humanity.

Resentment against the impact of technology on society is growing. With augmented and virtual reality, tech has the ability to be part of the solution, not just the problem. JL

Ron Miller reports in Tech Crunch:

AR could be part of an overall solution to help prepare and train workers for the next generation of jobs. We are seeing a convergence of humans and machines and don’t have a good form factor to engage in that. When you train people in a classroom, you end up with displacement, as you take the worker out of the context of their work. Workers who use AR for training are more productive, more accurate and they are more satisfied with the experience.
We’ve all heard the predictions that artificial intelligence, and by extension robotics, is gunning for our jobs.
Indeed, as technology marches relentlessly forward, it feels like many of today’s positions could soon be displaced. But just as with past technological inflection points — whether the steam engine, the telegraph, the computer or even industrial robots — technology will always give as much as it takes, as it always has.
That matters little to people who have lost their jobs though. You could argue that the current political climate is due, at least in part, to economic changes driven by technology being created in Silicon Valley. Yet for all of the rhetoric, there are millions of jobs going unfilled in the US today simply because people lack the requisite skills.
Instead of a net job loss, that could mean the nature of work is simply changing. While some of the past jobs won’t be coming back because of economic shifts, market dynamics and, yes, technology; the next generation of employment will likely require much higher-level skills, and we are going to need retraining continually over our entire working lives.
Perhaps technology, which is at least partly responsible for the problem, could help us out of this quagmire. And, in fact, we may actually be on the edge of finding an answer in the form of augmented and mixed reality. While no single piece of technology is likely to be a panacea, AR could be part of an overall solution to help prepare and train workers for the next generation of jobs. And that’s a start.

The new reality

Photo: Microsoft
Imagine putting on a pair of glasses that can understand where you are in time and space and being shown a diagram, a set of instructions or even a 3D hologram that overlays the office or shop floor in front of you, and then steps you through a process you’ve never done before. AR could do that.
While virtual reality completely immerses you in a virtual world, augmented reality, as the name implies, acts as a layer on top of the world in front of you. You are still in the room, and you can still see your desk or your living room or the factory, but there is additional information being projected onto the scene you are seeing.
Pokemon Go was the first real consumer-driven example of AR and it was a great proof of concept, which helped popularize the idea for a mass market. And just as Pokemon Go simply used a smartphone or tablet as the AR interface, not a pair of special glasses hardware, much of the early use of AR in business involves simply holding up a tablet or smartphone to project the information over the world. As we move forward though and the tech evolves, wearable hardware will enable employees to work hands-free and that has the potential to be much more powerful.
Photo: Stefan Etienne/TechCrunch
In a recent report, Tractica, a research firm focused on robotics, AI and wearables (among other topics), sees augmented and mixed reality headsets having great utility in an enterprise or industrial setting.
“AR headsets provide an ideal UI for hands-free operation, with the device at eye level, presenting information when needed. AR headsets can also bring powerful first-person views, which are valuable hands-free resources for field force automation, training, or maintenance jobs,” the Tractica report stated.
Tractica further divides the market into what it has termed “mixed reality,” which it defines as having “positional tracking and depth sensors to provide a more immersive experience, enabling interactions with holographic objects.”
It’s worth noting that Facebook announced an augmented reality tool to create customized image filters at F8 in April, while a third-party developer, Amber Garage, announced HoloKit earlier this month to build mixed reality content for Google Cardboard and Apple released an AR content creation platform at the recent WWDC event. Samsung is also working on MR tools and you can bet that Amazon could enter the fray at some point too. While these tools appear to be aimed mostly at consumers, it’s not unlikely they could be used for business too.
While Tractica remains cautious, especially given that the market is still in the earliest stages and is being defined as we speak, it is still predicting some pretty substantial growth over the next several years. Keep in mind that some of that growth will be driven by consumers as well as business, and it doesn’t break out the different market segments.
Screenshot 2017-05-26 17.46.32.png

Teaching tool

Exactly how much AI and robotics will displace jobs is subject to debate, but it will have some impact, that much is clear. The question is how do we minimize the effect and use AR/MR to provide workers with new skills.
Brian Ballard, CEO at Upskill (formerly known as APX Labs), a firm that wants to be the operating system for virtual and augmented reality, says we are at a point where we are seeing a convergence of humans and machines and we don’t really have a good form factor to engage in that. As he sees it, when you train people in a classroom, you end up with some displacement, as you take the worker out of the context of their work.
Photo: Daqri
“At a base level people need more skills to do their jobs,” he says. “What we see in real life is that there is a way to get better information right way and it’s always available to see,” he added. That better way involves using AR glasses to place the information in context right in front of the employee.
Brian Mullins, CEO at Daqri, makers of mixed reality headsets, sees these devices as a way to bridge the skills gap and train workers for new jobs. “Augmented reality is a modern technology that is human focused, and when done right, focused on knowledge transfer. You can show a worker how to do something that they didn’t know, and give them actionable information to make the right decisions,” he explained. And that could make for a very powerful training tool.

Putting AR to work

While AR is still in the early stages of development and most training solutions remain in the experimental stage, what we have seen so far shows great promise to speed up the learning process. It’s going to be up to the vendors, content producers and users to take us the rest of the way.
For instance, GE is working on technology with Hololens to teach people without a medical background to use an ultrasound machine and identify the correct organ. It’s still very much in the experimental stage, but it is a clear example of using mixed reality to teach people a given skill and give them immediate feedback to help them learn to use it effectively over time.
Further, research conducted by Boeing, a company that has been working with AR to increasing efficiency on certain jobs like creating wired hubs for airplanes, has shown that workers who use AR for training purposes are more productive, more accurate and they are more satisfied with the experience. That’s right, they enjoyed learning this way, as opposed to be lectured at in a classroom, and trying to recall what they learned when they are back on the job.The study, conducted in conjunction with Iowa State University, looked at building a wing-like assembly. Participants were mostly from the campus community and some were given instructions on a desktop computer in the corner of the room with a pdf drawing, some on a tablet with an adjustable arm, but also with a static pdf, and finally some used an AR system with 3D immersive instructions with animations. What they found is that the error rate was dramatically higher on the desktop, better on the tablet and lowest using VR.


Post a Comment