All Access


When real life user interfaces begin to emulate video games

By Ernesto Burden
Posted by Ernesto Burden.

It used to be that video game creators tried to emulate real life experiences. Remember Microsoft's Flight Simulator? It was about as complicated to fly those virtual planes as it is to fly real planes (I spent more time crashing my airliners than landing them as a kid), and that was the goal. But what happens when that paradigm gets flipped on its head - when the real life user interfaces model themselves on rapidly evolving video game standards? I had a first hand taste of this at a recent defense electronics shows I attended - and even got to take the joystick and learn just how easy robot-wranglin' can be at the surreal VR dawn of the 21st century.

If you've played a newer first-person-shooter style video game, you know how powerful the graphics engines are and how immersive the experience is. In a lineage descending from classics such as Doom on through the the most recent Call of Duty or Halo releases, first-person-shooter games have evolved into marvels of 3D graphics rendering, allowing for ultra smooth movement through incredibly detailed environments that draw the player in so well that experiences such as a fall or wild charge down a winding corridor generate actual physical sensations. At the touch a button on the computer keyboard or controller device, you can toggle visual perspectives and control not only forward, backward, left and right movement, but also left and right "strafing" movements, crouching, leaping and in some cases flying or swimming with perfect altitude and depth control.

So what does this embarrassment of riches in entertainment technology mean in aerospace and defense? Well for one thing, it means that the commercial game environment has had generations to explore not only virtual environments, but astoundingly intuitive user interface for control for navigating those environments.

Which brings me to the Association for Unmanned Vehicle Systems International (AUVSI) show in Washington, DC, our Military & Aerospace Electronics Team attended last month, and back to Flight Simulator. I found as a kid - not being a pilot or someone inclined wanted to read a full length instruction manual just to play a game - the planes in Flight Simulator to be difficult to fly. At AUVSI, M&AE chief editor John Keller and I watched a small drone helicopter - the Hornet Micro UAS - demonstration. After the demonstration we visited with the helicopter's maker Adaptive Flight and we got to see how the vehicle was flown. Hint - you didn't need four hands and six feet to operate all the pedals and levers and sticks and whatnot. You used one joystick and a keyboard. The 12-year-old version of you could drop in from the past and fly this thing with about one minute of instruction, no manual required. You'd know exactly how to do it, because it worked just like a video game. In fact, that's pretty much what the UAV's maker says in the product literature: "Advanced flight control technology makes flying the Hornet as easy as navigating a video game with take-offs and landings at the push of a button."

A little bit later that day I was chatting with Andrew Borene at the Recon Robotics booth. Recon makes a tiny little robot called the Recon Scout IR. It's basically a cylinder about the size of a 2.5 lb dumbbell with rubbery wheels on either end and a couple of flexible antennas sticking out. The idea is you can lob this little guy up onto the roof of a building, say, and then drive it around reconnoitering. Andrew gave me one of the robots and let me throw it onto the roof of the booth, which was designed to look like a desert outpost. He then handed me the controller - once again a single joystick was all you needed to drive. The vehicle was designed to self-right and then get on with business, shooting video automatically and transmitting it back to a screen in the controller. Drive into a dark room on the roof? The camera automatically switches to an IR view. I drove a robot about this size in a video game a long time - James Bond Golden Eye - and I say with absolute conviction that the video game version was actually a bit harder to operate. That's how good these things are getting.

So while soldiers are using "serious" games for training and simulation from the cockpit to the battlefield (read this article by M&AE's Courtney Howard for a great overview of this), it's also clear that elements of these games are blurring the line between reality and virtual reality in the other direction as well. And it's fascinating to wonder what impact having grown up in the deeply immersive, super-detailed environments of contemporary video games will have on the engineers and developers of the future in terms of the direction from which they instinctively approach user interface challenges. Link

Ernesto Burden is the publisher of PennWell's Aerospace and Defense Media Group, which include Military & Aerospace Electronics, Avionics Intelligence, and Avionics Europe. Email him at ernestob@pennwel.com.

Easily post a comment below using your Linkedin, Twitter, Google or Facebook account.

Previous Blog Posts

SWAPped: how size, weight, and power are transforming the military electronics industry

Tue May 21 11:46:00 CDT 2013

China continues to improve capabilities in carrier-based military aviation

Tue May 14 10:23:00 CDT 2013

Small is more: SWAP for soldier systems and unmanned vehicles dominates today's technology

Tue May 07 10:44:00 CDT 2013

The defense budget is here: time to get to work

Mon Apr 29 11:57:00 CDT 2013

Ron Mastro: an unforgettable figure in the aerospace and defense electronics industry

Tue Apr 23 07:45:00 CDT 2013

Mil & Aero Publisher Ernesto Burden unhurt after bombs hit today's Boston Marathon

Mon Apr 15 15:04:00 CDT 2013

After all those sleepless nights of worry, now we find the Pentagon's budget is actually UP?

Wed Apr 10 11:54:00 CDT 2013

Confederate surrender at Appomattox ended the American Civil War 148 years ago this month

Tue Apr 09 10:22:00 CDT 2013

Dear God, what more can the U.S. military ask from the poor letter C?

Fri Apr 05 10:23:00 CDT 2013

Saber rattling in North Korea: how dangerous are these threats?

Tue Apr 02 10:26:00 CDT 2013

At last, some good news; is our industry really ready for this?

Tue Mar 26 09:24:00 CDT 2013

Teledyne Technologies becoming major player in unmanned underwater vehicle (UUV) sensors

Tue Mar 19 09:46:00 CDT 2013

Is sequestration killing aerospace and defense trade shows?

Thu Mar 14 11:27:00 CDT 2013

Nuclear ballistic missile technology remains a post-Cold-War defense priority

Tue Mar 12 09:22:00 CDT 2013

The sequester hits! Is everyone okay?

Tue Mar 05 09:46:00 CST 2013

The continuing drone war of low-tech vs. high-tech

Tue Feb 26 12:30:00 CST 2013

Prospects for high-performance embedded computing (HPEC) look brighter than ever before

Tue Feb 19 10:09:00 CST 2013

Self-sealing suction cups show promise for future robots

Mon Feb 11 11:32:00 CST 2013

Air Force moving forward with potential upgrades to PAVE PAWS, BMEWS, and PARCS missile-defense radar

Thu Feb 07 13:32:00 CST 2013

Cyberattacks carried out against media outlets

Mon Feb 04 15:49:00 CST 2013

Quest for the humvee-mounted mobile data center for the battlefield edge

Wed Jan 30 11:40:00 CST 2013

Dempsey worries about cyberattack, DoD makes plans to hire additional cybersecurity workers

Mon Jan 28 14:16:00 CST 2013

Defense industry will emerge from these hard times stronger than ever

Thu Jan 24 11:07:00 CST 2013

More on our favorite quadruped robot, the LS3

Mon Jan 21 14:09:00 CST 2013

Wave of aerospace and defense company acquisitions may be indication of things to come

Thu Jan 17 10:05:00 CST 2013

The Aerospace & Defense Bloggers

John Keller is editor-in-chief of Military & Aerospace Electronics magazine, which provides extensive coverage and analysis of enabling electronic and optoelectronic technologies in military, space, and commercial aviation applications. A member of the Military & Aerospace Electronics staff since the magazine's founding in 1989, Mr. Keller took over as chief editor in 1995.

Ernesto Burden is the publisher of PennWell’s Aerospace & Defense Media Group, including Military & Aerospace Electronics, Avionics Intelligence and Avionics Europe.  He’s a father of four, a runner, and an avid digital media enthusiast with a deep background in the intersection of media publishing, digital technology, and social media. He can be reached at ernestob@pennwell.com and on Twitter @aero_ernesto.

Courtney E. Howard, as executive editor, enjoys writing about all things electronics and avionics in PennWell’s burgeoning Aerospace and Defense Group, which encompasses Military & Aerospace Electronics, Avionics Intelligence, the Avionics Europe conference, and much more. She’s also a self-proclaimed social-media maven, mil-aero nerd, and avid avionics geek. Connect with Courtney at Courtney@Pennwell.com, @coho on Twitter, and on LinkedIn.

Mil & Aero Magazine

April 2013
Volume 24, Issue 4
file

Download Our Free Apps



iPhone

iPad

Android

Follow Us On...