When real life user interfaces begin to emulate video games

By Ernesto Burden
Posted by Ernesto Burden.

It used to be that video game creators tried to emulate real life experiences. Remember Microsoft's Flight Simulator? It was about as complicated to fly those virtual planes as it is to fly real planes (I spent more time crashing my airliners than landing them as a kid), and that was the goal. But what happens when that paradigm gets flipped on its head - when the real life user interfaces model themselves on rapidly evolving video game standards? I had a first hand taste of this at a recent defense electronics shows I attended - and even got to take the joystick and learn just how easy robot-wranglin' can be at the surreal VR dawn of the 21st century.

If you've played a newer first-person-shooter style video game, you know how powerful the graphics engines are and how immersive the experience is. In a lineage descending from classics such as Doom on through the the most recent Call of Duty or Halo releases, first-person-shooter games have evolved into marvels of 3D graphics rendering, allowing for ultra smooth movement through incredibly detailed environments that draw the player in so well that experiences such as a fall or wild charge down a winding corridor generate actual physical sensations. At the touch a button on the computer keyboard or controller device, you can toggle visual perspectives and control not only forward, backward, left and right movement, but also left and right "strafing" movements, crouching, leaping and in some cases flying or swimming with perfect altitude and depth control.

So what does this embarrassment of riches in entertainment technology mean in aerospace and defense? Well for one thing, it means that the commercial game environment has had generations to explore not only virtual environments, but astoundingly intuitive user interface for control for navigating those environments.

Which brings me to the Association for Unmanned Vehicle Systems International (AUVSI) show in Washington, DC, our Military & Aerospace Electronics Team attended last month, and back to Flight Simulator. I found as a kid - not being a pilot or someone inclined wanted to read a full length instruction manual just to play a game - the planes in Flight Simulator to be difficult to fly. At AUVSI, M&AE chief editor John Keller and I watched a small drone helicopter - the Hornet Micro UAS - demonstration. After the demonstration we visited with the helicopter's maker Adaptive Flight and we got to see how the vehicle was flown. Hint - you didn't need four hands and six feet to operate all the pedals and levers and sticks and whatnot. You used one joystick and a keyboard. The 12-year-old version of you could drop in from the past and fly this thing with about one minute of instruction, no manual required. You'd know exactly how to do it, because it worked just like a video game. In fact, that's pretty much what the UAV's maker says in the product literature: "Advanced flight control technology makes flying the Hornet as easy as navigating a video game with take-offs and landings at the push of a button."

A little bit later that day I was chatting with Andrew Borene at the Recon Robotics booth. Recon makes a tiny little robot called the Recon Scout IR. It's basically a cylinder about the size of a 2.5 lb dumbbell with rubbery wheels on either end and a couple of flexible antennas sticking out. The idea is you can lob this little guy up onto the roof of a building, say, and then drive it around reconnoitering. Andrew gave me one of the robots and let me throw it onto the roof of the booth, which was designed to look like a desert outpost. He then handed me the controller - once again a single joystick was all you needed to drive. The vehicle was designed to self-right and then get on with business, shooting video automatically and transmitting it back to a screen in the controller. Drive into a dark room on the roof? The camera automatically switches to an IR view. I drove a robot about this size in a video game a long time - James Bond Golden Eye - and I say with absolute conviction that the video game version was actually a bit harder to operate. That's how good these things are getting.

So while soldiers are using "serious" games for training and simulation from the cockpit to the battlefield (read this article by M&AE's Courtney Howard for a great overview of this), it's also clear that elements of these games are blurring the line between reality and virtual reality in the other direction as well. And it's fascinating to wonder what impact having grown up in the deeply immersive, super-detailed environments of contemporary video games will have on the engineers and developers of the future in terms of the direction from which they instinctively approach user interface challenges. Link

Ernesto Burden is the publisher of PennWell's Aerospace and Defense Media Group, which include Military & Aerospace Electronics, Avionics Intelligence, and Avionics Europe. Email him at ernestob@pennwel.com.

Previous Blog Posts

The haunting bugle call Taps is 150 years old this summer

May 24, 2012

The Navy's solid-state laser weapon

May 22, 2012

High-performance embedded computing (HPEC) gaining market traction, but its definition remains elusive

May 14, 2012

Did I say $114 million mistake? I meant $351 million.

May 9, 2012

Continuing the conversation

May 7, 2012

Lockheed Martin experimental stealth surface vessel to be scrapped after yielding valuable technology

May 3, 2012

Air Force competes in National Collegiate Cyber Defense competition

April 30, 2012

Will Intel 3rd Generation Intel Core processor make a big splash in embedded computing applications?

April 27, 2012

The $114 million mistake

April 25, 2012

Iran under attack once again

April 23, 2012

High-performance computing for rugged mobile military applications is becoming a hot design issue

April 18, 2012

Is the U.S. getting ready for conflict?

April 16, 2012

Historic obsession about the Titanic sinking 100 years ago wipes Bread and Roses strike from popular memory

April 12, 2012

The future of UAV technology aims high

April 3, 2012

Conference combo

March 30, 2012

We can thank a self-absorbed Congress for hurting national defense if deep automatic defense cuts happen

March 28, 2012

Securing the military network

March 21, 2012

FAA's impending rule on small UAVs may usher in a new era of civil aerial warfare

March 14, 2012

Boeing and Airbus both claim victory in WTO Appeal? That can't be right...

March 12, 2012

The defense industry may be adjusting to a new age of financial austerity

March 7, 2012

What's up with all the anti-tamper technology?

March 5, 2012

Effects of 2013 DOD budget cuts already being felt with program cancellations

February 29, 2012

Top ten technologies the U.S. Army's Rapid Equipping Force is looking for

February 25, 2012

The Aerospace & Defense Bloggers

Ernesto Burden is the publisher of PennWell’s Aerospace & Defense Media Group, including Military & Aerospace Electronics, Avionics Intelligence and Avionics Europe.  He’s a father of four, a runner, and an avid digital media enthusiast with a deep background in the intersection of media publishing, digital technology, and social media. He can be reached at ernestob@pennwell.com and on Twitter @aero_ernesto.

John Keller is editor-in-chief of Military & Aerospace Electronics magazine, which provides extensive coverage and analysis of enabling electronic and optoelectronic technologies in military, space, and commercial aviation applications. A member of the Military & Aerospace Electronics staff since the magazine's founding in 1989, Mr. Keller took over as chief editor in 1995.

Skyler Frink is an Assistant Editor of Military & Aerospace Electronics and Avionics Intelligence. Skyler graduated Cum Laude from the University of New Hampshire with a BA in Journalism and a Minor in Information Technology in 2011. He has contributed to many different publications both online and in print throughout his career as a Journalist. Skyler can be reached skylerf@pennwell.com.

Courtney E. Howard, as executive editor, enjoys writing about all things electronics and avionics in PennWell’s burgeoning Aerospace and Defense Group, which encompasses Military & Aerospace Electronics, Avionics Intelligence, the Avionics Europe conference, and much more. She’s also a self-proclaimed social-media maven, mil-aero nerd, and avid avionics geek. Connect with Courtney at Courtney@Pennwell.com, @coho on Twitter, and on LinkedIn.

Mil & Aero Magazine

May 2012
Volume 23, Issue 5