Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:


MIT team guides airplane remotely using spoken English


Aeronautics researchers at MIT have developed a manned-to-unmanned aircraft guidance system that allows a pilot in one plane to guide another unmanned airplane by speaking commands in English.

In a flight test, the pilotless vehicle, called a UAV (unmanned aerial vehicle), responded to sudden changes in plan and avoided unexpected threats en route to its destination, in real time. "The system allows the pilot to interface with the UAV at a high level--not just ’turn right, turn left’ but ’fly to this region and perform this task,’" said Mario Valenti, a flight controls engineer for Boeing who is on leave to pursue a Ph.D. in electrical engineering and computer science at MIT. "The pilot essentially treats the UAV as a wingman," said Valenti, comparing the UAV to a companion pilot in a fighter-plane squadron.

Tom Schouwenaars, a Ph.D. candidate in aeronautics and astronautics, and Valenti are principal researchers on the guidance system, which is part of the capstone demonstration of the Software Enabled Control (SEC) program. Professors Eric Feron and Jonathan How of the Department of Aeronautics and Astronautics (aero/astro) are among the principal investigators on the SEC program. The SEC program is a five-year, inter-university effort sponsored by the Defense Advanced Research Projects Agency (DARPA) through the Air Force Research Laboratory. As industry partner, Boeing provided the avionics test platform for the MIT guidance system and the planes used to demonstrate it.

The new guidance system is designed for volatile combat situations. For instance, a pilot might be commanded to gather images of an enemy site located in unknown territory. Rather than putting himself in danger, the pilot could assign a nearby UAV to the task. The UAV moves toward the enemy site, avoiding known threats (no-fly zones) and the unexpected (radar emanating from a missile site), all the while communicating its actions to the pilot in the other aircraft, which follows behind at a higher altitude and a safe distance. The technology also could have applications in the coordination of multiple air or space vehicles, such as in air traffic control or the reconfiguration of distributed satellite systems.

The guidance system performed flawlessly in flight tests involving a Boeing F-15 fighter jet and a Lockheed T-33 trainer fighter jet at Edwards Air Force Base in June. A pilot in the manned F-15 issued mission-level commands in everyday English--"fly to Task Area B"--to the T-33, and the T-33 executed them, maintaining a trajectory safe from threats, and at one point adjusting to a last-minute change in the predetermined mission plan. The T-33 was a substitute for the actual UAV in the test. It was manned by a pilot and crewperson who were on board to manage the aircraft in case of failure, but the vehicle was controlled entirely by MIT’s software, which ran on laptops placed inside each plane. "Through the recent experiments, the SEC program has demonstrated advanced behaviors that may now be integrated into the next generation of unmanned vehicles," said John Bay, DARPA’s SEC program manager.

A paper published by the American Institute of Aeronautics and Astronautics (AIAA) in August discussed the results of the flight test in more detail. Aero/astro graduate student Yoshiaki Kuwata and James L. Paunicka, associate technical fellow at Boeing Phantom Works, authored the paper along with Feron, How, Schouwenaars and Valenti. Schouwenaars’ work on autonomous trajectory-planning algorithms earned him the AIAA’s Unmanned Aerial Vehicles Graduate Award, which he will receive at a conference in Reno, Nev., in January.

Teaching English to an airplane

Three elements combine to make MIT’s manned-to-unmanned air vehicle guidance system more flexible and more "intelligent" than previous systems. First, the team worked with Teragram Corp., a software company specializing in language technology, to create a natural-language interface through which the two vehicles communicate and coordinate their actions. The interface translates the pilot’s human language into the UAV’s machine language, and vice versa. "It allows us to task machines at a higher level, improving safety and efficiency," said Feron.

Second, Valenti designed a task scheduler that keeps track of the oft-changing mission data from the manned vehicle and interprets it into tasks the UAV can perform. The task scheduler is integrated with the third element, Schouwenaars’ safe-trajectory-planning algorithm. The algorithm is based on mixed-integer linear programming (MILP), an optimization framework originally developed for operations research. Feron and Schouwenaars started applying MILP to the problem of aircraft routing in 2000. Unlike earlier technologies, MILP allows trajectory planning that can guarantee against collisions. Moreover, the trajectories can be computed while the vehicle is flying, requiring no pre-planning.

Using the off-the-shelf optimization software CPLEX, Schouwenaars fine-tuned the MILP-based guidance technique to enable the UAV to choose the fastest safe path to its destination--and then change course in a split second when faced with a new command or a sudden obstacle. The June flight tests marked the first time that a manned air vehicle used a MILP-based guidance system to control a UAV.

Already, said Feron, "the aerospace industry is using our system in its most advanced UAV programs." He and his team are currently working toward implementing their guidance technology in systems with multiple air vehicles. Their work is being done in MIT’s Laboratory for Information and Decision Systems. A version of this article appeared in the November 3, 2004 issue of MIT Tech Talk (Volume 49, Number 8).

Elizabeth Thomson | EurekAlert!
Further information:

More articles from Communications Media:

nachricht High Number of Science Enthusiasts in Switzerland
05.02.2018 | Universität Zürich

nachricht Between filter bubbles, uneven visibility and transnationality
06.12.2017 | Schweizerischer Nationalfonds SNF

All articles from Communications Media >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Space observation with radar to secure Germany's space infrastructure

Satellites in near-Earth orbit are at risk due to the steady increase in space debris. But their mission in the areas of telecommunications, navigation or weather forecasts is essential for society. Fraunhofer FHR therefore develops radar-based systems which allow the detection, tracking and cataloging of even the smallest particles of debris. Satellite operators who have access to our data are in a better position to plan evasive maneuvers and prevent destructive collisions. From April, 25-29 2018, Fraunhofer FHR and its partners will exhibit the complementary radar systems TIRA and GESTRA as well as the latest radar techniques for space observation across three stands at the ILA Berlin.

The "traffic situation" in space is very tense: the Earth is currently being orbited not only by countless satellites but also by a large volume of space...

Im Focus: Researchers Discover New Anti-Cancer Protein

An international team of researchers has discovered a new anti-cancer protein. The protein, called LHPP, prevents the uncontrolled proliferation of cancer cells in the liver. The researchers led by Prof. Michael N. Hall from the Biozentrum, University of Basel, report in “Nature” that LHPP can also serve as a biomarker for the diagnosis and prognosis of liver cancer.

The incidence of liver cancer, also known as hepatocellular carcinoma, is steadily increasing. In the last twenty years, the number of cases has almost doubled...

Im Focus: Researchers at Fraunhofer monitor re-entry of Chinese space station Tiangong-1

In just a few weeks from now, the Chinese space station Tiangong-1 will re-enter the Earth's atmosphere where it will to a large extent burn up. It is possible that some debris will reach the Earth's surface. Tiangong-1 is orbiting the Earth uncontrolled at a speed of approx. 29,000 km/h.Currently the prognosis relating to the time of impact currently lies within a window of several days. The scientists at Fraunhofer FHR have already been monitoring Tiangong-1 for a number of weeks with their TIRA system, one of the most powerful space observation radars in the world, with a view to supporting the German Space Situational Awareness Center and the ESA with their re-entry forecasts.

Following the loss of radio contact with Tiangong-1 in 2016 and due to the low orbital height, it is now inevitable that the Chinese space station will...

Im Focus: Alliance „OLED Licht Forum“ – Key partner for OLED lighting solutions

Fraunhofer Institute for Organic Electronics, Electron Beam and Plasma Technology FEP, provider of research and development services for OLED lighting solutions, announces the founding of the “OLED Licht Forum” and presents latest OLED design and lighting solutions during light+building, from March 18th – 23rd, 2018 in Frankfurt a.M./Germany, at booth no. F91 in Hall 4.0.

They are united in their passion for OLED (organic light emitting diodes) lighting with all of its unique facets and application possibilities. Thus experts in...

Im Focus: Mars' oceans formed early, possibly aided by massive volcanic eruptions

Oceans formed before Tharsis and evolved together, shaping climate history of Mars

A new scenario seeking to explain how Mars' putative oceans came and went over the last 4 billion years implies that the oceans formed several hundred million...

All Focus news of the innovation-report >>>



Industry & Economy
Event News

New solar solutions for sustainable buildings and cities

23.03.2018 | Event News

Virtual reality conference comes to Reutlingen

19.03.2018 | Event News

Ultrafast Wireless and Chip Design at the DATE Conference in Dresden

16.03.2018 | Event News

Latest News

For graphite pellets, just add elbow grease

23.03.2018 | Materials Sciences

Unique communication strategy discovered in stem cell pathway controlling plant growth

23.03.2018 | Agricultural and Forestry Science

Sharpening the X-ray view of the nanocosm

23.03.2018 | Physics and Astronomy

Science & Research
Overview of more VideoLinks >>>