Facebook Updates Progress on Artificial Intelligence

Facebook offered an update on its advances in artificial intelligence, touching on object detection, natural language understanding, predictive learning and planning.

Facebook offered an update on its advances in artificial intelligence, touching on object detection, natural language understanding, predictive learning and planning.

Chief technology officer Mike Schroepfer detailed the social network’s advances in posts in its Newsroom and its engineering blog.

Object detection

Schroepfer said the Facebook AI Research team will present a new paper at AI conference NIPS 2015 next month detailing its state-of-the-art object-detection system, which segments images 30 percent quicker than previous industry benchmarks, using 10 times less training data.

He also shared the image below, writing:

How many zebras do you see in the photo? Hard to tell, right? Imagine how hard this is for a machine, which doesn’t even see the stripes—it sees only pixels. Our researchers have been working to train systems to recognize patterns in the pixels so they can be as good as or better than humans at distinguishing objects in a photo from one another—known in the field as “segmentation”—and then identifying each object.


Natural language understanding

Schroepfer wrote about the combination of the Memory Networks (MemNets) system Facebook introduced last year with image-recognition technology, which the social network refers to as VQA, or visual Q&A. He added:

MemNets add a type of short-term memory to the convolutional neural networks that power our deep-learning systems, allowing those systems to understand language more like a human would. Earlier this year, I showed you this demo of MemNets at work, reading and then answering questions about a short synopsis of The Lord of the Rings. Now we’ve scaled this system from being able to read and answer questions on tens of lines of text to being able to perform the same task on data sets exceeding 100,000 questions, an order of magnitude larger than previous benchmarks.

Predictive learning

The Facebook AI Research team developed a system that can “watch” a series of visual tests and predict the outcome, and Schroepfer wrote that the system is now making the correct predictions 90 percent of the time, which is better than the performance of most humans.


Schroepfer described how the Facebook AI Research team is using classic board game Go in its efforts:

Another area of longer-term research is teaching our systems to plan. One of the things we’ve built to help do this is an AI player for the board game Go. Using games to train machines is a pretty common approach in AI research. In the last couple of decades, AI systems have become stronger than humans at games like checkers, chess and even Jeopardy. But despite close to five decades of work on AI Go players, the best humans are still better than the best AI players. This is due in part to the number of different variations in Go. After the first two moves in a chess game, for example, there are 400 possible next moves. In Go, there are close to 130,000.

We’ve been working on our Go player for only a few months, but it’s already on par with the other AI-powered systems that have been published, and it’s already as good as a very strong human player. We’ve achieved this by combining the traditional search-based approach—modeling out each possible move as the game progresses—with a pattern-matching system built by our computer vision team. The best human Go players often take advantage of their ability to recognize patterns on the board as the game evolves, and with this approach our AI player is able to mimic that ability—with very strong early results.

Finally, Schroepfer offered a look at how M, the virtual digital assistant being tested for the social network’s Messenger applications, is incorporating AI technology:

This is a huge technology challenge—it’s so hard that, starting out, M is a human-trained system: Human operators evaluate the AI’s suggested responses, and then they produce responses while the AI observes and learns from them.

Recommended articles