Homepage / Technology / Inside Facebook's speech recognition factory
Amazon says this Prime Day was its biggest shopping event ever Kudlow says President Trump is 'so dissatisfied' with China trade talks that he is keeping the pressure on As stocks regain their footing, an ominous warning looms Goldman Sachs downgrades Clorox to sell, says valuation is 'unsustainably high' How Satya Nadella has spurred a tripling of Microsoft's stock price in just over four years Kudlow says economic growth could top 4% for 'a quarter or two,' more tax cuts could be coming The one chart that explains Netflix’s stunning comeback US housing starts plunge 12% in June to a nine-month low Aerospace titans Boeing and Airbus top $110 billion in orders at Farnborough Target uses Prime Day to its advantage, logging its 'biggest online shopping day' so far this year Billionaire Marc Lasry sees bitcoin reaching up to $40,000 as it becomes more mainstream and easier to trade These are the 10 US airports where you're most likely to be hacked Amazon shares slightly higher as investors await Prime Day results Wreck of Russian warship found, believed to hold gold worth $130 billion A bullish ‘phenomenon’ in bond market is weeks away from fading, top credit strategist says Stocks making the biggest moves premarket: MS, GOOGL, TXN, UAL, NFLX & more Twitter shares up 50% since late April means most upside priced in, analyst says in downgrade EU fines Google $5 billion over Android antitrust abuse Mortgage applications fall 2.5% as buyers struggle to find affordable homes America may not have the tools to counter the next financial crisis, warn Bernanke, Geithner and Paulson Investors are getting spooked as the risk of a no-deal Brexit rises EU expected to fine Google $5 billion over Android antitrust abuse Ex-FBI chief James Comey urges Americans to vote for Democrats in midterm elections Elon Musk apologizes to British cave diver following baseless 'pedo guy' claim Disney, Comcast and Fox: All you need to know about one of the biggest media battles ever Xiaomi shares notch new high after Hong Kong, mainland China stock exchanges reach agreement The trade war is complicating China's efforts to fix its economy European markets set for a strong open amid earnings; Google in focus Hedge fund billionaire Einhorn places sixth in major poker tournament The biggest spender of political ads on Facebook? President Trump Asian stocks poised to gain after Fed's Powell gives upbeat comments; dollar firmer Stocks are setting up to break to new highs Not all FAANG stocks are created equal EU ruling may be too little, too late to stop Google's mobile dominance Cramer explains how Netflix's stock managed to taper its drop after disappointing on earnings Airbnb condemns New York City's 'bellhop politics,' threatens legal retaliation Amazon sellers say they were unfairly suspended right before Prime Day, and now have two bad choices Investor explains why 'duller' tech stocks can have better returns than 'high-flying' tech names Elon Musk is 'thin-skinned and short-tempered,' says tech VC Texas Instruments CEO Brian Crutcher resigns for violating code of conduct Google Cloud Platform fixes issues that took down Spotify, Snapchat and other popular sites Uber exec: We want to become the 'one stop' transportation app 'What a dumb hearing,' says Democrat as Congress grills tech companies on conservative bias Amazon shares rebound, report says Prime Day sales jumped 89 percent in first 12 hours of the event How to put your medical history on your iPhone in less than 5 minutes Investment chief: Watch these two big events in 2018 Even with Netflix slowing, the market rally is likely not over Cramer: Netflix subscriber weakness debunks the 'sky's the limit' theory on the stock Netflix is looking at watch time as a new area of growth, but the competition is stiff Why Nobel laureate Richard Thaler follows Warren Buffett's advice to avoid bitcoin Rolls-Royce is developing tiny 'cockroach' robots to crawl in and fix airplane engines After Netflix plunge, Wall Street analysts forecast just tame returns ahead for the once high-flying FANG group Roku shares rise after analyst raises streaming video company's price target due to customer growth China is investing 9 times more into Europe than into North America, report reveals Amazon says US Prime Day sales 'so far bigger than ever' as glitch is resolved Netflix is on pace for its worst day in two years US lumber producers see huge opportunity, rush to expand San Francisco to consider tax on companies to help homeless Homebuilder sentiment, still high, stalls as tariffs, labor and land drive up costs Powell backs more rate hikes as economy growing 'considerably stronger' Netflix history is filled with big stock declines – like today – followed by bigger rebounds Intel shares get downgraded by Evercore ISI due to rising competition from Nvidia, AMD Petco aims to reinvent the pet store with something you can't buy online Genetic testing is coming of age, but for consumers it's buyer beware Tech 'FAANG' was the most-crowded trade in the world heading into the Netflix implosion, survey shows Netflix weak subscriber growth may indicate a 'maturity wall' that could whack the stock even more: Analyst This chart may be predicting the bull market's demise Wall Street says Netflix's stock plunge is a ‘compelling’ buying opportunity because the streaming giant ‘never misses twice’ Tesla sinks after Musk tweets, again Boeing announces new division devoted to flying taxis Stocks making the biggest move premarket: NFLX, UNH, GS, AMZN, WMT & more Deutsche Bank downgrades Netflix, but says big subscriber miss is not 'thesis changing' IBM is experimenting with a cryptocurrency that’s pegged to the US dollar North Korea and Zimbabwe: A friendship explained Virgin Galactic spinoff Orbit to launch rockets from the UK with space deal Artificial intelligence will create more jobs than it destroys? That’s what PwC says ‘Treasonous’ Trump and ‘Putin’s poodle:' Scathing headlines follow the Trump-Putin summit China’s fintech companies offer ‘enormous’ opportunity, investment manager says Trump's performance at summit with Putin was 'unprecedented,' experts say Walmart and Microsoft link up on cloud technology as they both battle Amazon European stocks seen mixed amid earnings; Fed’s Powell to address Congress How I knew I should quit my day job and run my start-up full-time: Viral website founder China's stocks have been trounced, but the trade war may ultimately be good news for those shares Billionaire tech investor Peter Thiel bets on crypto start-up Block.one Asian shares subdued open after mixed close on Wall Street; energy stocks under pressure Amazon cloud hits snags after Amazon Prime Day downtime Netflix isn't doomed by one quarter unless people start questioning the long-term investor thesis Tech stocks set to sink on Tuesday after rough evening for ‘FANG’ Netflix plummets after missing big on subscriber growth This wristband lets humans control machines with their minds The U.S. has a rocky history convincing Russia to extradite computer criminals Amazon suffers glitches at the start of Prime Day Jeff Bezos is now the richest man in modern history 'The United States has been foolish': Read Trump and Putin's full exchange Goldman Sachs recommends these 5 highly profitable companies — including Nvidia — to combat rising inflation Goldman Sachs releases 'tactical' stock picks for this earnings season Three red flags for Netflix ahead of its earnings report The bond market may be raising recession fears, but don't expect one anytime soon Cramer: Banks are 'making fortunes' but are still as hated as they were during the financial crisis Putin told Trump at summit: Russia never meddled in US election


Inside Facebook's speech recognition factory

Apple has Siri and Amazon’s got Alexa. Microsoft created Cortana and Alphabet launched the Google Assistant.

The technology giants are racing to bring speech recognition to consumers through a host of mass-market devices and apps. But one company has been curiously absent: Facebook.

While Mark Zuckerberg has pushed his app across the globe — last week it crossed 2 billion active users to go along with 1.2 billion people on chat service WhatsApp — Facebook has lagged behind its rivals when it comes to voice control.

There’s too much at stake for the company to stand still. Research firm Markets and Markets predicted last year that the speech recognition market would reach $10 billion by 2022. Beyond the money, internet companies need consumers using their speech tools so they accumulate even more data in order to improve accuracy.

Device makers have a big advantage in pushing out voice technology because they have direct access to consumers. Unlike, Apple, Amazon and Alphabet, Facebook doesn’t have a piece of hardware or a mobile operating system that’s in many millions of people’s pockets or homes.

The closest thing Facebook has in terms of hardware is Oculus, the virtual reality headset maker Zuckerberg snapped up for $2 billion in 2014. As Facebook seeks to make headway into speech recognition, Oculus is one of its testing grounds.

Here’s the idea: While wearing the headset, you can say “Hey Oculus” and get a response to an inquiry. For example, you can ask for the view to be recentered or to open up a particular game or to search the app store. The technology works on the Oculus Rift and the Samsung Gear VR, which is powered by Oculus.

“To explore any interesting hands-free interfaces, you will definitely need speech,” Joaquin Quinonero Candela, the head of Facebook’s Applied Machine Learning group, said in an interview last week at the company’s Silicon Valley headquarters.

Facebook’s use of speech recognition goes well beyond Oculus. The company also deployed a system for automatically generating captions for certain videos. And more speech-enabled products are on the way.

Facebook made a clear jump into artificial intelligence when it hired Yann LeCun from New York University in 2013. LeCun is a longtime academic in machine learning who was tapped to lead the new Facebook Artificial Intelligence Research group.

Within a few months, Facebook engineers were taking products developed in LeCun’s research group and getting them ready for wider use. That process was formalized with the establishment of the Applied Machine Learning group in September 2015, under the leadership of Candela, a veteran of Microsoft Research who had arrived at Facebook three years earlier.

Facebook has kept its progress in speech recognition largely under wraps, even as Alphabet, Apple and Microsoft have been touting improvements in the accuracy of their systems in recent years.

Candela said his group began working on speech enhancements about 2½ years ago, with help from Jibbigo, a start-up Facebook acquired in 2013.

Facebook’s research and development, Candela said, falls into two categories: push and pull. Push involves betting that some capability will be useful in any number of ways in the future and then setting out to create it, while pull is when engineers are asking for a new feature to be built internally.

Speech was squarely in the push category.

One use case the researchers came up with was to automatically generate captions of videos, something Google started doing for YouTube videos in 2009.

Facebook initially focused on ads. The rationale was that at the time people were typically scrolling through their feeds with the sound off, so for advertisers to get their message across they needed text to run inside their video ads.

“We looked for a problem space in the speech recognition area through which we could deliver value to users,” said Reena Philip, an engineering manager for Facebook’s speech infrastructure group. Joining forces with the ads team, “we collaborated closely on a prototype,” she said.

The feature launched in the second quarter of 2016. Facebook then went deeper with the technology, automatically generating subtitles for videos that organizations posted to their dedicated pages in U.S. English.

“We did experiments — we got a double-digit increase in engagement with videos if we captioned them,” Candela said.

Unlike the video captioning system, the Oculus speech recognition feature was an example of a pull that triggered Candela’s group’s work.

On the Gear VR, apps and games became difficult to find as more were made available. Saying a name out loud became a viable alternative for hunting down something specific. The bigger challenge was related to titles that eschewed normal English words, such as Vrideo.

“‘Lucky’s Tale‘ is probably something we could do fine on,” said Merlyn Deng, a Facebook product manager, referring to a game that comes bundled with the Oculus Rift.

But Philip, who worked on Amazon Alexa before joining Facebook in 2015, said non-English words in titles are “very typical.”

Facebook also had to make sure that Samsung smartphones hooked into Gear VR headsets would respond to the words “Hey Oculus.” Unlike the Oculus Rift headset, a Gear VR is just powered by a mobile phone and doesn’t have a beefy computing system behind it.

“The footprint can only handle so much space, but it’s getting better and better,” Philip said. Apple and Google have found ways to squish voice activation into phones, and now Facebook has followed.

When speech recognition launched in Oculus in the fourth quarter, it only worked for U.S. English, but the team has since added support for more English dialects, Philip said.

Over time, Facebook could make the Oculus speech recognition technology work offline, Philip said. The company also may eventually support languages other than English.

Beyond that, Facebook employees weren’t specific about exactly where the company is headed.

At a high level, said Deng, “we want to build a deep semantic understanding of people’s interests, and also of content.”

It’s possible to guess about what could come next if you think about where Facebook excels. The company has data about your interests, your friends’ interests and their friends’ interests. It has users’ pictures, videos and text posts, along with articles and other content that people have shared on the social network over the years.

“Other voice assistants may be geared toward what they have data for,” Deng said.

Today, Facebook is all about community. That’s another good guideline to consider when you imagine what sorts of voice-activated experiences Facebook might decide are worth pursuing.

“The stuff we would attempt to do has to be lined up with the mission and also the data that we have here,” Deng said.

Source: Tech CNBC
Inside Facebook's speech recognition factory

Comments are closed.