Microsoft Supercharges Bing Search With Programmable Chips - FPGA - Altera chips
![Bob Lawrence (VE1RLL)](https://forums.parallax.com/uploads/userpics/770/nLR8ZVA1DX61Q.png)
News Source:
http://www.wired.com/2014/06/microsoft-fpga/
Doug Burger called it Project Catapult.
Burger works inside Microsoft Researchthe group where the tech giant explores blue-sky ideasand in November 2012, he pitched a radical new concept to Qi Lu, the man who oversees Microsofts Bing web search engine. He wanted to completely change the machines that make Bing run, arming them with a new kind of computer processor.
Doug Burger.
Microsoft
Like Google and every other web giant, Microsoft runs its web services atop thousands of computer servers packed into warehouse-sized data centers, and most of these machines are equipped with ordinary processors from Intel, the worlds largest chip maker. But when he sat down with Lu, Burger said he wanted millions of dollars to build rack after rack of computer servers that used what are called field-programmable arrays, or FPGAs, processors that Microsoft could modify specifically for use with its own software. He said that these chipsbuilt by a company called Alteracould not only speed up Bing searches, but also change the way Microsoft run all sorts of other online services.Despite the cost, and the riskiness of the proposition, Lu liked the idea. In a first for Microsoft, he approved a 1,600-server pilot-system to test out Burgers ideas, and now, he has given the green light to actually move these FPGAs into Microsofts live data centers. This is set to happen early next year. That means that a few months from now, when you do a Bing search, theres a decent chance that it will be carried out by one of Burgers servers.
The move is part of a larger effort to fix what is an increasingly worrisome problemfor big web companies like Microsoft, Google, and Facebook. After decades of regular performance boosts, chips are no longer improving at the same rate they once were. As their web services continue to grow, these companies are looking for new ways of improving the speed and efficiency of their already massive operations. Facebook is exploring the use of low-power ARM processors. According to reports, Google is too. And now Microsoft is about to roll out FPGAs. There are large challenges in scaling the performance of software now, says Burger. The question is: Whats next? We took a bet on programmable hardware.
THERE ARE LARGE CHALLENGES IN SCALING THE PERFORMANCE OF SOFTWARE NOW, SAYS BURGER.THE QUESTION IS: WHATS NEXT? WE TOOK A BET ON PROGRAMMABLE HARDWARE.
FPGAs, like the Altera chips that Microsoft used in its pilot project, have been around for years. A decade ago, they were widely used by chip designers as a low-cost way to prototype their new products. But lately, theyve crept into networking gear, complex computer rigs that run the bitcoin digital currency, and even some specialized systems used by Wall Street firms to do data analysis. They give hardware makers more freedom to customize their gear.
Using FPGAs, Microsoft engineers are building a kind of super-search machine network they call Catapult. Its comprised of 1,632 servers, each one with an Intel Xeon processor and a daughter card that contains the Altera FPGA chip, linked to the Catapault network. The system takes search queries coming from Bing and offloads a lot of the work to the FPGAs, which are custom-programmed for the heavy computational work needed to figure out which webpages results should be displayed in which order. Because Microsofts search algorithms require such a mammoth amount of processing, Catapult can bundle the FPGAs into mini-networks of eight chips.
![catapault-inline31.jpg](http://www.wired.com/wp-content/uploads/2014/06/catapault-inline31.jpg)
Microsoft
The FPGAs are 40 times faster than a CPU at processing Bings custom algorithms, Berger says. That doesnt mean Bing will be 40 times fastersome of the work is still done by those Xeon CPUsbut Microsoft believes the overall system will be twice as fast as Bings existing system. Ultimately, this means Microsoft can operate a much greener data center. Right off the bat we can chop the number of servers that we use in half, Burger says.Whats more, Microsoft can update the chips in much the same way it updates Bings system software, and Burger and his team can modify the logic on their processors to address bugs and changes in the Bing search algorithm. They do this by building a binary file that represents the updated chip logic and distributing it though Microsofts standard server management software, called Autopilot. Its not uncommon to have several chip updates per week, Burger says.
Of course, there have been challenges. There was a lab flood and a fire with one of their Taiwanese parts suppliers, and as it stands, Microsoft server monitoring tools didnt always know what to make of chips that are suddenly dropping offline and restarting with reconfigured logic. But Microsoft is confident that the new FPGAs can be used across the companys online empire. If all we were doing was improving Bing, I probably wouldnt get clearance from my boss to spend this kind of money on a project like this, says Peter Lee, the head of Microsoft Research. The Catapult architecture is really much more general-purpose, and the kinds of workloads that Doug is envisioning that can be dramatically accelerated by this are much more wide-ranging.
Its also the kind of work thats likely to be emulated at other big web companies who have the resources to hire hardware developers, says James Larus, dean of the School of Computer and Communications Sciences with the École Polytechnique Fédérale de Lausanne. He previously worked at Microsoft on Project Catapult. The benefits of hardware specialization are far too large for the right application for these companies to pass up the opportunity, he says.
According to Burger, developing a whole new chip architecture for one of the worlds largest data center operators is the kind of thing that Microsoft Research does pretty well. Lets jump way out, think of something a little crazy, and then push on it and see how well that works, he says. Come 2015, you can get the answer that question simply by searching Bing.
http://www.wired.com/2014/06/microsoft-fpga/
Doug Burger called it Project Catapult.
Burger works inside Microsoft Researchthe group where the tech giant explores blue-sky ideasand in November 2012, he pitched a radical new concept to Qi Lu, the man who oversees Microsofts Bing web search engine. He wanted to completely change the machines that make Bing run, arming them with a new kind of computer processor.
![catapault-inline2.jpg](http://www.wired.com/wp-content/uploads/2014/06/catapault-inline2.jpg)
![gallery-cam@2x.png](https://www.wired.com/wp-content/vendor/condenast/pangea/themes/wired/assets/images/gallery-cam@2x.png)
Like Google and every other web giant, Microsoft runs its web services atop thousands of computer servers packed into warehouse-sized data centers, and most of these machines are equipped with ordinary processors from Intel, the worlds largest chip maker. But when he sat down with Lu, Burger said he wanted millions of dollars to build rack after rack of computer servers that used what are called field-programmable arrays, or FPGAs, processors that Microsoft could modify specifically for use with its own software. He said that these chipsbuilt by a company called Alteracould not only speed up Bing searches, but also change the way Microsoft run all sorts of other online services.Despite the cost, and the riskiness of the proposition, Lu liked the idea. In a first for Microsoft, he approved a 1,600-server pilot-system to test out Burgers ideas, and now, he has given the green light to actually move these FPGAs into Microsofts live data centers. This is set to happen early next year. That means that a few months from now, when you do a Bing search, theres a decent chance that it will be carried out by one of Burgers servers.
The move is part of a larger effort to fix what is an increasingly worrisome problemfor big web companies like Microsoft, Google, and Facebook. After decades of regular performance boosts, chips are no longer improving at the same rate they once were. As their web services continue to grow, these companies are looking for new ways of improving the speed and efficiency of their already massive operations. Facebook is exploring the use of low-power ARM processors. According to reports, Google is too. And now Microsoft is about to roll out FPGAs. There are large challenges in scaling the performance of software now, says Burger. The question is: Whats next? We took a bet on programmable hardware.
THERE ARE LARGE CHALLENGES IN SCALING THE PERFORMANCE OF SOFTWARE NOW, SAYS BURGER.THE QUESTION IS: WHATS NEXT? WE TOOK A BET ON PROGRAMMABLE HARDWARE.
FPGAs, like the Altera chips that Microsoft used in its pilot project, have been around for years. A decade ago, they were widely used by chip designers as a low-cost way to prototype their new products. But lately, theyve crept into networking gear, complex computer rigs that run the bitcoin digital currency, and even some specialized systems used by Wall Street firms to do data analysis. They give hardware makers more freedom to customize their gear.
Using FPGAs, Microsoft engineers are building a kind of super-search machine network they call Catapult. Its comprised of 1,632 servers, each one with an Intel Xeon processor and a daughter card that contains the Altera FPGA chip, linked to the Catapault network. The system takes search queries coming from Bing and offloads a lot of the work to the FPGAs, which are custom-programmed for the heavy computational work needed to figure out which webpages results should be displayed in which order. Because Microsofts search algorithms require such a mammoth amount of processing, Catapult can bundle the FPGAs into mini-networks of eight chips.
![catapault-inline31.jpg](http://www.wired.com/wp-content/uploads/2014/06/catapault-inline31.jpg)
![gallery-cam@2x.png](https://www.wired.com/wp-content/vendor/condenast/pangea/themes/wired/assets/images/gallery-cam@2x.png)
The FPGAs are 40 times faster than a CPU at processing Bings custom algorithms, Berger says. That doesnt mean Bing will be 40 times fastersome of the work is still done by those Xeon CPUsbut Microsoft believes the overall system will be twice as fast as Bings existing system. Ultimately, this means Microsoft can operate a much greener data center. Right off the bat we can chop the number of servers that we use in half, Burger says.Whats more, Microsoft can update the chips in much the same way it updates Bings system software, and Burger and his team can modify the logic on their processors to address bugs and changes in the Bing search algorithm. They do this by building a binary file that represents the updated chip logic and distributing it though Microsofts standard server management software, called Autopilot. Its not uncommon to have several chip updates per week, Burger says.
Of course, there have been challenges. There was a lab flood and a fire with one of their Taiwanese parts suppliers, and as it stands, Microsoft server monitoring tools didnt always know what to make of chips that are suddenly dropping offline and restarting with reconfigured logic. But Microsoft is confident that the new FPGAs can be used across the companys online empire. If all we were doing was improving Bing, I probably wouldnt get clearance from my boss to spend this kind of money on a project like this, says Peter Lee, the head of Microsoft Research. The Catapult architecture is really much more general-purpose, and the kinds of workloads that Doug is envisioning that can be dramatically accelerated by this are much more wide-ranging.
Its also the kind of work thats likely to be emulated at other big web companies who have the resources to hire hardware developers, says James Larus, dean of the School of Computer and Communications Sciences with the École Polytechnique Fédérale de Lausanne. He previously worked at Microsoft on Project Catapult. The benefits of hardware specialization are far too large for the right application for these companies to pass up the opportunity, he says.
According to Burger, developing a whole new chip architecture for one of the worlds largest data center operators is the kind of thing that Microsoft Research does pretty well. Lets jump way out, think of something a little crazy, and then push on it and see how well that works, he says. Come 2015, you can get the answer that question simply by searching Bing.
Comments
Networking companies are moving away from complex hardware systems to Software Defined Networks, and MSFT talks about moving toward more complex hardware systems. Go figure.
Altera might counter that FPGA are very much software-defined solutions
LOL..I assume that Microsoft has asked the hardware houses to bid on this and didn't like the answer for a coprocessor.
http://arstechnica.com/information-technology/2014/06/bing-doubles-performance-with-fpgas-will-use-them-in-2015/
http://fpgablog.com/posts/altera-accelerated-libraries-mentor/