Wednesday, December 25, 2013

My Xmas Dream


Xmas is a time of reflection, of meditation on how the world faring. But the situation for many is dire. In the United States one out of zeven people live in poverty, getting their food from foodbanks whose budgets are now being cut by the government. In Syria, hundreds of thousands if not millions live in tents, with hardly enough blankets and clothes to keep them warm. In Central Africa rebel bands kill and rape in ways beyond our worst imaginations. In the meantime, a few fortunate bankers, traders, investors and CEOs of mega-companies make millions or even billions. This unequal distribution of wealth is perhaps the most disturbing fact of all.

At Xmas time we buy off our conscious by giving to charity. But most big charities are run as full scale companies these days. For instance, Salil Shetty, the Secretary-General of Amnesty International earns $305,000 a year. I wonder, how do you justify to Joe the carpenter who earns a tenth of that amount per year to give generously? This world is deeply twisted.

So then here is my Xmas dream. Let's build a company with the brightest minds in the world. Everyone who joins can not earn more than a modest salary (or if you do this on the side, you will earn nothing at all). We will join forces to develop the most amazingly intelligent algorithms to suck the financial markets dry. (Our secret algorithms will of course based on deep learning.) We will wreck the large trading firms into bankruptcy. With the billions of dollars that we earn with trading we will refrain from buying ourselves that Ferrari, but instead we will save the rainforest, educate the world, provide food and shelter for those who need it.

That is my Xmas dream. Who wants to join?


Tuesday, December 17, 2013

The Role of Corporate Involvement at NIPS



I was conference chair for NIPS 2013 together with Zoubin Ghahramani (but I only speak for myself in what I write below). Mark Zuckerberg visited NIPS and created quite stir. And discussion about the role of companies at NIPS. Here is my perspective on the issue.

First, I think it's great to have this discussion, because it's clear that the field is rapidly changing. I view corporate involvement of this magnitude as an interesting experiment that we have to work through and reevaluate every year. As with everything there are advantages and disadvantages to corporate involvement. Here are a few I can see:

pro's
-Industry is an integrated part part of our ecosystem from which we hugely benefit. Our students have good jobs (with higher salaries than mine). I have never heard of anyone being worried that their students could not find a job. That's a huge blessing.

-Industry helps us with funding our fundamental research and our conferences. There are many faculty grants that support fundamental research that only needs to be tangentially related to the main mission of the company. Industry also pays for a good chunk of our registration fees, meals, student awards etc.

-Some companies, in particular Microsoft, operate as an op research lab, allowing their employees to serve the community as reviewers, area chairs, workshop organizers and even program chairs (see last years program chairs at NIPS 2012). Their research papers are just as interesting as papers coming out of academia.

-Industry labs may accelerate the pace at which our field develops. We may actually need their resources (data and computational infrastructure) to make the next leap in building truly intelligent AI systems. These successes may generate enthusiasm among our new students entering the field, further accelerating progress. 

con's
- Reproducibility. There is a certain danger that more datasets and algorithm details will be locked behind the company's firewall. It's not good if talks have classified elements, or certain questions can not be answered. Mark Zuckerberg announced that Facebook has developed the best ever face recognition system in just under three months. That's super exciting, but will we have access to it (either to the parameters of the deep net, or to the dataset and algorithm used to train it)? In other words, can we reproduce their results?

-The Google question (soon the be renamed as the Facebook question). I am often reviewed by a mix of astronomers, mathematicians and computer scientists (The Netherlands is a small country..). I have been confronted more often than I like with what has become known as "the Google question": if this research can be done at Google with many more resources, why should we grant you this money? So here our close connection to industry fires back because it is not considered as "fundamental research" by many who don't understand how we operate. 

-Is it desirable that big companies lure our best students away to improve ad-placement, where they could also have contributed to curing some of the horrible diseases that plague mankind? Perhaps not, but people have the right to make their own decisions.

And as to Mark Zuckerberg's visit. I found it super exciting! I think it's a small price to pay that certain workshops were temporarily under-attended. But I agree that NIPS should not be turned into a publicity and recruitment event for big companies. We should acknowledge that our field is a complex ecosystem that involves both academia and industry. Our challenge is to find the right balance.