Big data is creating a big buzz in industry. In this talk, I will overview the big data strategy of Microsoft and present recent research/production works in COSMOS and SCOPE to present the challenges and opportunities that we are facing. COSMOS is Microsoft internal big data platform backing many key Microsoft online services such as Bing, Office 365, and Xbox Live. SCOPE is the computational platform running on top of COSMOS and provides declarative query/script interface similar to SQL. Some big production SCOPE scripts often include tens of user-defined operators, and periodically process hundreds of TB of data running on hundreds of thousands of machines.

YongChul Kwon is a Senior Software Engineer in Cloud and Enterprise group at Microsoft. YongChul Kwon holds a Ph.D. in Computer Science from University of Washington (2012). He received his B.S. degree in Computer Science from KAIST (2004). His research interests are in the field of database management systems and distributed systems. His current research focus is in query optimization and execution in the cloud.