Are you looking to make an impact at the intersection of leading technological trends of our time: big data, artificial intelligence, open source, cloud and serverless computing? If yes, Azure Big Data team are looking for you. 

  

Azure Big Data team (Azure Synapse Analytics, Azure HDInsight, Azure Stream Analytics, Azure Datalake Analytics, Azure Databricks and Cosmos) present exciting challenges in technologies such as big-data, cloud, distributed computing, artificial intelligence, storage and open-source. We build reliable, highly scalable and highly performing distributed systems for data analytics on Azure. Azure HDInsight is one of the fastest growing Azure services that offers popular open source technologies, such as Spark, Hadoop, Kafka, HBase and many others in a form that is easy for customers to use. We work with various open-source technologies including Spark, Hadoop, Yarn, etc. and make contributions to these technologies. We are running one of the world’s largest big data cluster which has more than 25,000 machine, stored more than 10,000PB data and run tens of thousands of jobs everyday across search, ads, Office, Xbox, etc. Azure Stream Analytics is an event-processing engine that allows users to examine high volumes streaming data at scale. We are supporting massively parallel complex streaming processing in Azure.  

Responsibilities

As an engineer, you have the opportunity to work on the latest technology in big data area: 

• Design and develop world-class experience for new big data cloud offering 
• Design and develop platform-specific APIs and tools as building blocks for a world-class user experience 

• Operationalize open source analytics to run at scale, for example, Spark, Hadoop, Yarn, etc. 

Qualifications

Basic Qualifications:  
 

• BS/MS degree in computer science or related field. 
• 3+ years of software design and development experience with at least one of C/C++/C#/Java/python/scala. 

  

Preferred Qualifications: 
 

• Passion and experience for building great developer experience and user experience of modern analytics systems 
• Experience with open source components like Spark and Hadoop ecosystem as a plus 
• Experience with leveraging ML and AI for analytics as a plus  

• Great curiosity and willingness to question  
• High enthusiasm, integrity, ingenuity, results-orientation, self-motivation, and resourcefulness in a fast-paced competitive environment 
• Love the next problem, the next experiment, the next partner  
• Have a deep desire to work collaboratively, solve problems with teams across the world, find win/win solutions and celebrate successes  
• Get excited by the challenge of hard technical problems  

• Solve problems by always leading with deep passion and empathy for customers 

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.