Diving into Microsoft's Azure Data Lake

Microsoft has been working with big data for a long time. Internally, it uses a tool called Cosmos, built with its own distributed processing technology, Dryad, to handle the data for everything from Bing AdCenter to Windows telemetry. Cosmos is used for curation, processing, analysis and reporting on massive data sets; imagine what looks like a single file that contains all the URLs Bing has ever seen, against which you can run interactive queries, with those queries running on maybe 50,000 mac