Rainbow in the Cloud

-
Image result for rainbow and clouds
Cloud technologies burst into our lives without asking our permission.

At the beginning many of us thought the only thing that it brings would be the thunder and the rain. 
Time shows that, instead, it might even bring some color to our skies.

Today, on a first day Keynote of the 16th PASS Summit, Microsoft representatives 
 -Corporate VP Data Platform, Cloud & Enterprize T.K. "Ranga" Rengarajan, 
- General Manager of Power BI James Phillips 
- Corporate VP Information Management &Machine Learning Joseph Sirosh 
took stage one after another talking about the Microsoft Data Platform and what it can offer in the cloud space.

They have talked about the explosion of all kinds of data devices.  Those devices produce enormous amounts of data. Many also consume enormous amounts of data.
This data is changing the way we work, the way we do business, and the way we live. We all depend on data to make decisions.
Microsoft Data Platform allows us to do more. To achieve more. In theory, i might add. Just because I had no chance to try their new products myself.

Microsoft Data Platform has all kind of technologies that are used by many mission critical environments around the world.

Technologies based on the structured data & technologies based on unstructured data.
In memory & on disk data processing. 
Products that can scale up & products that can scale out. 
Technologies that can store data & technologies that only process the data. 
Some can live on premises & some can live only in the cloud.

Microsoft Data Platform in the cloud has a lot to offer. 
Key/value pairs management using Microsoft Azure Tables ( http://msdn.microsoft.com/en-us/library/azure/jj553018.aspx )
Document management, schema free, write optimised platform using new highly Scalable Azure DocumentDB ( http://azure.microsoft.com/en-us/services/documentdb/ )
Relational database-as-a-service ( http://azure.microsoft.com/en-us/services/sql-database/ )
File system computation using Azure HDinsight, which both process data and store it in the cloud ( http://azure.microsoft.com/en-us/services/hdinsight/ )
Json based full indexing using Azure Search ( http://azure.microsoft.com/en-us/services/search/ )
Browser-based data orchestration by Azure Data Factory ( http://azure.microsoft.com/en-us/services/data-factory/ )
Prediction models technology by Azure Stream Analytics and Azure Machine Learning. (http://azure.microsoft.com/en-us/services/machine-learning/)
 PowerBI.com dashboards used in several demos today were very impressive with all its interactive and colourful reports. 

Loud music contributed to the great spirits of 3,941 attendees from 56 countries and 2,000 companies. Huge screens thanked all  community volunteers, chapter leaders and sponsors.

The World is excited about data.  Microsoft are excited about their data platform. I am excited to be at the PASS summit. 

Yours,
Maria

Comments

Post a Comment

Popular posts from this blog

Unlocking Microsoft Fabric: A Simple Guide when you only have a personal account.

-
Image
" You cannot create a Microsoft capacity using a personal account. Use your organizational account instead." What a disappointment and frustration! I've been trying to set up Microsoft Fabric for a while now and figure out how to work around this error. I use my personal Gmail for an MVP subscription to learn and experiment with Azure services. When I visit app.fabric.microsoft.com and try to use my private Gmail address, I keep getting a similar message: It's frustrating because I'm eager to dive into Fabric and explore its capabilities. I would get the same error trying to set up Azure Data Catalog, PowerBI embedded, and more. What are the different account types and how do they differ? A work or school account is created through Active Directory or other cloud directory services, such as Microsoft 365. On the other hand, a personal account is one that's manually created for individual use, consisting simply of a username and password. After digging into ...
Read more

ETL to ELT journey: Break free your Transformations and discover Happiness and Data Zen

-
Every data integration pipeline consists of 3 stages: Data Extraction (E), Data Transformation (T) and Data Load (L) During the  Data Extraction stage, the source data is read from its origins: transactional databases, CRM or ERP systems or through data scraping from web pages. During the  Data Transformation stage, the necessary modifications are applied to the source data. This includes data filtering, enrichment or merging with existing or other source datasets, data obfuscation, dataset structure alignment or validation, fields renaming and data structuring, according to the canonical data warehouse model.  During the Data Loading stage, the data is stored in the pipeline destination, which could be a staging area, data lake or data warehouse. There are two principal methods for the data integration process: transferring it from where it originated to the destination, where the data will be used for analysis, ETL and ELT. The difference between ETL and ELT pipelines...
Read more

Coding is a rollercoaster of efficiency and eyebrow-raising discoveries.

-
Image
Data Engineers or Developers - many of us love to be gourmet chefs in the kitchen. When it comes to planning and design, we would rather throw all ingredients in the pot and see how it comes out.  Coding without a plan is like assembling a puzzle in a dark room. The result will most probably be unexpected and off the canvas. Whether you follow Waterfall or Agile development strategy, planning and design phases are non-negotiable and are essential to reduce development cycles and redo work. Once upon a time, one data engineer created an amazing piece-of-cake automation pipeline. This masterpiece had very complex logic, pulling data from multiple sources, and merging and persisting the data in a complex, incremental way. When the pipeline started to run successfully and automation flows worked, the data engineer got very excited and considered this development done. A few days later QA engineer found out that the result dataset was never created in the destination. Why has that ...
Read more