Rainbow in the Cloud

-
Image result for rainbow and clouds
Cloud technologies burst into our lives without asking our permission.

At the beginning many of us thought the only thing that it brings would be the thunder and the rain. 
Time shows that, instead, it might even bring some color to our skies.

Today, on a first day Keynote of the 16th PASS Summit, Microsoft representatives 
 -Corporate VP Data Platform, Cloud & Enterprize T.K. "Ranga" Rengarajan, 
- General Manager of Power BI James Phillips 
- Corporate VP Information Management &Machine Learning Joseph Sirosh 
took stage one after another talking about the Microsoft Data Platform and what it can offer in the cloud space.

They have talked about the explosion of all kinds of data devices.  Those devices produce enormous amounts of data. Many also consume enormous amounts of data.
This data is changing the way we work, the way we do business, and the way we live. We all depend on data to make decisions.
Microsoft Data Platform allows us to do more. To achieve more. In theory, i might add. Just because I had no chance to try their new products myself.

Microsoft Data Platform has all kind of technologies that are used by many mission critical environments around the world.

Technologies based on the structured data & technologies based on unstructured data.
In memory & on disk data processing. 
Products that can scale up & products that can scale out. 
Technologies that can store data & technologies that only process the data. 
Some can live on premises & some can live only in the cloud.

Microsoft Data Platform in the cloud has a lot to offer. 
Key/value pairs management using Microsoft Azure Tables ( http://msdn.microsoft.com/en-us/library/azure/jj553018.aspx )
Document management, schema free, write optimised platform using new highly Scalable Azure DocumentDB ( http://azure.microsoft.com/en-us/services/documentdb/ )
Relational database-as-a-service ( http://azure.microsoft.com/en-us/services/sql-database/ )
File system computation using Azure HDinsight, which both process data and store it in the cloud ( http://azure.microsoft.com/en-us/services/hdinsight/ )
Json based full indexing using Azure Search ( http://azure.microsoft.com/en-us/services/search/ )
Browser-based data orchestration by Azure Data Factory ( http://azure.microsoft.com/en-us/services/data-factory/ )
Prediction models technology by Azure Stream Analytics and Azure Machine Learning. (http://azure.microsoft.com/en-us/services/machine-learning/)
 PowerBI.com dashboards used in several demos today were very impressive with all its interactive and colourful reports. 

Loud music contributed to the great spirits of 3,941 attendees from 56 countries and 2,000 companies. Huge screens thanked all  community volunteers, chapter leaders and sponsors.

The World is excited about data.  Microsoft are excited about their data platform. I am excited to be at the PASS summit. 

Yours,
Maria

Comments

Post a Comment

Popular posts from this blog

SQL Awesomeness: Finding a QUALIFY query clause in the depths of the database ocean

-
Image
After so many years of writing SQL queries, I cannot believe I never came across a QUALIFY query clause. It feels like discovering a treasure in the depths of the database ocean. Even ChatGPT was not aware of it! QUALIFY query clause was invented by Teradata and is not a part of SQL Standart but apparently, multiple database vendors are supporting it, for instance, Snowflake and Databricks. QUALIFY clause solves the challenge when applying a window function as a query filter. SQL Standart and most database vendors will not allow to run of a window function as a part of a WHERE clause because window functions get evaluated after the HAVING clause. We typically create a CTE or subquery adding a window function to be able to filter on a it at a later query stage. Here is an example of how you can use QUALIFY to piece-of-cake filter on the window function.  I will use the Snowflake database, as an example. Let us consider that we have a list of queries and we need to find the last query ex
Read more

Look back and realize how far you came

-
Image
It appeared out of nowhere while I was having a strong argument with the ton of dust that had taken over my computer room. My former favourite book, "Advanced Transact-SQL for SQL server 2000" brought an upset look to my face, the one I usually get from our NetApp admin. He usually gives me such a look when I ask him for more disk space. At the time of SQL 2000 there were far less good SQL books available than today and amazing SQL programming tricks were living on Itzik’s book pages; and, similar to the Rubeus Hagrid’s “The Monster Book of Monsters” it attacked anyone who attempted to open it, unleashing wild and exciting brilliant ideas. Nowadays there are a lot of SQL books but not all of them are worth reading. Some of them should be strongly avoided and if you touch them you should immediately wash your hands and have a drink or three. A few month ago I was asked to technically review some new SQL Server book. Reading their missleading claims of how the optim
Read more

The Greatest Reasons to use or not to use a Centralized Data Access Architecture

-
Image
When developing a modern Data Platform Layer, one of the main decisions is whether to opt for centralized or decentralized data access architecture.  There is no “one-fits-all” solution, both have advantages and disadvantages. A Centralized Data Access Architecture would usually mean duplicating data from the operational layer into the analytical layer and applying various transformations to data to support and speed up data analytics. Operational online transaction processing Layer , where all microservices and their operational databases are located. Analytical Data Layer , where we would have data lakes that support data Scientists' work and a data warehouse, that supports Business Intelligence. Transformations, ETL or ELT data pipelines , which are moving data from the operational layer into the analytical layer. I f we opt for a Centralized Data Access architecture, what would be the benefits and the drawbacks? CONSISTENCY : consolidating data into a central location can
Read more