Showing posts with label Big Data. Show all posts
Showing posts with label Big Data. Show all posts

Wednesday, July 12, 2017

What is Microsoft Graph?

Microsoft SQL Server is for accessing data and Microsoft Graph is to access the myriad of things that are not really part of the database. The things that spring to the mind are things like, emails; your devices; the teams you work with; calendars; files; messages, peoples etc..

Also read this post on Graph databases:
http://hodentek.blogspot.com/2013/12/what-is-neo4j.html

A quick look at this image shows how Microsoft Graph is positioned.



Well, what is it Microsoft Graph good for?

Believe me, you indeed have a great deal of use for it. Allow me to quote Microsoft:

'Looks at your next meeting and helps you prepare for it by providing profile information for attendees, including their job titles and who they work with, as well as information on the latest documents and projects they're working on (pro-active, do diligence).

Scans your calendar, and suggests the best times for the next team meeting.

Fetches the latest sales projection chart from an Excel file in your OneDrive and lets you update the forecast in real time, all from your phone.

Subscribes to changes in your calendar, sends you an alert when you’re spending too much time in meetings, and provides recommendations for the ones you could miss or delegate based on how relevant the attendees are to you.

Helps you sort out personal and work information on your phone; for example, by categorizing pictures that should go to your personal OneDrive and business receipts that should go to your OneDrive for Business.
'
Behind Microsoft Graph is the Microsoft Graph API; a RESTful web api that enables you to access Microsoft Cloud serivce resources.

Come back to this blog again for more on Microsoft Graph.

Saturday, October 10, 2015

What is U-SQL?

While SQL covered the RDBMS landscape U-SQL covers a much larger data landscape.

At the same time as the announcement of Azure Data Lake Services, a new language under development at Microsoft, the U-SQL language was also announced. For the Azure Data Lake Service and what it means to business read here.

With the advent of Big Data and the task of mining all kinds of data, RDBMS suddenly found itself at a disadvantage. Structured Query Language (SQL) could only address what is in a relational data store. U-SQL was born to address this challenge posed by Big Data defined by volume, velocity and variety.

What is U-SQL
U-SQL deep dives into Big Data to extract the most relevant information. It is a powerful language (in the words of Microsoft):
  • Process any type of data. From analyzing BotNet attack patterns from security logs to extracting features from images and videos for machine learning, the language needs to enable you to work on any data.
  • Use custom code easily to express your complex, often proprietary business algorithms. The example scenarios above may all require custom processing that is often not easily expressed in standard query languages, ranging from user defined functions, to custom input and output formats.
  • Scale efficiently to any size of data without you focusing on scale-out topologies, plumbing code, or limitations of a specific distributed infrastructure.
Compared to HIVE, a SQL-Based language, U-SQL is flexible and does not have the limited capability to address the 'variety' in non-structured data requiring schema generation prior to running queries. U-SQL should prove more easy to use than Hive for complex scenarios.

U-SQL has been designed as declarative SQL based language with native extensibility through user code in C#. This approach:
  • Unifies SQL and C#
  • Unifies structured and Unstructured
  • Unifies declarative and custom code
U-SQL is based on SCOPE which is based on  existing prior languages, ANSI-SQL, T-SQL and HIVE. U-SQL should present a less steeper curve for those who are using SQL already.

U-SQL is an important development that developer need to jump on.