Overview: Today the terminology “Data Analytics” becomes a buzz across all industries & enterprises. Every organization strongly believes Data Analytics greatly helps to get insight & accelerate the business strategies in order to grow & lead in their fast and ever-changing markets. Azure Databricks: Azure Databricks is a data analytics platform optimized for the Microsoft […]
Posts Tagged ‘Azure Data Factory’
Log Pipeline Executions to File in Azure Data Factory
Why Azure Data Factory? Nowadays, the data our customer’s applications generate is increasingly exponential, especially if data is coming from several different products. Organizations have data of several types located in the cloud and on-premises, in structured, unstructured, and semi-structured formats all arriving at different time-frequency and speeds. It will be a critical task to […]
Transform Your Data with Azure Data Factory
This blog will help you to understand the basic functionality of Azure Data Factory (ADF) and how powerful a tool it is when working with big data. Explore the basic architecture on ADF and get to know the components and services involved. A Quick Intro to Azure Data Factory & Its Key Features ADF is […]
Building Modular Pipelines in Azure Data Factory using JSON data
Azure Data Factory (ADF) pipelines are powerful and can be complex. In this post, I share some lessons and practices to help make them more modular to improve reuse and manageability. Why Modular Pipelines? Pipelines are composed of activities, as the number of activities and conditions increases, the difficulty in maintaining the pipeline increases as […]
Cortana Analytics and Information Management
In previous posts I’ve provided an introduction to Microsoft’s cloud-based Cortana Analytics Suite, and we’ve looked at what data and event ingest capability it provides. This time, I want to shed some light on what happens after Ingest. Where do you land the data so that you can work to transform it into actionable intelligence? […]
Data and Event Ingest with Cortana Analytics
In my last post, I introduced Microsoft’s Cortana Analytics Suite, a collection of Azure-based PaaS and SaaS offerings bundled to provide a comprehensive toolkit for building Advanced Analytics and IoT solutions. These are cloud-based resources to perform a variety of functions, from collecting telemetry from remote devices, to predicting diabetes-related hospital readmissions, to showing real-time race […]
Introducing Microsoft’s Cortana Analytics Suite
As far back as this year’s Ignite event, Microsoft has been mentioning “Cortana Analytics” by name. But at the first-ever Cortana Analytics Workshop in Redmond this past Sept 10 and 11, they unveiled a bigger offering and vision linking their current slate of cloud-based data platform tools. It’s known that Microsoft has been using Big […]
Azure: Did You Know? Azure Data Factory
One of Azure’s ever-increasing number of new data platform services, Azure Data Factory provides the ability to execute and orchestrate Big Data workflows. Azure Data Factory allows you to manage and produce information by offering an easy way to create, orchestrate, and monitor data pipelines. Activities are combined into Pipelines, and these pipelines are used […]