Explore Azure data with Apache Drill, now part of the Data Science Virtual Machine, a custom virtual machine image on Azure, which is pre-installed and configured with a host of popular tools that are commonly used in data science, machine learning and AI.
“Drill is an Apache open-source SQL query engine designed to support high-performance analysis on data coming from modern Big Data sources ranging from flat files, RDBMS, NoSQL databases, Hadoop/Hive stored on local server/desktop or cloud platforms like Azure and AWS.” It’s designed for low latency and high throughput, and can scale from a single machine to thousands of nodes.
And using ODBC/JDBC interface, “Drill allow performing data exploration on BI tool such as Excel, Power BI or Tableau, using SQL queries.” Even, it’s possible to query data from any programming language such as R or Python with ODBC/JDBC interfaces.
The best part of querying data with Drill is that the data stays in the original source and you can join data across multiple sources.
See this Cortana Intelligence Gallery tutorial that walks you through the installation and how to query data with Drill. Also, watch the embedded webinar “Inside the Data Science Virtual Machine” video:
Eight new service offerings added to Certification scope in Azure Government and may be used by federal, Department of Defense, and state and local government customers and partners building solutions who are required to meet rigorous compliance standards such as Federal Risk and Authorization Program (FedRAMP) High, DISA L4, CJIS, ITAR and IRS 1075, Microsoft stated.
With the addition of the eight offerings, the total number of Azure Government offerings that meet the FedRAMP High baseline is now 26 services, and the new service added include: “Azure Resource Manager, Automation, Azure Batch, Log Analytics, Azure Media Services, Policy Administration Service/RBAC, Redis Cache and Scheduler.”
Certificate-based authentication is now generally available for Azure Active Directory (AD), Microsoft’s multi-tenant, cloud-based directory and identity management service.
The general release enables two key scenarios “Federated Azure AD customers can sign in using certificate-based authentication with Office applications on iOS and Android,” and “Azure AD customers can sign in using certificate-based authentication with Exchange ActiveSync mobile apps in iOS and Android when signing into Exchange Online,” Alex Simons says.
Message routing, a new feature in the Azure Internet of Things (IoT) Hub, allows customers to set up automatic routing to different systems via Azure messaging services and routing logic in IoT Hub itself.
“Azure IoT is committed to offering our customers high availability message ingestion that is secure and easy to use,” writes Nicole Berdy, Azure IoT senior program manager. “Message routing takes telemetry processing to the next step by offering customers a code-free way to dispatch messages based on message properties.”
Azure Blueprint is now available for the FedRAMP High Baseline, and is designed to facilitate the secure and compliant use of Azure Government, and streamlining the path to attain a Federal Risk and Authorization Management Program (FedRAMP) Authorizations to Operate (ATO).
With this release, Azure Blueprint now supports the FedRAMP Moderate and High Baselines and DoD L4, and includes documentation to assist Azure customers with documenting their security control implementations as part of their individual agency ATO processes.
“FedRAMP High Baseline Customer Responsibility Matrix (CRM) and System Security Plan (SSP) template are designed for use by Program Managers, Information System Security Officers (ISSO), and other security personnel.” And, it explicitly lists all control requirements including both controls “with a shared responsibility between Azure Government and Azure customers,” as well as “controls that are fully implemented by Azure customers.”
The FedRAMP High SSP template is customer-focused and designed for use in developing an SSP that includes both customer implementations as well as control inheritance from Azure Government. Customer responsibility sections include guidance on how to write a thorough and compliant control response. Azure inheritance sections include information about how the control is implemented by Azure Government on behalf of the customer.
The Change Feed support in Azure DocumentDB is also available now and provides a sorted list of documents within a DocumentDB collection in the order in which they were modified.
This feed can be used to listen for modifications to data within the collection and perform actions such as:
- Trigger a call to an API when a document is inserted or modified
- Perform real-time (stream) processing on updates
- Synchronize data with a cache, search engine, or data warehouse
- DocumentDB’s Change Feed is enabled by default for all accounts, and does not incur any additional costs on your account. You can use your provisioned throughput in your write region or any read region to read from the change feed, just like any other operation from DocumentDB.
Learn more about Change Feed support in Azure DocumentDB HERE.
Microsoft has begun offering private internet connections to the Azure installations in the U.K., and now allow customers to use Azure ExpressRoute and PSN/N3 Connectivity for their private internet connection needs using the UK Azure datacenters.
UK businesses and governments alike are taking advantage of the UK Azure datacenters scattered throughout the region, including the UK Ministry of Defence, the London Metropolitan Police and parts of the NHS.
Other new Azure services include:
- Azure Security Center, which helps customers prevent, detect and respond to threats, giving them full visibility and control over their secure network.
- Service Fabric lets developers focus on building features for their applications, without needing to design and write additional code to deal with reliability, scalability or latency.
- Azure Marketplace is an online store featuring thousands of certified and open source applications, developer service and data.
- Power BI and Power BI embedded allow developers to place fully interactive reports and visualisations in customer-facing apps without the time and expense of having to build custom controls from the ground up.
Microsoft also said that in 2017 it plans to release more Microsoft Azure services, including: “Azure Site Recovery, Azure Backup, Azure Automation, DocumentDB, Azure Devtest Labsm, and Dynamics 365.”
Take an interactive tour of a Microsoft Datacenter HERE.