For reliability, accuracy and performance, both AI and machine learning heavily rely on large sets. Because the larger the pool of data, the better you can train the models. That’s why it’s critical for big data platforms to efficiently work with different data streams and systems, regardless of the structure of the data (or lack thereof), data velocity or volume.
However, that’s easier said than done.
Today every big data platform faces these systemic challenges:
Compute / Storage Overlap: Traditionally, compute and storage were never delineated. As data volumes grew, you had to invest in compute as well as storage.
Non-Uniform Access of Data: Over the years, too much dependency on business operations and applications have led companies to acquire, ingest and store data in different physical systems like file systems, databases and data warehouses (e.g. SQL Server or Oracle), big data systems (e.g….
The Associated Press delivers 2017 Virginia gubernatorial primary results with Microsoft Power BI publish to web.
For more than 170 years, The Associated Press (AP) has told the world’s biggest and most important stories, from the assassination of Abraham Lincoln to the fall of the Berlin Wall, and more recently Brexit and the 2016 U.S. presidential election.
Today, when news is frequently accompanied by massive quantities of data, reporting means making sense of all that data, and AP continues to lead the way in data journalism. The news agency, with locations in more than 100 countries, provides newsrooms worldwide with data-driven reporting on everything from politics, business, environmental science and public safety to sports, education and more. Recent AP data journalism efforts uncovered water quality issues in public and private water systems, analyzed the history of refugees from the seven countries included…
Efficient data management keeps goods flowing smoothly in Denmark. Danske Fragtmaend, the country’s largest national transport and distribution firm, has been moving freight for more than a century. Today, Danske Fragtmaend delivers more than 40,000 consignments each day throughout Denmark, and businesses from small mom-and-pop operations to factories rely on its services.
The firm handles logistics in a central location, where 200 dispatchers keep an eye on the movement of thousands of trucks and their cargo. Both drivers and dispatchers need the latest information to operate efficiently, so they rely on a data platform based on SQL Server 2016. The storage system includes 160 terabytes of flash memory for fast I/O and high uptimes. Throughout the day, drivers continually scan transactions with PDAs and send shipping information including GPS coordinates to the data platform. Fast access to information is essential. Ulf…
Power BI was first made generally available in July 2015. Since then, Microsoft’s driving vision for Power BI has been to enable users across roles, disciplines and industries to sign up for the service in seconds and get business value by drawing insights from their data within minutes. Microsoft’s relentless focus to drive access to insights at scale has helped Power BI reach more than 200,000 organizations, and the breadth of this global community continues to directly contribute to Power BI’s evolution – to date more than 400 features have been added to the service as the result of input from more than 50,000 users.
Introducing Power BI Premium
Today Microsoft is taking the next step in its commitment to empower people and organizations with access to critical intelligence: introducing Power BI Premium. Power BI Premium builds on the existing Power BI…
1: Build data-driven apps that learn and adapt
Applications show intelligence when they can spot trends, react to events, predict outcomes or recommend choices—often leading to richer customer experiences, improved business process, or addressing issues before they arise. The three key ingredients to creating an intelligent app are:
Ingest data in real time
Query across historical and real-time data
Analyze patterns and make predictions with machine learning
With Azure, you can make your applications intelligent by establishing feedback loops, and applying big data and machine learning techniques to classify, predict, or otherwise analyze explicit and implicit signals. Today, apps for consumers and enterprises can deliver greater customer or business benefit by learning from user behavior and other signals.
Pier 1 Imports launched a mobile-friendly pier1.com, making shopping online easier. It enabled the selection of delivery options like direct shipment, picking up products in the local store,…
Upgrading your software can be daunting, Microsoft knows. The fast pace of business makes it easy to tell yourself, “I’ll do it later when I have time.” Microsoft gets it! But here are five key reasons to make time to upgrade to SQL Server 2016, which was named DBMS of the Year in 2016 by DBengines.com.
Seamless step-up without rewriting apps. Thanks to November’s SQL Server 2016 Service Pack 1 (SP1), SQL Server now has one programming surface across all editions. If you switch from Express to Standard, or Standard to Enterprise, you don’t have to rework code to take advantage of additional features. Time saved! In addition, the change brings access to innovative features across performance, security, and analytics not previously available in Express or Standard—a great reason to upgrade applications that run on those editions. The Enterprise edition of…
Recently I was tasked with the task of creating an automatic extraction and importing solution using PowerShell Scripts. To do this I created two files one for export and extracting with the other in charge of pack and importing the solution. I was using the Visual Studio template of CRM Package that comes with the sdk.
Export and Extracting The Solution
First thing I did was implement the export and extraction of the CRM solution. The PowerShell script first exports the solution from the web using a module called Microsoft.Xrm.Data.PowerShell. Then it extracts the downloaded zip into a folder for the correct file structure. A nice thing about using the Microsoft.Xrm.Data.PowerShell dll is the fact it gives you additional CRM commands you can do. For example before downloading the solution it allows you to change the version number of the solution before downloading.
Quick measures, a new feature Microsoft released in their April Power BI Desktop update, lets you quickly create new measures based on measures and numerical columns in your table. These new measures become part of your model and can be used in any of your charts, just like manually created DAX calculations. You can also see the underlying DAX, and edit it if you need to tweak the results.
You can create measures based on 19 different calculations across five different categories. Let’s take a look at those five different categories.
Aggregate within category
These calculations let you apply different aggregates at different levels in your data. For example, you can sum revenue up to the month level, and then take an average of that total to display at the year level.
The result would look something like this:
The calculations included in the Aggregate…
Introduction – Part 2
Part 1 of this post focused on the first category of how the Analysis Services Multidimensional (MD) duplicate attribute key error can arise. It reflects the perspective of an atomic attribute – an attribute having no attribute relationships other than with the dimension key attribute.
This post focuses on the second category of this error, which can arise when an attribute does have attribute relationships besides the (required) one with the dimension key attribute.
As is well known, creating attribute relationships is a best practice in Analysis Services MD for improving query performance. The most common reason attribute relationships are created is to support a natural hierarchy – so your data model has to have one for this to arise. The next most common reason is to support attribute properties, such as a sort order – i.e. when the…
Managing the editable properties of your custom objects in SQL Server Integration Services (SSIS) is a great way to improve their usability, but how can you? By properties, I mean the common fields exposed on the Properties tool window in Visual Studio, any time you’re working with a visual designer, and which you’ve probably used any time you wanted to make a precise change, or a quick change.
In SSIS, you can create your own class to handle all of the following types:
Data Flow / Pipeline Components
Control Flow Tasks
For Each Enumerators (for the for each loop task)
For the most part, these custom classes can be directly modified when editing SSIS packages in Visual Studio, and so anything properties you expose on the class can be edited right from Visual Studio without opening up any new UIs. For simple objects especially, these can…