Tallan's Technology Blog

Tallan's Top Technologists Share Their Thoughts on Today's Technology Challenges

Using AzCopy as a Workaround for Microsoft Azure File Storage Connector

Many times when working with Microsoft Azure, it is necessary to read and write information to Microsoft Azure File Storage. Unfortunately, at this time Dell Boomi currently only supports a Microsoft Blob Storage Connector; one possible solution to this problem is to use Microsoft’s AzCopy utility to read and write information to Microsoft Azure File Storage.

AzCopy is a command-line Utility designed for copy data to and from Microsoft Azure Blob, File, and Table storage; but our purposes we will be using it to write data to Microsoft Azure File Storage.

AzCopy can be downloaded from this link (http://aka.ms/downloadazcopy). To install, simply follow the installation instructions.

One possible use of AzCopy is to upload newly created data files to Microsoft Azure File Storage.  By doing so we can call AzCopy to upload the data files after we have finished creating them all rather than uploading each file individually. This process saves both time and resources. One way to accomplish this task is to create a batch script to run this process for you. An example of such a script can be found below.

 

@echo off
cd C:\Program Files (x86)\Microsoft SDKs\Azure\AzCopy
AzCopy /Source:C:\myFolder /Dest:https://myazureaccount.windows.net/myfileshare1 /DestKey:mydestKey /S /Y

 

Let’s look at each component of the AzCopy command in detail:

  • /Source: – Specifies the source of the file. This source can be regular file storage or any of the Microsoft Azure Storage options. In this case, we are specifying a folder on our C drive.
  • /Dest: – Specifies the destination of the command. If the destination is one of the Microsoft Azure Storage options, you will need to specify a destination key in order to access the storage.
  • /DestKey – Specifies the storage account key for the destination key
  • /S – Sets the mode to recursive which will cause AzCopy to copy all blob or files.
  • /Y – Suppresses all AzCopy confirmation prompts

 

Integrating AzCopy into a Boomi Workflow.

While the previously mentioned batch file will work, it would help to parameterize the file to help with the integration into Boomi. By doing so we can pass in the parameters to the script depending on the location that we wish to send the files instead of having multiple copies of the file. An example of a modified script file that accepts parameters can be found below.

@echo off
cd C:\Program Files (x86)\Microsoft SDKs\Azure\AzCopy
AzCopy /Source:%1 /Dest:%2 /DestKey:%3 /S /Y

 

This revised script has the Source, Destination, and Destination Key passed in as parameters to the batch file.  We can pass in the parameters using a Boomi System Command Shape.

Here is an example of what a sample workflow would look like.

1

 

 

When we drill into the command shape, the following is an example of what the command shape could look like.

 

2

 

Dell Boomi AtomSphere

 

The Dell Boomi AtomSphere integration platform is a shared-everything, multi-tenant platform that supports cloud-to-cloud, SaaS-to-SaaS, cloud-to-on-premises, on-premises-to-on-premises and B2B integration. Boomi AtomSphere supports real-time integration and elastically scales to meet high-volume needs in mobile, batch (ETL) and EDI environments. Easily accessed via a browser, it delivers an impressive range of integration, master data management (MDM) and platform extension capabilities.

 

Tallan Integration Solutions for Dell Boomi

Tallan is a certified Dell Boomi Partner specializing in iPaaS platform integrations. We specialize in Integrations using EDI and Dell Boomi as the iPaaS platform of choice. Leverage Tallan’s vast integration experience for your AtomSphere platform needs.  Our certified architects and developers provide the expertise, best practices, and guidance to deliver a successful integration solution.

 

We hope this guide will help you in your use of AtomSphere. If you have any questions or comments, or need assistance with any Integrations or development questions, please contact us at integrations@tallan.com.

No comments

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>

\\\