Azure Storage - Upload entities

Declaration

<AMAZURESTORAGE ACTIVITY="upload_entities" TABLE="text" FILE="text" 
USECOLUMNHEADER="yes/no" PROTOCOL="text (options)" 
ACCOUNTNAME="text" ACCESSKEY="text (encrypted)" 
BLOBENDPOINT="text" QUEUEENDPOINT="text" TABLEENDPOINT="text" 
TIMOUT="number" />

Description: Uploads a .CSV (Comma-Separated Values) file to the specified table storage.

Practical Usage

Commonly used to migrate existing on-premises databases to the cloud.

Connection Parameters

Property

Type

Required

Default

Markup

Description

Connection

 

 

 

 

Indicates where user credentials and preferences should originate from. This is a design mode parameter used only during task construction and configuration, thus, comprises no markup. The available options are:

  • Host (default) - Specifies that user credentials and/or advanced preferences are configured individually for this activity. This option is normally chosen if only a single activity is required to complete an operation.

  • Session - Specifies that user credentials and/or advanced preferences are obtained from a pre-configured session created in a prior step with the use of the Azure Storage - Create session activity. This option is normally chosen if a combination of related activities are required to complete an operation. Linking several activities to a single session eliminates redundancy. Additionally, a single task supports construction and simultaneous execution of multiple sessions, improving efficiency.

Session

Text

Yes if connection is session-based

AzureStorageSession1

SESSION="MyAzureSession"

The name of an existing session to associate this activity with. This parameter is active only if the Connection parameter is set to Session. The default session name is 'AzureStorageSession1'.

Account name

Text

Yes if connection is host-based

(Empty)

ACCOUNTNAME="myaccount"

The globally unique name of the Windows Azure storage account. This parameter is active only if the Connection parameter is set to Host.

Access key

Text

Yes if connection is host-based

(Empty)

ACCESSKEY="[AccessKey]"

The primary or secondary access key (each composed of 88 ASCII characters) used to authorize access to Azure Storage. This parameter is active only if the Connection parameter is set to Host.

Protocol

Text (options)

No

HTTPS

  1. PROTOCOL="HTTPS"

  2. PROTOCOL="HTTP"

The type of protocol used to access Azure Storage. The available options are:

  • HTTPS (default) - Hypertext Transfer Protocol Secure

  • HTTP - Hypertext Transfer Protocol

Timeout (seconds)

Number

No

90

TIMEOUT="180"

The timeout interval (in seconds) for requests made to the storage service. If the timeout elapses before a server response is returned, the operation times out and the service returns an error. The default timeout value is 90 seconds.

Blob endpoint URI

Text

No

(Empty)

BLOBENDPOINT="http://accnt

.blob.core.windows.net"

The endpoint for the Blob service, as configured for the Azure Storage account. The default Blob service endpoint is'[http/https]://accountname.blob.core.windows.net',where 'accountname' is the name of the Azure Storage account.

Queue endpoint URI

Text

No

(Empty)

QUEUEENDPOINT="http://accnt

.queue.core.windows.net"

The endpoint for the Queue service, as configured for the Azure storage account. The default Queue service endpoint is '[http/https]://accountname.queue.core.windows.net', where 'accountname'is the name of the Azure Storage account.

Table endpoint URI

Text

No

(Empty)

TABLEENDPOINT="http://accnt

.table.core.windows.net"

The endpoint for the Table service, as configured for the Azure storage account. The default Table service endpoint is 'Property

Table name

Text

Yes

 (Empty)

TABLE="mytable"

The unique name of the table storage in which to upload data to.

File

Text

Yes

 (Empty) FILE="c:\temp\fileName.csv"

The path and file name of the .csv file to upload.

Use first row as column(s)

Yes/No

 No

Yes

SOURCE="C:\PDFFileName.pdf"

If set to YES (default), the first row of the .csv file will be converted to columns in the Azure table storage.  

Description tab - A custom description can be provided on the Description tab to convey additional information or share special notes about a task step.

Error Causes tab - Specify how this step should behave upon the occurrence of an error. (Refer to Task Builder > Error Causes Tab for details.)

On Error tab - Specify what AWE should do if this step encounters an error as defined on the Error Causes tab. (Refer to Task Builder > On Error Tab for details.)

Example

The sample AML code below can be copied and pasted directly into the Steps panel of the Task Builder.

Description: A simple Azure Storage session that creates a new table and inserts entities into a specific partition/row of the table. It also uploads entities retrieved from a .csv file onto a new table.

<!-- Create session -->
<AMAZURESTORAGE ACTIVITY="create_session" 
ACCOUNTNAME="netauto" ACCESSKEY="AM3iiVi4GlX+AHmMoxmR8X662rSFHWxHn0abTRBWBxM2ZIJQ2QFrQapQE6+qUP/Islta6nfcdHj0SfNj+fWwskg8Q==aME" 
PROTOCOL="http" SESSION="AzureStorageSession1" />
<!-- Create table -->
<AMAZURESTORAGE ACTIVITY="create_table" SESSION="AzureStorageSession1" TABLE="customerBase" />
<!-- Insert entity -->
<AMAZURESTORAGE ACTIVITY="insert_entity" 
SESSION="AzureStorageSession1" TABLE="customerBase" 
PARTITIONKEY="2" ROWKEY="3"><PROPERTY 
NAME="Name" TYPE="string" VALUE="David" />
</AMAZURESTORAGE>
<!-- Upload entity -->
<AMAZURESTORAGE ACTIVITY="upload_entities" SESSION="AzureStorageSession1" TABLE="SupportBase" FILE="C:\Temp\Support.csv" />
<!-- End Session -->
<AMAZURESTORAGE ACTIVITY="end_session" />