Spectra Logic

1-800-833-1132 : 1-303-449-6400

Replicate Put Job

Description

Replicates a job from another BlackPearl gateway to this BlackPearl gateway, ensuring that the objects are recognized as identical across the gateways on which replication is performed. Clients must provide the response payload returned by Get Put Job to Replicate on the source BlackPearl gateway as the request payload for the Replicate Put Job on the target gateway.

Requests

Syntax

GET http[s]://{datapathDNSname}/_rest_/bucket/{UUID, name, or other unique attribute for the bucket}/?operation=START_BULK_PUT
&replicate[&conflict_resolution_mode=ACCEPT_EXISTING| ACCEPT_IMPORT|ACCEPT_HIGHEST_VERSION|ACCEPT_MOST_RECENT|CANCEL][&priority=URGENT|HIGH| NORMAL|LOW]

To determine the UUID for a bucket, see Get Buckets - Spectra S3.

Request Parameters

Parameter	Description	Required
operation	The operation to perform. For this request, the operation is to start a bulk put job. Value: START_BULK_PUT	yes
replicate	Included to indicate a replicate operation.	yes
conflict_resolution_mode	How the data path backend handles object name conflicts. Values: § ACCEPT_EXISTING — Keep the file currently in the BlackPearl database. § ACCEPT_IMPORT — Keep the file currently being imported. § ACCEPT_HIGHEST_VERSION — Keep the file with the highest version number. § ACCEPT_MOST_RECENT — Keep the file with the most recent creation date. § CANCEL (default) — Cancel the import process.	no
Priority	The priority for processing this job. The job priority determines the resources assigned and the processing order. Jobs with Priority URGENT can use up all of the resources and prevent other jobs from making progress. Use this priority sparingly. Values: URGENT, HIGH, NORMAL, LOW Default: Configured in the data policy for the bucket.	no

Request Elements

An XML payload, the response from Get Put Job to Replicate run on the source BlackPearl gateway, must be sent as the request payload.

Responses

Response Elements

<MasterObjectList
   Aggregating="TRUE|FALSE"
   BucketName="{string}"
   CachedSizeInBytes="{64-bit integer}"    ChunkClientProcessingOrderGuarantee="IN_ORDER|NONE"    CompletedSizeInBytes="{64-bit integer}"
   JobId="{string}"
   Naked="TRUE|FALSE"
   Name="{string}"
   OriginalSizeInBytes="{64-bit integer}"
   Priority="CRITICAL|URGENT|HIGH|NORMAL|LOW|BACKGROUND"
   RequestType="PUT"
   StartDate="YYYY-MM-DDThh:mm:ss.xxxZ"
   Status="IN_PROGRESS|COMPLETED|CANCELED"
   UserId="{string}"
   UserName="{string}">
   <Nodes>
      <Node EndPoint="{string}" Id="{string}"/>
   </Nodes>
   <Objects
      ChunkId="{string}"
      ChunkNumber="{32-bit integer}">
      <Object InCache="TRUE|FALSE" Latest="TRUE|FALSE"
         Length="{64-bit integer}" Name="{string}"
         Offset="{64-bit integer}" Version="{64-bit integer}"/>
      ...
   </Objects>
   ...
</MasterObjectList>

where the response elements are defined as follows:

Parameter	Description
MasterObjectList	The container for the response.
Aggregating	Whether the job can have additional work appended to it. Jobs can aggregate if they are created with the aggregating request parameter set to TRUE (Naked=FALSE) or if they are created by the BlackPearl gateway in response to Amazon S3 PUT and GET requests (Naked=TRUE). Values: TRUE, FALSE
BucketName	The name of the bucket that is acted on by the job request.
CachedSizeInBytes	The amount of data that has been transferred to the cache for this job. For RequestType=PUT, this is the amount of data successfully transferred to the BlackPearl Deep Storage Gateway from the client.
ChunkClient ProcessingOrder Guarantee	Specifies whether the job chunks will be processed in order. Values: IN_ORDER, NONE
CompletedSizeIn Bytes	The amount of data that is completely processed for this job. For RequestType=PUT, this indicates the amount of data written to all permanent data stores.
JobId	The UUID for the job.
Naked	Whether the job was created as the result of a native S3 command (TRUE) or a Create Get/Put/Verify Job command (FALSE). Values: TRUE, FALSE
Name	The name assigned to the job for tracking.
OriginalSizeInBytes	The full size of the job.
Priority	The priority for processing this job. The job priority determines the resources assigned and the processing order. Values: CRITICAL, URGENT, HIGH, NORMAL, LOW, BACKGROUND
RequestType	Type of job request. Values: PUT
StartDate	The date and time the job was started in the format YYYY-MM-DDThh:mm:ss.xxxZ.
Status	The current status of the job. Values: § IN_PROGRESS — The job is currently running. § COMPLETED — The job completed. § CANCELED — The job was canceled by the user or automatically due to internal timeouts.
UserId	The UUID for the user who initiated the job.
UserName	The username of the user who initiated the job.
Nodes	A container for information about all BlackPearl nodes.
Node	A container for information about a single BlackPearl node.
EndPoint	The IP address or DNS name of the BlackPearl node.
Id	The UUID for the node.
Objects	Container for information about the objects in one chunk.
ChunkId	The UUID for the job chunk.
ChunkNumber	The position of the chunk within the job.
Object	The container for information about a single object.
InCache	Indicates if the object is currently in cache on the BlackPearl Deep Storage Gateway. Values: TRUE, FALSE
Latest	Whether this version of the object is the latest. Values: TRUE, FALSE
Length	The length in bytes of the object.
Name	The name of the object.
Offset	The offset in bytes from the start of the object.
Version	The version number of the object.

Example

Sample Request

This request sent with the response from the example for Get Put Job to Replicate on page 129, creates a bulk PUT job to replicate the bulk PUT on the source gateway.

PUT http://blackpearl-hostname/_rest_/bucket/bucket1/?operation=start_bulk_put&replicate HTTP/1.1

Sample Response

HTTP/1.1 200 OK
<MasterObjectList
   Aggregating="FALSE"
   BucketName="existing_bucket"
   CachedSizeInBytes="0"
   ChunkClientProcessingOrderGuarantee="IN_ORDER"
   CompletedSizeInBytes="0"
   JobId="cce39f77-7570-48e1-92de-235a5b282c1d"
   Naked="FALSE"
   Name="Untitled"
   OriginalSizeInBytes="10"
   Priority="NORMAL"
   RequestType="PUT"
   StartDate="2016-01-21T18:54:21.000Z"
   Status="IN_PROGRESS"
   UserId="d0bf86e8-7bba-4507-a0f0-2698fb8fccfa"
   UserName="test_user">
   <Nodes>
      <Node EndPoint="blackpearl-hostname"
      Id="a651430c-22aa-468b-8b4b-42b50627faf3"/>
   </Nodes>
   <Objects
      ChunkId="4294b5c2-b4ae-46db-8aca-858805a7a116"
      ChunkNumber="1">
      <Object InCache="FALSE" Latest="TRUE"
         Length="10" Name="o1" Offset="0" Version="1"/>
   </Objects>
</MasterObjectList>