diff --git a/CHANGELOG.md b/CHANGELOG.md index f343bc8c93..95d7d610d8 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,12 @@ +Release v1.41.4 (2021-10-15) +=== + +### Service Client Updates +* `service/elasticfilesystem`: Updates service documentation + * EFS adds documentation for a new exception for short identifiers to be thrown after its migration to long resource identifiers. +* `service/glue`: Updates service API and documentation + * Enable S3 event base crawler API. + Release v1.41.3 (2021-10-14) === diff --git a/aws/version.go b/aws/version.go index 988001c187..acf61117b0 100644 --- a/aws/version.go +++ b/aws/version.go @@ -5,4 +5,4 @@ package aws const SDKName = "aws-sdk-go" // SDKVersion is the version of this SDK -const SDKVersion = "1.41.3" +const SDKVersion = "1.41.4" diff --git a/models/apis/elasticfilesystem/2015-02-01/docs-2.json b/models/apis/elasticfilesystem/2015-02-01/docs-2.json index be905d96bd..9467a84824 100644 --- a/models/apis/elasticfilesystem/2015-02-01/docs-2.json +++ b/models/apis/elasticfilesystem/2015-02-01/docs-2.json @@ -22,10 +22,10 @@ "DescribeTags": "

DEPRECATED - The DeleteTags action is deprecated and not maintained. Please use the API action to remove tags from EFS resources.

Returns the tags associated with a file system. The order of tags returned in the response of one DescribeTags call and the order of tags returned across the responses of a multiple-call iteration (when using pagination) is unspecified.

This operation requires permissions for the elasticfilesystem:DescribeTags action.

", "ListTagsForResource": "

Lists all tags for a top-level EFS resource. You must provide the ID of the resource that you want to retrieve the tags for.

This operation requires permissions for the elasticfilesystem:DescribeAccessPoints action.

", "ModifyMountTargetSecurityGroups": "

Modifies the set of security groups in effect for a mount target.

When you create a mount target, Amazon EFS also creates a new network interface. For more information, see CreateMountTarget. This operation replaces the security groups in effect for the network interface associated with a mount target, with the SecurityGroups provided in the request. This operation requires that the network interface of the mount target has been created and the lifecycle state of the mount target is not deleted.

The operation requires permissions for the following actions:

", - "PutAccountPreferences": "

Use this operation to set the account preference in the current Amazon Web Services Region to use either long 17 character (63 bit) or short 8 character (32 bit) IDs for new EFS file systems and mount targets created. All existing resource IDs are not affected by any changes you make. You can set the ID preference during the opt-in period as EFS transitions to long resource IDs. For more information, see Managing Amazon EFS resource IDs.

", + "PutAccountPreferences": "

Use this operation to set the account preference in the current Amazon Web Services Region to use long 17 character (63 bit) or short 8 character (32 bit) resource IDs for new EFS file system and mount target resources. All existing resource IDs are not affected by any changes you make. You can set the ID preference during the opt-in period as EFS transitions to long resource IDs. For more information, see Managing Amazon EFS resource IDs.

Starting in October, 2021, you will receive an error if you try to set the account preference to use the short 8 character format resource ID. Contact Amazon Web Services support if you receive an error and need to use short IDs for file system and mount target resources.

", "PutBackupPolicy": "

Updates the file system's backup policy. Use this action to start or stop automatic backups of the file system.

", - "PutFileSystemPolicy": "

Applies an Amazon EFS FileSystemPolicy to an Amazon EFS file system. A file system policy is an IAM resource-based policy and can contain multiple policy statements. A file system always has exactly one file system policy, which can be the default policy or an explicit policy set or updated using this API operation. EFS file system policies have a 20,000 character limit. When an explicit policy is set, it overrides the default policy. For more information about the default file system policy, see Default EFS File System Policy.

EFS file system policies have a 20,000 character limit.

This operation requires permissions for the elasticfilesystem:PutFileSystemPolicy action.

", - "PutLifecycleConfiguration": "

Enables lifecycle management by creating a new LifecycleConfiguration object. A LifecycleConfiguration object defines when files in an Amazon EFS file system are automatically transitioned to the lower-cost EFS Infrequent Access (IA) storage class. To enable EFS Intelligent Tiering, set the value of TransitionToPrimaryStorageClass to AFTER_1_ACCESS. For more information, see EFS Lifecycle Management.

A LifecycleConfiguration applies to all files in a file system.

Each Amazon EFS file system supports one lifecycle configuration, which applies to all files in the file system. If a LifecycleConfiguration object already exists for the specified file system, a PutLifecycleConfiguration call modifies the existing configuration. A PutLifecycleConfiguration call with an empty LifecyclePolicies array in the request body deletes any existing LifecycleConfiguration and disables lifecycle management.

In the request, specify the following:

This operation requires permissions for the elasticfilesystem:PutLifecycleConfiguration operation.

To apply a LifecycleConfiguration object to an encrypted file system, you need the same Key Management Service permissions as when you created the encrypted file system.

", + "PutFileSystemPolicy": "

Applies an Amazon EFS FileSystemPolicy to an Amazon EFS file system. A file system policy is an IAM resource-based policy and can contain multiple policy statements. A file system always has exactly one file system policy, which can be the default policy or an explicit policy set or updated using this API operation. EFS file system policies have a 20,000 character limit. When an explicit policy is set, it overrides the default policy. For more information about the default file system policy, see Default EFS File System Policy.

EFS file system policies have a 20,000 character limit.

This operation requires permissions for the elasticfilesystem:PutFileSystemPolicy action.

", + "PutLifecycleConfiguration": "

Enables lifecycle management by creating a new LifecycleConfiguration object. A LifecycleConfiguration object defines when files in an Amazon EFS file system are automatically transitioned to the lower-cost EFS Infrequent Access (IA) storage class. To enable EFS Intelligent Tiering, set the value of TransitionToPrimaryStorageClass to AFTER_1_ACCESS. For more information, see EFS Lifecycle Management.

Each Amazon EFS file system supports one lifecycle configuration, which applies to all files in the file system. If a LifecycleConfiguration object already exists for the specified file system, a PutLifecycleConfiguration call modifies the existing configuration. A PutLifecycleConfiguration call with an empty LifecyclePolicies array in the request body deletes any existing LifecycleConfiguration and turns off lifecycle management for the file system.

In the request, specify the following:

This operation requires permissions for the elasticfilesystem:PutLifecycleConfiguration operation.

To apply a LifecycleConfiguration object to an encrypted file system, you need the same Key Management Service permissions as when you created the encrypted file system.

", "TagResource": "

Creates a tag for an EFS resource. You can create tags for EFS file systems and access points using this API operation.

This operation requires permissions for the elasticfilesystem:TagResource action.

", "UntagResource": "

Removes tags from an EFS resource. You can remove tags from EFS file systems and access points using this API operation.

This operation requires permissions for the elasticfilesystem:UntagResource action.

", "UpdateFileSystem": "

Updates the throughput mode or the amount of provisioned throughput of an existing file system.

" @@ -507,11 +507,11 @@ "base": null, "refs": { "LifecycleConfigurationDescription$LifecyclePolicies": "

An array of lifecycle management policies. EFS supports a maximum of one policy per file system.

", - "PutLifecycleConfigurationRequest$LifecyclePolicies": "

An array of LifecyclePolicy objects that define the file system's LifecycleConfiguration object. A LifecycleConfiguration object tells lifecycle management when to transition files from the Standard storage class to the Infrequent Access storage class.

" + "PutLifecycleConfigurationRequest$LifecyclePolicies": "

An array of LifecyclePolicy objects that define the file system's LifecycleConfiguration object. A LifecycleConfiguration object informs EFS lifecycle management and intelligent tiering of the following:

When using the put-lifecycle-configuration CLI command or the PutLifecycleConfiguration API action, Amazon EFS requires that each LifecyclePolicy object have only a single transition. This means that in a request body, LifecyclePolicies needs to be structured as an array of LifecyclePolicy objects, one object for each transition, TransitionToIA, TransitionToPrimaryStorageClass. See the example requests in the following section for more information.

" } }, "LifecyclePolicy": { - "base": "

Describes a policy used by EFS lifecycle management to transition files to the Infrequent Access (IA) storage class.

", + "base": "

Describes a policy used by EFS lifecycle management and EFS intelligent tiering that specifies when to transition files into and out of the file system's Infrequent Access (IA) storage class. For more information, see EFS Intelligentā€Tiering and EFS Lifecycle Management.

When using the put-lifecycle-configuration CLI command or the PutLifecycleConfiguration API action, Amazon EFS requires that each LifecyclePolicy object have only a single transition. This means that in a request body, LifecyclePolicies needs to be structured as an array of LifecyclePolicy objects, one object for each transition, TransitionToIA, TransitionToPrimaryStorageClass. For more information, see the request examples in PutLifecycleConfiguration.

", "refs": { "LifecyclePolicies$member": null } @@ -728,7 +728,7 @@ "ResourceIdType": { "base": "A preference indicating a choice to use 63bit/32bit IDs for all applicable resources.", "refs": { - "PutAccountPreferencesRequest$ResourceIdType": "

Specifies the EFS resource ID preference to set for the user's Amazon Web Services account, in the current Amazon Web Services Region, either LONG_ID (17 characters), or SHORT_ID (8 characters).

", + "PutAccountPreferencesRequest$ResourceIdType": "

Specifies the EFS resource ID preference to set for the user's Amazon Web Services account, in the current Amazon Web Services Region, either LONG_ID (17 characters), or SHORT_ID (8 characters).

Starting in October, 2021, you will receive an error when setting the account preference to SHORT_ID. Contact Amazon Web Services support if you receive an error and need to use short IDs for file system and mount target resources.

", "ResourceIdPreference$ResourceIdType": "

Identifies the EFS resource ID preference, either LONG_ID (17 characters) or SHORT_ID (8 characters).

" } }, @@ -877,13 +877,13 @@ "TransitionToIARules": { "base": null, "refs": { - "LifecyclePolicy$TransitionToIA": "

Describes the period of time that a file is not accessed, after which it transitions to the IA storage class. Metadata operations such as listing the contents of a directory don't count as file access events.

" + "LifecyclePolicy$TransitionToIA": "

Describes the period of time that a file is not accessed, after which it transitions to IA storage. Metadata operations such as listing the contents of a directory don't count as file access events.

" } }, "TransitionToPrimaryStorageClassRules": { "base": null, "refs": { - "LifecyclePolicy$TransitionToPrimaryStorageClass": "

Describes the policy used to transition a file from infequent access storage to primary storage.

" + "LifecyclePolicy$TransitionToPrimaryStorageClass": "

Describes when to transition a file from IA storage to primary storage. Metadata operations such as listing the contents of a directory don't count as file access events.

" } }, "Uid": { diff --git a/models/apis/glue/2017-03-31/api-2.json b/models/apis/glue/2017-03-31/api-2.json index 4a39176436..b1b04ad6a8 100644 --- a/models/apis/glue/2017-03-31/api-2.json +++ b/models/apis/glue/2017-03-31/api-2.json @@ -4809,6 +4809,7 @@ "BatchWindow":{"shape":"BatchWindow"} } }, + "EventQueueArn":{"type":"string"}, "ExecutionProperty":{ "type":"structure", "members":{ @@ -7040,7 +7041,8 @@ "type":"string", "enum":[ "CRAWL_EVERYTHING", - "CRAWL_NEW_FOLDERS_ONLY" + "CRAWL_NEW_FOLDERS_ONLY", + "CRAWL_EVENT_MODE" ] }, "RecrawlPolicy":{ @@ -7223,7 +7225,9 @@ "Path":{"shape":"Path"}, "Exclusions":{"shape":"PathList"}, "ConnectionName":{"shape":"ConnectionName"}, - "SampleSize":{"shape":"NullableInteger"} + "SampleSize":{"shape":"NullableInteger"}, + "EventQueueArn":{"shape":"EventQueueArn"}, + "DlqEventQueueArn":{"shape":"EventQueueArn"} } }, "S3TargetList":{ diff --git a/models/apis/glue/2017-03-31/docs-2.json b/models/apis/glue/2017-03-31/docs-2.json index 306fd1a41b..c2eef10b1c 100644 --- a/models/apis/glue/2017-03-31/docs-2.json +++ b/models/apis/glue/2017-03-31/docs-2.json @@ -1959,6 +1959,13 @@ "TriggerUpdate$EventBatchingCondition": "

Batch condition that must be met (specified number of events received or batch time window expired) before EventBridge event trigger fires.

" } }, + "EventQueueArn": { + "base": null, + "refs": { + "S3Target$EventQueueArn": "

A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

", + "S3Target$DlqEventQueueArn": "

A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

" + } + }, "ExecutionProperty": { "base": "

An execution property of a job.

", "refs": { @@ -4308,7 +4315,7 @@ "RecrawlBehavior": { "base": null, "refs": { - "RecrawlPolicy$RecrawlBehavior": "

Specifies whether to crawl the entire dataset again or to crawl only folders that were added since the last crawler run.

A value of CRAWL_EVERYTHING specifies crawling the entire dataset again.

A value of CRAWL_NEW_FOLDERS_ONLY specifies crawling only folders that were added since the last crawler run.

" + "RecrawlPolicy$RecrawlBehavior": "

Specifies whether to crawl the entire dataset again or to crawl only folders that were added since the last crawler run.

A value of CRAWL_EVERYTHING specifies crawling the entire dataset again.

A value of CRAWL_NEW_FOLDERS_ONLY specifies crawling only folders that were added since the last crawler run.

A value of CRAWL_EVENT_MODE specifies crawling only the changes identified by Amazon S3 events.

" } }, "RecrawlPolicy": { diff --git a/service/efs/api.go b/service/efs/api.go index d7d42e1818..2669952dfe 100644 --- a/service/efs/api.go +++ b/service/efs/api.go @@ -2498,11 +2498,16 @@ func (c *EFS) PutAccountPreferencesRequest(input *PutAccountPreferencesInput) (r // PutAccountPreferences API operation for Amazon Elastic File System. // // Use this operation to set the account preference in the current Amazon Web -// Services Region to use either long 17 character (63 bit) or short 8 character -// (32 bit) IDs for new EFS file systems and mount targets created. All existing -// resource IDs are not affected by any changes you make. You can set the ID -// preference during the opt-in period as EFS transitions to long resource IDs. -// For more information, see Managing Amazon EFS resource IDs (efs/latest/ug/manage-efs-resource-ids.html). +// Services Region to use long 17 character (63 bit) or short 8 character (32 +// bit) resource IDs for new EFS file system and mount target resources. All +// existing resource IDs are not affected by any changes you make. You can set +// the ID preference during the opt-in period as EFS transitions to long resource +// IDs. For more information, see Managing Amazon EFS resource IDs (https://docs.aws.amazon.com/efs/latest/ug/manage-efs-resource-ids.html). +// +// Starting in October, 2021, you will receive an error if you try to set the +// account preference to use the short 8 character format resource ID. Contact +// Amazon Web Services support if you receive an error and need to use short +// IDs for file system and mount target resources. // // Returns awserr.Error for service API and SDK errors. Use runtime type assertions // with awserr.Error's Code and Message methods to get detailed information about @@ -2789,14 +2794,12 @@ func (c *EFS) PutLifecycleConfigurationRequest(input *PutLifecycleConfigurationI // (IA) storage class. To enable EFS Intelligent Tiering, set the value of TransitionToPrimaryStorageClass // to AFTER_1_ACCESS. For more information, see EFS Lifecycle Management (https://docs.aws.amazon.com/efs/latest/ug/lifecycle-management-efs.html). // -// A LifecycleConfiguration applies to all files in a file system. -// // Each Amazon EFS file system supports one lifecycle configuration, which applies // to all files in the file system. If a LifecycleConfiguration object already // exists for the specified file system, a PutLifecycleConfiguration call modifies // the existing configuration. A PutLifecycleConfiguration call with an empty // LifecyclePolicies array in the request body deletes any existing LifecycleConfiguration -// and disables lifecycle management. +// and turns off lifecycle management for the file system. // // In the request, specify the following: // @@ -2804,8 +2807,10 @@ func (c *EFS) PutLifecycleConfigurationRequest(input *PutLifecycleConfigurationI // modifying lifecycle management. // // * A LifecyclePolicies array of LifecyclePolicy objects that define when -// files are moved to the IA storage class. The array can contain only one -// LifecyclePolicy item. +// files are moved to the IA storage class. Amazon EFS requires that each +// LifecyclePolicy object have only have a single transition, so the LifecyclePolicies +// array needs to be structured with separate LifecyclePolicy objects. See +// the example requests in the following section for more information. // // This operation requires permissions for the elasticfilesystem:PutLifecycleConfiguration // operation. @@ -6766,18 +6771,28 @@ func (s *IpAddressInUse) RequestID() string { return s.RespMetadata.RequestID } -// Describes a policy used by EFS lifecycle management to transition files to -// the Infrequent Access (IA) storage class. +// Describes a policy used by EFS lifecycle management and EFS intelligent tiering +// that specifies when to transition files into and out of the file system's +// Infrequent Access (IA) storage class. For more information, see EFS Intelligentā€Tiering +// and EFS Lifecycle Management (https://docs.aws.amazon.com/efs/latest/ug/lifecycle-management-efs.html). +// +// When using the put-lifecycle-configuration CLI command or the PutLifecycleConfiguration +// API action, Amazon EFS requires that each LifecyclePolicy object have only +// a single transition. This means that in a request body, LifecyclePolicies +// needs to be structured as an array of LifecyclePolicy objects, one object +// for each transition, TransitionToIA, TransitionToPrimaryStorageClass. For +// more information, see the request examples in PutLifecycleConfiguration. type LifecyclePolicy struct { _ struct{} `type:"structure"` // Describes the period of time that a file is not accessed, after which it - // transitions to the IA storage class. Metadata operations such as listing - // the contents of a directory don't count as file access events. + // transitions to IA storage. Metadata operations such as listing the contents + // of a directory don't count as file access events. TransitionToIA *string `type:"string" enum:"TransitionToIARules"` - // Describes the policy used to transition a file from infequent access storage - // to primary storage. + // Describes when to transition a file from IA storage to primary storage. Metadata + // operations such as listing the contents of a directory don't count as file + // access events. TransitionToPrimaryStorageClass *string `type:"string" enum:"TransitionToPrimaryStorageClassRules"` } @@ -7560,6 +7575,10 @@ type PutAccountPreferencesInput struct { // Services account, in the current Amazon Web Services Region, either LONG_ID // (17 characters), or SHORT_ID (8 characters). // + // Starting in October, 2021, you will receive an error when setting the account + // preference to SHORT_ID. Contact Amazon Web Services support if you receive + // an error and need to use short IDs for file system and mount target resources. + // // ResourceIdType is a required field ResourceIdType *string `type:"string" required:"true" enum:"ResourceIdType"` } @@ -7868,9 +7887,20 @@ type PutLifecycleConfigurationInput struct { FileSystemId *string `location:"uri" locationName:"FileSystemId" type:"string" required:"true"` // An array of LifecyclePolicy objects that define the file system's LifecycleConfiguration - // object. A LifecycleConfiguration object tells lifecycle management when to - // transition files from the Standard storage class to the Infrequent Access - // storage class. + // object. A LifecycleConfiguration object informs EFS lifecycle management + // and intelligent tiering of the following: + // + // * When to move files in the file system from primary storage to the IA + // storage class. + // + // * When to move files that are in IA storage to primary storage. + // + // When using the put-lifecycle-configuration CLI command or the PutLifecycleConfiguration + // API action, Amazon EFS requires that each LifecyclePolicy object have only + // a single transition. This means that in a request body, LifecyclePolicies + // needs to be structured as an array of LifecyclePolicy objects, one object + // for each transition, TransitionToIA, TransitionToPrimaryStorageClass. See + // the example requests in the following section for more information. // // LifecyclePolicies is a required field LifecyclePolicies []*LifecyclePolicy `type:"list" required:"true"` diff --git a/service/glue/api.go b/service/glue/api.go index 12afbd903c..9d059b2682 100644 --- a/service/glue/api.go +++ b/service/glue/api.go @@ -41924,6 +41924,9 @@ type RecrawlPolicy struct { // // A value of CRAWL_NEW_FOLDERS_ONLY specifies crawling only folders that were // added since the last crawler run. + // + // A value of CRAWL_EVENT_MODE specifies crawling only the changes identified + // by Amazon S3 events. RecrawlBehavior *string `type:"string" enum:"RecrawlBehavior"` } @@ -42775,6 +42778,12 @@ type S3Target struct { // Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC). ConnectionName *string `type:"string"` + // A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue. + DlqEventQueueArn *string `type:"string"` + + // A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs. + EventQueueArn *string `type:"string"` + // A list of glob patterns used to exclude from the crawl. For more information, // see Catalog Tables with a Crawler (https://docs.aws.amazon.com/glue/latest/dg/add-crawler.html). Exclusions []*string `type:"list"` @@ -42812,6 +42821,18 @@ func (s *S3Target) SetConnectionName(v string) *S3Target { return s } +// SetDlqEventQueueArn sets the DlqEventQueueArn field's value. +func (s *S3Target) SetDlqEventQueueArn(v string) *S3Target { + s.DlqEventQueueArn = &v + return s +} + +// SetEventQueueArn sets the EventQueueArn field's value. +func (s *S3Target) SetEventQueueArn(v string) *S3Target { + s.EventQueueArn = &v + return s +} + // SetExclusions sets the Exclusions field's value. func (s *S3Target) SetExclusions(v []*string) *S3Target { s.Exclusions = v @@ -51534,6 +51555,9 @@ const ( // RecrawlBehaviorCrawlNewFoldersOnly is a RecrawlBehavior enum value RecrawlBehaviorCrawlNewFoldersOnly = "CRAWL_NEW_FOLDERS_ONLY" + + // RecrawlBehaviorCrawlEventMode is a RecrawlBehavior enum value + RecrawlBehaviorCrawlEventMode = "CRAWL_EVENT_MODE" ) // RecrawlBehavior_Values returns all elements of the RecrawlBehavior enum @@ -51541,6 +51565,7 @@ func RecrawlBehavior_Values() []string { return []string{ RecrawlBehaviorCrawlEverything, RecrawlBehaviorCrawlNewFoldersOnly, + RecrawlBehaviorCrawlEventMode, } }