我可以强制CloudFormation删除非空的S3 Bucket吗？

Question

有没有办法强制CloudFormation删除非空的S3 Bucket？

Answer 1

您可以创建一个lambda函数来清理您的存储桶,并使用CustomResource从您的CloudFormation堆栈调用您的lambda .

在lambda示例下面清理你的桶:

#!/usr/bin/env python
# -*- coding: utf-8 -*-

import json
import boto3
from botocore.vendored import requests


def lambda_handler(event, context):
    try:
        bucket = event['ResourceProperties']['BucketName']

        if event['RequestType'] == 'Delete':
            s3 = boto3.resource('s3')
            bucket = s3.Bucket(bucket)
            for obj in bucket.objects.filter():
                s3.Object(bucket.name, obj.key).delete()

        sendResponseCfn(event, context, "SUCCESS")
    except Exception as e:
        print(e)
        sendResponseCfn(event, context, "FAILED")


def sendResponseCfn(event, context, responseStatus):
    response_body = {'Status': responseStatus,
                     'Reason': 'Log stream name: ' + context.log_stream_name,
                     'PhysicalResourceId': context.log_stream_name,
                     'StackId': event['StackId'],
                     'RequestId': event['RequestId'],
                     'LogicalResourceId': event['LogicalResourceId'],
                     'Data': json.loads("{}")}

    requests.put(event['ResponseURL'], data=json.dumps(response_body))

在上面创建lambda之后,只需将CustomResource放在CloudFormation堆栈中:

 ---
 AWSTemplateFormatVersion: '2010-09-09'

 Resources:

   myBucketResource:
     Type: AWS::S3::Bucket
     Properties:
       BucketName: my-test-bucket-cleaning-on-delete

   cleanupBucketOnDelete:
     Type: Custom::cleanupbucket
     Properties:
       ServiceToken: arn:aws:lambda:eu-west-1:123456789012:function:clean-bucket-lambda
       BucketName: !Ref myBucketResource

请记住将角色附加到您的lambda,该角色有权从您的存储桶中删除对象.

此外,请记住,您可以使用lambda函数cli2cloudformation创建一个接受CLI命令行的lambda函数.您可以从这里下载并安装.使用它你只需要像下面这样创建一个CustomResource:

"removeBucket": {
        "Type": "Custom::cli2cloudformation",
        "Properties": {
          "ServiceToken": "arn:aws:lambda:eu-west-1:123456789000:function:custom-lambda-name",
          "CliCommandDelete": "aws s3 rb s3://bucket-name --force",
        }
}

Answer 2

您应该清空存储桶：

$ aws s3 rm s3://bucket-name --recursive

然后删除Bucket

$ aws cloudformation delete-stack --stack-name mys3stack

Answer 3

我认为你的 DependsOn 是错误的资源，至少它对我不起作用，因为在堆栈删除（通过控制台）时，它会尝试首先强制删除存储桶，这将失败，然后将尝试删除自定义资源，这会触发lambda 清空桶。这将清空存储桶，但堆栈删除将失败，因为它在存储桶为空之前尝试删除它。我们想先启动自定义资源删除，然后在自定义资源删除后尝试删除bucket，所以我是这样做的，它对我有用：

myBucketResource:
  Type: AWS::S3::Bucket
  Properties:
    BucketName: my-test-bucket-cleaning-on-delete

cleanupBucketOnDelete:
  Type: Custom::cleanupbucket
  Properties:
    ServiceToken: arn:aws:lambda:eu-west-1:123456789012:function:clean-bucket-lambda
    BucketName: my-test-bucket-cleaning-on-delete
  DependsOn: myBucketResource

通过这种方式，您可以确保不会首先删除存储桶，因为还有另一个资源依赖于它，因此首先删除依赖资源（这会触发 lambda 清空存储桶），然后删除存储桶。希望有人觉得它有帮助。

Answer 4

botocore.vendored 已弃用，并将在 2021 年 1 月 30 日后从 Lambda 中删除。

这是更新版本

Type: AWS::Lambda::Function
Properties:
  Code: 
    ZipFile: 
      !Sub |
        import json, boto3, logging
        import cfnresponse
        logger = logging.getLogger()
        logger.setLevel(logging.INFO)

        def lambda_handler(event, context):
            logger.info("event: {}".format(event))
            try:
                bucket = event['ResourceProperties']['BucketName']
                logger.info("bucket: {}, event['RequestType']: {}".format(bucket,event['RequestType']))
                if event['RequestType'] == 'Delete':
                    s3 = boto3.resource('s3')
                    bucket = s3.Bucket(bucket)
                    for obj in bucket.objects.filter():
                        logger.info("delete obj: {}".format(obj))
                        s3.Object(bucket.name, obj.key).delete()

                sendResponseCfn(event, context, cfnresponse.SUCCESS)
            except Exception as e:
                logger.info("Exception: {}".format(e))
                sendResponseCfn(event, context, cfnresponse.FAILED)

        def sendResponseCfn(event, context, responseStatus):
            responseData = {}
            responseData['Data'] = {}
            cfnresponse.send(event, context, responseStatus, responseData, "CustomResourcePhysicalID")            

  Handler: "index.lambda_handler"
  Runtime: python3.7
  MemorySize: 128
  Timeout: 60
  Role: !GetAtt TSIemptyBucketOnDeleteFunctionRole.Arn