DQC Logo
|

Connection to files on AWS S3

To connect files stored in Amazon S3 to the DQC Platform, you need to configure IAM access and supply your bucket details. This guide explains the steps and required parameters.

Add an AWS S3 connector

To get started:

  1. Navigate to the Data Connectors screen

  2. Click on the AWS S3 button

  3. Fill in the required details (see table below)

Choose AWS S3 to link your object storage bucket

Required connection information

Field

Example

Description

Name

DataLakeObjectStore

Internal name for your connection

Access Key

AKIAIOSFODNN7EXAMPLE

AWS IAM access key

Secret Access Key

{secret here}

Corresponding secret key for authentication

Region

eu-central-1

AWS region where your S3 bucket is located

S3 URL

s3://bucketname/path

Path to your data — include folder if not using root

Configure IAM access in AWS

To ensure secure and scoped access to your S3 bucket, follow these steps:

Step 1: Create IAM policy

Define a custom IAM policy with the following permissions:

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Action": [
        "s3:ListBucket",
        "s3:GetObject",
        "s3:GetBucketLocation"
      ],
      "Resource": [
        "arn:aws:s3:::your-bucket-name",
        "arn:aws:s3:::your-bucket-name/*"
      ]
    }
  ]
}

Step 2: Create IAM user and attach policy

  1. Go to IAM > Users

  2. Create a new user or choose an existing one

  3. Attach the custom S3 access policy

  4. Generate an Access Key and Secret Access Key

Whitelist DQC Platform’s static IP

To allow inbound connections, ensure that the following static IP address is whitelisted in your S3 bucket policies or VPC security groups:

3.123.94.228

undefined Notes

Connection to files on AWS S3 | DQC