AWS Transfer Family SFTP connectors

AWS Transfer Family SFTP connectors establish a relationship for sending files and messages between Amazon storage and an external partner, using the SFTP protocol. You can send files from Amazon S3 to an external, partner-owned destination. You can also use an SFTP connector to retrieve files from a partner's SFTP server.

Note

Currently, SFTP connectors can only be used to connect to remote SFTP servers that offer an internet accessible endpoint.

The following video provides a brief introduction to Transfer Family SFTP connectors.

Reference architectures

This section lists the reference materials that are available for SFTP connectors.

Blog posts

The following blog post provides a reference architecture to build an MFT workflow using SFTP connectors, including encryption of files using PGP before sending them to a remote SFTP server using SFTP connectors: Architecting secure and compliant managed file transfers with AWS Transfer Family SFTP connectors and PGP encryption.

Workshops

  • The following workshop provides hands on labs for configuring SFTP connectors and using your connectors to send or retrieve files from remote SFTP servers: Transfer Family - SFTP workshop.

  • The following workshop provides hands on labs to build fully automated and event-driven workflows involving file transfer to or from external SFTP servers to Amazon S3, and common pre- and post-processing of those files: Event-driven MFT workshop.

Patterns

The following provides a sample pattern for listing files stored on remote SFTP locations, and transferring selective files to Amazon S3: Serverlessland - Selective file transfer between remote SFTP server & S3; using AWS Transfer Family.

Quotas for SFTP connectors

The following quotas are in place for SFTP connectors.

Note

More service quotas for SFTP connectors are listed in AWS Transfer Family endpoints and quotas in the Amazon Web Services General Reference.

SFTP connector quotas
Name Default Adjustable
Maximum test connection transactions per second (TPS) 1 request per second, per account No
Maximum queue size for pending file transfers 1000 No
Maximum file size 50 gibibytes (GiB) No
Maximum transfer time per file 6 hours No
Maximum request wait time per file 6 hours No
Maximum bandwidth for connectors per account (both SFTP and AS2 connectors contribute to this value) 50 MBps No
Maximum number of items for directory listing operations 10,000 No
Maximum rate of StartFileTransfer requests per connector 3 per second No
Maximum number of files per StartFileTransfer request 10 No

For storing the credentials for SFTP connectors, there are quotas associated with each Secrets Manager secret. If you use the same secret to store multiple types of keys, for multiple purposes, you may encounter these quotas.

  • Total length for a single secret: 12,000 characters

  • Maximum length of the Password string: 1024 characters

  • Maximum length of the PrivateKey string: 8192 characters

  • Maximum length of the Username string: 100 characters