Skip to main content

S3List

Description

Enables you to list files in an Amazon S3 bucket.

info
  • Ensure that you have a properly configured Amazon Web Services (S3) connection resource set up under the Resources folder.
  • S3 file names are case-sensitive; therefore, abc.JPG, abc.jpg, and ABC.jpg will be saved as different files. To ensure consistency, we recommend using lower-case file names and extensions: abc.jpg.

Configuration

FieldRequiredDescriptionExample
NameRequiredThe name of the activity. This name must be unique in a workflow.Weekly Inventory - Archive Bucket
DescriptionOptionalThe description of the activity. We recommend you make this as clear as possible to guide execution, foster understanding, and support collaboration.Weekly inventory of the archive bucket for reporting purposes.
ResourceRequiredA predefined resource for accessing S3 buckets./Resources/S3 Resources/S3Connection
Bucket NameRequiredThe name of the bucket that contains the files that you want to list.long-term-archive
File PathRequired

The path within the specified S3 bucket that leads to the folder containing the files that you want to list.

Note

While entering the file path, only list the virtual directories without adding the bucket name, because the it is already specified (see Bucket Name, above).

For example, consider the following complete path:

archive/2025/long-term-archive

In this complete path:

  • long-term-archive is the bucket that contains the files that you want to list.
  • archive/2025 is the path to the file.
PatternOptionalAn optional pattern (e.g., using wildcards like * or ?) to further filter the listed files based on their names within the specified bucket and prefix. This allows targeting files with specific naming conventions.log_202504*.json
PrefixOptionalLists files whose names begin with the specified prefix.2025-03-31
Max ResultsOptionalSpecifies the maximum number of file listings to retrieve in a single request. This can be useful for managing large buckets and processing results in batches.100
RecursiveOptionalInstructs the application to retrieve matching files recursively from subdirectories.Deselected
DescendingOptionalInstructs the application to display results in alphabetically descending order.Deselected

S3List Configuration

Input

FieldRequiredData TypeDescriptionExample
filepathOptionalStringThe path to the bucket (without the bucket name) that contains the file that you want to delete.archive/2025
patternOptionalStringThe file pattern that you want to use to filter the list of files in the target bucket.log_202504*.json
prefixOptionalStringThe prefix that you want to use to identify files to be listed from the specified file path.2025-03-31
maxResultOptionalNumberThe maximum number of search results that you want to be returned at a time.100
recursiveOptionalBooleanInstructs the application to retrieve matching files recursively from subdirectories, if true.FALSE
descendingOptionalBooleanInstructs the application to display results in alphabetically descending order, if true.FALSE

Output

FieldRequiredData TypeDescriptionExample
schemaRequiredNAA custom schema that can be imported.NA
filesRequiredArrayThe returned array containing the list of matching files in the destination bucket.NA
files > pathRequiredStringThe path to the file.archive/2025/long-term-archive
files > nameRequiredStringThe name of a file in the returned array. There must be at least one item in this list for the List call to be successfulraw/sensor-data/part-0001.json
files > sizeRequiredNumberThe size of the file (in bytes).2500
files > createdTimeRequiredStringThe date-time when the file was created.2025-03-10T19:20:30+01:00
files > lastModifiedRequiredStringThe date-time when the file was last modified.2025-03-15T09:10:30+01:00
files > permissionsRequiredStringPermissions associated with the file.Read, write, delete or manage files
files > propertiesRequiredStringProperties associated with the file.content-type
files > directoryRequiredBooleanIndicates a child directory.True
totalFilesRequiredNumberIndicates the number of files in the target bucket.23