Skip to content
TxPipe Docs

Aws S3 Bucket

The S3 source reads block objects from an AWS S3 bucket and replays them through the pipeline. It pairs naturally with the AWS S3 sink, which writes raw CBOR blocks to a bucket — letting you archive chain data once and reprocess it later without touching a node.

Configuration

daemon.toml
[source]
type = "S3"
bucket = "bucket-name"
items_per_batch = 10
  • type (required): the literal value S3.
  • bucket (required): the name of the bucket to read from.
  • items_per_batch (optional): the maximum number of object keys fetched per request.

Set the following environment variables unless Oura is already running in a configured AWS environment:

Terminal window
AWS_ACCESS_KEY_ID=
AWS_SECRET_ACCESS_KEY=
AWS_DEFAULT_REGION=us-west-2

Credentials follow the standard AWS provider chain — see AWS credentials for all the supported options.