s3-sort
by 6mile-puppet
DevOps & CloudBrief
Upload many files to S3 with automatic organization by first-character prefixes.
Description
What This Skill Does
Uploads files to an S3 bucket and organizes them into subdirectories based on the first character of each filename. Letters map to their lowercase folder (a/, b/), digits go to 0-9/, and other characters go to _other/. Supports dry runs, sync mode, and per-upload storage class selection.
Automatically partitions uploads into prefix directories, avoiding flat-bucket clutter that slows down listing and querying large S3 buckets.
When to Use It
- Organizing large media asset libraries uploaded to S3
- Archiving log files from multiple servers into sorted buckets
- Batch uploading dataset files for ML training pipelines
- Migrating a local file collection to cloud storage with folder structure
- Staging static assets alphabetically for CDN workflows
Example Workflow
User asks: Upload all files from ./exports to my-bucket using sync mode
- 1
Verifies AWS credentials with aws sts get-caller-identity
- 2
Tests bucket write access by uploading and removing a temporary file
- 3
Creates a staging directory and populates it with prefix-based subdirectories using symlinks
- 4
Runs aws s3 sync from the staging directory to s3://my-bucket/
- 5
Removes the staging directory after sync completes
All files from ./exports uploaded to my-bucket under organized prefix paths (a/, b/, 0-9/, _other/)
Requirements
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
- aws CLI (install via: brew install awscli)
Installation
clawhub install 6mile-puppet/s3-sortRun the CLI command, or paste the prompt into Claude Code, Cursor, Codex or whichever coding agent you use.