Best Amazon S3 File Manager Utility?Ever since I started using Amazon's S3 service I've been struggling to find a good solution for simple file management, without having to write my own app to browse my buckets, upload and delete files, etc.
The best I've found so far to do this is S3Fox [1]. But it's far from perfect, it has problems deleting files and folders. Comments on the Firefox plugin page indicate I'm not the only person with this problem and the developer does not respond to emails.
I've looked around briefly, but couldn't find anything that looked any better than S3Fox.
Please tell me there's a better way!
Edit (07/26/2009): The Firefox S3Fox extension seems to be getting love from its developer again, the problems I was having before have gone away, and I'm using it on a regular basis now with no problems!
Jungle Disk [1] can map network drives to your buckets, and can help with your backups.
I use it regularly on Windows Vista and Mac OS X. Sometimes I use it to transfer files between my office and home computers.
[1] http://www.jungledisk.com/For Mac and Windows, Cyberduck [1] (the FTP/SFTP client) has been able to handle it for a little while now, and I think it's pretty nice to use.
[1] http://cyberduck.chAmazon S3 for the rest of us.
Browse Amazon Simple Storage Service like your harddisk. Supporting the latest and greatest additions to the S3 storage options. Define website endpoints, logging options, storage class and geographical location of your content.
Versioning and MFA: Support for bucket versioning and Multi-Factor Authentication Delete. With versioning enabled, revert to any previous version of a file.
ACL: Configure Access Control Lists (ACLs) for fine grained access permissions. Copy a signed URL for temporary access.
Metadata: You can edit standard HTTP headers and add custom HTTP headers to files to store metadata and control cache expire settings. Batch editing included.
S3fm [1] - free online Amazon S3 File Manager.
Loads directly from Amazon S3 and runs in your browser - fast, secure and convenient. No software to install, just click and go.
User friendly, fast, slick interface. Multiplatform, all major browsers supported. Built-in document viewer, image slide show and media layer. Drag & drop, multi-file uploads and downloads and plenty of other features.
Best of all, you don't have to share your credentials with a 3rd party web site as with other online solutions. S3fm, is a stand-alone Ajax app that communicates directly with Amazon S3 so your secret key never leaves your computer.
[1] http://www.s3fm.com/On the Mac, you can use the FTP client Transmit [1], which has Amazon S3 support built in.
Amazon S3:
- CloudFront Support
- Deploy your files via CDN
- Bucket Loggin
If you are on Windows you can use CloudBerry Explorer [1] for Amazon S3. With FTP like client it makes managing files in S3 EASY It supports most of the Amazon S3 and CloudFront features and It is a FREEWARE.
[1] http://cloudberrylab.com/s3fs for Linux and Mac.
I have a bucket with over 500k files. None of the tools I tried above worked very well because they would choke when I tried to navigate to the folder.
A really good cross-platform tool I found was jh3ll.
Its a simple command line utility that lets you navigate, copy, delete, upload, download files,etc. Because its command line it can deal with very large buckets without a problem. You can also batch up a bunch of commands and input them into the program for repeatable tasks.
https://jsh3ll.dev.java.net/
Just saw, Bucket Explorer [1], don't know how good it is compare to the others.
Now Bucket Explorer latest version will help you to manage and upload data more than 5 GB as well multipart download resume upload all the features are available.
[1] http://www.bucketexplorer.com/It depends what your goals are. If you are managing backend storage for a web site, most of the tools mentioned are not sufficient. You need control over metadata (headers) and permissions, plus the ability to handle thousands of files efficiently.
If these are your needs, and you don’t want to write scripts (using boto [1] or s3cmd [2]), the best I’ve found is CloudBerry Explorer [3]. It was mentioned earlier, but appears to be someone from the company promoting it.
Nevertheless, it’s pretty good. The UI is clunky, but that’s what you get for working in Windows. Functionally, it’s superb and exposes almost every single capability of S3.
Cyberduck [4] (Windows and Mac) is a close second. It’s not quite as powerful as CloudBerry Explorer, but does give you full control over metadata.
Transmit [5] (Mac) is an absolute pleasure to use, but very limited in terms of metadata manipulation. You can set headers on upload, and that’s about it. You can’t even view metadata of existing files. I’ve also found it to be slow when dealing with large buckets. The S3 functionality has not been updated in a while and cannot create buckets in newer regions like Oregon and São Paulo (though you can access buckets in those regions).
Forklift [6] (Mac) is not nearly as polished as Transmit but is blazing fast, even with large buckets. Like Transmit, it’s very limited in terms of metadata manipulation and not sufficient to manage S3 as backend web site storage.
With that said, both Transmit and Forklift can have a place in your toolbox for those times you need to make a quick change or upload a few files.
[1] https://github.com/boto/botoSome folks like JungleDisk [1]. I've used it briefly, it seemed to work pretty well.
[1] http://www.jungledisk.com/I find I have to use two different tools to get the job done.
S3fox is great when you want to access S3 through a file browser interface. But like you said, deleting trees sucks. You also can't upload files to different names than you have them on your hard drive.
I also use S3 Browser [1] a lot. It's nice because it doesn't break up the keys into file paths. Instead, you get a list of all the keys in a bucket. If you want to delete a bunch of files out of a tree, just shift-select them and hit delete. It also lets you change the destination file on upload.
[1] http://people.no-distance.net/ol/software/s3/I'm surprised no one has mentioned it but ExpanDrive [1] (for Mac and Windows) allows you to mount Amazon S3 shares in Finder. You can even change file permissions using the standard Get Info dialogue.
[1] http://expandrive.comI use CLoud Turtle, its FREE, all in one, access Amazon S3 and others, plus its super fast, its the only one with Mutiple threads upload download and serach
Cloud Turtle [1]
[1] http://www.cloudturtle.com