BlobPorter

Introduction

BlobPorter is a data transfer tool for Azure Blob Storage that maximizes throughput through concurrent reads and writes that can scale up and down independently.

Sources and targets are decoupled, this design enables the composition of various transfer scenarios.

* The HTTP/HTTPS source must support HTTP byte ranges and return the file size as a response to a HTTP HEAD request.

What's new (0.6.20) ?

• Blob to Block Blobs transfers use the Put Block from URL API.
• Proxy support.
• Minor fixes and performance improvements.
• Upgrade to Go 1.11

Documentation

• Getting Started

  • Linux

  • Windows

  • Command Options

• Examples

  • Upload to Azure Block Blob Storage

  • Upload to Azure Page Blob Storage

  • Transfer data from S3 to Azure Storage

  • Transfer data between Azure Storage accounts, containers and blob types

  • Transfer from an HTTP/HTTPS source to Azure Blob Storage

  • Download from Azure Blob Storage

  • Download a file from a HTTP source

• Resumable Transfers

• Performance Considerations

  • Best Practices

  • Performance Measurement Mode

Issues and Feedback

If you have a question or find a bug, open a new issue in this repository. BlobPorter is an OSS project maintained by the contributors.

Contribute

If you would like to become an active contributor to this project please follow the instructions provided in Microsoft Azure Projects Contribution Guidelines.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.