DOKK / manpages / debian 11 / libhts3 / htslib-s3-plugin.7.en
htslib-s3-plugin(7) Bioinformatics tools htslib-s3-plugin(7)

s3 plugin - htslib AWS S3 plugin

The S3 plugin allows htslib file functions to communicate with servers that use the AWS S3 protocol. Files are identified by their bucket and object key in a URL format e.g.

s3://mybucket/path/to/file

With path/to/file being the object key.

Necessary security information can be provided in as part of the URL, in environment variables or from configuration files.

The full URL format is:

s3[+SCHEME]://[ID[:SECRET[:TOKEN]]@]BUCKET/PATH

The elements are:

The protocol used. Defaults to https.
The user AWS access key.
The secret key for use with the access key.
Token used for temporary security credentials.
AWS S3 bucket.
Path to the object under the bucket.

The environment variables below will be used if the user ID is not set.

The user AWS access key.
The secret key for use with the access key.
The region to use. Defaults to us-east-1.
Token used for temporary security credentials.
The profile to use in credentials, config or s3cfg files. Defaults to default.
Same as above.
Location of the credentials file. Defaults to ~/.aws/credentials.
Location of the s3cfg file. Defaults to ~/.s3cfg.
Sets the host. Defaults to s3.amazonaws.com.
If set use signature v2 rather the default v4. This will limit the plugin to reading only.
Sets the upload part size in Mb, the minimum being 5Mb. By default the part size starts at 5Mb and expands at regular intervals to accommodate bigger files (up to 2.5 Tbytes with the current rate). Using this setting disables the automatic part size expansion.

In the absence of an ID from the previous two methods the credential/config files will be used. The default file locations are either ~/.aws/credentials or ~/.s3cfg (in that order).

In most cases this plugin transforms the given URL into a virtual host-style format e.g. https://bucket.host/path/to/file. A path-style format is used where the URL is not DNS compliant or the bucket name contains a dot e.g. https://host/bu.cket/path/to/file.

htsfile(1) samtools(1)

htslib website: <http://www.htslib.org/>

22 September 2020 htslib-1.11