Skip to main content

Object Storage (S3-Compatible)

NovaPod provides scalable, distributed object storage accessible via any standard AWS S3 SDK, boto3, MinIO client, or rclone.


Configuration​

Obtain your S3 credentials in Console -> Settings.

# S3 Endpoint configuration
export AWS_ACCESS_KEY_ID="np_s3_your_access_key"
export AWS_SECRET_ACCESS_KEY="np_s3_your_secret_key"
export AWS_ENDPOINT_URL="https://s3.novapod.io"

Interacting with Buckets​

Using AWS CLI​

# List your buckets
aws s3 ls --endpoint-url https://s3.novapod.io

# Upload a dataset or model checkpoint
aws s3 sync ./my_model s3://my-checkpoint-bucket/v1 --endpoint-url https://s3.novapod.io

Using Python (Boto3)​

import boto3

s3 = boto3.client(
"s3",
endpoint_url="https://s3.novapod.io",
aws_access_key_id="np_s3_your_access_key",
aws_secret_access_key="np_s3_your_secret_key"
)

# Upload checkpoint directly from training loop
s3.upload_file("checkpoint-epoch-4.pt", "my-checkpoint-bucket", "epoch-4.pt")