Skip to main content

Downloading Results

After a Bacalhau job completes, you'll need to retrieve the output files generated by your job. This guide explains the basics of downloading job results.

What You'll Learn​

  • How to specify output paths in your jobs
  • How to retrieve job results using the CLI

Getting Job Results​

To download the results of a completed job:

bacalhau job get <jobID>

This command downloads all outputs from the job to your current directory.

Specifying an Output Directory​

You can specify where to save the downloaded results:

bacalhau job get <jobID> --output-dir /path/to/save

Download Timeout Setting​

For larger downloads, you can adjust the timeout:

bacalhau job get <jobID> --download-timeout-secs 10m

Specifying Job Outputs and Publisher​

When submitting a job, you need to define which files or directories should be collected as outputs, and where those outputs should be published.

Using Command Line​

For Docker jobs, use the --output flag to define outputs and the --publisher flag to specify where to publish the results:

bacalhau docker run \
  --output results:/outputs \
  --publisher s3://my-bucket/results-folder \
  ubuntu:latest \
  -- echo "Hello, World!" > /outputs/hello.txt

This tells Bacalhau to:

  1. Collect everything in the /outputs directory of the container
  2. Publish it to the specified S3 bucket and path
  3. Make it available for download with bacalhau job get

Using Declarative Submission​

You can also define outputs in a job specification file:

Type: batch
Count: 1
Tasks:
  - Name: main
    Engine:
      Type: docker
      Params:
        Image: python:3.9
        Entrypoint:
          - 'python'
          - '-c'
          - "import os; os.makedirs('/outputs', exist_ok=True); open('/outputs/result.txt', 'w').write('Analysis complete!')"
    Publisher:
      Type: s3
      Params:
        Bucket: my-bucket
        Key: results-folder
    ResultPaths:
      - Name: results
        Path: /outputs

Submit this job using:

bacalhau job run job-spec.yaml

Multiple Output Paths​

You can specify multiple output paths in a single job:

bacalhau docker run \
  --output logs:/var/log \
  --output results:/outputs \
  --publisher s3://my-bucket/results-folder \
  ubuntu:latest \
  -- <your-command>

Downloaded Results Structure​

After running bacalhau job get, the results will be organized in a directory structure like this:

.
├── job-j-6bafb8d4
│   ├── exitCode
│   ├── outputs
│   │   └── file1
│   ├── stderr
│   └── stdout

The directory structure includes:

  • exitCode: Contains the exit code of the job
  • outputs: Contains all the files from the job's specified output directories
  • stderr: Captures any error output from the job
  • stdout: Captures the standard output from the job