JuliaHub supports fully heterogeneous parallel compute. It uses the Distributed standard library to parallelize across workers on potentially many machines. Each worker can support multiple threads with the builtin Threads module. Each machine can optionally have a computational GPU attached to it for further acceleration with the CUDA package.
All of these modes of operation are fully supported and JuliaHub ensures that all machines in the cluster have the appropriate files and dependencies in place. This means, for example, that you do not need to
addprocs or set the number threads yourself; your code should use scale-invariant constructs like
@threads or other higher-level abstractions like those for DifferentialEquations.jl.
JuliaHub also scales seamlessly from simple single-file scripts to whole applications with many thousands of lines of code, dependencies (both private and public), binary artifacts, and data. Your IDE will automatically detect all such dependencies, bundle them together, and ensure their availability on every node.
When running from VS Code or Juno, these are pre-populated based upon your active project.
When running ad-hoc code, you may choose them manually.
ENV["RESULTS"] to contain a simple JSON string to display certain values in the Output table. This is helpful for a handful of summary values to compare jobs at a glance on JuliaHub through the Details button.
You can further set the
ENV["RESULTS_FILE"] to a local file on the filesystem that will be available for download after job completion. While there is only one results file per job, note that you can zip or tar multiple files together.
Choose the number of cores and machines as appropriate:
It is possible to either start a job with single Julia process or with multiple Julia processes.
To start a job with single Julia process, select
single-process in the first drop-down menu.
To start a job with multiple Julia processes, select
distributed in the first drop-down menu.
memory selections will determine the node type/size on which the job will be run.
The actual number of Julia processes that will be started depends on whether one Julia process for each vCPU is selected or one Julia process for each node is selected.
If one Julia process for each vCPU is selected, then the total number of Julia processes = number of nodes * number of vCPUs in each node
If one Julia process for each node is selected, then the total number of Julia Processes = number of nodes
Note that one Julia process will always be designated to be the
master and the remaining would be
While running your job, live logs are available. Note that it can take a few minutes to launch the machines (longer for GPU machines). The logs are searchable through dynamic filters, with additional information available if you use the builtin [logging] module and related macros (like
@warn, and friends).
Set your credit card information in the Payments settings:
Billing is done at per-second interval, but with a minimum 10 minutes per job. You may set the maximum time or cost for any given job, but note that jobs that exceed that limit will be killed without storing any outputs (although logs will still be available).