Some notes on using Nextflow

Hybrid deployment

It is possible to have some processes running on your local computer and some running through AWS Batch. See the Nextflow documentation

Nextflow Tower

Nextflow Tower does not have access to your data that is analysed in the pipeline. It will only see information about run commands, computer usage, paths to the different work directories and so on. You can run local pipelines, but view the information on the Tower website. You need an access token that is stored locally.

Documentation with tutorial on getting started.

Resource optimization

The plot with boxplots showing the requested computer resources for each process, and the actual resources used. This is useful to optimize how much resources are requested for each process.

Organization

It’s possible to create an organization and share info with different users. E.g. at work. And then we can deploy the same pipelines for example to Azure etc.

Operators

Documentation.
The map() operator allows us to do “something” to the elements of a channel. For example multiply every element with a number.

it is how I understand it a default name of an element in a channel. The name can be changed with ->. map can also be used to change order of elements, or remove certain elements of a channel.