Skip to content

Compute requirements

Atacformer is a transformer model that leverages a large context-window, due to the nature of scATAC-seq data. A typical Atacformer context-window size is 8,192 tokens. To that end, Atacformer requires a significant amount of GPU memory to use in its full capacity.

Atacformer processes data in chunks (batches). This batch_size is configurable and can be adjusted based on the available hardware resources and the specific requirements of the task at hand. You can use the following table as a general rule of thumb for how much GPU VRAM you need:

Batch SizeGPU VRAM RequiredExample GPUs
42GBNVIDIA RTX 2080 Ti
84GBNVIDIA RTX 3080
168GBNVIDIA RTX 3090
3216GBNVIDIA RTX 4070 Ti
6448GBNVIDIA A40/A6000