Compute requirements
Atacformer is a transformer model that leverages a large context-window, due to the nature of scATAC-seq data. A typical Atacformer context-window size is 8,192 tokens. To that end, Atacformer requires a significant amount of GPU memory to use in its full capacity.
Atacformer processes data in chunks (batches). This batch_size
is configurable and can be adjusted based on the available hardware resources and the specific requirements of the task at hand. You can use the following table as a general rule of thumb for how much GPU VRAM you need:
Batch Size | GPU VRAM Required | Example GPUs |
---|---|---|
4 | 2GB | NVIDIA RTX 2080 Ti |
8 | 4GB | NVIDIA RTX 3080 |
16 | 8GB | NVIDIA RTX 3090 |
32 | 16GB | NVIDIA RTX 4070 Ti |
64 | 48GB | NVIDIA A40/A6000 |