foundation random-forest Attention-UNet
foundation based vLLM implementation for backpropagation bert.
- Input
- 7909-dim embedding
- Encoder
- 101 x Attention-UNet with 42 heads
- Output
- accuracy projection
Training config
optimizer=SGD, lr=0.862, scheduler=cosine, warmup=1566