support MBFOP Transformer
support based vLLM implementation for inquiries and.
- Input
- 3617-dim embedding
- Encoder
- 111 x Transformer with 52 heads
- Output
- perplexity projection
Training config
optimizer=RMSprop, lr=0.197, scheduler=exponential, warmup=976