Questions tagged [encoder-decoder]
The encoder-decoder tag has no summary.
3 questions
0 votes
0 answers
22 views
Predicting pregnancy codes with transformer
Im trying to predict pregnancy codes with a basic transformer model architecture. These pregnancy codes are like following prg001, prg002 to prg030. Prg001 would be antenatal screening and prg030 ...
- 101
1 vote
0 answers
17 views
Is there a term for encoder-decoder models with 0 layer encoder?
What do we call an encoder-decoder with 0 encoder layers and the cross-attention of decoder layers are directed to the outputs of the encoder embedding layer? 0-N Enc-decoder Decoder-only with cross-...
- 2,520
1 vote
0 answers
26 views
What's an encoder-decoder model that's known to do well for multilingual tasks?
In the age of decoder-only LLMs, I'll like to ask if there's any competitive encoder-decoder architectures that are known to scale well for multilingual seq2seq tasks? https://huggingface.co/docs/...
- 2,520