GitHub

Evaluation of encoder and decoder models on SuperGLUE

I want to evaluate models like ModernBERT, Llama and many others on SuperGLUE and my own benchmark. In my setting, every model has to be fine-tuned for the specific task, even decoder models. Is this ...
marktechpost

Meet mmBERT: An Encoder-only Language Model Pretrained on 3T Tokens of Multilingual Text in over 1800 Languages and 2–4× Faster than Previous Models

Why was a new multilingual encoder needed? XLM-RoBERTa (XLM-R) has dominated multilingual NLP for more than 5 years, an unusually long reign in AI research. While encoder-only models like BERT and ...
marktechpost

NeoBERT: Modernizing Encoder Models for Enhanced Language Understanding

Encoder models like BERT and RoBERTa have long been cornerstones of natural language processing (NLP), powering tasks such as text classification, retrieval, and toxicity detection. However, while ...
blockchain

NVIDIA TensorRT-LLM Enhances Encoder-Decoder Models with In-Flight Batching

NVIDIA's TensorRT-LLM now supports encoder-decoder models with in-flight batching, offering optimized inference for AI applications. Discover the enhancements for generative AI on NVIDIA GPUs. NVIDIA ...
RBR

A New Closed Caption Encoder Comes From ENCO

NEW YORK — With NAB Show New York now concluded, ENCO has formally debuted its first closed caption encoder. Introducing DoCaption EN848, available separately or as part of ENCO’s enCaption system. It ...
Slator

A Primer on Decoder-Only vs Encoder-Decoder Models for AI Translation

Large language models (LLMs) have changed the game for machine translation (MT). LLMs vary in architecture, ranging from decoder-only designs to encoder-decoder frameworks. Encoder-decoder models, ...
IEEE

Connecting Speech Encoder and Large Language Model for ASR

Abstract: The impressive capability and versatility of large language models (LLMs) have aroused increasing attention in automatic speech recognition (ASR), with several pioneering studies attempting ...