公式動画ピックアップ
AAPL
ADBE
ADSK
AIG
AMGN
AMZN
BABA
BAC
BL
BOX
C
CHGG
CLDR
COKE
COUP
CRM
CROX
DDOG
DELL
DIS
DOCU
DOMO
ESTC
F
FIVN
GILD
GRUB
GS
GSK
H
HD
HON
HPE
HSBC
IBM
INST
INTC
INTU
IRBT
JCOM
JNJ
JPM
LLY
LMT
M
MA
MCD
MDB
MGM
MMM
MSFT
MSI
NCR
NEM
NEWR
NFLX
NKE
NOW
NTNX
NVDA
NYT
OKTA
ORCL
PD
PG
PLAN
PS
RHT
RNG
SAP
SBUX
SHOP
SMAR
SPLK
SQ
TDOC
TEAM
TSLA
TWOU
TWTR
TXN
UA
UAL
UL
UTX
V
VEEV
VZ
WDAY
WFC
WK
WMT
WORK
YELP
ZEN
ZM
ZS
ZUO
公式動画&関連する動画 [Unifying Autoregressive and Diffusion-Based Language Models]
Welcome to the AI research bites. This series of short and informative talks showcases cutting-edge research work from ServiceNow AI Research team. The AI Research Bites are open to all, especially those interested in keeping up with the fast-paced AI research community.
In this presentation, Pierre-André Noël will show that, if you squint hard enough, autoregressive language models are a special case of diffusion models. We make this idea more concrete by introducing hyperschedules, allowing different token positions to get different noise levels. Other developments include new hybrid processes (combining the strengths of two major discrete diffusion approaches) and adaptive correction sampling (helping the model fix its own mistakes). All our innovations support efficient training and fast inference with KV-caching.
Paper: https://arxiv.org/abs/2504.06416
ServiceNow AI Research team: https://www.servicenow.com/research/
319
7