SODA models trained on Yodas+Emilia+Nemotron for 500B tokens from scratch
AI & ML interests
multimodal, audio, speech, llms
Recent Activity
View all activity
Papers
View all PapersIsoFLOP Models trained on Yodas+Emilia+Nemotron from budgets of 3e18 to 3e20
-
soda-research/discrete-audio-isoflop-3e20-4.24B-d2816-L27-B64-b829f0
4B • Updated • 1 -
soda-research/discrete-audio-isoflop-3e20-1.93B-d2048-L20-B128-ca249f
2B • Updated • 1 -
soda-research/discrete-audio-isoflop-3e20-2.62B-d2304-L23-B128-29fe40
3B • Updated • 2 -
soda-research/discrete-audio-isoflop-3e20-1.68B-d1920-L19-B128-a41e32
2B • Updated • 1
SODA models trained on Yodas+Emilia+Nemotron for 500B tokens from scratch
IsoFLOP Models trained on Yodas+Emilia+Nemotron from budgets of 3e18 to 3e20
-
soda-research/discrete-audio-isoflop-3e20-4.24B-d2816-L27-B64-b829f0
4B • Updated • 1 -
soda-research/discrete-audio-isoflop-3e20-1.93B-d2048-L20-B128-ca249f
2B • Updated • 1 -
soda-research/discrete-audio-isoflop-3e20-2.62B-d2304-L23-B128-29fe40
3B • Updated • 2 -
soda-research/discrete-audio-isoflop-3e20-1.68B-d1920-L19-B128-a41e32
2B • Updated • 1
models 77
soda-research/soda-135m-base
0.2B • Updated • 1k • 2
soda-research/soda-600m-base
0.7B • Updated • 718
soda-research/soda-1.7b-base
2B • Updated • 668
soda-research/soda-4b-base
4B • Updated • 7.53k • 7
soda-research/soda-600m-prelim
0.6B • Updated • 225
soda-research/discrete-audio-isoflop-3e20-4.24B-d2816-L27-B64-b829f0
4B • Updated • 1
soda-research/discrete-audio-isoflop-3e20-1.93B-d2048-L20-B128-ca249f
2B • Updated • 1
soda-research/discrete-audio-isoflop-3e20-2.62B-d2304-L23-B128-29fe40
3B • Updated • 2
soda-research/discrete-audio-isoflop-3e20-1.68B-d1920-L19-B128-a41e32
2B • Updated • 1
soda-research/discrete-audio-isoflop-3e20-851M-d1408-L14-B256-37b469
0.9B • Updated • 1
datasets 15
soda-research/yodas2-mm-semantic
Viewer • Updated • 896k • 583 • 1
soda-research/yodas2-mm-acoustic
Viewer • Updated • 896k • 710 • 1
soda-research/commonvoice17-mm-pretrain
Viewer • Updated • 3.6M • 284
soda-research/peoples-speech-mm-pretrain
Viewer • Updated • 3.59M • 1.9k
soda-research/libritts-r-mm-pretrain
Viewer • Updated • 678k • 195
soda-research/emilia-mm-pretrain-fix
Viewer • Updated • 12.6M • 4.88k
soda-research/libritts-r-mm-tts0
Viewer • Updated • 334k • 500
soda-research/yodas2-mm-asr
Viewer • Updated • 4.26M • 641 • 1
soda-research/mls-en-mm-tts0
Viewer • Updated • 552k • 266
soda-research/emilia-mm-conversational
Viewer • Updated • 599k • 5