SODA models trained on Yodas+Emilia+Nemotron for 500B tokens from scratch
AI & ML interests
multimodal, audio, speech, llms
Recent Activity
View all activity
Papers
View all PapersIsoFLOP Models trained on Yodas+Emilia+Nemotron from budgets of 3e18 to 3e20
-
soda-research/discrete-audio-isoflop-3e20-4.24B-d2816-L27-B64-b829f0
4B • Updated • 8 -
soda-research/discrete-audio-isoflop-3e20-1.93B-d2048-L20-B128-ca249f
2B • Updated • 7 -
soda-research/discrete-audio-isoflop-3e20-2.62B-d2304-L23-B128-29fe40
3B • Updated • 5 -
soda-research/discrete-audio-isoflop-3e20-1.68B-d1920-L19-B128-a41e32
2B • Updated • 6
SODA models trained on Yodas+Emilia+Nemotron for 500B tokens from scratch
IsoFLOP Models trained on Yodas+Emilia+Nemotron from budgets of 3e18 to 3e20
-
soda-research/discrete-audio-isoflop-3e20-4.24B-d2816-L27-B64-b829f0
4B • Updated • 8 -
soda-research/discrete-audio-isoflop-3e20-1.93B-d2048-L20-B128-ca249f
2B • Updated • 7 -
soda-research/discrete-audio-isoflop-3e20-2.62B-d2304-L23-B128-29fe40
3B • Updated • 5 -
soda-research/discrete-audio-isoflop-3e20-1.68B-d1920-L19-B128-a41e32
2B • Updated • 6
models 77
soda-research/soda-135m-base
0.2B • Updated
• 35 • 1
soda-research/soda-600m-base
0.7B • Updated
• 30
soda-research/soda-1.7b-base
2B • Updated
• 37
soda-research/soda-4b-base
4B • Updated
• 149 • 6
soda-research/soda-600m-prelim
0.6B • Updated
• 21
soda-research/discrete-audio-isoflop-3e20-4.24B-d2816-L27-B64-b829f0
4B • Updated
• 8
soda-research/discrete-audio-isoflop-3e20-1.93B-d2048-L20-B128-ca249f
2B • Updated
• 7
soda-research/discrete-audio-isoflop-3e20-2.62B-d2304-L23-B128-29fe40
3B • Updated
• 5
soda-research/discrete-audio-isoflop-3e20-1.68B-d1920-L19-B128-a41e32
2B • Updated
• 6
soda-research/discrete-audio-isoflop-3e20-851M-d1408-L14-B256-37b469
0.9B • Updated
• 6
datasets 15
soda-research/yodas2-mm-semantic
Viewer
• Updated
• 896k • 187 • 1
soda-research/yodas2-mm-acoustic
Viewer
• Updated
• 896k • 704 • 1
soda-research/commonvoice17-mm-pretrain
Viewer
• Updated
• 3.6M • 314
soda-research/peoples-speech-mm-pretrain
Viewer
• Updated
• 3.59M • 42
soda-research/libritts-r-mm-pretrain
Viewer
• Updated
• 678k • 22
soda-research/emilia-mm-pretrain-fix
Viewer
• Updated
• 12.6M • 1.55k
soda-research/libritts-r-mm-tts0
Viewer
• Updated
• 334k • 83
soda-research/yodas2-mm-asr
Viewer
• Updated
• 4.26M • 113 • 1
soda-research/mls-en-mm-tts0
Viewer
• Updated
• 552k • 41
soda-research/emilia-mm-conversational
Viewer
• Updated
• 599k • 2