Model assets for the first Mixture-of-Lora technique applied to Llama. https://bit.ly/48bqshl
lauren
crumb
AI & ML interests
None yet
Recent Activity
updated
a dataset
about 3 hours ago
crumbs-playground/clmr-4B-dora-rb256-cb256-bs8-lr2e-05-gn0.5-eb0.01
published
a dataset
about 3 hours ago
crumbs-playground/clmr-4B-dora-rb256-cb256-bs8-lr2e-05-gn0.5-eb0.01
updated
a dataset
3 days ago
crumbs-playground/clmr-8B-lora-rb256-cb256-bs8-lr1e-05-gn0.5-eb0.01
Organizations
models
141
crumb/doc2desc_3b_gguf
Summarization
•
3B
•
Updated
•
6
crumb/GLORT2
Text Generation
•
0.2B
•
Updated
•
8
crumb/160m-plus-sauce
Text Generation
•
0.2B
•
Updated
•
6
crumb/410m-plus-sauce
Text Generation
•
0.4B
•
Updated
•
7
crumb/gpdst-small-2bit-128d
Text Generation
•
18.9M
•
Updated
•
12
crumb/L3.1-tokenizer
Updated
crumb/utf8-gelu-dec-8.5M-10KB-ctx-3GB
Text Generation
•
8.5M
•
Updated
•
6
crumb/utf8-relu-dec-8.5M-10KB-ctx-3GB
Text Generation
•
8.5M
•
Updated
•
8
crumb/92d52f-ame-full-7B
Text Generation
•
7B
•
Updated
•
14
•
2
crumb/a3843d-augmented-mappings-medium-experimental
Text Generation
•
0.3B
•
Updated
•
4
datasets
51
crumb/semantic-corruption-t5-v1_1-base
Viewer
•
Updated
•
1.54k
•
27
crumb/semantic-corruption-t5-v1_1-small
Viewer
•
Updated
•
2.28k
•
39
crumb/dril-tweets
Viewer
•
Updated
•
7.52k
•
40
•
4
crumb/basic_fim_set
Viewer
•
Updated
•
65.5k
•
7
crumb/askmistral-pile-2-15
Viewer
•
Updated
•
2.34M
•
109
•
11
crumb/songbird
Viewer
•
Updated
•
12M
•
7
crumb/semantic-corruption-t5-v1_1-large
Viewer
•
Updated
•
753
•
21
crumb/reup-test
Viewer
•
Updated
•
2k
•
3
crumb/redbeam-c4-rated-vit-l14-laion
Viewer
•
Updated
•
2k
•
6
crumb/dummy-cot-sampling-dataset-clean-preview
Viewer
•
Updated
•
313
•
4