lainlives commited on
Commit
dd5aa4e
·
verified ·
1 Parent(s): 00c5936

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama2
3
+ metrics:
4
+ - code_eval
5
+ library_name: transformers
6
+ tags:
7
+ - code
8
+ - llama-cpp
9
+ - gguf-my-repo
10
+ base_model: vanillaOVO/WizardCoder-Python-7B-V1.0
11
+ model-index:
12
+ - name: WizardCoder-Python-34B-V1.0
13
+ results:
14
+ - task:
15
+ type: text-generation
16
+ dataset:
17
+ name: HumanEval
18
+ type: openai_humaneval
19
+ metrics:
20
+ - type: pass@1
21
+ value: 0.555
22
+ name: pass@1
23
+ verified: false
24
+ ---
25
+
26
+ # lainlives/WizardCoder-Python-7B
27
+ This model contains GGUF format model files for [`vanillaOVO/WizardCoder-Python-7B-V1.0`](https://huggingface.co/vanillaOVO/WizardCoder-Python-7B-V1.0).
28
+
29
+ ### Available Quants
30
+ The following files were generated and uploaded to this repo:
31
+ `Q4_0`, `Q4_K_S`, `Q4_K_M`, `Q5_0`, `Q5_K_S`, `Q5_K_M`, `Q6_K`, `Q8_0`, `f16`, `bf16`
32
+
33
+ ### Use with llama.cpp
34
+
35
+ CLI:
36
+ ```bash
37
+ llama-cli --hf-repo lainlives/WizardCoder-Python-7B --hf-file WizardCoder-Python-7B-V1.0-Q4_K_M.gguf -p "The meaning to life and the universe is"
38
+ ```
39
+
40
+ Server:
41
+ ```bash
42
+ llama-server --hf-repo lainlives/WizardCoder-Python-7B --hf-file WizardCoder-Python-7B-V1.0-Q4_K_M.gguf -c 2048
43
+ ```
44
+
45
+ ### Or ollama
46
+
47
+ CLI:
48
+ ```bash
49
+ ollama run https://hf.co/lainlives/WizardCoder-Python-7B:Q4_K_M
50
+ ```