Updated Home (markdown)

Daniel Han 2024-02-20 22:25:41 +11:00
commit cb5e68a4e7

@ -165,4 +165,13 @@ tokenizer = get_chat_template(
mapping = {"role" : "from", "content" : "value", "user" : "human", "assistant" : "gpt"}, # ShareGPT style
map_eos_token = True, # Maps <|im_end|> to </s> instead
)
```
### NotImplementedError: A UTF-8 locale is required. Got ANSI
See https://github.com/googlecolab/colabtools/issues/3409
In a new cell, run the below:
```python
import locale
locale.getpreferredencoding = lambda: "UTF-8"
```