From cb5e68a4e7cdc2cef40bf81671fbcb35ff605a7f Mon Sep 17 00:00:00 2001 From: Daniel Han Date: Tue, 20 Feb 2024 22:25:41 +1100 Subject: [PATCH] Updated Home (markdown) --- Home.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/Home.md b/Home.md index 2a8b38b..8b534e9 100644 --- a/Home.md +++ b/Home.md @@ -165,4 +165,13 @@ tokenizer = get_chat_template( mapping = {"role" : "from", "content" : "value", "user" : "human", "assistant" : "gpt"}, # ShareGPT style map_eos_token = True, # Maps <|im_end|> to instead ) +``` + +### NotImplementedError: A UTF-8 locale is required. Got ANSI +See https://github.com/googlecolab/colabtools/issues/3409 + +In a new cell, run the below: +```python +import locale +locale.getpreferredencoding = lambda: "UTF-8" ``` \ No newline at end of file