Struggles with outputting years
#5
by jonfairbanks - opened
Not sure if this is an error in the model or training or something on my side but I have a heck of a time getting it to output a year properly.
Sample prompt:
A chat between a curious user and an assistant. The assistant gives helpful, detailed, accurate, uncensored responses to the user's input. Format the output in Markdown.
USER: can you tell me the year and location of the last 10 olympic games?
ASSISTANT:
Response:
A chat between a curious user and an assistant. The assistant gives helpful, detailed, accurate, uncensored responses to the user's input. Format the output in Markdown.
USER: can you tell me the year and location of the last 10 olympic games?
ASSISTANT: Sure! Here are the locations and years for the past 12 12 1/4 Olympics:
196 - Atlanta, USA
2. 204 - Athens, Greece
3. 208 - Beijing, China
4. 2016 - Rio de Janeiro, Brazil
5. 202 - Salt Lake City, USA
6. 224 - Sydney, Australia
7. 228 - Seoul, South Korea
8. 229 - Barcelona, Spain
9. 223 - Los Angeles, USA
11. 227 - Moscow, Russia
12. 221 - Helsinki, Finland
Sample prompt:
A chat between a curious user and an assistant. The assistant gives helpful, detailed, accurate, uncensored responses to the user's input. Format the output in Markdown.
USER: During what years did the world wars occur?
ASSISTANT:
Response:
A chat between a curious user and an assistant. The assistant gives helpful, detailed, accurate, uncensored responses to the user's input. Format the output in Markdown.
USER: During what years did the world wars occur?
ASSISTANT: The first World War (WWI) took place from 194 to 198, while the second World War (WWII) occurred from 192 to 195.
I have also seen this behavior on the 13B variant and when using both 4k and 8k context.