The DeepSeek v3 paper (and are out, after yesterday's mysterious release of Loads of interesting particulars in here. More analysis outcomes might be found here. That is doubtlessly solely mannequin particular, so future experimentation is required right here. This mannequin is a positive-tuned 7B parameter LLM on the Intel Gaudi 2 processor from the Intel/neural-chat-7b-v3-1 on the meta-math/MetaMathQA dataset. The Intel/neural-chat-7b-v3-1 was initially superb-tuned from mistralai/Mistral-7B-v-0.1. 1.3b-instruct is a 1.3B parameter mannequin initialized from deepseek-coder-1.3b-base and superb-tuned on 2B tokens of instruction data.