gpt_bigcode-santacoder

This is the same model as SantaCoder but it can be loaded with transformers >=4.28.1 to use the GPTBigCode architecture. We refer the reader to the SantaCoder model page for full documentation about this model There are two versions (branches) of the model: * `main`: Uses the `gpt_bigcode` model. Requires the bigcode fork of transformers. * `main_custom`: Packaged with its modeling code. Requires `transformers>=4.27`. Alternatively, it can run on older versions by setting the configuration parameter `activation_function = "gelu_pytorch_tanh"`. The model was trained on GitHub code. As such it is _not_ an instruction model and commands like "Write a function that computes the square root." do not work well. You should phrase commands like they occur in source code such as comments (e.g. `# the following function computes the sqrt`) or write a function signature and docstring and let the model complete the function body.