Meta Introduces Code Llama: An Advanced Tool for Code Generation and Debugging
Meta recently announced the release of a novel tool named Code Llama. The tool, which is built on Meta's Llama 2 large language model can generate new code and debugging existing code.
Code Llama will operate under the same community license as Llama 2 and will be free for both research and commercial use. This tool has the ability to create code from prompts or complete and debug code when directed towards a specific code string.
Alongside the base Code Llama model, Meta also introduced two specialized versions: Code Llama-Python and Code Llama-Instrct. The former is designed specifically for Python coding, while the latter is capable of understanding instructions in natural language. However, Meta emphasized that these versions of Code Llama are not interchangeable, and the base Code Llama or Code Llama-Python is not recommended for natural language instructions.
Meta's goal with Code Llama is to streamline developer workflows, allowing them to concentrate more on the human-centric aspects of their jobs. They stated, “Programmers are already using LLMs to assist in a variety of tasks, ranging from writing new software to debugging existing code”.
According to Meta, Code Llama performed better than the publicly available LLMs based on benchmark testing, although they did not specify which models they compared it against. In the code benchmark HumanEval, Code Llama scored an impressive 53.7 percent. Furthermore, it demonstrated the ability to accurately write code based on a text description.
Meta plans to release three sizes of Code Llama, with the smallest size being able to fit on a single GPU, making it suitable for more low-latency projects.
In the context of the broader tech industry, code generators have been assisting developers for some time. Other tech giants like GitHub, Amazon, and Google have also released or plan to release similar tools. For instance, GitHub launched Copilot, powered by OpenAI’s GPT-4, to quickly write and check code. Amazon’s AWS has CodeWhisperer, which also writes, checks, and updates code. Google is reportedly working on AlphaCode, although it has not been released.










