I occasionally train and publicly release large neural language models on programs, including PolyCoder. Here, I describe how to use these.

This is a PolyCoder model with 2.7B parameters, presented in the paper "A Systematic Evaluation of Large Language Models of Code" (MAPS'2022 and ICLR'2022 Workshop Deep Learning 4 Code). The model was trained on 249 GB of code across 12 programming languages.

Polycode is a C++ and Lua framework for building interactive applications. It is free, open source and cross-platform.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

I occasionally train and publicly release large neural language models on programs, including PolyCoder. Here, I describe how to use these. Setup; Models (incl. PolyCoder) Datasets; Evaluation; How to cite

Mar 4, 2022 · To remedy this, researchers at Carnegie Mellon University — Frank Xu, Uri Alon, Graham Neubig, and Vincent Hellendoorn — developed PolyCoder, a model based on OpenAI’s GPT-2 language model that...

Mar 10, 2022 · Several models have been trained on a large corpus of code spanning 12 programming languages. This includes a 2.7B parameter model (nick-named PolyCoder, trained for 100K and 150K steps), a 405M parameter model (100K & 150K steps) and a 160M parameter model (150K steps).

Polycoder is an open-source artificial intelligence code generation tool that outperforms all other models, including Codex. It is trained on a large dataset of code from GitHub and has been shown to outperform other open-source models in all parameter sets.

Mar 8, 2022 · PolyCoder, a massive open-source language model for code that was trained only on code in 12 distinct programming languages, was released to aid future study in the field. PolyCoder produces lower perplexity in the C programming language than all other models, including Codex.

Mar 6, 2021 · Ever wished you could tap into the power of AI to help you with your coding tasks? Enter PolyCoder, a large neural language model trained to generate code and improve programming efficiency. Whether you’re a seasoned developer or just starting out, using PolyCoder can be a game-changer.