Download
OpenAI GPT-2 model trained on four different datasets in French. Books in French, French film scripts, reports of parliamentary debates, Tweet by Emmanuel Macron, allowing to generate text. Tensorflow and gpt-2-simple are required in order to fine-tune GPT-2. Create an environment then install the two packages pip install tensorflow==1.14 gpt-2-simple. A script and a notebook are available in the src folder to fine-tune GPT-2 on your own datasets. The output of each workout, i.e. the folder checkpoint/run1, is to be put ingpt2-model/model1 model2 model3 etc. You can run the script deploy_cloudrun.shto deploy all your different models (into gpt2-model) at once. However, you must have already initialized the gcloud CLI tool (Cloud SDK).
Features
- OpenAI GPT-2 model trained on four different datasets
- A large dataset in French
- Tensorflow and gpt-2-simple are required in order to fine-tune GPT-2
- A script and a notebook are available in the src folder to fine-tune GPT-2 on your own datasets
- French demo of GPT-2
Project Samples
