YouTokenToMe Files

Unsupervised text tokenizer focused on computational efficiency

This is an exact mirror of the YouTokenToMe project, hosted at https://github.com/VKCOM/YouTokenToMe. SourceForge is not affiliated with YouTokenToMe.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
Add dropout support source code.tar.gz	2019-11-19	48.2 kB	0
Add dropout support source code.zip	2019-11-19	57.9 kB	0
README.md	2019-11-19	138 Bytes	0
Totals: 3 Items		106.3 kB	0

Add support of dropout in encoding
Add support of IDs ignoring for decoding
Fix unhandled exception on unknown --output_type

Source: README.md, updated 2019-11-19

Other Useful Business Software

Enterprise-grade ITSM, for every business

Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity.

Freshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.

Try it Free

$300 in Free Credit for Your Google Cloud Projects

Build, test, and explore on Google Cloud with $300 in free credit. No hidden charges. No surprise bills.

Launch your next project with $300 in free Google Cloud credit—no hidden charges. Test, build, and deploy without risk. Use your credit across the Google Cloud platform to find what works best for your needs. After your credits are used, continue building with free monthly usage products. Only pay when you're ready to scale. Sign up in minutes and start exploring.

Start Free Trial

Recommended Projects

UnsupervisedMT
Phrase-Based & Neural Unsupervised Machine Translation
SentencePiece
Unsupervised text tokenizer for Neural Network-based text generation
Lesan
New way to create web server and NoSQL data model
GPT-2
Code for the paper Language Models are Unsupervised Multitask Learners
TextBlob
TextBlob is a Python library for processing textual data

YouTokenToMe Files

Unsupervised text tokenizer focused on computational efficiency

Get an email when there's a new version of YouTokenToMe