Tokenize.jl Files

Tokenization for Julia source code

This is an exact mirror of the Tokenize.jl project, hosted at https://github.com/JuliaLang/Tokenize.jl. SourceForge is not affiliated with Tokenize.jl. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
v0.5.27 source code.tar.gz	2024-01-05	35.6 kB	0
v0.5.27 source code.zip	2024-01-05	39.9 kB	0
Totals: 2 Items		75.5 kB	0

Other Useful Business Software

Auth0 for AI Agents now in GA

Ready to implement AI with confidence (without sacrificing security)?

Connect your AI agents to apps and data more securely, give users control over the actions AI agents can perform and the data they can access, and enable human confirmation for critical agent actions.

Start building today

Deliver trusted data with dbt

dbt Labs empowers data teams to build reliable, governed data pipelines—accelerating analytics and AI initiatives with speed and confidence.

Data teams use dbt to codify business logic and make it accessible to the entire organization—for use in reporting, ML modeling, and operational workflows.

Learn More

Recommended Projects

ULS
A lexical analyzer generator that makes the class source code.
Chroma
A general purpose syntax highlighter in pure Go
Discord Bot Token Checker
Check Your Discord Bot Tokens To Get Stats
MATLAB.jl
Calling MATLAB in Julia through MATLAB Engine
Tashkeela processed
Tashkeela dataset cleaned and normalized.

Tokenize.jl Files

Tokenization for Julia source code

Get an email when there's a new version of Tokenize.jl