Zygote provides source-to-source automatic differentiation (AD) in Julia, and is the next-gen AD system for the Flux differentiable programming framework. For more details and benchmarks of Zygote's technique, see our paper. You may want to check out Flux for more interesting examples of Zygote usage; the documentation here focuses on internals and advanced AD usage.
Features
- Zygote supports Julia 1.6 onwards, but we highly recommend using Julia 1.8 or later
- Zygote supports the flexibility and dynamism of the Julia language, including control flow, recursion, closures, structs, dictionaries, and more
- Zygote benefits from using the ChainRules.jl ruleset
- Custom gradients can be defined by extending the ChainRulesCore.jl's rrule
- To support large machine learning models with many parameters, Zygote can differentiate implicitly-used parameters
- Examples available
Categories
Machine LearningFollow Zygote
Other Useful Business Software
Cut Cloud Costs with Google Compute Engine
Save on compute costs with Compute Engine. Reduce your batch jobs and workload bill 60-91% with Spot VMs. Compute Engine's committed use offers customers up to 70% savings through sustained use discounts. Plus, you get one free e2-micro VM monthly and $300 credit to start.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Zygote!