Use Keras models in C++ with ease. A lightweight header-only library for using Keras (TensorFlow) models in C++. Works out-of-the-box also when compiled into a 32-bit executable. (Of course, 64 bit is fine too.) Avoids temporarily allocating (potentially large chunks of) additional RAM during convolutions (by not materializing the im2col input matrix). Utterly ignores even the most powerful GPU in your system and uses only one CPU core per prediction. Quite fast on one CPU core, and you can run multiple predictions in parallel, thus utilizing as many CPUs as you like to improve the overall prediction throughput of your application/pipeline.

Features

  • Is a small header-only library written in modern and pure C++
  • Very easy to integrate and use
  • Depends only on FunctionalPlus, Eigen and json - also header-only libraries
  • Supports inference (model.predict) not only for sequential models but also for computational graphs with a more complex topology, created with the functional API
  • Re-implements a (small) subset of TensorFlow, i.e., the operations needed to support prediction
  • Results in a much smaller binary size than linking against TensorFlow

Project Samples

Project Activity

See All Activity >

Categories

Libraries

License

MIT License

Follow frugally-deep

frugally-deep Web Site

Other Useful Business Software
Our Free Plans just got better! | Auth0 Icon
Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Try free now
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of frugally-deep!

Additional Project Details

Programming Language

C++

Related Categories

C++ Libraries

Registered

2024-05-27