Apache DataFusion

Apache DataFusion

Apache Software Foundation
Apache Storm

Apache Storm

Apache Software Foundation
+
+

Related Products

  • Tenzir
    3 Ratings
    Visit Website
  • StarTree
    25 Ratings
    Visit Website
  • Azore CFD
    14 Ratings
    Visit Website
  • Cribl Stream
    8 Ratings
    Visit Website
  • SureSync
    13 Ratings
    Visit Website
  • RaimaDB
    5 Ratings
    Visit Website
  • Epsilon3
    259 Ratings
    Visit Website
  • FusionAuth
    119 Ratings
    Visit Website
  • Google Cloud BigQuery
    1,734 Ratings
    Visit Website
  • Vertex AI
    713 Ratings
    Visit Website

About

Apache DataFusion is an extensible, high-performance query engine written in Rust that utilizes Apache Arrow as its in-memory format. Designed for developers building data-centric systems such as databases, data frames, machine learning, and streaming applications, DataFusion offers SQL and DataFrame APIs, a vectorized, multi-threaded, streaming execution engine, and support for partitioned data sources. It natively supports formats like CSV, Parquet, JSON, and Avro, and allows for seamless integration with object stores including AWS S3, Azure Blob Storage, and Google Cloud Storage. The engine features a comprehensive query planner, a state-of-the-art optimizer with capabilities like expression coercion and simplification, projection and filter pushdown, sort and distribution-aware optimizations, and automatic join reordering. DataFusion is highly customizable, enabling the addition of user-defined scalar, aggregate, and window functions, custom data sources, query languages, etc.

About

Apache Storm is a free and open source distributed realtime computation system. Apache Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for batch processing. Apache Storm is simple, can be used with any programming language, and is a lot of fun to use! Apache Storm has many use cases: realtime analytics, online machine learning, continuous computation, distributed RPC, ETL, and more. Apache Storm is fast: a benchmark clocked it at over a million tuples processed per second per node. It is scalable, fault-tolerant, guarantees your data will be processed, and is easy to set up and operate. Apache Storm integrates with the queueing and database technologies you already use. An Apache Storm topology consumes streams of data and processes those streams in arbitrarily complex ways, repartitioning the streams between each stage of the computation however needed. Read more in the tutorial.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Professional developers and data engineers seeking a solution for building data-centric systems

Audience

Developers and companies in search of a big data software solution that integrates with any queueing system and any database system

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Apache Software Foundation
Founded: 2019
United States
datafusion.apache.org

Company Information

Apache Software Foundation
Founded: 1999
United States
storm.apache.org

Alternatives

Alternatives

Apache Gobblin

Apache Gobblin

Apache Software Foundation
Apache Heron

Apache Heron

Apache Software Foundation
Apache Spark

Apache Spark

Apache Software Foundation
Apache Spark

Apache Spark

Apache Software Foundation
BigLake

BigLake

Google
Apache Flink

Apache Flink

Apache Software Foundation

Categories

Categories

Integrations

Activeeon ProActive
Akira AI
Amazon Kinesis
Amazon S3
Apache Arrow
Apache Avro
Apache Ranger
Azure Blob Storage
Azure HDInsight
C
Google Sheets
JSON
Microsoft Excel
Python
RabbitMQ
Rust
SDF
SQL
Sematext Cloud

Integrations

Activeeon ProActive
Akira AI
Amazon Kinesis
Amazon S3
Apache Arrow
Apache Avro
Apache Ranger
Azure Blob Storage
Azure HDInsight
C
Google Sheets
JSON
Microsoft Excel
Python
RabbitMQ
Rust
SDF
SQL
Sematext Cloud
Claim Apache DataFusion and update features and information
Claim Apache DataFusion and update features and information
Claim Apache Storm and update features and information
Claim Apache Storm and update features and information