An AWS Professional Service open-source python initiative that extends the power of Pandas library to AWS connecting DataFrames and AWS data-related services. Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON, and EXCEL). Built on top of other open-source projects like Pandas, Apache Arrow and Boto3, it offers abstracted functions to execute usual ETL tasks like load/unload data from Data Lakes, Data Warehouses, and Databases. Convert the column name to be compatible with Amazon Athena and the AWS Glue Catalog. Run a query against AWS CloudWatchLogs Insights and convert the results to Pandas DataFrame. Get QuickSight dashboard ID given a name and fails if there is more than 1 ID associated with this name. List IAM policy assignments in the current Amazon QuickSight account.

Features

  • Copy a list of S3 objects to another S3 directory
  • Delete Amazon S3 objects from a received S3 prefix or list of S3 objects paths
  • Describe Amazon S3 objects from a received S3 prefix or list of S3 objects paths
  • Download file from a received S3 path to local file
  • Merge a source dataset into a target dataset
  • Perform Upsert (Update else Insert) onto an existing Glue table

Project Samples

AWS Data Wrangler Screenshot 1

Project Activity

See All Activity >

Categories

Scientific/Engineering, ETL, Cloud Services

License

Apache License V2.0

Follow AWS Data Wrangler

AWS Data Wrangler Web Site

Other Useful Business Software
Cut Cloud Costs with Google Compute Engine Icon
Cut Cloud Costs with Google Compute Engine

Save up to 91% with Spot VMs and get automatic sustained-use discounts. One free VM per month, plus $300 in credits.

Save on compute costs with Compute Engine. Reduce your batch jobs and workload bill 60-91% with Spot VMs. Compute Engine's committed use offers customers up to 70% savings through sustained use discounts. Plus, you get one free e2-micro VM monthly and $300 credit to start.
Try Compute Engine
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of AWS Data Wrangler!

Additional Project Details

Programming Language

Python

Related Categories

Python Scientific Engineering, Python ETL Tool, Python Cloud Services Software

Registered

2022-04-01
Report inappropriate content