Download Latest Version
v2.0.0-beta source code.tar.gz (1.3 MB)
Get an email when there's a new version of Dataproc Templates
| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2024-03-04 | 5.1 kB | |
| v0.5.0-beta source code.tar.gz | 2024-03-04 | 1.3 MB | |
| v0.5.0-beta source code.zip | 2024-03-04 | 1.6 MB | |
| Totals: 3 Items | 2.8 MB | 0 | |
0.5.0-beta (2024-03-04)
Features
- Add arguments to run MongToBQ template (f0bfd4c)
- Add integration test for MongoToBigQuery Python template (906e26f)
- Add preliminary documentation for MongoToBigQuery template (99146fa)
- added support for running python templates on an existing dataproc cluster (bed0d62)
- Built java KafkaToBQDstream template for Dataproc (220cd0e)
- Built Java KafkaToGCSDstream template for Dataproc (d6c6232)
- Connection to MongoDB established via the template (8ba9e18)
- Initialise MongoToBQ Python template test file (1345dfc)
- MongoToBigQuery template initiated with config to run from main.py (4178ec9)
- MongoToBQ template writes successfully to destination table (21f44ba)
Bug Fixes
- Add Usage details of MongoToBQ template to README (3cb21f1)
- integration test for MongoToBigQuery python (955db75)
- removed dupliacted code for read and write operations (b3e8f98)
- removed dupliacted code for read and write operations (9d5c5f4)
Documentation
- Add recommended jar versions to run MongoToGCS template (#871) (3d1b729)
- added instructions for CLUSTER mode in python README (ecb2955)
- added jenkins status for python cluster integration tests (73967d1)
- added links in README for KafkaToBQDstream template (bfc076c)
- added links in README for KafkaToGCSDstream template (8def950)
- adding blog for cassandra to gcs (5ab3342)
- adding blog for cassandra to gcs (47a478b)
- adding blogpost for MongodbToGCS (2960f71)
- adding updates in a few python templates (1597691)
- clarify serverless and cluster modes, improve template execution instructions (7a8e529)
- enhanced instructions for better clarity on serverless and cluster modes (5ae1999)
- hyperlink blog guide for RedshiftToGCS java template (4dcf0a5)
- updating GCS to Cloud Storage in Java templates (426b772)
- updating gcs to cloud storage in remaining python templates (ec9925b)
