Download Latest Version v0.14.8 source code.tar.gz (626.0 kB)
Email in envelope

Get an email when there's a new version of Datapipe

Home / v0.11.1
Name Modified Size InfoDownloads / Week
Parent folder
README.md 2022-09-14 993 Bytes
0
v0.11.1 source code.tar.gz 2022-09-14 704.1 kB
0
v0.11.1 source code.zip 2022-09-14 731.3 kB
0
Totals: 3 Items   1.4 MB 0
  • Column filepath is now written to meta-pseudo-df of TableStoreFiledir when add_filepath_column is enabled (https://github.com/epoch8/datapipe/pull/149)
  • Fix TableStoreFiledir issues with regular expressions: https://github.com/epoch8/datapipe/issues/146 and https://github.com/epoch8/datapipe/issues/147 (https://github.com/epoch8/datapipe/pull/149)
  • Added new arguments readonly and disable_rm in TableStoreFiledir. By default TableStoreFiledir is running as reader and writer, but if enable_rm=True then it also removes files. When readonly=None (default), it checks for patterns * to disable/enable writing files, but if it needed to force enable or disable writing, readonly should be changed accordingly.
  • Addeed OR patterns support in format (aaa|bbb|ccc) in TableStoreFiledir. For example: /path/to/(folder1|folder2|folder3)/to/the/files.(jpg|png|jpeg).
  • Fix: read_rows() should return DataFrame with primary key columns even if empty
Source: README.md, updated 2022-09-14