Data Transfer Project Versions Save

What's Changed

• chore: bump version to v1.0.3 by @alexeyqu-fb in https://github.com/google/data-transfer-project/pull/1319
• Refactor GooglePhotosExporter to take in an instance of JobStore by @osamahan999 in https://github.com/google/data-transfer-project/pull/1316
• Refactor GoogleMediaExporter to use JobStore instead of TemporaryDataStore by @osamahan999 in https://github.com/google/data-transfer-project/pull/1317
• Refactor GoogleMediaImporter to only have a DataStore, not both by @osamahan999 in https://github.com/google/data-transfer-project/pull/1318
• Catch DatastoreException thrown by datastore transactions in PortabilityAbstractInMemoryDataCopier.java by @kateyeo in https://github.com/google/data-transfer-project/pull/1322
• Helper class for when Google code wants to log errors that may have failed an item outside of the executors by @osamahan999 in https://github.com/google/data-transfer-project/pull/1315
• Fix retrying executor to actually catch the IOExceptions & add tests by @osamahan999 in https://github.com/google/data-transfer-project/pull/1323
• Log and skip errors in GooglePhotosExporter when converting MediaItem to PhotoModel by @osamahan999 in https://github.com/google/data-transfer-project/pull/1321
• Add creation time field to GoogleMediaItem and populate the upload time for the media models. by @aksingh737 in https://github.com/google/data-transfer-project/pull/1306
• Add retrying for listAlbums in GoogleMediaExporter by @osamahan999 in https://github.com/google/data-transfer-project/pull/1324
• Retry listMediaItems in GoogleMediaExporter by @osamahan999 in https://github.com/google/data-transfer-project/pull/1326
• Define retry-then-skip retry strategies by @kateyeo in https://github.com/google/data-transfer-project/pull/1330
• add Retry and skip logic in AppleMediaImporter by @yy9669 in https://github.com/google/data-transfer-project/pull/1329
• Preserve filenames when importing items by @aksingh737 in https://github.com/google/data-transfer-project/pull/1332
• add log to investigate missing upload date in Google -> Apple Photos … by @yy9669 in https://github.com/google/data-transfer-project/pull/1333
• feat: add userAlias field to PortabilityJob class by @alexeyqu-fb in https://github.com/google/data-transfer-project/pull/1334

New Contributors

• @aksingh737 made their first contribution in https://github.com/google/data-transfer-project/pull/1306

Full Changelog: https://github.com/google/data-transfer-project/compare/v1.0.3...v1.0.4

What's Changed

• Add the RetryingInMemoryIdempotentExecutor to the GoogleMediaExporter constructor by @osamahan999 in https://github.com/google/data-transfer-project/pull/1294
• fix video count in import result of AppleMediaImporter by @yy9669 in https://github.com/google/data-transfer-project/pull/1296
• chore: bump version to v1.0.2 by @alexeyqu-fb in https://github.com/google/data-transfer-project/pull/1293
• Refactored GoogleMediaImporter to include the GoogleVideosImporter implementation of PhotosLibraryClient, current implementation always null by @osamahan999 in https://github.com/google/data-transfer-project/pull/1301
• Refactor artist and release in GoogleTrack as reference by @gauss0818 in https://github.com/google/data-transfer-project/pull/1303
• Bump loader-utils from 1.4.0 to 1.4.2 in /client-rest by @dependabot in https://github.com/google/data-transfer-project/pull/1181
• Upgrade karma to 6.4.2 by @wmorland in https://github.com/google/data-transfer-project/pull/1305
• Refactor GoogleMediaExporter to call thirdparty getMediaItem with retrying & error skipping. by @osamahan999 in https://github.com/google/data-transfer-project/pull/1295
• Refactor GoogleMediaExporter to call PhotosInterface.getAlbum with error retrying and skipping by @osamahan999 in https://github.com/google/data-transfer-project/pull/1302
• fix: include timestamp in DriveImporter root folder by @alexeyqu-fb in https://github.com/google/data-transfer-project/pull/1309

Full Changelog: https://github.com/google/data-transfer-project/compare/v1.0.2...v1.0.3

What's Changed

• Change idempotent id for Social Activity Model by @calmarj in https://github.com/google/data-transfer-project/pull/1247
• Change retrying executor to singleton by @kateyeo in https://github.com/google/data-transfer-project/pull/1249
• Add skipRetryStrategy to RetryLibrary by @kateyeo in https://github.com/google/data-transfer-project/pull/1252
• Add flag guarded retrying idempotent executor to google importer by @kateyeo in https://github.com/google/data-transfer-project/pull/1254
• Add logic to check for skippable error in RetryingInMemoryIdempotentImportExecutor by @kateyeo in https://github.com/google/data-transfer-project/pull/1258
• Update Google music models and Import/Export adapters by @gauss0818 in https://github.com/google/data-transfer-project/pull/1259
• throw InvalidTokenException when Google uploadVideo returns HTTP 401 by @alexeyqu-fb in https://github.com/google/data-transfer-project/pull/1262
• Update google music importer/exporter by @gauss0818 in https://github.com/google/data-transfer-project/pull/1261
• Fix google music adapter java style and import issue by @gauss0818 in https://github.com/google/data-transfer-project/pull/1264
• Add mime-type guessing logic based on the filename, with default mime-types as fallbacks. by @osamahan999 in https://github.com/google/data-transfer-project/pull/1265
• Add is_explicit flag to MusicRecording by @gauss0818 in https://github.com/google/data-transfer-project/pull/1268
• Create SmugMugMediaImporter by @kateyeo in https://github.com/google/data-transfer-project/pull/1271
• Add items with null album-ids into the item-map with an empty string key by @osamahan999 in https://github.com/google/data-transfer-project/pull/1267
• Create FlickrMediaImporter by @kateyeo in https://github.com/google/data-transfer-project/pull/1039
• Add explicit type to GoogleTrack by @gauss0818 in https://github.com/google/data-transfer-project/pull/1273
• Google Music API refactoring by @gauss0818 in https://github.com/google/data-transfer-project/pull/1277
• refactor apple media exceptions by @yy9669 in https://github.com/google/data-transfer-project/pull/1269
• Use Apache Tika-core for guessing mime-types, added additional mimetype test cases by @osamahan999 in https://github.com/google/data-transfer-project/pull/1278
• Made GoogleAlbum serializable; added test to check serializability by @osamahan999 in https://github.com/google/data-transfer-project/pull/1279
• Make Photo serializable, add a test that confirms it is serializable by @osamahan999 in https://github.com/google/data-transfer-project/pull/1280
• Make Video serializable and add a test that confirms its serializability by @osamahan999 in https://github.com/google/data-transfer-project/pull/1281
• Made MediaMetadata serializable, added a test to confirm by @osamahan999 in https://github.com/google/data-transfer-project/pull/1282
• Made GoogleMediaItem serializable, added a test to confirm by @osamahan999 in https://github.com/google/data-transfer-project/pull/1283
• Made AlbumListResponse serializable and added a test to confirm by @osamahan999 in https://github.com/google/data-transfer-project/pull/1284
• Add Media to list of supported transfer types for SmugMug importer by @kateyeo in https://github.com/google/data-transfer-project/pull/1285
• handle album without album name in Apple Media Importer by @yy9669 in https://github.com/google/data-transfer-project/pull/1287
• Made Status serializable and added a test for it by @osamahan999 in https://github.com/google/data-transfer-project/pull/1289
• Made MediaItemSearchResponse serializable and added a test to confirm by @osamahan999 in https://github.com/google/data-transfer-project/pull/1288
• BatchMediaItemResponse made serializable, with tests to confirm by @osamahan999 in https://github.com/google/data-transfer-project/pull/1290
• Bump @babel/traverse from 7.18.6 to 7.23.2 in /client-rest by @dependabot in https://github.com/google/data-transfer-project/pull/1286
• fix: wrap invalid token, destination full exceptions from DriveImporter by @alexeyqu-fb in https://github.com/google/data-transfer-project/pull/1292

New Contributors

• @osamahan999 made their first contribution in https://github.com/google/data-transfer-project/pull/1265
• @yy9669 made their first contribution in https://github.com/google/data-transfer-project/pull/1269

Full Changelog: https://github.com/google/data-transfer-project/compare/v1.0.1...v1.0.2

What's Changed

• Release v1.0.0 by @wmorland in https://github.com/google/data-transfer-project/pull/1223
• Add getRetryingIdempotentImportExecutor by @kateyeo in https://github.com/google/data-transfer-project/pull/1225
• noop refactor as a pre-step to landing a new importer that needs some of this video logic by @jzacsh in https://github.com/google/data-transfer-project/pull/1229
• show unit test failure reason in CLI by @jzacsh in https://github.com/google/data-transfer-project/pull/1230
• introduces GoogleMediaImporter via newly factored out GoogleVideoInterface from GoogleVideoImporter by @jzacsh in https://github.com/google/data-transfer-project/pull/1231
• noop(typo) fix old variable name from forked test by @jzacsh in https://github.com/google/data-transfer-project/pull/1233
• Add Apple Photos Import extensions by @sparuvu in https://github.com/google/data-transfer-project/pull/1232
• google internal refactoring: factor out batch-import logic so we can (later PR) delete duplication that lives in GooglePhotosImporter by @jzacsh in https://github.com/google/data-transfer-project/pull/1234
• noop(cleanup) delete duplicate importPhotos code from GooglePhotosImporter by @jzacsh in https://github.com/google/data-transfer-project/pull/1235
• Add mocks for InputStream so that Imgur tests do not fail offline by @kateyeo in https://github.com/google/data-transfer-project/pull/1240
• Add retrying version of InMemory idempotent executor by @kateyeo in https://github.com/google/data-transfer-project/pull/1239
• Add flag guarded retrying idempotent executor to flickr importer by @kateyeo in https://github.com/google/data-transfer-project/pull/1244

New Contributors

• @sparuvu made their first contribution in https://github.com/google/data-transfer-project/pull/1232

Full Changelog: https://github.com/google/data-transfer-project/compare/v1.0.0...v1.0.1

Full Changelog: https://github.com/google/data-transfer-project/compare/v0.4.5...v1.0.0

What's Changed

• Google media exporter: installs along side Photos, but will replace photos in the future by @jzacsh in https://github.com/google/data-transfer-project/pull/1218
• Fix base album url in MicrosoftMediaImporter by @seehamrun in https://github.com/google/data-transfer-project/pull/1220
• Update MicrosoftTransferExtension to have Media as a valid import datatype by @seehamrun in https://github.com/google/data-transfer-project/pull/1219
• Throw invalid token exception for video import by @srujithm in https://github.com/google/data-transfer-project/pull/1222

New Contributors

• @srujithm made their first contribution in https://github.com/google/data-transfer-project/pull/1222

Full Changelog: https://github.com/google/data-transfer-project/compare/v.0.4.4...v0.4.5

What's Changed

• Separate getErrors from copy, so it isn't skipped when copy throws. by @carrot-lion in https://github.com/google/data-transfer-project/pull/1206
• Upgrade scribejava and flickr4java 3rd party libraries by @KevinStrong in https://github.com/google/data-transfer-project/pull/1209
• Bump ua-parser-js from 0.7.31 to 0.7.33 in /client-rest by @dependabot in https://github.com/google/data-transfer-project/pull/1211
• Bump google photos client version by @incjo in https://github.com/google/data-transfer-project/pull/1212
• Bump jszip from 3.7.1 to 3.10.1 in /client-rest by @dependabot in https://github.com/google/data-transfer-project/pull/1213
• Bump http-cache-semantics from 4.1.0 to 4.1.1 in /client-rest by @dependabot in https://github.com/google/data-transfer-project/pull/1214
• Implement inMemeoryIdempotentExecutorExtension and update loader and worker by @kateyeo in https://github.com/google/data-transfer-project/pull/1210

New Contributors

• @carrot-lion made their first contribution in https://github.com/google/data-transfer-project/pull/1206
• @KevinStrong made their first contribution in https://github.com/google/data-transfer-project/pull/1209

Full Changelog: https://github.com/google/data-transfer-project/compare/v0.4.3...v.0.4.4

What's Changed

• Updated Daybook posts importer to log bytes by @saratchebrolu in https://github.com/google/data-transfer-project/pull/1198
• Update the photo and video importers of Koofr and Backblaze to log bytes by @saratchebrolu in https://github.com/google/data-transfer-project/pull/1195

Full Changelog: https://github.com/google/data-transfer-project/compare/v0.4.2...v0.4.3

What's Changed

• Updated SocialActivityAttachment and SocialActivityModel classes to implement ImportableItem class by @saratchebrolu in https://github.com/google/data-transfer-project/pull/1197

Full Changelog: https://github.com/google/data-transfer-project/compare/v0.4.1...v0.4.2

What's Changed

• Add de- and serialisation for blobby container resource by @xokker in https://github.com/google/data-transfer-project/pull/1180

Full Changelog: https://github.com/google/data-transfer-project/compare/v0.4.0...v0.4.1