Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Add Custom Part Metadata Decorator to ParallelCompositeUploadConfig #2434

Merged
merged 24 commits into from
Mar 15, 2024
Merged

feat: Add Custom Part Metadata Decorator to ParallelCompositeUploadConfig #2434

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
33122ad
feat: Custom Time Part Metadata Strategy
sydney-munro Mar 4, 2024
fe168d6
set customtime directly instead of via metadata builder
sydney-munro Mar 4, 2024
d14d141
lint and change null to IllegalStateException
sydney-munro Mar 4, 2024
9f12759
Add in version to javadoc
sydney-munro Mar 5, 2024
71ec5cf
removing unnecessary override
sydney-munro Mar 5, 2024
8b64aa6
removing unnecessary tag
sydney-munro Mar 5, 2024
15a29dc
address pr comments
sydney-munro Mar 13, 2024
b1bc015
add in ability to set a specific clock
sydney-munro Mar 13, 2024
19297a0
chore: refactor and separate lifecycle of config from customer and wh…
BenWhitehead Mar 13, 2024
4a51be1
chore: add pool size validation
BenWhitehead Mar 13, 2024
2a98f6c
IT test to ensure customtime is updated
sydney-munro Mar 14, 2024
746b581
lint
sydney-munro Mar 14, 2024
4acfa8c
Adding in more tests
sydney-munro Mar 14, 2024
f4e7fa8
lint
sydney-munro Mar 14, 2024
e88574b
more tests
sydney-munro Mar 14, 2024
57597dd
lint
sydney-munro Mar 14, 2024
80c747d
add missing null check
sydney-munro Mar 14, 2024
2adc0e5
address pr comments
sydney-munro Mar 14, 2024
6678349
unit test for offset calculations
sydney-munro Mar 15, 2024
7d39672
fixing docs
sydney-munro Mar 15, 2024
f7c4358
lint
sydney-munro Mar 15, 2024
6762593
Update google-cloud-storage/src/main/java/com/google/cloud/storage/Pa…
sydney-munro Mar 15, 2024
4f51449
Apply suggestions from code review
sydney-munro Mar 15, 2024
4861c85
lint
sydney-munro Mar 15, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
Prev Previous commit
Next Next commit
lint
  • Loading branch information
@sydney-munro
sydney-munro committed Mar 15, 2024
commit 746b5815d78c6a79bedeb23bb53113f02b1bdac5
4 changes: 3 additions & 1 deletion ...src/main/java/com/google/cloud/storage/ParallelCompositeUploadBlobWriteSessionConfig.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -704,7 +704,9 @@ private static final class CustomTimeInFuture extends PartMetadataFieldDecorator
@Override
PartMetadataFieldDecoratorInstance newInstance(Clock clock) {
return builder -> {
OffsetDateTime futureTime = OffsetDateTime.from(clock.instant().plus(duration).atZone(clock.getZone()).toOffsetDateTime());
OffsetDateTime futureTime =
OffsetDateTime.from(
clock.instant().plus(duration).atZone(clock.getZone()).toOffsetDateTime());
return builder.setCustomTimeOffsetDateTime(futureTime);
};
}
Expand Down
11 changes: 3 additions & 8 deletions ...java/com/google/cloud/storage/it/ITParallelCompositeUploadBlobWriteSessionConfigTest.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,10 +69,7 @@
import org.junit.Before;
import org.junit.BeforeClass;
import org.junit.Test;
import org.junit.rules.TestRule;
import org.junit.runner.Description;
import org.junit.runner.RunWith;
import org.junit.runners.model.Statement;

@RunWith(StorageITRunner.class)
@CrossRun(
Expand Down Expand Up @@ -116,7 +113,8 @@ public void setUp() throws Exception {
.withBufferAllocationStrategy(BufferAllocationStrategy.simple(_1MiB))
.withPartNamingStrategy(PartNamingStrategy.prefix("prefix-a"))
// Write customTime 30 seconds in the future
.withPartMetadataFieldDecorator(PartMetadataFieldDecorator.setCustomTimeInFuture(Duration.ofSeconds(30)))
.withPartMetadataFieldDecorator(
PartMetadataFieldDecorator.setCustomTimeInFuture(Duration.ofSeconds(30)))
// let our fixtures take care of cleaning things
.withPartCleanupStrategy(PartCleanupStrategy.never());

Expand Down Expand Up @@ -151,10 +149,7 @@ public static void afterClass() {
@Test
public void partFilesCreatedWithCustomTimeWritten() throws IOException {
doTest(bucket, 10 * _1MiB + 37, ImmutableList.of(), ImmutableList.of(), ImmutableList.of());
Page<Blob> blobs =
storage.list(
bucket.getName(),
Storage.BlobListOption.prefix("prefix-a"));
Page<Blob> blobs = storage.list(bucket.getName(), Storage.BlobListOption.prefix("prefix-a"));
for (Blob blob : blobs.iterateAll()) {
assertThat(blob.getCustomTimeOffsetDateTime()).isNotNull();
}
Expand Down