-
Notifications
You must be signed in to change notification settings - Fork 231
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add java-storage implementation for get buckets and object methods. #1089
Add java-storage implementation for get buckets and object methods. #1089
Conversation
ca8fb72
to
a008e09
Compare
/gcbrun |
ca026c4
to
b7dbda6
Compare
/gcbrun |
4a90385
to
61d196b
Compare
/gcbrun |
61d196b
to
b118ae1
Compare
/gcbrun |
return new ArrayList<>(); | ||
} | ||
|
||
Map<StorageResourceId, GoogleCloudStorageItemInfo> itemInfos = new ConcurrentHashMap<>(); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: we can consider setting the capacity since it is known.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
"Somehow missing resourceId '%s' from map: %s", | ||
resourceId, | ||
itemInfos); | ||
sortedItemInfos.add(itemInfos.get(resourceId)); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What will happen if getting this resourceId failed? it will not be present in the map, correct?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In cases where fetching the resource failed, the exceptions will be added as part of innerExceptions
https://github.com/GoogleCloudDataproc/hadoop-connectors/pull/1089/files/b118ae14967f9a6299f10c87e6b8ee24b17787ec#diff-23a518b24b3819c111aacec5ec168906787ef291585a52e128c1ce776b8ed0fbR601 and these lines wont be executed.
b118ae1
to
b5080d8
Compare
/gcbrun |
b5080d8
to
9c5da9f
Compare
/gcbrun |
// Blob field that are used in GoogleCloudStorageItemInfo. | ||
static final List<BlobField> BLOB_FIELDS = | ||
ImmutableList.of( | ||
BlobField.BUCKET, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nit: Consider keeping this sorted.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
/gcbrun |
1dbc1ea
to
d0b3cd4
Compare
d0b3cd4
to
864a686
Compare
/gcbrun |
No description provided.