I have a problem about writing a test to upload Image in Amazon s3 in Spring Boot. I tried to write its test method but I got an error shown below. How can I fix it? Here is the method of Rest controller Here is the method of imageService. Here is the test method shown below. Here is the error
Tag: amazon-s3
Uploading json content on s3 using presigned url – gzipped
On the backend i’m generating a presigned url to upload a json object to an s3 bucket. I want the body actual json to be compressed. This is what i’m doing in the backend: Now, in postman, I manually add the content-encoding: gzip header and the file gets uploaded Issues: 1. If i go to the aws con…
Newest version Postman creating different signature for AWS access compared to my java algorithm
So I’ve created the java algorithm for AWS signature creation, following the guidelines of AWS >https://docs.aws.amazon.com/AmazonS3/latest/API/sig-v4-header-based-auth.html The algorithm is available on my github >https://github.com/marcodag/aws_signature_creation/blob/main/SignatureCreation.java…
S3 bucket given name versus physical name Cloudformation
I created a bucket with name “my-bucket”, cloudformation creates it as “StackName-my-bucket-{random text}”. I want to read from this bucket in the java code, what would be the right way to access provided I cannot touch anything in cloudformation. Answer Assuming you cannot modify the …
AmazonsS3Client throws UnknownHostException if attempting to connect to a local service (MinIO)
In Short: Using AmazonS3Client to connect to a local instance of MinIO results in a UnknownHostException thrown because the url is resolved to http://{bucket_name}.localhost:port. Detailed description of the problem: I’m creating an integration test for a Java service that uses AmazonS3Client lib to ret…
It is possible to Stream data from beam (Scio) to an S3 bucket?
Currently, I’m working on a project which extracts data from a BigQuery table using Scio in Scala. I’m able to extract and ingest the data into ElasticSearch, but I’m trying to do the same but using an S3 bucket as storage. Certainly, I’m able to write the data into a txt file using th…
Missing data in response body
I have a web service(FastAPI) deployed on AWS EC2. In java client code, when I call the api, i got this error In postman, when I call this api, the response is returned but not enough like this image Seem the server (Fast API web service) do not return all data in response body. I already check this question,…
Error while uploading to S3 from Hadoop using s3a
I am running a java application on kubernetes which upload multiple files from local container to s3 bucket using s3a, but I am getting the below exception in logs and files are not getting uploaded to s3. Partial files are getting uploaded to s3 Answer Looks like this is a bug. problems caused by AWS SDK cla…
How to Log/ View AWS Java SDK HTTP(S) Requests
I am developing a Spring Boot Application that uses HTTPS Only. I am using AWS services and the corresponding AWS Java SDK. How can I view the HTTP(S) request that the java sdk methods call on the backend of my application? I want to make sure when doing uploads to S3, etc, that everything is done over HTTPS …
How to save/zip binary/octet-stream s3 content to zip
I am trying to add s3 bucket files into a zip. The files in the s3 bucket are in binary/octet-stream format. When I run the below method The IO Exception below is thrown when executing IOUtils.copy method “exception”: “Premature end of Content-Length delimited message body (expected: 206,034…