feat: add validation bucket

[codeflyer]

This pr refers to: #97

Add a new bucket for the validation.
Pickup store the file in a vavlidation bucket. The CAR is validated then, if is valid, moved to the final Bucket.

[seed-deploy]

View stack outputs

• pr98-pickup-BasicApiStack

  Name	Value
  ApiEndpoint	https://9ltdppfoc5.execute-api.us-west-2.amazonaws.com
  CustomDomain	https://pr98.pickup.dag.haus
  S3EventsTopicARN	arn:aws:sns:us-west-2:505595374361:pr98-pickup-S3Events

• pr98-pickup-PickupStack

  Name	Value
  ServiceSQSQueue88C16836	pr98-pickup-Pin
  ServiceSQSQueueArnDDC422AE	arn:aws:sqs:us-west-2:505595374361:pr98-pickup-Pin

[seed-deploy]

Stack outputs updated

• pr98-pickup-BasicApiStack

  Name	Value
  ApiEndpoint	https://9ltdppfoc5.execute-api.us-west-2.amazonaws.com
  CustomDomain	https://pr98.pickup.dag.haus
  S3EventsTopicARN	arn:aws:sns:us-west-2:505595374361:pr98-pickup-S3Events

• pr98-pickup-PickupStack

  Name	Value
  ServiceSQSQueue88C16836	pr98-pickup-Pin
  ServiceSQSQueueArnDDC422AE	arn:aws:sqs:us-west-2:505595374361:pr98-pickup-Pin
  ServiceValidatorSQSQueue5667BEDA	pr98-pickup-ValidationPinQueue
  ServiceValidatorSQSQueueArnCF57A57B	arn:aws:sqs:us-west-2:505595374361:pr98-pickup-ValidationPinQueue

[github-actions]

package-lock.json changes

Summary

Status	Count
	4
	72

Click to toggle table visibility

Name	Status	Previous	Current
@ipld/dag-json		-	8.0.11
ansi-term		0.0.2	-
ansicolors		0.2.1	-
assert-plus		1.0.0	-
asynckit		0.4.0	-
aws-sign2		0.7.0	-
aws4		1.12.0	-
blessed-contrib		2.5.3	-
blessed		0.1.81	-
bresenham		0.0.3	-
buffers		0.1.1	-
cardinal		1.0.0	-
caseless		0.12.0	-
charm		0.1.2	-
cli-table		0.3.11	-
climem		1.0.3	-
colors		1.0.3	-
combined-stream		1.0.8	-
dashdash		1.14.1	-
delayed-stream		1.0.0	-
drawille-blessed-contrib		1.0.0	-
drawille-canvas-blessed-contrib		0.1.3	-
ecc-jsbn		0.1.2	-
event-stream		0.9.8	-
eventemitter3		4.0.7	-
extend		3.0.2	-
extsprintf		1.3.0	-
flush-write-stream		1.1.1	-
forever-agent		0.6.1	-
form-data		2.3.3	-
from2		2.3.0	-
getpass		0.1.7	-
gl-matrix		2.8.1	-
har-schema		2.0.0	-
har-validator		5.1.5	-
has-ansi		2.0.0	-
here		0.0.2	-
http-signature		1.2.0	-
is-typedarray		1.0.0	-
isstream		0.1.2	-
it-merge		2.0.0	-
it-parallel		3.0.0	-
it-pushable		3.1.2	-
it-stream-types		1.0.5	-
jsbn		0.1.1	-
json-schema		0.4.0	-
jsprim		1.4.2	-
linkdex		-	2.0.0
lodash.assign		4.2.0	-
map-canvas		0.1.5	-
marked-terminal		1.7.0	-
marked		0.3.19	-
memory-streams		0.1.3	-
memorystream		0.3.1	-
mri		-	1.2.0
node-emoji		1.11.0	-
oauth-sign		0.9.0	-
optimist		0.3.7	-
p-queue		7.3.0	-
performance-now		2.1.0	-
picture-tube		0.0.4	-
png-js		0.1.1	-
psl		1.9.0	-
redeyed		1.0.1	-
request		2.88.2	-
sade		-	1.8.1
sparkline		0.1.2	-
sshpk		1.17.0	-
term-canvas		0.0.5	-
through2		2.0.5	-
tough-cookie		2.5.0	-
tunnel-agent		0.6.0	-
verror		1.10.0	-
wordwrap		0.0.3	-
x256		0.0.2	-
xtend		4.0.2	-

[olizilla]

We only need to iterate the blocks of the car and let linkdex tell us if the dag is complete. The other checks are redundant here as kubo has already verified each block as it reads it from the blockstore... (the old api code this is taken from has to do more checks as it is not running an ipfs node, and has to verify CARs sent over http from the wild)

[olizilla]

we don't need to do the all the same validation that the api does here... kubo has done most of this for us already. We really only need to detect CAR truncation here.