Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tilesets cli aborts connection with api on large source data uploads #31

Closed
dnomadb opened this issue Oct 11, 2019 · 5 comments
Closed

Tilesets cli aborts connection with api on large source data uploads #31

dnomadb opened this issue Oct 11, 2019 · 5 comments
Assignees
@Gerdie
Labels
bug Something isn't working loe 2 p1

Comments

@dnomadb
Copy link
Contributor

dnomadb commented Oct 11, 2019 

requests.exceptions.ConnectionError: ('Connection aborted.', BrokenPipeError(32, 'Broken pipe'))
@JamesChevalier
Copy link

I'm seeing a fair amount of these, as well as Connection reset by peer errors.

My workflow is iterating over 357 users and generating two tilesets for each user (public vs private data). I'm only about a third of the way through, and I've seen it fail for about 20 users.

I'd be happy to provide more info if you need it.

@dnomadb dnomadb added the bug Something isn't working label Jan 13, 2020
@vartikaz vartikaz added the loe 2 label Jan 13, 2020
@Gerdie
Copy link
Contributor

Gerdie commented Jan 16, 2020

possibly related:

@cmtoomey
Copy link
Contributor

I observed a similar error

string longer than N bytes

image

@dnomadb
Copy link
Contributor Author

dnomadb commented Jan 21, 2020

string longer than N bytes

This is likely due to the way we are reading input into a memory file for upload.

@vartikaz vartikaz added the p0 label Jan 27, 2020
@vartikaz vartikaz assigned Gerdie and unassigned dnomadb Jan 27, 2020
@brsbl brsbl added p1 and removed p0 labels Feb 4, 2020
@Gerdie Gerdie mentioned this issue Feb 6, 2020
Merged
@Gerdie
Copy link
Contributor

Gerdie commented Feb 26, 2020

This has been improved in 0.3.4 -- if you are still seeing errors here, please open a new issue and note the size of the file you're uploading.

@Gerdie Gerdie closed this as completed Feb 26, 2020
@CarlosMecha CarlosMecha changed the title tilesets cli aborts connection with api on large source data uploads [SOURCES] Tilesets cli aborts connection with api on large source data uploads Apr 23, 2020
@CarlosMecha CarlosMecha changed the title [SOURCES] Tilesets cli aborts connection with api on large source data uploads Tilesets cli aborts connection with api on large source data uploads Apr 28, 2020
@theprojectsomething theprojectsomething mentioned this issue Jun 23, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Gerdie Gerdie

Labels
bug Something isn't working loe 2 p1
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
7 participants
@JamesChevalier @vartikaz @CarlosMecha @dnomadb @Gerdie @cmtoomey @brsbl