Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

tarball: Streaming image parser PoC #1429

Closed
wants to merge 10 commits into from
Closed

tarball: Streaming image parser PoC #1429

wants to merge 10 commits into from

Commits on Aug 16, 2022

  1. e2e: pull and export stdin and stdout

    @abitrolly
    abitrolly committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    076236e View commit details
    Browse the repository at this point in the history

  2. List all resulting tar files

    @abitrolly
    abitrolly committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    b0c6d9c View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2022

  1. tarball: Streaming image parser PoC 

    TarBuffered scans stream (`io.Reader`) once for filename and saves
unused sections in memory for later access. This should speedup
parsing a bit, because right now tarball is scanned several times,
and should save resources and speed for parsing well-formed images
from network.

See google#1339.
    @abitrolly
    abitrolly committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    a790e3b View commit details
    Browse the repository at this point in the history

  2. Presubmit requires comment

    @abitrolly
    abitrolly committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    f62ab3e View commit details
    Browse the repository at this point in the history

  3. Style fix

    @abitrolly
    abitrolly committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    69e7441 View commit details
    Browse the repository at this point in the history

  4. Reuse buffer for loadTarDescriptorAndConfig()

    @abitrolly
    abitrolly committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    abf6a21 View commit details
    Browse the repository at this point in the history

  5. Use scanFile() to detect if an image is compressed

    @abitrolly
    abitrolly committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    34aefce View commit details
    Browse the repository at this point in the history

  6. Improve error messages, show memory used by layer

    @abitrolly
    abitrolly committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    0f6cc5e View commit details
    Browse the repository at this point in the history

  7. Attempt to process Stdin stream directly

    @abitrolly
    abitrolly committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    36af408 View commit details
    Browse the repository at this point in the history

  8. Log img type in mutate.Extract() 

    Go subclassing with partials is rather hardcore here
    @abitrolly
    abitrolly committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    7f2ecfc View commit details
    Browse the repository at this point in the history