Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

some files randomly won't get generated. #163

Open
berkaytheunicorn opened this issue Apr 4, 2018 · 5 comments
Open

some files randomly won't get generated. #163

berkaytheunicorn opened this issue Apr 4, 2018 · 5 comments

Comments

@berkaytheunicorn
Copy link

Hi, moving the issue here from #161,

config

{
    "bucket": "untytled-test",
    "resizes": [
        {
            "size": 256,
            "suffix": "_sm",
            "quality": 90
        },
        {
            "size": "256x256^",
            "gravity": "Center",
            "crop": "256x256",
            "suffix": "_sm_sq",
            "quality": 90
        },
        {
            "size": 512,
            "suffix": "_md",
            "quality": 90
        },
        {
            "size": "512x512^",
            "gravity": "Center",
            "crop": "512x512",
            "suffix": "_md_sq",
            "quality": 90
        },
        {
            "size": 1024,
            "quality": 90,
            "suffix": "_lg"
        },
        {
            "size": "1024x1024^",
            "gravity": "Center",
            "crop": "1024x1024",
            "suffix": "_lg_sq",
            "quality": 90
        },
        {
            "size": 1440,
            "quality": 90,
            "suffix": "_xl"
        }
    ]
}

While resizing I can watch logs from CloudWatch and very randomly stops;

for example;

a 2560x1440 file stops at _lg
a 3360x2100 file stops at _md_sq

@berkaytheunicorn
Copy link
Author

BTW, some files just resized perfectly.

@berkaytheunicorn
Copy link
Author

hmm partly my bad. some of them just timed out. I was set to 20 sec. (I don't know if it is normal though) but one of them gives this error

    "errorMessage": "Error processing logo-transparent.png: Error: Stream yields empty buffer"
}

file:
logo-transparent

@berkaytheunicorn
Copy link
Author

on that file nothing generated.

@ysugimoto
Copy link
Owner

I suspect that once script gets an image from S3, all resize/reduce is processed on the fly so any processing binary buffers will be allocated on that process, then some resize/reduce process might not work unexpectedly.

Well, I'll plan to use temporary file while processing, but I'm not sure it solves the issue.

@jplarar
Copy link

jplarar commented Jun 27, 2018

For me on some png files it was the timeout, try increasing it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants