Unable to upload 2G files

Hey there,
We installed cumulusclips and configured it to accept files up to 4G, also changed php.ini max post size to 25G and max execution time to 6000 seconds.

We are unable to see logs in dashboard. We can't see it even if we enable logging on System > Video.

Also unable to upload 2G files yet we can successfully upload files at 40M.

Any ideas where we went wrong?

Comments

  • I get 500 error without any other messages.
    "POST /ajax/upload/ HTTP/1.1" 500 440
  • Try increasing the post body size in Apache. Add one of these to your Apache comfig depending on which setup you have:

    Apache: LimitRequestBody 104857600
    Ngnix: client_max_body_size 1m
    Apache mod_cgi: MaxRequestLen 104857600
    Apache mod_fcgid: FcgiMaxRequestLen 104857600

    Restart Apache and try again.
  • Thanks for the reply. Now we can upload other bigger files (200M, 370M, 590M or even 1G!) which was having errors, yet we are still unable to upload that 2G file of ours (tried with 2 different video to check if it's caused by any other codec-related issues)

    I put LimitRequestBody parameter into a seperate file then included it as a regular config file and system started working normally.

    Where else I should check? Or is there any chance to get detailed log to see where process gets broken (codec, etc.) ?

    Thank you very much.
  • I don't think your video is making that far into the transcoding process. If it was, you would see logs in /cc-core/logs and in the admin panel detailing the issues.

    Your request is failing before that, most likely at the Apache or PHP level. Check your Apache error and access logs, in REHL it would be in /var/log/httpd/. Increase the memory limit in your php.ini too for good measure.
  • I guess you're right, cumulusclips doesn't even starting process the video.

    I increased every upload size, execution time level I know.
    I went through my configuration files like 5 times. I guess I should have to take a detailed look again tomorrow with a clear mind.

    Thank you again. I'll post an update once i figure out what i was doing wrong.
  • Well, I couldn't find what the heck is going on... I checked every single line of configs.
    I changed my loglevel to info yet my log files doesn't give me much information. I am speechless here.

    I'll try using nginx soon just to see if that works.


    ==> ssl_access_log <==
    IP_ADDRESS - - [14/Jul/2017:18:35:21 +0300] "POST /ajax/upload/ HTTP/1.1" 500 440

    ==> ssl_request_log <==
    [14/Jul/2017:18:35:21 +0300] IP_ADDRESS TLSv1.2 ECDHE-RSA-AES128-GCM-SHA256 "POST /ajax/upload/ HTTP/1.1" 440

    ==> ssl_error_log <==
    [Fri Jul 14 18:41:19 2017] [info] [client IP_ADDRESS] Connection closed to child 7 with standard shutdown (server video.iyzico.net:443)
  • Are you using PHP-FPM? If so, the config for the FPM sometimes declares different locations for error logs. Also are there any error logs defined in any of the Apache config or vhosts config files?

    Was the snippet from above from your access or error log, or a manual combination of both? Sometimes the file is named error_log vs error.log.

    I'm sure we can help you fix what the problem is, we just need to find out what the exact error you're getting is.
  • edited July 17
    Hey there,

    No, I'm not using php-fpm, not even installed on my system.
    There are only 2 ErrorLog directive in my all config (I "grep"ped to be sure as I don't trust my eyes anymore).

    I'm using SSL so my related virtual host configuration includes this line:
    ErrorLog logs/ssl_error_log

    I also have these log configs in my conf files:

    CustomLog logs/access_log combined
    TransferLog logs/ssl_access_log
    ErrorLog logs/error_log (this one is empty as my site is using SSL and write into ssl_error_log)

    I also set LogLevel to info to see anything that might be handy (should I set debug?).
    Or should I change my server to Nginx maybe?

    Is there a chance that somewhere in CumulusClips source code error have supressed?
    Here's the detailed log of the process. From beginning to the error.


    ==> /var/log/httpd/ssl_error_log <==
    [Mon Jul 17 15:33:13 2017] [info] [client CLIENT_IP] Connection to child 2 established (server MY_DOMAIN:443)
    [Mon Jul 17 15:33:13 2017] [info] Seeding PRNG with 144 bytes of entropy
    [Mon Jul 17 15:33:13 2017] [info] Initial (No.1) HTTPS request received for child 2 (server MY_DOMAIN:443)

    ==> /var/log/httpd/ssl_access_log <==
    CLIENT_IP - - [17/Jul/2017:15:33:13 +0300] "POST /ajax/upload/ HTTP/1.1" 500 440

    ==> /var/log/httpd/ssl_error_log <==
    [Mon Jul 17 15:38:59 2017] [info] [client CLIENT_IP] Connection closed to child 2 with standard shutdown (server MY_DOMAIN:443)


    I also get this response from /upload:
    {"result":false,"message":"Errors were encountered during the processing of your file, and it cannot be uploaded at this time. We apologize for this inconvenience. Our support team has been notified and will investigate into the cause and fix for this issue. If you continue to experience problems using this feature please <a href=\"https:\/\/MY_DOMAIN/contact\/\">contact us<\/a> for further assistance.","data":null,"other":null}

    I also went ahead and attached my configuration files as a last effort. I'd be happy if you be so kind and take a look into them:
    https://drive.google.com/open?id=0BxuVaw6FUyILNFo0azFWbldfLUk

    Many thanks!
    txt
    txt
    php.ini.txt
    3K
    txt
    txt
    httpd.conf.txt
    7K
  • That JSON response you posted means the request actually made it to the upload handler. When it fails there, it fires off an email to the admin with the reason the error occurred, see /cc-core/controllers/ajax/upload.php line 79 & 121. Check your admin email defined in the admin panel for the email that was sent out.

    Other things to note.

    - Disable SELinux if it is enabled
    - Ensure there is enough disk space available to accommodate your uploaded video
Sign In or Register to comment.