Nexus Repo 3.29.2-02 - proxy “OutOfDirectMemoryError”

post by peppe1977 on Mar 10, 2021

Pedro Ivo Popelier Salomao

peppe1977

nexus is running on K8S/1.18 and has/uses external EBS volumes.

After we upgraded to 3.29.2-02, we started to experience intermittent connectivity problems towards nexus (runners throws: server does not respond - when trying to publish to nexus/maven). It is random and not the same artifact. we have been troubleshooting trying to reduce search domain as to isolate the problem and just few minutes ago we had 2 occurrences of the problem and around same time - came across below nexus-proxy errors. we want some guidance/recommendation wrt understand why proxy is starving and more importantly what is recommended settings to alleviate this problem? increasing memory allocated? interesting to not that on the older version (3.23 I want to say) we used to have - we had less than what is below listed and did not come across this problem.

btw: this is what is passed to nexus via env variable → install4jAddVmParams: -Xms3072M -Xmx3072M -XX:MaxDirectMemorySize=6G -XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap

log below

    nexus-0 nexus-proxy 2021-03-10 06:11:03,488 [ERROR] [vert.x-eventloop-thread-0] [io.vertx.core.net.impl.ConnectionBase] io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658279, max: 259522560)
    nexus-0 nexus-proxy 2021-03-10 06:11:03,883 [ERROR] [vert.x-eventloop-thread-0] [io.vertx.core.net.impl.ConnectionBase] io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658279, max: 259522560)
    nexus-0 nexus-proxy 2021-03-10 06:11:03,883 [ERROR] [vert.x-eventloop-thread-0] [io.vertx.core.http.impl.HttpClientRequestImpl] io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658279, max: 259522560)
    nexus-0 nexus-proxy 2021-03-10 06:11:05,919 [ERROR] [vert.x-eventloop-thread-0] [io.vertx.core.net.impl.ConnectionBase] io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658279, max: 259522560)
    nexus-0 nexus-proxy 2021-03-10 06:11:05,919 [ERROR] [vert.x-eventloop-thread-0] [io.vertx.core.http.impl.HttpClientRequestImpl] io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658279, max: 259522560)
    nexus-0 nexus-proxy 2021-03-10 06:13:31,155 [ERROR] [vert.x-eventloop-thread-0] [io.vertx.core.net.impl.ConnectionBase] io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658279, max: 259522560)
    nexus-0 nexus-proxy 2021-03-10 06:13:31,193 [ERROR] [vert.x-eventloop-thread-0] [io.vertx.core.net.impl.ConnectionBase] io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658279, max: 259522560)
    nexus-proxy 2021-03-10 06:13:31,193 [ERROR] [vert.x-eventloop-thread-0] [io.vertx.core.http.impl.HttpClientRequestImpl] io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658279, max: 259522560)
    nexus-0 nexus-proxy 2021-03-10 06:28:39,573 [ERROR] [vert.x-eventloop-thread-0] [io.vertx.core.net.impl.ConnectionBase] io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658279, max: 259522560)

706 views

New & Unread Topics