issues by building the camel-cassandraql component

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

issues by building the camel-cassandraql component

Christian Mueller
Administrator
I have issues by building the camel-cassandraql component:

mvn clean install -Psourcecheck -rf :camel-cassandraql
...
java.lang.OutOfMemoryError: unable to create new native thread
    at java.lang.Thread.start0(Native Method)
    at java.lang.Thread.start(Thread.java:714)
    at
org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
    at
org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
    at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:125)
java.lang.OutOfMemoryError: unable to create new native thread
    at java.lang.Thread.start0(Native Method)
    at java.lang.Thread.start(Thread.java:714)
    at
org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
    at
org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
    at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:133)


My env:
Christians-MBP:camel cmueller$ mvn -v
Apache Maven 3.2.5 (12a6b3acb947671f09b81f49094c53f426d8cea1;
2014-12-14T18:29:23+01:00)
Maven home: /Applications/apache-maven-3.2.5
Java version: 1.7.0_75, vendor: Oracle Corporation
Java home:
/Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"


My Maven options:
-Xmx2048m -XX:MaxPermSize=512m


Any ideas?

Thanks in advance,
Christian
-----------------

Software Integration Specialist

Apache Member
V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
Apache Incubator PMC Member

https://www.linkedin.com/pub/christian-mueller/11/551/642
Reply | Threaded
Open this post in threaded view
|

Re: issues by building the camel-cassandraql component

Claus Ibsen-2
Hi

I use mvn options

MAVEN_OPTS="-Xmx2048m -XX:MaxPermSize=1024m"

On Thu, Apr 23, 2015 at 11:35 PM, Christian Müller
<[hidden email]> wrote:

> I have issues by building the camel-cassandraql component:
>
> mvn clean install -Psourcecheck -rf :camel-cassandraql
> ...
> java.lang.OutOfMemoryError: unable to create new native thread
>     at java.lang.Thread.start0(Native Method)
>     at java.lang.Thread.start(Thread.java:714)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:125)
> java.lang.OutOfMemoryError: unable to create new native thread
>     at java.lang.Thread.start0(Native Method)
>     at java.lang.Thread.start(Thread.java:714)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:133)
>
>
> My env:
> Christians-MBP:camel cmueller$ mvn -v
> Apache Maven 3.2.5 (12a6b3acb947671f09b81f49094c53f426d8cea1;
> 2014-12-14T18:29:23+01:00)
> Maven home: /Applications/apache-maven-3.2.5
> Java version: 1.7.0_75, vendor: Oracle Corporation
> Java home:
> /Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
>
>
> My Maven options:
> -Xmx2048m -XX:MaxPermSize=512m
>
>
> Any ideas?
>
> Thanks in advance,
> Christian
> -----------------
>
> Software Integration Specialist
>
> Apache Member
> V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
> Apache Incubator PMC Member
>
> https://www.linkedin.com/pub/christian-mueller/11/551/642



--
Claus Ibsen
-----------------
Red Hat, Inc.
Email: [hidden email]
Twitter: davsclaus
Blog: http://davsclaus.com
Author of Camel in Action: http://www.manning.com/ibsen
hawtio: http://hawt.io/
fabric8: http://fabric8.io/
Reply | Threaded
Open this post in threaded view
|

Re: issues by building the camel-cassandraql component

Christian Mueller
Administrator
I still get the OOM exceptions. Any other difference to my
system/configuration?

Best,

Christian
-----------------

Software Integration Specialist

Apache Member
V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
Apache Incubator PMC Member

https://www.linkedin.com/pub/christian-mueller/11/551/642

On Fri, Apr 24, 2015 at 7:22 AM, Claus Ibsen <[hidden email]> wrote:

> Hi
>
> I use mvn options
>
> MAVEN_OPTS="-Xmx2048m -XX:MaxPermSize=1024m"
>
> On Thu, Apr 23, 2015 at 11:35 PM, Christian Müller
> <[hidden email]> wrote:
> > I have issues by building the camel-cassandraql component:
> >
> > mvn clean install -Psourcecheck -rf :camel-cassandraql
> > ...
> > java.lang.OutOfMemoryError: unable to create new native thread
> >     at java.lang.Thread.start0(Native Method)
> >     at java.lang.Thread.start(Thread.java:714)
> >     at
> >
> org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
> >     at
> > org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
> >     at
> > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:125)
> > java.lang.OutOfMemoryError: unable to create new native thread
> >     at java.lang.Thread.start0(Native Method)
> >     at java.lang.Thread.start(Thread.java:714)
> >     at
> >
> org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
> >     at
> > org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
> >     at
> > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:133)
> >
> >
> > My env:
> > Christians-MBP:camel cmueller$ mvn -v
> > Apache Maven 3.2.5 (12a6b3acb947671f09b81f49094c53f426d8cea1;
> > 2014-12-14T18:29:23+01:00)
> > Maven home: /Applications/apache-maven-3.2.5
> > Java version: 1.7.0_75, vendor: Oracle Corporation
> > Java home:
> > /Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre
> > Default locale: en_US, platform encoding: UTF-8
> > OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
> >
> >
> > My Maven options:
> > -Xmx2048m -XX:MaxPermSize=512m
> >
> >
> > Any ideas?
> >
> > Thanks in advance,
> > Christian
> > -----------------
> >
> > Software Integration Specialist
> >
> > Apache Member
> > V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
> > Apache Incubator PMC Member
> >
> > https://www.linkedin.com/pub/christian-mueller/11/551/642
>
>
>
> --
> Claus Ibsen
> -----------------
> Red Hat, Inc.
> Email: [hidden email]
> Twitter: davsclaus
> Blog: http://davsclaus.com
> Author of Camel in Action: http://www.manning.com/ibsen
> hawtio: http://hawt.io/
> fabric8: http://fabric8.io/
>
Reply | Threaded
Open this post in threaded view
|

Re: issues by building the camel-cassandraql component

Claus Ibsen-2
Hi

Not really I am on an older java version

davsclaus:~/workspace/hawtio (master)/$ mvn -version
Apache Maven 3.2.5 (12a6b3acb947671f09b81f49094c53f426d8cea1;
2014-12-14T18:29:23+01:00)
Maven home: /opt/apache-maven-3.2.5
Java version: 1.7.0_45, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.7.0_45.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.9.5", arch: "x86_64", family: "mac"





On Fri, Apr 24, 2015 at 11:02 PM, Christian Müller
<[hidden email]> wrote:

> I still get the OOM exceptions. Any other difference to my
> system/configuration?
>
> Best,
>
> Christian
> -----------------
>
> Software Integration Specialist
>
> Apache Member
> V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
> Apache Incubator PMC Member
>
> https://www.linkedin.com/pub/christian-mueller/11/551/642
>
> On Fri, Apr 24, 2015 at 7:22 AM, Claus Ibsen <[hidden email]> wrote:
>
>> Hi
>>
>> I use mvn options
>>
>> MAVEN_OPTS="-Xmx2048m -XX:MaxPermSize=1024m"
>>
>> On Thu, Apr 23, 2015 at 11:35 PM, Christian Müller
>> <[hidden email]> wrote:
>> > I have issues by building the camel-cassandraql component:
>> >
>> > mvn clean install -Psourcecheck -rf :camel-cassandraql
>> > ...
>> > java.lang.OutOfMemoryError: unable to create new native thread
>> >     at java.lang.Thread.start0(Native Method)
>> >     at java.lang.Thread.start(Thread.java:714)
>> >     at
>> >
>> org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
>> >     at
>> > org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
>> >     at
>> > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:125)
>> > java.lang.OutOfMemoryError: unable to create new native thread
>> >     at java.lang.Thread.start0(Native Method)
>> >     at java.lang.Thread.start(Thread.java:714)
>> >     at
>> >
>> org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
>> >     at
>> > org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
>> >     at
>> > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:133)
>> >
>> >
>> > My env:
>> > Christians-MBP:camel cmueller$ mvn -v
>> > Apache Maven 3.2.5 (12a6b3acb947671f09b81f49094c53f426d8cea1;
>> > 2014-12-14T18:29:23+01:00)
>> > Maven home: /Applications/apache-maven-3.2.5
>> > Java version: 1.7.0_75, vendor: Oracle Corporation
>> > Java home:
>> > /Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre
>> > Default locale: en_US, platform encoding: UTF-8
>> > OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
>> >
>> >
>> > My Maven options:
>> > -Xmx2048m -XX:MaxPermSize=512m
>> >
>> >
>> > Any ideas?
>> >
>> > Thanks in advance,
>> > Christian
>> > -----------------
>> >
>> > Software Integration Specialist
>> >
>> > Apache Member
>> > V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
>> > Apache Incubator PMC Member
>> >
>> > https://www.linkedin.com/pub/christian-mueller/11/551/642
>>
>>
>>
>> --
>> Claus Ibsen
>> -----------------
>> Red Hat, Inc.
>> Email: [hidden email]
>> Twitter: davsclaus
>> Blog: http://davsclaus.com
>> Author of Camel in Action: http://www.manning.com/ibsen
>> hawtio: http://hawt.io/
>> fabric8: http://fabric8.io/
>>



--
Claus Ibsen
-----------------
Red Hat, Inc.
Email: [hidden email]
Twitter: davsclaus
Blog: http://davsclaus.com
Author of Camel in Action: http://www.manning.com/ibsen
hawtio: http://hawt.io/
fabric8: http://fabric8.io/
Reply | Threaded
Open this post in threaded view
|

Re: issues by building the camel-cassandraql component

Willem.Jiang
Administrator
In reply to this post by Christian Mueller
I cannot reproduce it on my box, did you run it within a VM?

--  
Willem Jiang

Red Hat, Inc.
Web: http://www.redhat.com
Blog: http://willemjiang.blogspot.com (English)
http://jnn.iteye.com (Chinese)
Twitter: willemjiang  
Weibo: 姜宁willem



On April 25, 2015 at 5:04:21 AM, Christian Müller ([hidden email]) wrote:

> I still get the OOM exceptions. Any other difference to my
> system/configuration?
>  
> Best,
>  
> Christian
> -----------------
>  
> Software Integration Specialist
>  
> Apache Member
> V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
> Apache Incubator PMC Member
>  
> https://www.linkedin.com/pub/christian-mueller/11/551/642
>  
> On Fri, Apr 24, 2015 at 7:22 AM, Claus Ibsen wrote:
>  
> > Hi
> >
> > I use mvn options
> >
> > MAVEN_OPTS="-Xmx2048m -XX:MaxPermSize=1024m"
> >
> > On Thu, Apr 23, 2015 at 11:35 PM, Christian Müller
> > wrote:
> > > I have issues by building the camel-cassandraql component:
> > >
> > > mvn clean install -Psourcecheck -rf :camel-cassandraql
> > > ...
> > > java.lang.OutOfMemoryError: unable to create new native thread
> > > at java.lang.Thread.start0(Native Method)
> > > at java.lang.Thread.start(Thread.java:714)
> > > at
> > >
> > org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)  
> > > at
> > > org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)  
> > > at
> > > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:125)  
> > > java.lang.OutOfMemoryError: unable to create new native thread
> > > at java.lang.Thread.start0(Native Method)
> > > at java.lang.Thread.start(Thread.java:714)
> > > at
> > >
> > org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)  
> > > at
> > > org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)  
> > > at
> > > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:133)  
> > >
> > >
> > > My env:
> > > Christians-MBP:camel cmueller$ mvn -v
> > > Apache Maven 3.2.5 (12a6b3acb947671f09b81f49094c53f426d8cea1;
> > > 2014-12-14T18:29:23+01:00)
> > > Maven home: /Applications/apache-maven-3.2.5
> > > Java version: 1.7.0_75, vendor: Oracle Corporation
> > > Java home:
> > > /Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre
> > > Default locale: en_US, platform encoding: UTF-8
> > > OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
> > >
> > >
> > > My Maven options:
> > > -Xmx2048m -XX:MaxPermSize=512m
> > >
> > >
> > > Any ideas?
> > >
> > > Thanks in advance,
> > > Christian
> > > -----------------
> > >
> > > Software Integration Specialist
> > >
> > > Apache Member
> > > V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
> > > Apache Incubator PMC Member
> > >
> > > https://www.linkedin.com/pub/christian-mueller/11/551/642
> >
> >
> >
> > --
> > Claus Ibsen
> > -----------------
> > Red Hat, Inc.
> > Email: [hidden email]
> > Twitter: davsclaus
> > Blog: http://davsclaus.com
> > Author of Camel in Action: http://www.manning.com/ibsen
> > hawtio: http://hawt.io/
> > fabric8: http://fabric8.io/
> >
>  

Reply | Threaded
Open this post in threaded view
|

Re: issues by building the camel-cassandraql component

Gregor Zurowski-3
In reply to this post by Christian Mueller
Hi Christian,

I had similar issues when building camel-cassandra on a Linux box with
Java 7. Cassandra spawns a huge amount of threads when running the
component's unit tests. The problem was caused by not having enough
file descriptors available to spawn new threads. This eventually led
to the error message as described in your post.  After increasing the
number of file descriptors per user all tests completed successfully
and I was eventually able to build the component. I used the following
configuration in my limits.conf, but you may need to use other
configuration facilities on your OS X machine:

== /etc/security/limits.conf ====
* soft nofile 32768
* hard nofile 32768
root soft nofile 32768
root hard nofile 32768
[...]
========================

Hope this helps.

Gregor

On Thu, Apr 23, 2015 at 5:35 PM, Christian Müller
<[hidden email]> wrote:

> I have issues by building the camel-cassandraql component:
>
> mvn clean install -Psourcecheck -rf :camel-cassandraql
> ...
> java.lang.OutOfMemoryError: unable to create new native thread
>     at java.lang.Thread.start0(Native Method)
>     at java.lang.Thread.start(Thread.java:714)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:125)
> java.lang.OutOfMemoryError: unable to create new native thread
>     at java.lang.Thread.start0(Native Method)
>     at java.lang.Thread.start(Thread.java:714)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
>     at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:133)
>
>
> My env:
> Christians-MBP:camel cmueller$ mvn -v
> Apache Maven 3.2.5 (12a6b3acb947671f09b81f49094c53f426d8cea1;
> 2014-12-14T18:29:23+01:00)
> Maven home: /Applications/apache-maven-3.2.5
> Java version: 1.7.0_75, vendor: Oracle Corporation
> Java home:
> /Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
>
>
> My Maven options:
> -Xmx2048m -XX:MaxPermSize=512m
>
>
> Any ideas?
>
> Thanks in advance,
> Christian
> -----------------
>
> Software Integration Specialist
>
> Apache Member
> V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
> Apache Incubator PMC Member
>
> https://www.linkedin.com/pub/christian-mueller/11/551/642
Reply | Threaded
Open this post in threaded view
|

Re: issues by building the camel-cassandraql component

Christian Mueller
Administrator
Thanks Gregor, this solved the issue!

Best,
Christian
-----------------

Software Integration Specialist

Apache Member
V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
Apache Incubator PMC Member

https://www.linkedin.com/pub/christian-mueller/11/551/642

On Wed, Apr 29, 2015 at 2:27 AM, Gregor Zurowski <[hidden email]>
wrote:

> Hi Christian,
>
> I had similar issues when building camel-cassandra on a Linux box with
> Java 7. Cassandra spawns a huge amount of threads when running the
> component's unit tests. The problem was caused by not having enough
> file descriptors available to spawn new threads. This eventually led
> to the error message as described in your post.  After increasing the
> number of file descriptors per user all tests completed successfully
> and I was eventually able to build the component. I used the following
> configuration in my limits.conf, but you may need to use other
> configuration facilities on your OS X machine:
>
> == /etc/security/limits.conf ====
> * soft nofile 32768
> * hard nofile 32768
> root soft nofile 32768
> root hard nofile 32768
> [...]
> ========================
>
> Hope this helps.
>
> Gregor
>
> On Thu, Apr 23, 2015 at 5:35 PM, Christian Müller
> <[hidden email]> wrote:
> > I have issues by building the camel-cassandraql component:
> >
> > mvn clean install -Psourcecheck -rf :camel-cassandraql
> > ...
> > java.lang.OutOfMemoryError: unable to create new native thread
> >     at java.lang.Thread.start0(Native Method)
> >     at java.lang.Thread.start(Thread.java:714)
> >     at
> >
> org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
> >     at
> > org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
> >     at
> > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:125)
> > java.lang.OutOfMemoryError: unable to create new native thread
> >     at java.lang.Thread.start0(Native Method)
> >     at java.lang.Thread.start(Thread.java:714)
> >     at
> >
> org.apache.maven.surefire.booter.ForkedBooter.launchLastDitchDaemonShutdownThread(ForkedBooter.java:181)
> >     at
> > org.apache.maven.surefire.booter.ForkedBooter.exit(ForkedBooter.java:141)
> >     at
> > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:133)
> >
> >
> > My env:
> > Christians-MBP:camel cmueller$ mvn -v
> > Apache Maven 3.2.5 (12a6b3acb947671f09b81f49094c53f426d8cea1;
> > 2014-12-14T18:29:23+01:00)
> > Maven home: /Applications/apache-maven-3.2.5
> > Java version: 1.7.0_75, vendor: Oracle Corporation
> > Java home:
> > /Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre
> > Default locale: en_US, platform encoding: UTF-8
> > OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
> >
> >
> > My Maven options:
> > -Xmx2048m -XX:MaxPermSize=512m
> >
> >
> > Any ideas?
> >
> > Thanks in advance,
> > Christian
> > -----------------
> >
> > Software Integration Specialist
> >
> > Apache Member
> > V.P. Apache Camel | Apache Camel PMC Member | Apache Camel committer
> > Apache Incubator PMC Member
> >
> > https://www.linkedin.com/pub/christian-mueller/11/551/642
>