[jira] Created: (CAMEL-354) add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] Created: (CAMEL-354) add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP

JIRA jira@apache.org
add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP
---------------------------------------------------------------------------------------------------------------------------------------------

                 Key: CAMEL-354
                 URL: https://issues.apache.org/activemq/browse/CAMEL-354
             Project: Apache Camel
          Issue Type: New Feature
            Reporter: James Strachan


For example, define a DataSet of 10,000,000 messages and be able to send them to some endpoint and assert that they are all received by another endpoint...

{code}
from("dataset:foo").to("activemq:SomeQueue");

// lets assert that the data set is received again
from("activemq:SomeQueue").to("dataset:foo");
{code}



--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-354) add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP

JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=41512#action_41512 ]

James Strachan commented on CAMEL-354:
--------------------------------------

Documentation is here : http://cwiki.apache.org/CAMEL/dataset.html

> add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CAMEL-354
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-354
>             Project: Apache Camel
>          Issue Type: New Feature
>            Reporter: James Strachan
>
> For example, define a DataSet of 10,000,000 messages and be able to send them to some endpoint and assert that they are all received by another endpoint...
> {code}
> from("dataset:foo").to("activemq:SomeQueue");
> // lets assert that the data set is received again
> from("activemq:SomeQueue").to("dataset:foo");
> {code}

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-354) add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=41513#action_41513 ]

Magnus Heino commented on CAMEL-354:
------------------------------------

Please add info about since what version or camel features are available in the wiki.

> add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CAMEL-354
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-354
>             Project: Apache Camel
>          Issue Type: New Feature
>            Reporter: James Strachan
>
> For example, define a DataSet of 10,000,000 messages and be able to send them to some endpoint and assert that they are all received by another endpoint...
> {code}
> from("dataset:foo").to("activemq:SomeQueue");
> // lets assert that the data set is received again
> from("activemq:SomeQueue").to("dataset:foo");
> {code}

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-354) add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=41516#action_41516 ]

Claus Ibsen commented on CAMEL-354:
-----------------------------------

The surce code sample (spring config) uses 10000 in size but the documentation text said 10 mio. Would be nice to align these numbers, eg change the text to 10000.

> add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CAMEL-354
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-354
>             Project: Apache Camel
>          Issue Type: New Feature
>            Reporter: James Strachan
>
> For example, define a DataSet of 10,000,000 messages and be able to send them to some endpoint and assert that they are all received by another endpoint...
> {code}
> from("dataset:foo").to("activemq:SomeQueue");
> // lets assert that the data set is received again
> from("activemq:SomeQueue").to("dataset:foo");
> {code}

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-354) add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=41523#action_41523 ]

James Strachan commented on CAMEL-354:
--------------------------------------

Thanks for your comments guys - I've updated the wiki page to reflect your comments - let me know what you think...

http://cwiki.apache.org/CAMEL/dataset.html


> add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CAMEL-354
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-354
>             Project: Apache Camel
>          Issue Type: New Feature
>            Reporter: James Strachan
>
> For example, define a DataSet of 10,000,000 messages and be able to send them to some endpoint and assert that they are all received by another endpoint...
> {code}
> from("dataset:foo").to("activemq:SomeQueue");
> // lets assert that the data set is received again
> from("activemq:SomeQueue").to("dataset:foo");
> {code}

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-354) add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=41527#action_41527 ]

Claus Ibsen commented on CAMEL-354:
-----------------------------------

I think that the example on the wiki page doesn't clearly state how this magic test is performed.

- Does it test that the message are received in the same order?
- Is it using a single thread to send the message or can you set concurrent users
- The reporting, is it timing only the executed time to consume the message or also the sending part?
- Could the wiki also have a sample of the logging reporting - (help as eye candy)

And for features. Maybe the recent added code for delay could be improved to allow random delay. JMeter and SoapUI have features for randomizing sending with
- constant offset
- random delay
that can be combined.


> add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CAMEL-354
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-354
>             Project: Apache Camel
>          Issue Type: New Feature
>            Reporter: James Strachan
>
> For example, define a DataSet of 10,000,000 messages and be able to send them to some endpoint and assert that they are all received by another endpoint...
> {code}
> from("dataset:foo").to("activemq:SomeQueue");
> // lets assert that the data set is received again
> from("activemq:SomeQueue").to("dataset:foo");
> {code}

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-354) add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=41598#action_41598 ]

James Strachan commented on CAMEL-354:
--------------------------------------

* yes its testing that the messages are received in the same order (we don't yet support out-of-order messages, but am hopefully gonna add that soon, so we could use concurrent consumers)
* currently the test is using single thread to send and consume; ideally we'd have a way to do concurrent sending & consumption
* yes, just sending right now; we could patch the code to report the sending time too I guess?
* yeah, good idea

Also love the idea for randomizing the delay. We should have a plugin for 'delay' we can use in each side - anyone fancy submitting patch? :)

> add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CAMEL-354
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-354
>             Project: Apache Camel
>          Issue Type: New Feature
>            Reporter: James Strachan
>
> For example, define a DataSet of 10,000,000 messages and be able to send them to some endpoint and assert that they are all received by another endpoint...
> {code}
> from("dataset:foo").to("activemq:SomeQueue");
> // lets assert that the data set is received again
> from("activemq:SomeQueue").to("dataset:foo");
> {code}

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Resolved: (CAMEL-354) add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

     [ https://issues.apache.org/activemq/browse/CAMEL-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

James Strachan resolved CAMEL-354.
----------------------------------

    Fix Version/s: 1.3.0
       Resolution: Fixed

I've spun up a separate issue CAMEL-405 for future improvements

> add a simple DataSet concept so that its easy to define small or large data sets of messages that can be used for soak or load testing of EIP
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CAMEL-354
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-354
>             Project: Apache Camel
>          Issue Type: New Feature
>            Reporter: James Strachan
>             Fix For: 1.3.0
>
>
> For example, define a DataSet of 10,000,000 messages and be able to send them to some endpoint and assert that they are all received by another endpoint...
> {code}
> from("dataset:foo").to("activemq:SomeQueue");
> // lets assert that the data set is received again
> from("activemq:SomeQueue").to("dataset:foo");
> {code}

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.