[jira] Created: (CAMEL-1148) Add capability to move files prior to routing messages

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] Created: (CAMEL-1148) Add capability to move files prior to routing messages

JIRA jira@apache.org
Add capability to move files prior to routing messages
------------------------------------------------------

                 Key: CAMEL-1148
                 URL: https://issues.apache.org/activemq/browse/CAMEL-1148
             Project: Apache Camel
          Issue Type: New Feature
          Components: camel-core
    Affects Versions: 1.5.0
            Reporter: Christopher Hammack


From http://www.nabble.com/Concerns-about-File-endpoint-td20802855s22882.html

I'd like to suggest that you add a "preMove" option as it seems to be pretty much a requirement for doing clustered seda-style processing from a file endpoint.

The use case for this is a very large number of small files is being dropped into a directory.  This directory is then being scanned by camel's file endpoint.  The files as they are discovered are then moved to the .camel directory, and the filename is put onto a jms endpoint.  A clustered set of camel processors then pull the filename off the endpoint and process the file, and then delete it.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Assigned: (CAMEL-1148) Add capability to move files prior to routing messages

JIRA jira@apache.org

     [ https://issues.apache.org/activemq/browse/CAMEL-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Claus Ibsen reassigned CAMEL-1148:
----------------------------------

    Assignee: Claus Ibsen

> Add capability to move files prior to routing messages
> ------------------------------------------------------
>
>                 Key: CAMEL-1148
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-1148
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.5.0
>            Reporter: Christopher Hammack
>            Assignee: Claus Ibsen
>
> From http://www.nabble.com/Concerns-about-File-endpoint-td20802855s22882.html
> I'd like to suggest that you add a "preMove" option as it seems to be pretty much a requirement for doing clustered seda-style processing from a file endpoint.
> The use case for this is a very large number of small files is being dropped into a directory.  This directory is then being scanned by camel's file endpoint.  The files as they are discovered are then moved to the .camel directory, and the filename is put onto a jms endpoint.  A clustered set of camel processors then pull the filename off the endpoint and process the file, and then delete it.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (CAMEL-1148) Add capability to move files prior to routing messages

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

     [ https://issues.apache.org/activemq/browse/CAMEL-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Claus Ibsen updated CAMEL-1148:
-------------------------------

    Fix Version/s: 2.0.0
                   1.5.1

Okay Christopher let me see if I can get this in Camel 1.5.1 also.

I am aiming for options
- preMoveNamePrefix
- preMoveNamePostfix


> Add capability to move files prior to routing messages
> ------------------------------------------------------
>
>                 Key: CAMEL-1148
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-1148
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.5.0
>            Reporter: Christopher Hammack
>            Assignee: Claus Ibsen
>             Fix For: 1.5.1, 2.0.0
>
>
> From http://www.nabble.com/Concerns-about-File-endpoint-td20802855s22882.html
> I'd like to suggest that you add a "preMove" option as it seems to be pretty much a requirement for doing clustered seda-style processing from a file endpoint.
> The use case for this is a very large number of small files is being dropped into a directory.  This directory is then being scanned by camel's file endpoint.  The files as they are discovered are then moved to the .camel directory, and the filename is put onto a jms endpoint.  A clustered set of camel processors then pull the filename off the endpoint and process the file, and then delete it.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Work started: (CAMEL-1148) Add capability to move files prior to routing messages

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

     [ https://issues.apache.org/activemq/browse/CAMEL-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on CAMEL-1148 started by Claus Ibsen.

> Add capability to move files prior to routing messages
> ------------------------------------------------------
>
>                 Key: CAMEL-1148
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-1148
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.5.0
>            Reporter: Christopher Hammack
>            Assignee: Claus Ibsen
>             Fix For: 1.5.1, 2.0.0
>
>
> From http://www.nabble.com/Concerns-about-File-endpoint-td20802855s22882.html
> I'd like to suggest that you add a "preMove" option as it seems to be pretty much a requirement for doing clustered seda-style processing from a file endpoint.
> The use case for this is a very large number of small files is being dropped into a directory.  This directory is then being scanned by camel's file endpoint.  The files as they are discovered are then moved to the .camel directory, and the filename is put onto a jms endpoint.  A clustered set of camel processors then pull the filename off the endpoint and process the file, and then delete it.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Issue Comment Edited: (CAMEL-1148) Add capability to move files prior to routing messages

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=47884#action_47884 ]

davsclaus edited comment on CAMEL-1148 at 12/5/08 11:59 AM:
--------------------------------------------------------------

Okay Christopher let me see if I can get this in Camel 1.5.1 also.

I am aiming for options
- preMoveNamePrefix
- preMoveNamePostfix

Well we got the full monty. I also added the expression based:
- preMoveExpression



      was (Author: davsclaus):
    Okay Christopher let me see if I can get this in Camel 1.5.1 also.

I am aiming for options
- preMoveNamePrefix
- preMoveNamePostfix

 

> Add capability to move files prior to routing messages
> ------------------------------------------------------
>
>                 Key: CAMEL-1148
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-1148
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.5.0
>            Reporter: Christopher Hammack
>            Assignee: Claus Ibsen
>             Fix For: 1.5.1, 2.0.0
>
>
> From http://www.nabble.com/Concerns-about-File-endpoint-td20802855s22882.html
> I'd like to suggest that you add a "preMove" option as it seems to be pretty much a requirement for doing clustered seda-style processing from a file endpoint.
> The use case for this is a very large number of small files is being dropped into a directory.  This directory is then being scanned by camel's file endpoint.  The files as they are discovered are then moved to the .camel directory, and the filename is put onto a jms endpoint.  A clustered set of camel processors then pull the filename off the endpoint and process the file, and then delete it.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-1148) Add capability to move files prior to routing messages

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=47895#action_47895 ]

Claus Ibsen commented on CAMEL-1148:
------------------------------------

D:\project\camel\camel-core>svn commit --message "CAMEL-1148: Added options pre move options to move file before processing"
Sending        camel-core\src\main\java\org\apache\camel\component\file\FileConsumer.java
Sending        camel-core\src\main\java\org\apache\camel\component\file\FileEndpoint.java
Sending        camel-core\src\main\java\org\apache\camel\component\file\FileExchange.java
Sending        camel-core\src\main\java\org\apache\camel\component\file\strategy\FileProcessStrategyFactory.java
Sending        camel-core\src\main\java\org\apache\camel\component\file\strategy\RenameFileProcessStrategy.java
Adding         camel-core\src\test\java\org\apache\camel\component\file\FileConsumerBeginAndCommitExpressionRenameStrategyTest.java
Adding         camel-core\src\test\java\org\apache\camel\component\file\FileConsumerBeginAndCommitRenameStrategyTest.java
Adding         camel-core\src\test\java\org\apache\camel\component\file\FileConsumerBeginExpressionRenameStrategyTest.java
Adding         camel-core\src\test\java\org\apache\camel\component\file\FileConsumerBeginRenameStrategyTest.java
Adding         camel-core\src\test\java\org\apache\camel\component\file\FileConsumerCommitRenameStrategyTest.java
Deleting       camel-core\src\test\java\org\apache\camel\component\file\FileProducerRenameStrategyTest.java
Transmitting file data ..........
Committed revision 723835.

> Add capability to move files prior to routing messages
> ------------------------------------------------------
>
>                 Key: CAMEL-1148
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-1148
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.5.0
>            Reporter: Christopher Hammack
>            Assignee: Claus Ibsen
>             Fix For: 1.5.1, 2.0.0
>
>
> From http://www.nabble.com/Concerns-about-File-endpoint-td20802855s22882.html
> I'd like to suggest that you add a "preMove" option as it seems to be pretty much a requirement for doing clustered seda-style processing from a file endpoint.
> The use case for this is a very large number of small files is being dropped into a directory.  This directory is then being scanned by camel's file endpoint.  The files as they are discovered are then moved to the .camel directory, and the filename is put onto a jms endpoint.  A clustered set of camel processors then pull the filename off the endpoint and process the file, and then delete it.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-1148) Add capability to move files prior to routing messages

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=47897#action_47897 ]

Claus Ibsen commented on CAMEL-1148:
------------------------------------

Committed revision 723860.  for the 1.x branch

> Add capability to move files prior to routing messages
> ------------------------------------------------------
>
>                 Key: CAMEL-1148
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-1148
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.5.0
>            Reporter: Christopher Hammack
>            Assignee: Claus Ibsen
>             Fix For: 1.5.1, 2.0.0
>
>
> From http://www.nabble.com/Concerns-about-File-endpoint-td20802855s22882.html
> I'd like to suggest that you add a "preMove" option as it seems to be pretty much a requirement for doing clustered seda-style processing from a file endpoint.
> The use case for this is a very large number of small files is being dropped into a directory.  This directory is then being scanned by camel's file endpoint.  The files as they are discovered are then moved to the .camel directory, and the filename is put onto a jms endpoint.  A clustered set of camel processors then pull the filename off the endpoint and process the file, and then delete it.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Resolved: (CAMEL-1148) Add capability to move files prior to routing messages

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

     [ https://issues.apache.org/activemq/browse/CAMEL-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Claus Ibsen resolved CAMEL-1148.
--------------------------------

    Resolution: Fixed

> Add capability to move files prior to routing messages
> ------------------------------------------------------
>
>                 Key: CAMEL-1148
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-1148
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.5.0
>            Reporter: Christopher Hammack
>            Assignee: Claus Ibsen
>             Fix For: 1.5.1, 2.0.0
>
>
> From http://www.nabble.com/Concerns-about-File-endpoint-td20802855s22882.html
> I'd like to suggest that you add a "preMove" option as it seems to be pretty much a requirement for doing clustered seda-style processing from a file endpoint.
> The use case for this is a very large number of small files is being dropped into a directory.  This directory is then being scanned by camel's file endpoint.  The files as they are discovered are then moved to the .camel directory, and the filename is put onto a jms endpoint.  A clustered set of camel processors then pull the filename off the endpoint and process the file, and then delete it.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.