[jira] Created: (CAMEL-790) Camel-File Read Files Regardless Of Last Modified And Size

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] Created: (CAMEL-790) Camel-File Read Files Regardless Of Last Modified And Size

JIRA jira@apache.org
Camel-File Read Files Regardless Of Last Modified And Size
----------------------------------------------------------

                 Key: CAMEL-790
                 URL: https://issues.apache.org/activemq/browse/CAMEL-790
             Project: Apache Camel
          Issue Type: New Feature
          Components: camel-core
    Affects Versions: 1.4.0
         Environment: Windows, Linux
            Reporter: Carlo M. Camerino
            Priority: Minor


Hi,

I've noticed that the behavior of Camel for now is that it polls the file system for files. If the last modified attribute of the file is less than what is stored in memory,
camel ignores the file already.
However in our case we need to poll the file regardless of its last modified date or its file size.

Can you add a new attributge for this type of behavior?
from("file://c:/uploads?ignoreLastModified=true&ignoreFileSizeChange=true");

Thanks

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (CAMEL-790) Camel-File Read Files Regardless Of Last Modified And Size

JIRA jira@apache.org

     [ https://issues.apache.org/activemq/browse/CAMEL-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Claus Ibsen updated CAMEL-790:
------------------------------

    Fix Version/s: 1.5.0

Good idea will get it in Camel 1.5 pretty soon.



> Camel-File Read Files Regardless Of Last Modified And Size
> ----------------------------------------------------------
>
>                 Key: CAMEL-790
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-790
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.4.0
>         Environment: Windows, Linux
>            Reporter: Carlo M. Camerino
>            Priority: Minor
>             Fix For: 1.5.0
>
>
> Hi,
> I've noticed that the behavior of Camel for now is that it polls the file system for files. If the last modified attribute of the file is less than what is stored in memory,
> camel ignores the file already.
> However in our case we need to poll the file regardless of its last modified date or its file size.
> Can you add a new attributge for this type of behavior?
> from("file://c:/uploads?ignoreLastModified=true&ignoreFileSizeChange=true");
> Thanks

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-790) Camel-File Read Files Regardless Of Last Modified And Size

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=44866#action_44866 ]

Hadrian Zbarcea commented on CAMEL-790:
---------------------------------------

Carlo, I have a hard time imagining the use case.  Could you please provide some more details on how this feature would be useful?  If the file didn't change at all, isn't this as good as a periodic wakeup, something camel-quartz could do?  
Thanks!

> Camel-File Read Files Regardless Of Last Modified And Size
> ----------------------------------------------------------
>
>                 Key: CAMEL-790
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-790
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.4.0
>         Environment: Windows, Linux
>            Reporter: Carlo M. Camerino
>            Priority: Minor
>             Fix For: 1.5.0
>
>
> Hi,
> I've noticed that the behavior of Camel for now is that it polls the file system for files. If the last modified attribute of the file is less than what is stored in memory,
> camel ignores the file already.
> However in our case we need to poll the file regardless of its last modified date or its file size.
> Can you add a new attributge for this type of behavior?
> from("file://c:/uploads?ignoreLastModified=true&ignoreFileSizeChange=true");
> Thanks

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-790) Camel-File Read Files Regardless Of Last Modified And Size

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=44867#action_44867 ]

Carlo M. Camerino commented on CAMEL-790:
-----------------------------------------

I have a  directory that is being used to read files and send web services on the file.
When the web services times out the file is placed in another directory.

When it does, the file is recopied into the directory at some other time.
It will still have the same timestamp so camel doesn't read it already.
But we still need to resend the file.






> Camel-File Read Files Regardless Of Last Modified And Size
> ----------------------------------------------------------
>
>                 Key: CAMEL-790
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-790
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.4.0
>         Environment: Windows, Linux
>            Reporter: Carlo M. Camerino
>            Priority: Minor
>             Fix For: 1.5.0
>
>
> Hi,
> I've noticed that the behavior of Camel for now is that it polls the file system for files. If the last modified attribute of the file is less than what is stored in memory,
> camel ignores the file already.
> However in our case we need to poll the file regardless of its last modified date or its file size.
> Can you add a new attributge for this type of behavior?
> from("file://c:/uploads?ignoreLastModified=true&ignoreFileSizeChange=true");
> Thanks

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-790) Camel-File Read Files Regardless Of Last Modified And Size

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=44868#action_44868 ]

Hadrian Zbarcea commented on CAMEL-790:
---------------------------------------

I think I get it :).  You are using something like `cp -p` to copy it back which preserves the modification time.
Thanks for the clarification.

> Camel-File Read Files Regardless Of Last Modified And Size
> ----------------------------------------------------------
>
>                 Key: CAMEL-790
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-790
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.4.0
>         Environment: Windows, Linux
>            Reporter: Carlo M. Camerino
>            Priority: Minor
>             Fix For: 1.5.0
>
>
> Hi,
> I've noticed that the behavior of Camel for now is that it polls the file system for files. If the last modified attribute of the file is less than what is stored in memory,
> camel ignores the file already.
> However in our case we need to poll the file regardless of its last modified date or its file size.
> Can you add a new attributge for this type of behavior?
> from("file://c:/uploads?ignoreLastModified=true&ignoreFileSizeChange=true");
> Thanks

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (CAMEL-790) Camel-File Read Files Regardless Of Last Modified And Size

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/activemq/browse/CAMEL-790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=44877#action_44877 ]

Claus Ibsen commented on CAMEL-790:
-----------------------------------

Actually at work we have a similar low practical integration using a different platform than Camel we store backup and erros in files that can be copied into a special folder for retransmission.

So I see a valid use-case as well that Camel should be able to consume the files.

I am wondering if there is a better combine option name for it though?

> Camel-File Read Files Regardless Of Last Modified And Size
> ----------------------------------------------------------
>
>                 Key: CAMEL-790
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-790
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.4.0
>         Environment: Windows, Linux
>            Reporter: Carlo M. Camerino
>            Priority: Minor
>             Fix For: 1.5.0
>
>
> Hi,
> I've noticed that the behavior of Camel for now is that it polls the file system for files. If the last modified attribute of the file is less than what is stored in memory,
> camel ignores the file already.
> However in our case we need to poll the file regardless of its last modified date or its file size.
> Can you add a new attributge for this type of behavior?
> from("file://c:/uploads?ignoreLastModified=true&ignoreFileSizeChange=true");
> Thanks

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Resolved: (CAMEL-790) Camel-File Read Files Regardless Of Last Modified And Size

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

     [ https://issues.apache.org/activemq/browse/CAMEL-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Claus Ibsen resolved CAMEL-790.
-------------------------------

      Assignee: Claus Ibsen
    Resolution: Fixed

Added the option *consumer.alwaysConsume* as a boolean to enable this feature.

Description for option in wiki:
Camel 1.5: Is used to force consuming the file even if it hasn't changed since last time it was consumed. Is useful if you for instance move files back into a folder and the file keeps the original timestamp.

> Camel-File Read Files Regardless Of Last Modified And Size
> ----------------------------------------------------------
>
>                 Key: CAMEL-790
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-790
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.4.0
>         Environment: Windows, Linux
>            Reporter: Carlo M. Camerino
>            Assignee: Claus Ibsen
>            Priority: Minor
>             Fix For: 1.5.0
>
>
> Hi,
> I've noticed that the behavior of Camel for now is that it polls the file system for files. If the last modified attribute of the file is less than what is stored in memory,
> camel ignores the file already.
> However in our case we need to poll the file regardless of its last modified date or its file size.
> Can you add a new attributge for this type of behavior?
> from("file://c:/uploads?ignoreLastModified=true&ignoreFileSizeChange=true");
> Thanks

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Closed: (CAMEL-790) Camel-File Read Files Regardless Of Last Modified And Size

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

     [ https://issues.apache.org/activemq/browse/CAMEL-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carlo M. Camerino closed CAMEL-790.
-----------------------------------


closing

> Camel-File Read Files Regardless Of Last Modified And Size
> ----------------------------------------------------------
>
>                 Key: CAMEL-790
>                 URL: https://issues.apache.org/activemq/browse/CAMEL-790
>             Project: Apache Camel
>          Issue Type: New Feature
>          Components: camel-core
>    Affects Versions: 1.4.0
>         Environment: Windows, Linux
>            Reporter: Carlo M. Camerino
>            Assignee: Claus Ibsen
>            Priority: Minor
>             Fix For: 1.5.0
>
>
> Hi,
> I've noticed that the behavior of Camel for now is that it polls the file system for files. If the last modified attribute of the file is less than what is stored in memory,
> camel ignores the file already.
> However in our case we need to poll the file regardless of its last modified date or its file size.
> Can you add a new attributge for this type of behavior?
> from("file://c:/uploads?ignoreLastModified=true&ignoreFileSizeChange=true");
> Thanks

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.