[GitHub] [camel-k] kameshsampath opened a new issue #1209: Integration builds takes lots of time

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] [camel-k] kameshsampath opened a new issue #1209: Integration builds takes lots of time

GitBox
kameshsampath opened a new issue #1209: Integration builds takes lots of time
URL: https://github.com/apache/camel-k/issues/1209
 
 
   **Platform**: minikube 1.6.2
   **camel-k**: 1.0.0.RC1
   
   The camel-k integration builds takes lots of time to complete ~ 12 mins and i see its struck in a particular place for long  as shown in the log below ( not sure its Kankio issue)
   
   ```shell
   camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0492] Downloading base image 10.111.197.108/chapter-7/camel-k-kit-bofj39ei1aal47gim830:36212
   camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0647] Skipping unpacking as no commands require it.
   camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0647] Taking snapshot of full filesystem...
   camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0647] Using files from context: [/builder/kit-bofk6gui1aal47gim840/package/context]
   camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0647] ADD . /deployments
   camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0647] Taking snapshot of files...
   ```
   Is there a way to optimize this ? As majority of developers will be on minikube we need to make sure its faster and quicker there.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services
Reply | Threaded
Open this post in threaded view
|

[GitHub] [camel-k] astefanutti commented on issue #1209: Integration builds takes lots of time

GitBox
astefanutti commented on issue #1209: Integration builds takes lots of time
URL: https://github.com/apache/camel-k/issues/1209#issuecomment-575032262
 
 
   @kameshsampath out of curiosity, what OS do you use?
   
   Kaniko takes a snapshot of the file system and performance may depend on the OS: https://github.com/GoogleContainerTools/kaniko/blob/200a0eabdd4669c6bcacb948e1b3f52b56fd1f5f/pkg/snapshot/snapshot.go#L122-L125.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services
Reply | Threaded
Open this post in threaded view
|

[GitHub] [camel-k] kameshsampath commented on issue #1209: Integration builds takes lots of time

GitBox
In reply to this post by GitBox
kameshsampath commented on issue #1209: Integration builds takes lots of time
URL: https://github.com/apache/camel-k/issues/1209#issuecomment-575162031
 
 
   @astefanutti  - I use macOS Catalina

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services
Reply | Threaded
Open this post in threaded view
|

[GitHub] [camel-k] astefanutti commented on issue #1209: Integration builds takes lots of time

GitBox
In reply to this post by GitBox
astefanutti commented on issue #1209: Integration builds takes lots of time
URL: https://github.com/apache/camel-k/issues/1209#issuecomment-575165498
 
 
   @kameshsampath that's what I suspected. As Minikube runs through virtualisation layers on Mac OS, it may be the file system snapshotting is particularly slow for that platform. I'd like to hear from people using Linux if they are also affected.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services
Reply | Threaded
Open this post in threaded view
|

[GitHub] [camel-k] astefanutti commented on issue #1209: Integration builds takes lots of time

GitBox
In reply to this post by GitBox
astefanutti commented on issue #1209: Integration builds takes lots of time
URL: https://github.com/apache/camel-k/issues/1209#issuecomment-576388205
 
 
   I had a quick look at it and it seems a significant portion of the build time is taken to push the built image to the internal registry. Still need to be confirmed and properly analysed...

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services
Reply | Threaded
Open this post in threaded view
|

[GitHub] [camel-k] astefanutti edited a comment on issue #1209: Integration builds takes lots of time

GitBox
In reply to this post by GitBox
astefanutti edited a comment on issue #1209: Integration builds takes lots of time
URL: https://github.com/apache/camel-k/issues/1209#issuecomment-576388205
 
 
   I had a quick look at it and it seems a significant portion of the build time is taken to push the built image to the internal registry deployed on Minikube. Still need to be confirmed and properly analysed...

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services
Reply | Threaded
Open this post in threaded view
|

[GitHub] [camel-k] astefanutti commented on issue #1209: Integration builds takes lots of time

GitBox
In reply to this post by GitBox
astefanutti commented on issue #1209: Integration builds takes lots of time
URL: https://github.com/apache/camel-k/issues/1209#issuecomment-580152978
 
 
   After a deeper analysis, it seems to confirm most of the time is taken by the image upload to the local registry, I've created GoogleContainerTools/kaniko#1013 to track progress on this.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services
Reply | Threaded
Open this post in threaded view
|

[GitHub] [camel-k] astefanutti edited a comment on issue #1209: Integration builds takes lots of time

GitBox
In reply to this post by GitBox
astefanutti edited a comment on issue #1209: Integration builds takes lots of time
URL: https://github.com/apache/camel-k/issues/1209#issuecomment-580152978
 
 
   After a deeper analysis, it seems to confirm most of the time is taken by the image upload to the local registry. I've created GoogleContainerTools/kaniko#1013 to track progress on this.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services
Reply | Threaded
Open this post in threaded view
|

[GitHub] [camel-k] astefanutti commented on issue #1209: Integration builds takes lots of time

GitBox
In reply to this post by GitBox
astefanutti commented on issue #1209: Integration builds takes lots of time
URL: https://github.com/apache/camel-k/issues/1209#issuecomment-586313120
 
 
   It should be fixed with #1256.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services
Reply | Threaded
Open this post in threaded view
|

[GitHub] [camel-k] astefanutti closed issue #1209: Integration builds takes lots of time

GitBox
In reply to this post by GitBox
astefanutti closed issue #1209: Integration builds takes lots of time
URL: https://github.com/apache/camel-k/issues/1209
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services