chef-client installed with omnibus fullstack-package is very slow on startup

Details

Description

chef-client installed with omnibus fullstack package is very slow on startup

OS: Ubuntu 10.04 LTS amd64

Even showing "help" ist terribly slow with the omnibus-Package:

normal install (via apt opscode-repo):

root@chefclient:~# time chef-client --help
.
.
.
real 0m0.205s
user 0m0.130s
sys 0m0.090s

root@chefclient:~# time chef-client
[Mon, 16 Jul 2012 18:41:40 +0200] INFO: *** Chef 10.12.0 ***
[Mon, 16 Jul 2012 18:41:40 +0200] INFO: Run List is [role[test1]]
[Mon, 16 Jul 2012 18:41:40 +0200] INFO: Run List expands to [bjtest]
[Mon, 16 Jul 2012 18:41:40 +0200] INFO: Starting Chef Run for chefclient.test.local
[Mon, 16 Jul 2012 18:41:40 +0200] INFO: Running start handlers
[Mon, 16 Jul 2012 18:41:40 +0200] INFO: Start handlers complete.
[Mon, 16 Jul 2012 18:41:40 +0200] INFO: Loading cookbooks [bjtest]
[Mon, 16 Jul 2012 18:41:40 +0200] INFO: Processing package[curl] action install (bjtest::default line 12)
[Mon, 16 Jul 2012 18:41:40 +0200] INFO: Processing package[unzip] action install (bjtest::default line 12)
[Mon, 16 Jul 2012 18:41:40 +0200] INFO: Processing template[/tmp/test.conf] action create (bjtest::default line 18)
[Mon, 16 Jul 2012 18:41:41 +0200] INFO: Chef Run complete in 0.297965 seconds
[Mon, 16 Jul 2012 18:41:41 +0200] INFO: Running report handlers
[Mon, 16 Jul 2012 18:41:41 +0200] INFO: Report handlers complete

real 0m0.942s
user 0m0.620s
sys 0m0.090s

omnibus: (8 seconds for only showing the help !)

root@chef-testclient01:~# time chef-client --help
.
.
.
real 0m7.859s
user 0m7.730s
sys 0m0.140s

root@chef-testclient01:~# time chef-client
[Mon, 16 Jul 2012 18:42:06 +0200] INFO: *** Chef 10.12.0 ***
[Mon, 16 Jul 2012 18:42:07 +0200] INFO: Run List is []
[Mon, 16 Jul 2012 18:42:07 +0200] INFO: Run List expands to []
[Mon, 16 Jul 2012 18:42:07 +0200] INFO: Starting Chef Run for chef-testclient01
[Mon, 16 Jul 2012 18:42:07 +0200] INFO: Running start handlers
[Mon, 16 Jul 2012 18:42:07 +0200] INFO: Start handlers complete.
[Mon, 16 Jul 2012 18:42:07 +0200] INFO: Loading cookbooks []
[Mon, 16 Jul 2012 18:42:07 +0200] WARN: Node chef-testclient01 has an empty run list.
[Mon, 16 Jul 2012 18:42:07 +0200] INFO: Chef Run complete in 0.285267519 seconds
[Mon, 16 Jul 2012 18:42:07 +0200] INFO: Running report handlers
[Mon, 16 Jul 2012 18:42:07 +0200] INFO: Report handlers complete

real 0m9.133s
user 0m8.690s
sys 0m0.280s

Issue Links

duplicates

Bug - A problem which impairs or prevents the functions of the product. CHEF-2871 Omnibus should be updated to use Ruby 1.9.3/Rubygems 1.8.10

  • Minor - Minor loss of function, or other problem where easy workaround is present.
  • Closed - The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.
relates to

Bug - A problem which impairs or prevents the functions of the product. CHEF-2871 Omnibus should be updated to use Ruby 1.9.3/Rubygems 1.8.10

  • Minor - Minor loss of function, or other problem where easy workaround is present.
  • Closed - The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Jessica Bourne added a comment -

I was able to reproduce this on Ubuntu, but not OS X. It looks like Ubuntu is using an embedded rubygems version 1.8.12 while the OS X version has 1.3.7 embedded.

Related ticket: https://tickets.corp.opscode.com/browse/PC-20

Show
Jessica Bourne added a comment - I was able to reproduce this on Ubuntu, but not OS X. It looks like Ubuntu is using an embedded rubygems version 1.8.12 while the OS X version has 1.3.7 embedded. Related ticket: https://tickets.corp.opscode.com/browse/PC-20
Hide
Permalink
KC Braunschweig added a comment -

Also happens on redhat/centos. Seems related to the upgraded rubygems. Likely related to https://github.com/rubygems/rubygems/issues/73

Show
KC Braunschweig added a comment - Also happens on redhat/centos. Seems related to the upgraded rubygems. Likely related to https://github.com/rubygems/rubygems/issues/73
Hide
Permalink
jtimberman added a comment -

Resolving as this is related to CHEF-2871, which has a pull request to update Ruby/RubyGems.

Show
jtimberman added a comment - Resolving as this is related to CHEF-2871 , which has a pull request to update Ruby/RubyGems.
jtimberman made changes -
Field Original Value New Value
Status Open [ 1 ] Resolved [ 5 ]
Resolution Fixed [ 1 ]
jtimberman made changes -
Link This issue relates to CHEF-2871 [ CHEF-2871 ]
jtimberman made changes -
Component/s Packages [ 10040 ]
Hide
Permalink
jtimberman added a comment -

To work around the issue until new chef-full packages are built with newer Ruby/RubyGems, you can update RubyGems on your system for Chef's use with the following command:

% sudo /opt/chef/embedded/bin/gem update --system

Version 1.8.13 seems to be the one that introduced the performance improvement:

=== 1.8.13 / 2011-12-21

* 1 bug fix:

  * Check loaded_specs properly when trying to satisfy a dep

* 2 minor enhancements:

  * Remove using #loaded_path? for performance
  * Remove Zlib workaround for Windows build.
Show
jtimberman added a comment - To work around the issue until new chef-full packages are built with newer Ruby/RubyGems, you can update RubyGems on your system for Chef's use with the following command: % sudo /opt/chef/embedded/bin/gem update --system Version 1.8.13 seems to be the one that introduced the performance improvement: === 1.8.13 / 2011-12-21 * 1 bug fix: * Check loaded_specs properly when trying to satisfy a dep * 2 minor enhancements: * Remove using #loaded_path? for performance * Remove Zlib workaround for Windows build.
Hide
Permalink
Bryan McLellan [Opscode] added a comment -

Passing along to Opscode Engineering.

Show
Bryan McLellan [Opscode] added a comment - Passing along to Opscode Engineering.
Hide
Permalink
Bryan McLellan [Opscode] added a comment -

Jessica, OS X is a unique Omnibus platform as it is still built on the clojure build system so it is different than the rest.

Show
Bryan McLellan [Opscode] added a comment - Jessica, OS X is a unique Omnibus platform as it is still built on the clojure build system so it is different than the rest.
Bryan McLellan [Opscode] made changes -
Resolution Fixed [ 1 ]
Status Resolved [ 5 ] Reopened [ 4 ]
Hide
Permalink
Bryan McLellan [Opscode] added a comment -

Closing as a duplicate of CHEF-2871 for record keeping purposes because it is older. (it's a tossup)

The Chef 10.14.0 Omnibus release will have Ruby 1.9.3-p194 and Rubygems 1.8.24. Work is currently in the omnibus-software/performance-improvements branch and should be merged to master by EOD.

Show
Bryan McLellan [Opscode] added a comment - Closing as a duplicate of CHEF-2871 for record keeping purposes because it is older. (it's a tossup) The Chef 10.14.0 Omnibus release will have Ruby 1.9.3-p194 and Rubygems 1.8.24. Work is currently in the omnibus-software/performance-improvements branch and should be merged to master by EOD.
Bryan McLellan [Opscode] made changes -
Status Reopened [ 4 ] Closed [ 6 ]
Resolution Duplicate [ 3 ]
Bryan McLellan [Opscode] made changes -
Link This issue duplicates CHEF-2871 [ CHEF-2871 ]
Bryan McLellan [Opscode] made changes -
Workflow jira [ 16240 ] New OSS [ 20530 ]
Bryan McLellan [Opscode] made changes -
Workflow New OSS [ 20530 ] OSS: Product Management [ 28450 ]
Transition Time In Source Status Execution Times Last Executer Last Execution Date
Open Open Resolved Resolved
21d 23h 51m 1 jtimberman 07/Aug/12 4:38 PM
Resolved Resolved Reopened Reopened
8d 4h 45m 1 Bryan McLellan [Opscode] 15/Aug/12 9:23 PM
Reopened Reopened Closed Closed
48s 1 Bryan McLellan [Opscode] 15/Aug/12 9:24 PM

People

  • Assignee:
    Unassigned
    Reporter:
    Max Larsen
Vote (2)
Watch (4)

Dates

  • Created:
    Updated:
    Resolved: