Bootstrapping Chef on EC2 Ubuntu 12.04

Details

  • Type: Bug Bug
  • Status: Open Open
  • Priority: Major Major
  • Resolution: Unresolved
  • Affects Version/s: 10.12.0
  • Fix Version/s: None
  • Component/s: None
  • Environment:

    Using knife-ec2 0.5.12

Description

Unable to install chef through the knife ec2 server create command.

Example error output -

ec2-176-34-94-91.eu-west-1.compute.amazonaws.com E
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com :
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com Unable to locate package libruby-extras
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com E
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com :
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com Unable to locate package libruby1.8-extras
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com E
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com :
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com Couldn't find any package by regex 'libruby1.8-extras'
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com -2012-07-06 10:50:32- http://production.cf.rubygems.org/rubygems/rubygems-1.6.2.tgz
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com Resolving production.cf.rubygems.org (production.cf.rubygems.org)...
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com 205.251.209.161
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com ,
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com 205.251.209.237
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com ,
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com 205.251.209.19
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com , ...
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com Connecting to production.cf.rubygems.org (production.cf.rubygems.org)|205.251.209.161|:80...
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com connected.
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com HTTP request sent, awaiting response...
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com 200 OK
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com Length:
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com 242518
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com (237K)
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com [binary/octet-stream]
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com Saving to: `rubygems-1.6.2.tgz'
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com 0% [ ] 0 --.-K/s
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com 89% [=================================> ] 216,559 951K/s
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com 100%[======================================>] 242,518 1.04M/s in 0.2s
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com 2012-07-06 10:50:32 (1.04 MB/s) - `rubygems-1.6.2.tgz' saved [242518/242518]
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com bash: line 9: ruby: command not found
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com bash: line 12: gem: command not found
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com bash: line 13: gem: command not found
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com bash: line 14: gem: command not found
ec2-176-34-94-91.eu-west-1.compute.amazonaws.com bash: line 71: chef-client: command not found

I have read about omnibus installers etc but cant find a reference to this problem. Essentially I would like to continue to create servers from the commandline on ec2. Do I need to install a prerelease?

Thanks,
Alastair.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Bryan McLellan [Opscode] added a comment -

What version of Chef are you using? By default, knife installs the same version of Chef on the remote machine that you are running on your workstation.

The latest version of Chef will default to using the 'chef-full' template, which will install using the Omnibus installer. If you didn't want to use Omnibus you could specify '-d ubuntu12.04-gems' which would use the version of Rubygems provided by the distribution.

Show
Bryan McLellan [Opscode] added a comment - What version of Chef are you using? By default, knife installs the same version of Chef on the remote machine that you are running on your workstation. The latest version of Chef will default to using the 'chef-full' template, which will install using the Omnibus installer. If you didn't want to use Omnibus you could specify '-d ubuntu12.04-gems' which would use the version of Rubygems provided by the distribution.
Hide
Permalink
Alastair Brunton added a comment -

Chef 10.12.0.

It may be an issue with the omnibus installer or 'chef-full' template. Specifying -d ubuntu12.04-gems fixed the problem.

Cheers,
Alastair

Show
Alastair Brunton added a comment - Chef 10.12.0. It may be an issue with the omnibus installer or 'chef-full' template. Specifying -d ubuntu12.04-gems fixed the problem. Cheers, Alastair
Hide
Permalink
Bryan McLellan [Opscode] added a comment -

Hrm. What is the exact knife ec2 command you run that produces this?

chef-full and the omnibus installer do not download Rubygems, as they ship with rubygems.

Show
Bryan McLellan [Opscode] added a comment - Hrm. What is the exact knife ec2 command you run that produces this? chef-full and the omnibus installer do not download Rubygems, as they ship with rubygems.
Hide
Permalink
Alastair Brunton added a comment -

example command

knife ec2 server create -r 'role[redis],role[mongo]' --node-name redismongotest --flavor m1.large \
--identity-file ~/.ssh/chef.pem --image ami-b39491c7 -G defaultchef --region eu-west-1 \
--ssh-key chef --ssh-user ubuntu

Show
Alastair Brunton added a comment - example command knife ec2 server create -r 'role [redis] ,role [mongo] ' --node-name redismongotest --flavor m1.large \ --identity-file ~/.ssh/chef.pem --image ami-b39491c7 -G defaultchef --region eu-west-1 \ --ssh-key chef --ssh-user ubuntu
Hide
Permalink
Bryan McLellan [Opscode] added a comment -

Chef 0.10.10 and knife-ec2 0.5.12 defaulted to chef-full (to the --distro / -d option) and it looks like the template that is running above is the ubuntu10.04-gems template that used to be the default prior to chef 0.10.10.

Is it possible you weren't using knife-ec2 0.5.12. On brief review it doesn't appear that you can set distro in a configuration file so that shouldn't matter.

Show
Bryan McLellan [Opscode] added a comment - Chef 0.10.10 and knife-ec2 0.5.12 defaulted to chef-full (to the --distro / -d option) and it looks like the template that is running above is the ubuntu10.04-gems template that used to be the default prior to chef 0.10.10. Is it possible you weren't using knife-ec2 0.5.12. On brief review it doesn't appear that you can set distro in a configuration file so that shouldn't matter.
Hide
Permalink
Alastair Brunton added a comment -

Hi,

Yes I can confirm it is knife-ec2 0.5.12. I have also tried upgrading to knife-ec2 0.5.14 but end up with the following error:

ERROR: Fog::Compute::AWS::Error: InvalidParameterValue => Invalid availability zone: [us-east-1b]

This could be related to https://github.com/opscode/knife-ec2/blob/master/lib/chef/knife/ec2_server_create.rb specifying an incorrect availability zone.

But the result being I have to specify the -d ubuntu12.04-gems and cant use the most recent version of knife-ec2.

Thanks for the help.

Cheers,
Alastair

Show
Alastair Brunton added a comment - Hi, Yes I can confirm it is knife-ec2 0.5.12. I have also tried upgrading to knife-ec2 0.5.14 but end up with the following error: ERROR: Fog::Compute::AWS::Error: InvalidParameterValue => Invalid availability zone: [us-east-1b] This could be related to https://github.com/opscode/knife-ec2/blob/master/lib/chef/knife/ec2_server_create.rb specifying an incorrect availability zone. But the result being I have to specify the -d ubuntu12.04-gems and cant use the most recent version of knife-ec2. Thanks for the help. Cheers, Alastair
Hide
Permalink
Ping Wu added a comment -

I have the same problem on EC2 with Ubuntu 12.04 for Unable to locate package libruby-extras

Where and how do I specify '-d ubuntu12.04-gems' to avoid the error?

I am running chef server 10.14.4

Many Thanks.

Show
Ping Wu added a comment - I have the same problem on EC2 with Ubuntu 12.04 for Unable to locate package libruby-extras Where and how do I specify '-d ubuntu12.04-gems' to avoid the error? I am running chef server 10.14.4 Many Thanks.
Hide
Permalink
Bryan McLellan [Opscode] added a comment -

Ping, it depends on your chef-client version and knife-ec2 version, not your chef-server version.

You need at least Chef 0.10.10 to use the ubuntu12.04-gems template to install Chef on Ubuntu 12.04 using Rubygems (30589e70). Also, if you have Chef 0.10.10 or higher, if you do not specify a -d flag you will install using Omnibus (chef-full template) (85f3b203).

If you have knife-ec2 0.5.12 or higher, and you do not specify the -d flag, you default to using Omnibus as well (fa5ee568).

If you have the latest versions of chef and knife-ec2 installed and are installing on Ubuntu 12.04:

knife ec2 server create HOSTNAME # installs using Omnibus
knife ec2 server create HOSTNAME -d ubuntu12.04-gems # installs using Ruby packages
Show
Bryan McLellan [Opscode] added a comment - Ping, it depends on your chef-client version and knife-ec2 version, not your chef-server version. You need at least Chef 0.10.10 to use the ubuntu12.04-gems template to install Chef on Ubuntu 12.04 using Rubygems (30589e70). Also, if you have Chef 0.10.10 or higher, if you do not specify a -d flag you will install using Omnibus (chef-full template) (85f3b203). If you have knife-ec2 0.5.12 or higher, and you do not specify the -d flag, you default to using Omnibus as well (fa5ee568). If you have the latest versions of chef and knife-ec2 installed and are installing on Ubuntu 12.04: knife ec2 server create HOSTNAME # installs using Omnibus knife ec2 server create HOSTNAME -d ubuntu12.04-gems # installs using Ruby packages

People

  • Assignee:
    Unassigned
    Reporter:
    Alastair Brunton
Vote (0)
Watch (0)

Dates

  • Created:
    Updated: