53 Commits

Author SHA1 Message Date
Rohit Yadav
facc5945f0 CLOUDSTACK-10193: Fix smoke tests failures with new systemvmtemplate
- Several systemvmtemplate optimizations
- Uses new macchinina template for running smoke tests
- Switch to latest Debian 9.3.0 release for systemvmtemplate
- Introduce a new `get_test_template` that uses tiny test template
  such as macchinina as defined test_data.py
- rVR related fixes and improvements

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-12-23 09:22:44 +05:30
Rohit Yadav
85aee8d18d CLOUDSTACK-10013: SystemVM codebase refactorings and improvements
- Refactors and simplifies systemvm codebase file structures keeping
  the same resultant systemvm.iso packaging
- Password server systemd script and new postinit script that runs
  before sshd starts
- Fixes to keepalived and conntrackd config to make rVRs work again
- New /etc/issue featuring ascii based cloudmonkey logo/message and
  systemvmtemplate version
- SystemVM python codebase linted and tested. Added pylint/pep to
  Travis.
- iptables re-application fixes for non-VR systemvms.
- SystemVM template build fixes.
- Default secondary storage vm service offering boosted to have 2vCPUs
  and RAM equal to console proxy.
- Fixes to several marvin based smoke tests, especially rVR related
  tests. rVR tests to consider 3*advert_int+skew timeout before status
  is checked.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-12-23 09:22:44 +05:30
Rohit Yadav
bb965649d9 CLOUDSTACK-10013: Debian9 SystemVM appliance improvements
- Refactor cloud-early-config and make appliance specific scripts
- Make patching work without requiring restart of appliance and remove
  postinit script
- Migrate to systemd, speedup booting/loading
- Takes about 5-15s to boot on KVM, and 10-30seconds for VMware and XenServer
- Appliance boots and works on KVM, VMware, XenServer and HyperV
- Update Debian9 ISO url with sha512 checksum
- Speedup console proxy service launch
- Enable additional kernel modules
- Remove unknown ssh key
- Update vhd-util URL as previous URL was down
- Enable sshd by default
- Use hostnamectl to add hostname
- Disable services by default
- Use existing log4j xml, patching not necessary by cloud-early-config
- Several minor fixes and file refactorings, removed dead code/files
- Removes inserv
- Fix dnsmasq config syntax
- Fix haproxy config syntax
- Fix smoke tests and improve performance
- Fix apache pid file path in cloud.monitoring per the new template

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-12-23 09:22:44 +05:30
Rohit Yadav
78bb74188d CLOUDSTACK-10013: Migrate systemvmtemplate to Debian9
SystemVM changes to work on Debian 9
- Migrate away from chkconfig to systemctl
- Remove xenstore-utils override deb pkg
- Fix runlevel in sysv scripts for systemd

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-12-23 09:22:44 +05:30
Rohit Yadav
e6cc78f531 CLOUDSTACK-9710: Switch to JRE1.8
- Switches Travis to use jdk1.8
- Changes java-version to 1.8
- Change jdk/maven version to 1.8
- Switch to F5/java8 compatible library release
- Switch packaging to use jdk 1.8, and jre 1.8 in init/systemd scripts
- Switch systemvm to openjdk-8-jre

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-01-11 14:04:03 +05:30
Rohit Yadav
2cddaf3d36 CLOUDSTACK-9447: fix build and upgrade to debian 7.11 iso
- Update base debian iso to version 7.11
- Upgrade ruby version to 2.3.0 (latest/stable)
- Fix Gemfile
- Update README
- Fix openswan pkg name with the same version
- Remove cloud-cleanup it's not available

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2016-08-05 12:40:07 +05:30
Rajani Karuturi
61526190d0 changed the base iso file from debian-7.8.0 to debian-7.9.0
7.8.0 url is not available(404 Error)
2015-09-15 21:37:44 +05:30
Rohit Yadav
0fa1453809 systemvmtemplate: use archived debian 7.8.0 iso since Debian8 is released now
This fixes the urls and jenkins build

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-29 17:19:15 +02:00
Rohit Yadav
6f907fb2cd systemvmtemplate: increase disk size to 3000
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 13:58:33 +05:30
Ian Southam
cc5d72133e Removed chef as we will definitely not go this way 2015-03-16 11:35:14 +01:00
Ian Southam
5b82e2059d Cherry-pick of 11c00977f77f45aa7b0c387dc88360eba0819e8a:
----
Author:    Ian Southam <isoutham@schubergphilis.com>

First commit towards moving systemvm to chef based configuration
In this commit

1.  cmdline json databag is created
2.  ip association data bag is created
3.  Basic chef cookbook to manage ips and routes

Conflicts:
	systemvm/patches/debian/config/etc/init.d/cloud-early-config
	systemvm/patches/debian/config/var/chef/cookbooks/README
	tools/appliance/definitions/systemvm64template/postinstall.sh
----
Because we've refactored the systemvm template the change to
postinstall.sh now gets its own chef.sh file.
2015-03-16 11:34:59 +01:00
Hugo Trippaers
4fd616fc0f Make sure the location for the persistant configs exists 2015-03-16 11:34:58 +01:00
Rohit Yadav
3fddfe0e10 appliance: fix Debian ISO urls, fixes jenkins build
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-15 15:35:13 +05:30
SrikanteswaraRao Talluri
93529e47fd CLOUDSTACK-7824: using debian 7.7.0 and
added 'sharutils' package installation in system template

Signed-off-by: SrikanteswaraRao Talluri <talluri@apache.org>
2014-10-31 18:52:17 +05:30
Leo Simons
91ffedb39c CLOUDSTACK-7143: a better fix for kernel upgrade disk space problems
Increase / and /boot a little bit, to the point that there is enough
space on them to do a kernel upgrade. With this I think we can
decrease total disk space usage back down to 2.5GB.

Docs for the preseed config found at
  http://anonscm.debian.org/gitweb/?p=d-i/debian-installer.git;a=blob_plain;f=doc/devel/partman-auto-recipe.txt;hb=HEAD
2014-09-22 21:38:15 +02:00
Leo Simons
0570d37106 CLOUDSTACK-7143: initial apt-upgrade still running out of space (upgrading the kernel)
I wonder if this is due to the 7.4.0->7.6.0 needing more space. Should see if
there's more stuff that can be cleaned earlier?
2014-09-22 21:38:15 +02:00
Leo Simons
b4fceef407 CLOUDSTACK-7143: sometimes the consolidated 'apt' command runs out of space 2014-09-22 21:38:15 +02:00
Leo Simons
33fd6894a0 CLOUDSTACK-7143: use shar to inject cloud-scripts from working copy
The current build downloads its script from master by fetching a cloudstack
tarball. Besides being an unneeded load on the apache git server, this is a
problem when working on a branch and wanting to inject a different set of
scripts. It also makes it pretty likely that the injected copy of the script
will not match what a production release wants, so there is very little
chance of not needing to overwrite the scripts.

Ideally we would just rsync over some files. However, veewee does not provide
an option to do that. In order to keep a 'cleanly veewee-only' build possible,
and work with any recent veewee version, in this change we restor to using
shar (http://en.wikipedia.org/wiki/Shar) to produce an archive which can
execute as a script, which we feed to veewee to execute.
2014-09-22 21:38:14 +02:00
Leo Simons
35ba68444b CLOUDSTACK-7143: add the ability to inject a custom SSH key
When working on the systemvm in isolation, or using vagrant or similar tools,
it can be useful to inject a custom SSH key before merging a management server
systemvm.iso into it. This option allows that. It should _not_ have effect
on management-server-managed vms which always get their SSH keys injected.
2014-09-22 21:38:13 +02:00
Leo Simons
de68741f60 CLOUDSTACK-7143: license headers on all the systemvm scripts 2014-09-22 21:38:13 +02:00
Leo Simons
f67a379a46 CLOUDSTACK-7143: tune timeouts to expect about <=~60 min build 2014-09-22 21:38:12 +02:00
Leo Simons
7d9e46425f CLOUDSTACK-7143: rename postinstall.sh to represent what remains 2014-09-22 21:37:19 +02:00
Leo Simons
06c1c16dc3 CLOUDSTACK-7143: move install_packages from postinstall.sh to its own file 2014-09-22 21:37:18 +02:00
Leo Simons
a533de7593 CLOUDSTACK-7143: move networking logic from postinstall.sh to configure_networking.sh 2014-09-22 21:34:47 +02:00
Leo Simons
3574dcf543 CLOUDSTACK-7143: split connection tracking config into its own file 2014-09-22 21:31:36 +02:00
Leo Simons
5627b67ff3 CLOUDSTACK-7143: move fix_acpid to its own file 2014-09-22 21:31:35 +02:00
Leo Simons
aa14a619a6 CLOUDSTACK-7143: split locale config into its own file 2014-09-22 21:31:35 +02:00
Leo Simons
e86121db7b CLOUDSTACK-7143: split login config out from postinstall.sh 2014-09-22 21:31:35 +02:00
Leo Simons
29c1f91aea CLOUDSTACK-7143: add vagrant_box_build_time file that's standard with current veewee templates 2014-09-22 21:31:34 +02:00
Leo Simons
5f3caf6d01 CLOUDSTACK-7143: reformat definition.rb code. No other changes. 2014-09-22 21:31:34 +02:00
Leo Simons
039a47bd5b CLOUDSTACK-7143: merge systemvm templates, step 1: remove differences 2014-09-22 21:30:39 +02:00
Leo Simons
262cde5fb7 CLOUDSTACK-7143: move network tuning from cleanup.sh to its own script. 2014-09-22 21:30:39 +02:00
Leo Simons
e2f1740de5 CLOUDSTACK-7143: split base.sh into its two functions. 2014-09-22 21:30:39 +02:00
Leo Simons
0f2012e842 CLOUDSTACK-7143: upgrade systemvm to latest debian stable, 7.6.0. 2014-09-22 21:30:39 +02:00
Rohit Yadav
765659091a appliance: fix newer debian iso links and checksums for debian
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
(cherry picked from commit ac5309b8b47ddb1e5588a2d5090f2bcce0e7c2a4)
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2014-09-09 18:41:53 +02:00
Hugo Trippaers
733a7ba8c1 Put in a note that will hopefully prevent a bunch of systemvm build failures 2014-07-18 10:18:19 +02:00
ynojima
f21e527923 CLOUDSTACK-6614 bugfix: systemvm template build failed because of src iso link is broken 2014-05-08 16:48:18 -06:00
Daan Hoogland
9b26ca20fc build recent systemvm[64]templates 2014-02-27 17:48:18 +01:00
Hugo Trippaers
0ce488849d CLOUDSTACK-5932: update the definitions with the new debian version 2014-02-05 10:52:36 +01:00
Abhinandan Prateek
18191ce79a CLOUDSTACK-5932: updated script with the valid iso download urls 2014-02-05 10:38:26 +01:00
Hugo Trippaers
789438651a Fix systemvm build scripts with the new location of the systemvm patches.
And wondering why they are included here and not in the systemvm.iso.

Also giving the systemvm a little more space to fix the out-of-diskspace error during the build
2013-10-17 14:57:33 +02:00
Prasanna Santhanam
4591f94a0b Debian 7.0.0 in archives
Debian released 7.1 and moved the old image to archives. Updated with
the archives link to the -netinst image.

Signed-off-by: Prasanna Santhanam <tsp@apache.org>
2013-06-22 16:25:22 +05:30
Nitin Mehta
c11dbad9c9 merge master 2013-05-11 15:28:43 +05:30
Rohit Yadav
c2fbac4166 appliance: Use Debian Wheezy rc1 for building systemvm
We switch from Debian beta-4 i386 to rc1 i386.

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-07 15:01:01 +05:30
Rohit Yadav
80a6aaf7e1 CLOUDSTACK-1340: Fix locale, cmd, disk size and remove multiple apt-get installs
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-28 16:15:09 +05:30
Rohit Yadav
23be2e7ba0 CLOUDSTACK-1340: Shrink the final virtual disk, vmdk was not supported, use vdi
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-27 16:59:34 +05:30
Rohit Yadav
98c0a4fb9d CLOUDSTACK-1066: Fix FIXMEs, rename script to postinstall.sh
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-12 18:28:55 +05:30
Chip Childers
ebe738ee20 CLOUDSTACK-1233: Fixed veewee config file legal documentation
The veewee configuration files used for the devcloud base-box build, as
well as the newly introduced files used to create a system vm, were
inappropriately identified as ASLv2 licensed and copyrighted by the ASF.

The fixes:
- The ASF headers stripped to match the source.
- The files are now excluded from RAT checks in the root pom.
- The tools/whisker/descriptor.xml file updated
- The root LICENSE and NOTICE were re-generated

Changes in the Apache Whisker templates for LICENSE and NOTICE files
caused a good bit of whitespace oddness in this commit for those 2
files.

Signed-off-by: Chip Childers <chip.childers@gmail.com>
2013-02-11 21:40:06 -05:00
Chiradeep Vittal
78b00f51a9 CLOUDSTACK-1066: fixes
cloudstack-packages: fixes install_packages (diff -> diffutils),
                     use debconf-set-selections for iptables-persistent
preseed.cfg : change root password, use separate partitions for /usr /var /home
definition.rb: reset timeout to sane value
cleanup.sh, zerodisk.sh: move wipe of root directory to zerodisk
2013-02-08 17:44:56 -08:00
Chiradeep Vittal
82dc16e58a CLOUDSTACK-1066: no need for build helpers. Also reduces attack surface of system vm
CLOUDSTACK-1066: no need for busybox and dictionaries

CLOUDSTACK-1066: fix bug in generating signature

CLOUDSTACK-1066: don't confuse veewee about root password
Clean up stuff copied in to vm by veewee
2013-02-08 12:52:41 -08:00