246 Commits

Author SHA1 Message Date
Rohit Yadav
98a9856b70 Merge branch '4.9' into 4.10 2017-08-01 20:39:26 +02:00
Rohit Yadav
a24dfe6f98 appliance: fix progress version in Gemfile (#2212)
Fixes veewee build issue: jedi4ever/veewee#1103

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-08-01 20:28:19 +02:00
Jayapal
6a59eb7327 CLOUDSTACK-9669: updated the strongswan debian conf setting for template 2017-06-06 15:51:00 +05:30
Jayapal
065fa1c849 CLOUDSTACK-9669:Advaced zone isolated network egress destination cidr support
CLOUDSTACK-9669:egress destination cidr VR python script changes
    CLOUDSTACK-9669:egress destination API and orchestration changes
    CLOUDSTACK-9669: Added the ipset package in systemvm template
    CLOUDSTACK-9669:Added licence header for new files
    CLOUDSTACK-9669: replacing 0.0.0.0/0 with the network cidr

     ipset member add with 0.0.0.0/0 fails. So 0.0.0.0/0 replaced with the network cidr.
     In source cidr 0.0.0.0/0 is nothing but network cidr.
     updated the default egress all cidr with network cidr
2017-06-06 15:51:00 +05:30
Daan Hoogland
70ef0788c9 CLOUDSTACK-9408: Fix download urls in sql and scripts
This fixes the agreed upon url on download.cloudstack.org in various
sql files and misc scripts.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-04-20 12:33:33 +05:30
Daan Hoogland
f07d729086 CLOUDSTACK-9408 for the move away from download.cloud.com
- commented some occurences of cloud.com as being harmless
  * examples
  * identifiers (internal)
 - changed the URL for vhd-util download
 - changed comments from 'cloud.com' to 'Apache CloudStack'
2017-04-20 11:35:36 +05:30
Rajani Karuturi
7b78a22c5e Merge release branch 4.9 to master
* 4.9:
  CLOUDSTACK-9591: Fix guest VM ovf xml to remove network nodes
  CLOUDSTACK-9591: Fix systemvmtemplate to not include network details
2017-04-12 10:30:23 +05:30
Rohit Yadav
92fd5bee3d CLOUDSTACK-9591: Fix systemvmtemplate to not include network details
This removes nic/network specific details while exporting the systemvmtemplate
for vmware (ova file). Having this causes the ssvms to not deploy in
dvswitch-based vmware environments that have no vswitch portgroups (dummy etc).
Tested this on a local Trillian env.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-03-30 13:47:53 +05:30
Will Stevens
f045d65b90 complete implementation of the StrongSwan VPN feature 2017-02-02 16:18:06 -05:00
Rohit Yadav
e6cc78f531 CLOUDSTACK-9710: Switch to JRE1.8
- Switches Travis to use jdk1.8
- Changes java-version to 1.8
- Change jdk/maven version to 1.8
- Switch to F5/java8 compatible library release
- Switch packaging to use jdk 1.8, and jre 1.8 in init/systemd scripts
- Switch systemvm to openjdk-8-jre

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-01-11 14:04:03 +05:30
Wido den Hollander
2a5f37c1b1
CLOUDSTACK-8715: Add channel to Instances for Qemu Guest Agent
This commit adds a additional VirtIO channel with the name
'org.qemu.guest_agent.0' to all Instances.

With the Qemu Guest Agent the Hypervisor gains more control over the Instance if
these tools are present inside the Instance, for example:

* Power control
* Flushing filesystems
* Fetching Network information

In the future this should allow safer snapshots on KVM since we can instruct the
Instance to flush the filesystems prior to snapshotting the disk.

More information: http://wiki.qemu.org/Features/QAPI/GuestAgent

Keep in mind that on Ubuntu AppArmor still needs to be disabled since the default
AppArmor profile doesn't allow libvirt to write into /var/lib/libvirt/qemu

This commit does not add any communication methods through API-calls, it merely
adds the channel to the Instances and installs the Guest Agent in the SSVMs.

With the addition of the Qemu Guest Agent channel a second channel appears in /dev
on a SSVM as a VirtIO port.

The order in which the ports are defined in the XML matters for the naming inside
the SSVM VM and by not relying on /dev/vportXX but looking for a static name the
SSVM still boots properly if the order in the XML definition is changed.

A SSVM with both ports attached will have something like this:

  root@v-215-VM:~# ls -l /dev/virtio-ports
  total 0
  lrwxrwxrwx 1 root root 11 May 13 21:41 org.qemu.guest_agent.0 -> ../vport0p2
  lrwxrwxrwx 1 root root 11 May 13 21:41 v-215-VM.vport -> ../vport0p1
  root@v-215-VM:~# ls -l /dev/vport*
  crw------- 1 root root 251, 1 May 13 21:41 /dev/vport0p1
  crw------- 1 root root 251, 2 May 13 21:41 /dev/vport0p2
  root@v-215-VM:~#

In this case the SSVM port points to /dev/vport0p1, but if the order in the XML
is different it might point to /dev/vport0p2

By looking for a portname with a pre-defined pattern in /dev/virtio-ports we
do not rely on the order in the XML definition.

Signed-off-by: Wido den Hollander <wido@widodh.nl>
2016-11-23 16:01:08 +01:00
Rohit Yadav
2cddaf3d36 CLOUDSTACK-9447: fix build and upgrade to debian 7.11 iso
- Update base debian iso to version 7.11
- Upgrade ruby version to 2.3.0 (latest/stable)
- Fix Gemfile
- Update README
- Fix openswan pkg name with the same version
- Remove cloud-cleanup it's not available

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2016-08-05 12:40:07 +05:30
Rajani Karuturi
61526190d0 changed the base iso file from debian-7.8.0 to debian-7.9.0
7.8.0 url is not available(404 Error)
2015-09-15 21:37:44 +05:30
Pierre-Luc Dion
9e4a1a08ff fix dependency for keepalived from wheezy-backports
Signed-off-by: wilderrodrigues <wrodrigues@schubergphilis.com>
2015-07-28 14:18:40 +02:00
wilderrodrigues
08348593a2 CLOUDSTACK-8616 - the systemvm packages are installed from install_systemvm_packages.sh
- Adding keepalived installation in the right script. I added the change on the buildsystemvm.sh, which is no longer used.

Signed-off-by: wilderrodrigues <wrodrigues@schubergphilis.com>
2015-07-16 13:14:49 +02:00
Rohit Yadav
9d8a62d0ee systemvmtemplate: install libc6:i386 for 64bit template
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-18 19:58:57 +02:00
Remi Bergsma
95e7673a55 Systemvm: Disable services that slow down boot
The console-setup service brings a nice font to the console, but why would we want to use it. In most cases it takes a <10 seconds to set it up. When using nested hypervising, I found this takes much longer time that causes tests to time-out. I'd suggest turning off these services. They are not required for the services the systemvm provides.
2015-05-18 13:44:09 +02:00
Rohit Yadav
0f82650dcf systemvmtemplate: use ovftool for building vmware template if available
This commit fixes a chmod issue where extracted vmdk file is not readable by all
users/groups. The other improvement is to use ovftool to build systemvm template
for vmware if it's available. This is based on a dev ML discussion and a suggested
approach by Ilya: http://markmail.org/message/kntsetgxdbppfh22

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-12 16:46:23 +02:00
Rohit Yadav
0fa1453809 systemvmtemplate: use archived debian 7.8.0 iso since Debian8 is released now
This fixes the urls and jenkins build

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-29 17:19:15 +02:00
Rohit Yadav
d8eb2e5e48 systemvmtemplate: install open-vm-tools from wheezy-backports, install XStools
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-10 15:48:36 +05:30
Rohit Yadav
97ad1e24b8 systemvmtemplate: increase /opt parititon by 100MB
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-03 10:49:36 +05:30
Rohit Yadav
2de12b50f8 systemvmtemplate: zero out /var/log partition
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 15:52:51 +05:30
Rohit Yadav
6f907fb2cd systemvmtemplate: increase disk size to 3000
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 13:58:33 +05:30
Rohit Yadav
d0e65d7c34 systemvmtemplate: use separate partition for /var/log
/var/log fills up /var and fails operation of normal services. This fix
restricts /var/log to 100-200M. The fix for CLOUDSTACK-6885 tries to make sure
we don't keep a lot of logs.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 13:54:20 +05:30
Rohit Yadav
8fe3c0b8ba appliance: remove raw.img before exporting and building template for KVM
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-25 17:27:03 +05:30
Rene Moser
dc2aa8a808 systemvm: use Debian http redirector for backports
This closes #123

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-24 16:51:05 +05:30
Rohit Yadav
6a881b9337 systemvmtemplate: install irqbalance from wheezy-backports
Ported systemvm enhancement by Rene Moser <rene.moser@swisstxt.ch> from
https://github.com/apache/cloudstack/pull/119

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-23 14:31:12 +05:30
Rohit Yadav
7a2e27c3b3 appliance: save md5 checksums after building systemvm templates
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-20 15:16:57 +05:30
Leo Simons
3bd59a4bf3 veewee 0.5 alpha is breaking build 2015-03-16 11:38:14 +01:00
Leo Simons
d0281a3b41 Seems like some of these can be nil 2015-03-16 11:35:35 +01:00
Ian Southam
cc5d72133e Removed chef as we will definitely not go this way 2015-03-16 11:35:14 +01:00
Ian Southam
c7c1f3202e Plan B
Replace chef with a python script
configure.py will read the bags and (hopefully) create the desired state
At this stage this is ipassociation
This code should work for both VR and VPCrs

TODO:
iptables
ip route throw (present in VR but not in VPCr
Determine default route
Unit tests
2015-03-16 11:35:08 +01:00
Leo Simons
66b5260c90 Documentation and license headers for new systemvm testing tools. 2015-03-16 11:35:08 +01:00
Leo Simons
04ad01a064 Commit missing .kitchen.yml 2015-03-16 11:35:07 +01:00
Ian Southam
ab64c7df6f Added curl to the base install 2015-03-16 11:35:00 +01:00
Ian Southam
5b82e2059d Cherry-pick of 11c00977f77f45aa7b0c387dc88360eba0819e8a:
----
Author:    Ian Southam <isoutham@schubergphilis.com>

First commit towards moving systemvm to chef based configuration
In this commit

1.  cmdline json databag is created
2.  ip association data bag is created
3.  Basic chef cookbook to manage ips and routes

Conflicts:
	systemvm/patches/debian/config/etc/init.d/cloud-early-config
	systemvm/patches/debian/config/var/chef/cookbooks/README
	tools/appliance/definitions/systemvm64template/postinstall.sh
----
Because we've refactored the systemvm template the change to
postinstall.sh now gets its own chef.sh file.
2015-03-16 11:34:59 +01:00
Hugo Trippaers
4fd616fc0f Make sure the location for the persistant configs exists 2015-03-16 11:34:58 +01:00
Leo Simons
f7dd35e1ee CLOUDSTACK-7143: a better fix for kernel upgrade disk space problems
Increase / and /boot a little bit, to the point that there is enough
space on them to do a kernel upgrade. With this I think we can
decrease total disk space usage back down to 2.5GB.

Docs for the preseed config found at
  http://anonscm.debian.org/gitweb/?p=d-i/debian-installer.git;a=blob_plain;f=doc/devel/partman-auto-recipe.txt;hb=HEAD
2015-03-16 11:34:58 +01:00
Funs
c27c69438b hypervisors: add OVM3 plugin that supports OVM 3.2.1/3.3.x
This is a plugin that puts in ovm3 support ranging from 3.3.1 to 3.3.2. Basic
functionality is in here, advanced networking etc..

Snapshots only work when a VM is stopped now due to the semantics of OVM's raw
image implementation (so snapshots should work on a storage level underneath the
hypervisor shrug)

This closes #113

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-12 11:33:42 +05:30
Rohit Yadav
5fb5937cdb appliance: do a apt-get clean before upgrade to free up space
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-02-06 17:02:44 +05:30
Rohit Yadav
b9ae18c5fb appliance: except for openswan upgrade rest of the packages
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-28 23:26:47 +05:30
Rohit Yadav
6b6ce5d074 appliance: don't fail is bak is not found
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-28 18:27:19 +05:30
Rohit Yadav
3fddfe0e10 appliance: fix Debian ISO urls, fixes jenkins build
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-15 15:35:13 +05:30
Wei Zhou
ca5c800f8d Fix CloudStack version (4.6.0) in systemvm template 2014-12-08 15:26:56 +01:00
Will Stevens
03daae571b CLOUDSTACK-7959: fixed 'qemu-img convert' compat issue 2014-12-02 12:15:16 -05:00
Will Stevens
8e689b1148 Updated the system vm build to remove incompatible qemu-img 'compat' option 2014-11-21 05:59:06 -05:00
Edison Su
05bec59c14 CS-27148 system vm image build process, needs to build an old version of qemu image, otherwise, it won't work on RHEL 6 Reviewed-by:Frank 2014-11-06 15:25:57 -08:00
Rohit Yadav
ce51fe32f9 CVE­2014­3566: Avoid using SSLv3 on apache2 webserver used by SSVM
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2014-11-04 14:46:22 +05:30
Harikrishna Patnala
34b7288ca4 CLOUDSTACK-7748: Cloudstack version number is missing in system vm template. /etc/cloudstack-release in system vm does not have version number which leads in vm deployment failure while checking router version. 2014-11-03 12:13:04 +05:30
Harikrishna Patnala
6c04d867b0 CLOUDSTACK-7660: Enhance system vm template to support baremetal
Installed flask package and removed the disk expert recipe in
system vm template to keep only one partition

Signed-off-by:  Frank Zhang <frank.zhang@citrix.com>
2014-10-31 19:35:09 +05:30