1876 Commits

Author SHA1 Message Date
Rohit Yadav
f7778194f0 tools: fix build_asf.sh release script to remove -SNAPSHOT from bunch of files
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
(cherry picked from commit cc63611cc24f67fcfa8d8cd13e9da445d9220c1e)
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-08-14 13:55:18 +05:30
shweta agarwal
792c27c9bd test case automated for list template pagination
additional verification added
This closes #646
2015-08-13 15:51:16 +05:30
sanjeev
18fee95109 Removed medium dictionary from test_data and modified the tests dependent on it
Removed duplicate test data related to vm properties.Modified tests dependent on it

Removed duplicte service offerings from test data and modified tests dependent on it
Bug-Id: CLOUDSTACK-8617
This closes #644
2015-08-06 11:29:13 +05:30
Pierre-Luc Dion
2ae2aac9f5 removed whitespaces, close #623 2015-08-01 08:33:55 -04:00
Pierre-Luc Dion
3381154faf initial dockerization commit. 1. update injectkeys.sh to work into restricted container 2. move previous dockerfiles into tools/docker 3. dockerfiles for management-server on centos and marvin
CLOUDSTACK-8249

Signed-off-by: Pierre-Luc Dion <pdion891@apache.org>
2015-08-01 08:30:16 -04:00
Pierre-Luc Dion
9e4a1a08ff fix dependency for keepalived from wheezy-backports
Signed-off-by: wilderrodrigues <wrodrigues@schubergphilis.com>
2015-07-28 14:18:40 +02:00
wilderrodrigues
08348593a2 CLOUDSTACK-8616 - the systemvm packages are installed from install_systemvm_packages.sh
- Adding keepalived installation in the right script. I added the change on the buildsystemvm.sh, which is no longer used.

Signed-off-by: wilderrodrigues <wrodrigues@schubergphilis.com>
2015-07-16 13:14:49 +02:00
Ian Southam
b7b54f1680 Fixes to enable test to succeed. Small change to Marvin to be able to override retries
Signed-off-by: wilderrodrigues <wrodrigues@schubergphilis.com>
2015-07-08 11:19:12 +02:00
wilderrodrigues
f72412a80d Merge branch 'fixtravis3' of https://github.com/rsafonseca/cloudstack
This closes #531
2015-07-01 09:12:17 +02:00
Rohit Yadav
107595a6a5 CLOUDSTACK-8457: SAML auth plugin improvements for production usage
* Move config options to SAML plugin
  This moves all configuration options from Config.java to SAML auth manager. This
  allows us to use the config framework.
* Make SAML2UserAuthenticator validate SAML token in httprequest
* Make logout API use ConfigKeys defined in saml auth manager
* Before doing SAML auth, cleanup local states and cookies
* Fix configurations in 4.5.1 to 4.5.2 upgrade path
* Fail if idp has no sso URL defined
* Add a default set of SAML SP cert for testing purposes
  Now to enable and use saml, one needs to do a deploydb-saml after doing a deploydb
* UI remembers login selections, IDP server

- CLOUDSTACK-8458:
    * On UI show dropdown list of discovered IdPs
    * Support SAML Federation, where there may be more than one IdP
        - New datastructure to hold metadata of SP or IdP
        - Recursive processing of IdP metadata
        - Fix login/logout APIs to get new interface and metadata data structure
        - Add org/contact information to metadata
        - Add new API: listIdps that returns list of all discovered IdPs
        - Refactor and cleanup code and tests

- CLOUDSTACK-8459:
    * Add HTTP-POST binding to SP metadata
    * Authn requests must use either HTTP POST/Artifact binding

- CLOUDSTACK-8461:
    * Use unspecified x509 cert as a fallback encryption/signing key
      In case a IDP's metadata does not clearly say if their certificates need to be
      used as signing or encryption and we don't find that, fallback to use the
      unspecified key itself.

- CLOUDSTACK-8462:
    * SAML Auth plugin should not do authorization
      This removes logic to create user if they don't exist. This strictly now
      assumes that users have been already created/imported/authorized by admins.
      As per SAML v2.0 spec section 4.1.2, the SP provider should create authn requests using
      either HTTP POST or HTTP Artifact binding to transfer the message through a
      user agent (browser in our case). The use of HTTP Redirect was one of the reasons
      why this plugin failed to work for some IdP servers that enforce this.
    * Add new User Source
      By reusing the source field, we can find if a user has been SAML enabled or not.
      The limitation is that, once say a user is imported by LDAP and then SAML
      enabled - they won't be able to use LDAP for authentication
    * UI should allow users to pass in domain they want to log into, though it is
      optional and needed only when a user has accounts across domains with same
      username and authorized IDP server
    * SAML users need to be authorized before they can authenticate
        - New column entity to track saml entity id for a user
        - Reusing source column to check if user is saml enabled or not
        - Add new source types, saml2 and saml2disabled
        - New table saml_token to solve the issue of multiple users across domains and
          to enforce security by tracking authn token and checking the samlresponse for
          the tokens
        - Implement API: authorizeSamlSso to enable/disable saml authentication for a
          user
        - Stubs to implement saml token flushing/expiry

- CLOUDSTACK-8463:
    * Use username attribute specified in global setting
      Use username attribute defined by admin from a global setting
      In case of encrypted assertion/attributes:
      - Decrypt them
      - Check signature if provided to check authenticity of message using IdP's
        public key and SP's private key
      - Loop through attributes to find the username

- CLOUDSTACK-8538:
    * Add new global config for SAML request sig algorithm

- CLOUDSTACK-8539:
    * Add metadata refresh timer task and token expiring
        - Fix domain path and save it to saml_tokens
        - Expire hour old saml tokens
        - Refresh metadata based on timer task
        - Fix unit tests

This closes #489

(cherry picked from commit 20ce346f3acb794b08a51841bab2188d426bf7dc)
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Conflicts:
	client/WEB-INF/classes/resources/messages_hu.properties
	plugins/hypervisors/xenserver/src/com/cloud/hypervisor/xenserver/resource/wrapper/xenbase/CitrixCheckHealthCommandWrapper.java
	plugins/user-authenticators/saml2/src/org/apache/cloudstack/api/command/SAML2LoginAPIAuthenticatorCmd.java
	ui/scripts/ui-custom/login.js
2015-06-29 12:31:51 +02:00
SrikanteswaraRao Talluri
17ecd65331 CLOUDSTACK-8593: assign __testName if it is not getting set from test
This closes #537
Signed-off-by: SrikanteswaraRao Talluri <talluri@apache.org>
2015-06-28 16:30:53 +05:30
Rafael da Fonseca
e8c0c8f849 Reclaim disk space from /tmp caused by long running mysql daemon 2015-06-26 01:16:05 +02:00
Rafael da Fonseca
c980003c37 Cleanup stale files in /tmp which is filling up during some runs
Output status of disk and memory on build host
2015-06-26 00:54:25 +02:00
Rafael da Fonseca
bdd42a4157 Reduce script running time around 80% This resolves the performance penalty introduced by adding the midonet repo
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

This closes #530
2015-06-26 00:00:13 +02:00
Rafael da Fonseca
12d52401f7 Add git status output to debug git fetch failures
Signed-off-by: Daan Hoogland <daan@onecht.net>

This closes #523
2015-06-25 11:29:13 +02:00
Rafael da Fonseca
6fd49e49a3 Add apache license header to script
Signed-off-by: Daan Hoogland <daan@onecht.net>

This closes #482
2015-06-21 15:13:27 +02:00
Rafael da Fonseca
4f098a1b90 Check return code on plugin runs
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:27 +02:00
Rafael da Fonseca
b9f5d38772 Improve plugin dependency download Add download for midonet and juniper stuff, this increases runtime for a few minutes, may remove in future if travis show too much overhead
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:27 +02:00
Rafael da Fonseca
0d671b9e54 Some of the plugin dependencies were'nt being properly resolved on the dependency:resolve-plugins mojo This adds a couple more dark magic sprinkles to make sure no dependencies will be downloaded at build time
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:27 +02:00
Rafael da Fonseca
358157f57c Manually add another dependency to be downloaded before build
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:27 +02:00
Rafael da Fonseca
e4f09e9ebc Allow proper retry in pip install command
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:27 +02:00
Rafael da Fonseca
5386e0f6b5 Travis reported another false negative, if paramiko was present but version too low for marvin, nosetests wouldn't run and result would be success
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:26 +02:00
Rafael da Fonseca
f77f4c2f11 xunit-reader.py was returning success in case of exception being thrown during test!
Revert the fix to throw failed test on exception, will fix that in a separate branch so all the other fixes can be committed already and not raise failure on an old intermittent issue that was hidden

Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:26 +02:00
Rafael da Fonseca
773e4158b6 Print log data on after_failure.sh
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:26 +02:00
Rafael da Fonseca
348bd2f3cc Use upstart to start mysql and get rid of the warnings
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:26 +02:00
Rafael da Fonseca
e52f3ab932 Add urandom as random source in install.sh
Add urandom as random source in before_script.sh

Remove commented lines in before_script.sh

Remove commented lines in install.sh

Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:26 +02:00
Rafael da Fonseca
b95f47c4d4 Remove some more unwanted stuff in install.sh
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:25 +02:00
Rafael da Fonseca
c4a38bdb0d Tomcat download is not doing anything except waste time and disk
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:25 +02:00
Rafael da Fonseca
4047dd571d Can't run travis_wait from script, this just throws an error
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:25 +02:00
Rafael da Fonseca
118f607942 Add some retry and debug to python packages install Sometimes after a full successful run, travis will fail due to not being able to parse tests output
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:25 +02:00
Rafael da Fonseca
9a50e0f03e Fix phase2 deps download for maven 3.2.5 This version didn't like missing <version> tag on artifacts
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:25 +02:00
Rafael da Fonseca
7838bfcc70 Add timeout to nc command, as it was waiting forever and not going through the while loop. This will make sure nc gets restared to retry in case something nasty is happening in the running process
host command not present in build env, switch to getent
second phase of dep download turning some error, print failure log

Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:25 +02:00
Rafael da Fonseca
c1c0382bf5 Don't sleep for a fixed amount of time, no use in continuing if repo is unavailable Check if DNS resolution is working properly when failure occurs
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:25 +02:00
Rafael da Fonseca
6a6d64b99a Get some verbosity and debug on after_script.sh to troubleshoot timeouts on this phase Travis is using maven 3.2.5 and this script was setting an alternate maven path before running script Setting CATALINA_BASE and CATALINA_HOME is of no consequence while running jetty, just adds more problems
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:24 +02:00
Rafael da Fonseca
b55ef551ca It seems the network failures last for a bit.. allow some sleeping time Add some verbosity for status checking
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:24 +02:00
Rafael da Fonseca
f0dcd403e7 Second phase wan't running properly due to path issue Add extra echo command to make sure there's data in the pom
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:24 +02:00
Rafael da Fonseca
f0e1c8908b Send output to oblivion because of this message in travis log view: This log is too long to be displayed. Please reduce the verbosity of your build or download the raw log.
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:24 +02:00
Rafael da Fonseca
880f116a62 This is a quick fix to attempt to resolve most of the travis failures Most of the failures have been due to transient network failures, that are causing dependency artifact downloads to fail Maven does not have a way to retry this without restarting the whole build, so the mvn dependency plugin is the best bet Unfortunately, running a dependency:resolve on the project returns yet to be compiled dependencies, and causes it to fail... There is an option to excludeGroupIds and excludeArtifactIds in the docs for this goal, but unfortunately they don't seem to work This drafts a dummy pom in a quick and dirty way, just to download all the deps in one go, while retrying for RETRY_COUNT times if it fails
Signed-off-by: Daan Hoogland <daan@onecht.net>
2015-06-21 15:13:24 +02:00
Daan Hoogland
797a7f05ff use version in branchname if branch is master 2015-06-19 00:01:43 +02:00
Abhinav Roy
108a74a6b8 CLOUDSTACK-8487 : Add vMotion related tests
Signed-off-by: Gaurav Aradhye <gaurav.aradhye@clogeny.com>
This closes #268
2015-06-02 12:01:12 +05:30
Rafael da Fonseca
1958a8e9c1 Cleanup awsapi leftovers
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

This closes #328
2015-05-29 19:15:51 +02:00
Stefan Magnus Landrø
161cc194d5 Fixed yum and apt repo locations used by chef in devcloud4
The testing repos seem to be gone, change to upstream

This closes #323

Signed-off-by: Erik Weber <erik@huug.no>
2015-05-28 22:50:02 +02:00
pritisarap12
a7ab794052 CLOUDSTACK-8308: Adding automation test cases for VM/Volume snapshot hardening
Signed-off-by: Gaurav Aradhye <gaurav.aradhye@clogeny.com>
This closes #301
2015-05-27 14:35:47 +05:30
Priti Sarap
c961f2f14d CLOUDSTACK-8476: Disable enable zone pod cluster and host: --Test cases for testing the behavior of resources running on zone, cluster, pod, host and admin/non-admin user after disabling the zone, cluster, pod, host respectively 2015-05-27 14:25:11 +05:30
Gaurav Aradhye
59388b09ab CLOUDSTACK-8500: Adding missing key in test_data.py
Signed-off-by: Gaurav Aradhye <gaurav.aradhye@clogeny.com>
This closes #279
2015-05-21 16:04:10 +05:30
Gaurav Aradhye
309c1b466f CLOUDSTACK-8498: Including schedule as default key in recurring_snapshot dict used to create recurring snapshot policy
Signed-off-by: Gaurav Aradhye <gaurav.aradhye@clogeny.com>
This closes #276
2015-05-21 14:35:10 +05:30
Gaurav Aradhye
832f0293b3 CLOUDSTACK-8492: Fix dictionary access issue in createChecksum method - common.py
Signed-off-by: Gaurav Aradhye <gaurav.aradhye@clogeny.com>
This closes #272
2015-05-21 12:32:45 +05:30
Rohit Yadav
9d8a62d0ee systemvmtemplate: install libc6:i386 for 64bit template
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-18 19:58:57 +02:00
Remi Bergsma
95e7673a55 Systemvm: Disable services that slow down boot
The console-setup service brings a nice font to the console, but why would we want to use it. In most cases it takes a <10 seconds to set it up. When using nested hypervising, I found this takes much longer time that causes tests to time-out. I'd suggest turning off these services. They are not required for the services the systemvm provides.
2015-05-18 13:44:09 +02:00
pritisarap12
f6789532b0 CLOUDSTACK-8476: Disabling Zone, Pod, Cluster: --Test cases for testing the behaviour of resources running on zone and admin/non-admin user after disabling the Zone
Signed-off-by: Gaurav Aradhye <gaurav.aradhye@clogeny.com>
This closes #242
2015-05-18 12:18:15 +05:30