8378 Commits

Author SHA1 Message Date
Pearl Dsilva
830f3061bc
SystemVM optimizations (#5831)
* Support for live patching systemVMs and deprecating systemVM.iso. Includes:
- fix systemVM template version
- Include agent.zip, cloud-scripts.tgz to the commons package
- Support for live-patching systemVMs - CPVM, SSVM, Routers
- Fix Unit test
- Remove systemvm.iso dependency

* The following commit:
- refactors logic added to support SystemVM deployment on KVM
- Adds support to copy specific files (required for patching) to the hosts on Xenserver
- Modifies vmops method - createFileInDomr to take cleanup param
- Adds configuratble sleep param to CitrixResourceBase::connect() used to verify if telnet to specifc port is possible (if sleep is 0, then default to _sleep = 10000ms)
- Adds Command/Answer for patch systemVMs on XenServer/Xcp

* - Support to patch SystemVMs - VMWare
- Remove attaching systemvm.iso to systemVMs
- Modify / Refactor VMware start command to copy patch related files to the systemvms
- cleanup

* Commit comprises of:
- remove docker from systemvm template - use containerd as container runtime
- update create-k8s-binaries script to use ctr for all docker operations
- Update userdata sent to the k8s nodes
- update cksnode script, run during patching of the cks/k8s nodes

* Add ssh to k8s nodes details in the Access tab on the UI

* test

* Refactor ca/cert patching logic

* Commit comprises of the following changes:
- Use restart network/VPC API to patch routers
- use livePatch API support patching of only cpvm/ssvm
- add timeout to the keystore setup/import script

* remove all references of systemvm.iso

* Fix keystore-cert-import invocation + refactor cert timeout in CP/SS VMs

* fix script timeout

* Refactor cert patching for systemVMs + update keystore-cert-import script + patch-sysvms script + remove patchSysvmCommand from networkelementcommand

* remove commented code + change core user to cloud for cks nodes

* Update ownership of ssh directory

* NEED TO DISCUSS - add on the fly template conversion as an ExecStartPre action (systemd)

* Add UI changes + move changes from patch file to runcmd

* test: validate performance for template modification during seeding

* create vms folder in cloudstack-commons directory - debian rules

* remove logic for on the fly template convert + update k8s test

* fix syntax issue - causing issue with shared network tests

* Code cleanup

* refactor patching logic - certs

* move logic of fixing rootdiskcontroller from upgrade to kubernetes service

* add livepatch option to restart network & vpc

* smooth upgrade of cks clusters

* Support for live patching systemVMs and deprecating systemVM.iso. Includes:
- fix systemVM template version
- Include agent.zip, cloud-scripts.tgz to the commons package
- Support for live-patching systemVMs - CPVM, SSVM, Routers
- Fix Unit test
- Remove systemvm.iso dependency

* The following commit:
- refactors logic added to support SystemVM deployment on KVM
- Adds support to copy specific files (required for patching) to the hosts on Xenserver
- Modifies vmops method - createFileInDomr to take cleanup param
- Adds configuratble sleep param to CitrixResourceBase::connect() used to verify if telnet to specifc port is possible (if sleep is 0, then default to _sleep = 10000ms)
- Adds Command/Answer for patch systemVMs on XenServer/Xcp

* - Support to patch SystemVMs - VMWare
- Remove attaching systemvm.iso to systemVMs
- Modify / Refactor VMware start command to copy patch related files to the systemvms
- cleanup

* Commit comprises of:
- remove docker from systemvm template - use containerd as container runtime
- update create-k8s-binaries script to use ctr for all docker operations
- Update userdata sent to the k8s nodes
- update cksnode script, run during patching of the cks/k8s nodes

* Add ssh to k8s nodes details in the Access tab on the UI

* test

* Refactor ca/cert patching logic

* Commit comprises of the following changes:
- Use restart network/VPC API to patch routers
- use livePatch API support patching of only cpvm/ssvm
- add timeout to the keystore setup/import script

* remove all references of systemvm.iso

* Fix keystore-cert-import invocation + refactor cert timeout in CP/SS VMs

* fix script timeout

* Refactor cert patching for systemVMs + update keystore-cert-import script + patch-sysvms script + remove patchSysvmCommand from networkelementcommand

* remove commented code + change core user to cloud for cks nodes

* Update ownership of ssh directory

* NEED TO DISCUSS - add on the fly template conversion as an ExecStartPre action (systemd)

* Add UI changes + move changes from patch file to runcmd

* test: validate performance for template modification during seeding

* create vms folder in cloudstack-commons directory - debian rules

* remove logic for on the fly template convert + update k8s test

* fix syntax issue - causing issue with shared network tests

* Code cleanup

* add cgroup config for containerd

* add systemd config for kubelet

* add additional info during image registry config

* address comments

* add temp links of download.cloudstack.org

* address part of the comments

* address comments

* update containerd config - as version has upgraded to 1.5 from 1.4.12 in 4.17.0

* address comments - simplify

* fix vue3 related icon changes

* allow network commands when router template version is lower but is patched

* add internal LB to the list of routers to be patched on network restart with live patch

* add unit tests for API param validations and new helper utilities - file scp & checksum validations

* perform patching only for non-user i.e., system VMs

* add test to validate params

* remove unused import

* add column to domain_router to display software version and support networkrestart with livePatch from router view

* Requires upgrade column to consider package (cloud-scripts) checksum to identify if true/false

* use router software version instead of checksum

* show N/A if no software version reported i.e., in upgraded envs

* fix deb failure

* update pom to official links of systemVM template
2022-04-21 13:40:19 -03:00
Wei Zhou
56fb7ac128
UI: hide Virtual Routers tab for domain admins (#6289) 2022-04-20 11:00:20 -03:00
Pearl Dsilva
25f92c50f0
ui: Fix Internal LB LB rule column and missing translation (#6288) 2022-04-20 10:33:43 -03:00
Wei Zhou
9f076ff10d
UI: checksum field is optional for direct-download templates on kvm (#6290) 2022-04-20 10:28:12 -03:00
Pearl Dsilva
c339f6eef9
ui: Fix bulk deletion of ssh key pairs (#6286) 2022-04-19 22:47:59 -03:00
Wei Zhou
a5014a28a6
New feature: give access permission of networks to other accounts in same domain (#5769)
* Enhancement: create Shared networks and VPC private gateways by users

* UI bug fix: pass correct domainid in CreateSharedNetworkForm

* Update #5730: fix test failure with test_guest_vlan_range.py

* Update #5730: fix test failure with test_persistent_network.py

* Update #5730: Add since to new API commands and API parameters

* Update #5730: Get first physical network for VPC private gateway if other ways do not work

* Update #5730: code optimization (return !offering.isSpecifyVlan())

* Update #5730: fix hard-coded network offering id in test_pvlan.py

* Update #5730: skip access check on the network owner if the owner is ROOT/system

* Update #5730: overlap check on cidr/startip/endip

* Update #5730: add methods to get accountid/domainid of shared networks

* Update #5730: improve integration tests

* Update #5730: update as per GutoVeronezi's comments

* Network Sharing: give network access permission to other accounts within a domain

* network: update ip in lb/pf/dnat tables when update vm nic ip

* Update #5757: create 3 separated methods for DNAT/LB/PF update

* travis: install python3-setuptools

* Network Sharing: update integration test

* Update #5769: Remove NetworkPermission.Ops

* Update #5769: Update as per Daan's comments

* Update #5769: Update as per Suresh's comments

* Update #5769: fix UI bug that accounts/projects are not listed

* Update #5769: fix domain admin can deploy vm on L2 network of other users

* Update #5769: Remove method listPermittedNetworkIdsByDomains in NetworkPermissionDao

* Update #5769: Skip network operation permissions check for root admin

* UI: fix create Isolated/L2 network form

* Update #5730: fix create Shared network form

* Update #5769: fix domain admin can deploy vm on L2 network of other users

* test: fix test_storage_policy.py

* Update #5769: fix remove_nic in test_network_permissions.py

* Update #5769: extract some codes to a method

* Update #5769: fix add/remove nic by domain admin

* Update #5769: allow domain admin to enable/disable static nat and create port forwarding rules

* Update #5769: update integration test

* Update #5769: fix unit test AssignLoadBalancerTest.java

* Update #5769: allow normal users to share network permission to other users on UI

* Update #5769: fix small UI bug with label

* Update #5769: Support L2 network as associated network

* test: sleep 30s after restarting mgt server in test_kubernetes_supported_versions.py to fix test failures with test_secondary_storage.py

* Update #5784: revert part of changes in #2420

* Update #5757: invert if condition to reduce code indentation

* Update #5769: fix regular user cannot create L2 network

* Update #5769: Add associated nework id and name in private gateway response

* Update #5769: list networks by networkfilter=Account on UI

* Update #5769: fix ui issue when list private gateways or create shared network if no isolated networks

* Update #5769: fix vue ui warnings

* Update #5679: add BaseResponseWithAssociatedNetwork and extract method setResponseAssociatedNetworkInformation

* Update #5679: extract some methods in VpcManagerImpl.java

* Update #5679: Update smoke tests as per Daan's comments

* Update #5769: fix vpc with private gateways cannot be removed when remove an acount

* Update #5769: fix unit test failures after merging latest main

* Update #5769: fix schema-41610to41700.sql

* Update #5769: fix Request failed due to empty network offering list on UI

* Update #5769: Throw exception when account is not found by name

* Update #5769: display a warning message if network offering list is empty

* Update #5769: fix an UI bug caused by previous commit b286cb76774e301d15cf2b3b6ea316eaa306018f

* Update #5769: fix UI bugs due to vue3 merge

* Update #5769: fix issue due to account type refactoring

* Update #5769: fix ui bugs due to vue3

* Update #5769: fix issue due to vue3 upgrade

* Update #5769: fix issue due to vue3 upgrade part 2

* Update #5769: fix issue due to vue3 upgrade part 3

* Update #5769: highlight default scope when create shared network on UI

* Update #5769: fix domain list is not loaded on UI

* Update #5769: fix restart/delete shared network by normal users

* Update #5769: fix restart domain-scope shared network by domain admin

* Update #5769: fix 3 UI bugs (1) double networks in list; (2) icon of first items in list; (3) account/project autoselect

* Update #5769: fix 2 ui bugs; (1) selected project is not changed when change domain; (2) no network should be selected by default

* Update #5769: fix update shared networks by domain admin/regular user

* Update #5769: fix Flicking warning message about the empty network offerings

* Update #5769: display associated network name in shared network info card

* Update #5769: fix create private gateway form

* Update #5769: fix network lists in project view

* Update #5769: fix duplicated networks in network dropdown

* Update #5769: fix failed to create shared network if associated L2 network is Setup

* Update #5769: check AccessType.OperateEntry on network in its implementation

* Revert "Update #5769: check AccessType.OperateEntry on network in its implementation"

This reverts commit c42c489e5bb26e2c780ac1be79bc8ca299a23f6e.

* Update #5769: fix keyword search in list guest vlans
2022-04-19 11:29:31 -03:00
nvazquez
334891a4b9
Merge branch '4.16' 2022-04-19 09:49:21 -03:00
Nicolas Vazquez
365966dd0a
UI: Fix custom unconstrained for a zone does not show CPU speed (#6285) 2022-04-19 09:48:26 -03:00
Pearl Dsilva
8a1b1250e8
ui: remove mandatory rule on root disk controller field while registering / updating a template (#6279) 2022-04-19 08:49:38 -03:00
Pearl Dsilva
14dd467a43
ui: Incorrect column key specified in secondary store column filter (#6275) 2022-04-18 15:07:10 +05:30
Hoang Nguyen
fecc5254de
ui: fixes style ui issues (#6261)
This PR for fixes some UI Bugs

 The project selected color is not displayed after switching project
 Project view, the cards are not separated but stick together
 Dashboard: The color of the selected zone is not displayed
 Dark mode: Hover through row tables that are discolored
2022-04-15 20:27:16 +05:30
Pearl Dsilva
05c907b3a8
ui: Allow editing VM and template settings (#6262) 2022-04-14 10:37:30 +02:00
nvazquez
a1fb44e41f
Merge branch '4.16' 2022-04-14 01:22:09 -03:00
Pearl Dsilva
08bfb4444a
ui: Add project switch to the Kubernetes tab (#6260) 2022-04-14 01:21:05 -03:00
Pearl Dsilva
b4ac98efa3
ui: Display action buttons in Project Accounts Tab view if project Admin (#6257) 2022-04-14 01:20:11 -03:00
Wei Zhou
bbb4ffa593
UI: fix dedicate public ip range to domain (#6258) 2022-04-14 01:19:23 -03:00
dahn
6140903004
local versions of .env ignored (#6256)
Co-authored-by: Daan Hoogland <dahn@onecht.net>
2022-04-13 09:46:07 -03:00
Wei Zhou
daa13af626
UI: fix icon user-delete-outlined for release dedicated public ip range (#6255) 2022-04-13 09:20:56 +02:00
Pearl Dsilva
6ec013718a
ui: Fix uploadCustomCertificate form in infraSummary view (#6248)
* ui: Fix uploadCustomCertificate form in infraSummary view

* vertical form layout

* align buttons

* update form rules
2022-04-12 13:20:19 -03:00
Nicolas Vazquez
177f04839c
UI: Fix protocol reset after changing provider on Add Primary Storage (#6243) 2022-04-11 20:09:45 +02:00
Abhishek Kumar
63a9da9548
ui: use different icon labe for releaseIpAddress action (#6235)
In publicip view, actions disassociateIpAddress and releaseIpAddress actions are shown same which could cause confusion for user.
Added a different icon and label for releaseIpAddress action

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2022-04-11 11:45:57 -03:00
Hoang Nguyen
5eb2b693e9
fixes login button not work and Single Sign-On tab disabled after logout (#6197) 2022-04-11 10:45:51 -03:00
José Flauzino
16f2896940
Persistence of VM stats (#5984)
* Add persistence of VM stats

* Fix API 'since' attribute

* Add license

* Address GutoVeronezi's reviews

* Fix the order of VM stats in the API response

* Fix msid in VM stats data

* Fix disk stats and add minor improvements

* Add log message

* Build string using ReflectionToStringBuilderUtils

* Rerun checks

Co-authored-by: joseflauzino <jose@scclouds.com.br>
2022-04-11 10:42:21 -03:00
Nicolas Vazquez
e0ce0228cc
ui: Fix Add secondary storage (#6241)
This PR fixes the Add secondary storage wizard failing due to a missing parameter
Fixes: #6239
2022-04-11 13:46:36 +05:30
Pearl Dsilva
c8ce6c0496
ui: Project owner (normal user) unable to perform any operations in the project (#6233) 2022-04-08 15:26:06 +05:30
Hoang Nguyen
676fe31ca9
UI: Fixes removing undesired API parameters on form submit (#6196)
* fixes removing undesired api parameters

* remove comment
2022-04-07 11:00:02 -03:00
Nicolas Vazquez
4193109c1d
ui: Logout before login (#6193)
This PR calls the logout API before login, to cleanup any duplicate sessionkey, as it was done on the legacy UI: #4326
Fixes: #6127
2022-04-06 14:33:30 +05:30
Abhishek Kumar
7e6d1f1f85
ui: fix acl rules listing (#6206)
When a rule in the list has start-end port, UI listing was failing.

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2022-04-05 19:40:41 +05:30
Pearl Dsilva
1c8d8cdef2
ui: Fix label for LUN number (#6204) 2022-04-05 12:03:44 +02:00
Pearl Dsilva
022906d9bd
UI: Fix minor UI issues (#6182)
* UI: Fix minor UI issues

* enable add button for acl tags - only when key and value are provided

* fix autosize deprecation warning

* update form variable

* fix issue observed when opening the createVPNConnection form

* list vpn gateway IPs when creating vpn connection

* fix issue when sumitting create vpn customer gateway form

* Fix updateAccount form - Physical Network View ; add confirmation message during update of physical network state

* revert backend change

* fix migrate data form

* fix disk offering form

* 13: remove redundant form entries

* 14: update form field for vpn customer gateway - dead peer detection

* cleanup

* remove newline
2022-04-04 09:54:21 -03:00
nvazquez
5f3a392eb5
Merge branch '4.16' 2022-04-01 13:14:09 -03:00
Abhishek Kumar
66a6671e0b
ui,refactor: fix missing label in update network form (#6181)
updateinsequence param for updateNetwork API wasn't have correponding label in UI.

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2022-04-01 13:12:50 -03:00
Abhishek Kumar
e339c4b964
ui: fix vpc tier redirect to show details (#6178)
* ui: fix vpc tier redirect to show details

When redirecting to VPC tier, details tab should be active by default

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>

* fix

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2022-03-31 09:57:14 +02:00
Hoang Nguyen
1a304ccf68
UI - Fixes UI bugs (#6162)
* fixes

* remove console

* fix hidden clear notification button

* fixes

* fixes

* fixes navigation to ssh from comments
2022-03-30 07:05:36 -03:00
Wei Zhou
d910c3c6cc
UI: fix update public IP ranges (#6177) 2022-03-29 13:16:38 +02:00
Pearl Dsilva
aab1e8a9d0
ui: Fix scale kubernetes (cks) cluster form (#6176) 2022-03-29 11:38:40 +02:00
John Bampton
15937369fe
Fix spelling (#6161)
* Fix spelling

* Fix spelling
2022-03-29 00:21:07 -03:00
nvazquez
cc70843555
Merge branch '4.16' 2022-03-28 23:33:02 -03:00
Wei Zhou
f4b9ab034b
UI: fix create l2 network offering with userdata (#6174) 2022-03-28 23:32:10 -03:00
Pearl Dsilva
6d11e2faa9
ui, Adv zone + SG: Fix invocation of create/revoke APIs for ingress/egress security group rules (#6170) 2022-03-28 13:53:50 -03:00
David Jumani
f0993ce098
ui: Remove misleading links for users (#6159) 2022-03-25 11:38:20 -03:00
David Jumani
f596dbb1f5
Fix wrong label entity.type (#6157) 2022-03-25 10:27:43 -03:00
David Jumani
a026f41e12
ui: Fix router link access (#6158)
* ui: Fix router link access

* Adding more
2022-03-23 08:56:52 -03:00
Pearl Dsilva
f8aca04733
UI: Prevent passing boottype/bootmode when template is deploy-as-is (#6151) 2022-03-22 12:11:05 -03:00
Pearl Dsilva
38a0ded053
ui: Support to specify security groups when updating/editing a VM (adv zone + SG) (#6138)
* ui: Support to specify security groups when updating/editing a VM (adv zone + SG)

* cleanup
2022-03-21 10:32:15 -03:00
Pearl Dsilva
7350067d43
ui: Fix icon on Load Balancing view tab (#6137) 2022-03-20 23:18:48 -03:00
Wei Zhou
6a53517d37
New feature: Reserve and release Public IPs (#6046)
* Reserve and release a public IP

* Update #6046: show orange color for Reserved public ip

* Update #6046 reserve IP: fix ui conflicts

* Update #6046: fix resource count

* Update #6046: associate Reserved public IP to network

* Update #6046: fix unit tests

* Update #6046: fix ui bugs

* Update #6046: make api/ui available for domain admin and users
2022-03-17 14:35:40 -03:00
Nicolas Vazquez
15e3a10f94
UI: Fix change offering type (#6135) 2022-03-17 13:09:53 -03:00
Hoang Nguyen
56bf418185
fixes form.getFieldValue is not a function (#6110) 2022-03-15 08:14:55 -03:00
Rohit Yadav
b2965462ea
ui: update npm dependencies to latest (#6091)
Update npm dependencies to latest and have audit fix;

Run commands to update dependencies:

    npm outdated
    npm update
    npm audit fix

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2022-03-15 15:12:39 +05:30