36256 Commits

Author SHA1 Message Date
Abhishek Kumar
0fbdbca10f test fix
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-23 18:53:59 +05:30
Abhishek Kumar
1aaf2ae6cd scaleio fix
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-23 18:29:41 +05:30
Abhishek Kumar
3dccebce77 make dynamicapichecker cache confgurable, fix test
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-23 13:02:33 +05:30
Abhishek Kumar
fd424d55f4 move adding indexes to java class
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-23 11:07:02 +05:30
Abhishek Kumar
bb5a2966b1 restore missing log
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-22 18:37:28 +05:30
Abhishek Kumar
895c617592 remove unused method
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-22 18:33:39 +05:30
Abhishek Kumar
6a84ec36ef restore dependency
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-22 18:33:20 +05:30
Abhishek Kumar
5c379fd7fc refactor
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-21 17:37:00 +05:30
Abhishek Kumar
eaf17ddbb9 renamed storage.pool.host.connect.workers
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-21 17:04:03 +05:30
Abhishek Kumar
f6c16d9cfc refactor capacity calculation
Added capacity.calculate.workers config to control the number threads
that can be used to calculate capacities.

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-21 17:00:56 +05:30
Abhishek Kumar
16a541cd71 changes for timertask to runnable for agent self tasks
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-21 15:01:23 +05:30
Abhishek Kumar
62ce43c2d5 agent: refactoring fixes for connection
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-21 13:10:09 +05:30
Abhishek Kumar
aae3a0a0b8 refactor to retrieve host count and cpu sockets in single query
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-20 19:58:43 +05:30
Abhishek Kumar
c885464c71 storage pool host connection improvements
- Enabels using worker threads for parallel connection of hosts to a
  storage pool
- HostDaoImpl refactorings

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-20 19:11:02 +05:30
Abhishek Kumar
9192027973 ui: use *metrics apis only when metrics enabled for list
In UI for the list views it is regular API view by default and *Metrics
API response may not be needed. *Metrics APIs will take more time to
return response so this PR tries to improve the behaviour and enables
calling regular API without metrics when metrics toggle is not enabled.

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-18 12:51:29 +05:30
Abhishek Kumar
e548d3b136 revert change to fix implicit tags
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-18 10:47:52 +05:30
Abhishek Kumar
c33aa96025 refactor, improve startuptask
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-17 19:30:26 +05:30
Abhishek Kumar
290f7a944f agent: allow not to exit on failure if serverresource has flag
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-17 19:29:25 +05:30
Abhishek Kumar
b178946dbf allow serverresource flag to not exit on failures
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-17 19:12:18 +05:30
Abhishek Kumar
4b2c5734db fix npe
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-17 14:01:41 +05:30
Abhishek Kumar
ad4c56a11f minor refactor for executor min-max
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-16 11:37:31 +05:30
Abhishek Kumar
053a19f551 refactor
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-15 18:53:46 +05:30
Abhishek Kumar
79c257c454 minor change for ssl handshake pool factory
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-15 11:28:54 +05:30
Abhishek Kumar
a932a9c2bb refactor agent hostname retrieval
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-15 11:28:35 +05:30
Abhishek Kumar
99e630370c revert min threads for AgentTaskPool
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-12 19:28:15 +05:30
Abhishek Kumar
4e41394088 refactor
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 18:21:43 +05:30
Abhishek Kumar
8038b28b1c server: indirectagentlb hypervisor type fix
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 17:56:18 +05:30
Abhishek Kumar
38765f327c fix Transaction error
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 16:51:33 +05:30
Abhishek Kumar
d7bfa276b9 remove unused
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 16:06:37 +05:30
Abhishek Kumar
3ff2d81976 fix Transaction.finalize error for updatePowerState
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 16:02:56 +05:30
Abhishek Kumar
d85dd6d782 make default for powersync for transitioning vms as true
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 16:02:05 +05:30
Abhishek Kumar
47333a7077 Merge remote-tracking branch 'apple/apple-base418' into scalability-improvements 2024-10-11 13:37:12 +05:30
Abhishek Kumar
af32bcf4ca
Merge pull request #478 from shapeblue/scalability-improvements-fixes
Following changes and improvements:
- Improvements in handling of PingRoutingCommand
   
    1. Added global config - vm.sync.power.state.transitioning, default value: false, to control syncing of power states for transitioning VMs
    2. Improved VirtualMachinePowerStateSync to allow power state sync for host VMs in a batch
    3. Optimized scanning stalled VMs
- Added caching for account/use role API access with expiration after write set to 60 seconds.
- Added caching for some recurring DB retrievals
   
    1. CapacityManager updateCapacityForHost - beneficial for calculation for host capacities by CapacityChecker, host joins
    2. CapacityManager - listing service offerings - beneficial in host capacity calculation
    3. LibvirtServerDiscoverer existing host for the cluster - beneficial for host joins
    4. DownloadListener - hypervisors for zone - beneficial for host joins
    5. VirtualMachineManagerImpl - VMs in progress- beneficial for processing stalled VMs during PingRoutingCommands
- Optimized MS list retrieval for agent connect 
- Optimize finding ready systemvm template for zone
- Database retrieval optimisations - fix and refactor for cases where only IDs or counts are used mainly for hosts and other infra entities. Also similar cases for VMs and other entities related to host concerning background tasks
- Changes in agent-manager connection with NIO classes
   
    1. Optimize use of executor service
    2. Do SSL handshakes within worker threads
    3. Added global configs to finely control the behaviour depending on the infra
    4. On agent side backoff and sslhandshake timeout can be controlled by agent properties
- Improvements in StatsCollection - minimize DB retrievals.
- Improvements in DeploymentPlanner to retrieve only desired host fields and lesser retrievals.
- Improvements in resource calculation
2024-10-11 13:33:38 +05:30
Abhishek Kumar
42111d8e83 fix EOF
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 12:30:57 +05:30
Fabricio Duarte
bc42264b34 Restore listNetworks behavior & clean up the code (#9461)
Co-authored-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 12:29:43 +05:30
Abhishek Kumar
52c483d91d revert to constant backoff
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 12:19:50 +05:30
Abhishek Kumar
7ecc173187 changes
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 12:12:57 +05:30
Abhishek Kumar
d0fc91ab2a build fix
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-09 17:29:18 +05:30
Abhishek Kumar
3ebc6c3d1e agent ssl handshake timeout
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-09 17:19:18 +05:30
Abhishek Kumar
0b8ebb08d6 increase expiry
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-09 17:18:44 +05:30
Wei Zhou
85076cb0f8
Resize volume: add pool capacity disablethreshold for resize and allow volume auto migration (#492)
* server: add global settings for volume resize

* resizeVolume: support automigrate

* server: fix build errors as it is backported from 4.20/main

* Address Suresh's comments

* Update api/src/main/java/org/apache/cloudstack/api/command/user/volume/ResizeVolumeCmd.java

Co-authored-by: Suresh Kumar Anaparti <suresh.anaparti@shapeblue.com>

* Apple issue-299: address Suresh's comments

* Update api/src/main/java/org/apache/cloudstack/api/command/user/volume/ResizeVolumeCmd.java

* UI: add autoMigrate to resizeVolume

---------

Co-authored-by: Suresh Kumar Anaparti <suresh.anaparti@shapeblue.com>
2024-10-09 16:36:33 +05:30
Abhishek Kumar
5f86dad4cb improve cluster overcommit value cache
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-09 16:28:24 +05:30
Abhishek Kumar
1589cde4e4 check for empty ids
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-09 16:27:39 +05:30
Abhishek Kumar
3e830252ab fix invalid range
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 17:36:55 +05:30
Abhishek Kumar
864afda935 backoff changes
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 16:03:31 +05:30
Abhishek Kumar
f85ac6adf9 add a todo
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 14:30:45 +05:30
Abhishek Kumar
a3ea8603a9 during resource calculation directly return ids for service offering,
templates

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 14:28:26 +05:30
Abhishek Kumar
3f6b7b930a during resourcecalculation select specific fields for uservmjoinvo
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 14:27:26 +05:30
Abhishek Kumar
a069e14cf9 directly return count for systemvms used in listInfra
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 14:25:25 +05:30
Abhishek Kumar
c6cc136ce6 changes in pools for agent executors
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 14:24:09 +05:30