Hi,
I'm trying to push out OMSA 6.1 and although I've had a little success where some servers have been upgraded successfully, although the task took nearly 30 minutes, for the most part the tasks are failing due to timing out at just over 30 minutes. Firstly is there anything I can do to speed this task up and secondly how do you change the timeout on these tasks?
Thanks, Col
mighty tigers: Hi, I'm trying to push out OMSA 6.1 and although I've had a little success where some servers have been upgraded successfully, although the task took nearly 30 minutes, for the most part the tasks are failing due to timing out at just over 30 minutes. Firstly is there anything I can do to speed this task up and secondly how do you change the timeout on these tasks? Thanks, Col
Hey Col,
Have not seen timeouts on OMSA deploy...
How many are you trying to do at once?
Do you have lot's of other network traffic at this time? (do you have a sniffer?)
What happens if you just try to push OMSA to _one_ server?
I'll dig on the timeout setting to see if possible.
Rob
Hi Rob,
I intalled the agent to 10 servers, nice and quick and then followed with an OMSA upgrade on the same 10 servers and that took nearly 30 minutes, but, was successful. I then tried 20 servers and the agent wasn't a problem, but, the OMSA upgrade timed out, after 30+ minutes. I then tried 5 servers and finally 1 server and couldn't get it to succeed at all. network bandwidth varies, but, no we don't have a sniffer, we sometimes flood the network with backups being copied, but, I tried a number of times over a 4-5 hour period and failed each time.
I'm going to schedule 5 servers for tonight in the wee hours of the morning, when not much is going on, I'll let you know how I go.
Cheers, Col
The plot thickens! The scheduled job went fine with the exception of one server which timed out after 31 minutes, the other four servers were successful between 11 to 14 minutes. These servers are in the same physical location and in the same network.
Very strange.
Col
Yeah...It would be interesting to know if, on the one that timed out, OMSA got pushed to the box in a timely manner, but then it just took a while to install. Or was the delay in getting the package pushed out...
I've been digging further and it looks like in most if not all cases, the package is not being delivered in a timely manner, although it is being delivered, all be it after the task has timed out. The below event log shows that package was delivered several minutes after the task had timed out. The package being delivered slowly won't be uncommon in my circumstance, as I need to push the package out to client sites across all of Australia from one central location.
In light of this, have made any progress on how I may be able to increase the timeout value on OMSA deployment and as a side issue, what happens if the OMSA is halfway through installing when the task times out?
<event date='Nov 04 20:05:06' severity='4' hostName='MELETRD-T-IRE1' source='Client Task Agent' module='client task agent.dll' process='aexnsagent.exe' pid='2088' thread='4716' tickCount='1571037890' > <![CDATA[Task: Dell OpenManage Server Administrator 6.1.0 Deployment has started]]></event><event date='Nov 04 20:05:06' severity='4' hostName='MELETRD-T-IRE1' source='SWDTSPAgent' module='smfagent.dll' process='aexnsagent.exe' pid='2088' thread='832' tickCount='1571037890' > <![CDATA[<DeliverSoftwareTask><DeliverSoftware guid="{17b1e227-ce41-471d-a16a-cc6940557c9a}" PackageGuid="{c6f0bfb0-8048-4ea9-8c82-34ae32e69dca}" SoftwareGuid="{00000000-0000-0000-0000-000000000000}" PackageName="Dell OpenManage Server Administrator 6.1.0 Deployment" PackageContainsFile="True" InternalVersion="1257315450" ProgramGuid="{ad0dd85e-43ca-4af4-a66c-dddcaf8c2f57}" ProgramName="" CommandLine="Install.bat" ExecutionFlag="True" SuccessCodes="0,3010" FailureCodes="" WorkingDir="" ProgramCanRun="None" IsInteractive="False" StartingWindow="Hidden" TerminateAfter="360" CleanupAfter="10080" ExecutionContext="SystemAccount" User="" Password="" Domain="" /><Advanced DefaultAgentSettings="True" RunFromServer="False" RunFromServerAboveRate="-1" RunLocally="True" RunLocallyAboveRate="0" AlternateLocation="" /></DeliverSoftwareTask>]]></event><event date='Nov 04 20:05:06' severity='4' hostName='MELETRD-T-IRE1' source='PackageDelivery' module='AeXPackageDelivery.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571037906' > <![CDATA[Begin download for package: Dell OpenManage Server Administrator 6.1.0 Deployment {C6F0BFB0-8048-4EA9-8C82-34AE32E69DCA}]]></event><event date='Nov 04 20:05:06' severity='4' hostName='MELETRD-T-IRE1' source='SWDAgent' module='smfagent.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571037906' > <![CDATA[Begin download for package: {C6F0BFB0-8048-4EA9-8C82-34AE32E69DCA}.]]></event><event date='Nov 04 20:05:06' severity='4' hostName='MELETRD-T-IRE1' source='PackageDownload' module='AeXPackageDelivery.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571037906' > <![CDATA[Download package sources from: http://MEL-DELLDMC1.prod.iress.com.au/Altiris/NS/Agent/GetPackageInfo.aspx]]></event><event date='Nov 04 20:05:07' severity='4' hostName='MELETRD-T-IRE1' source='PackageDelivery' module='AeXPackageDelivery.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571038421' > <![CDATA[End download for package: Dell OpenManage Server Administrator 6.1.0 Deployment {C6F0BFB0-8048-4EA9-8C82-34AE32E69DCA}]]></event><event date='Nov 04 20:05:07' severity='4' hostName='MELETRD-T-IRE1' source='SWDAgent' module='smfagent.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571038421' > <![CDATA[End download for package: {C6F0BFB0-8048-4EA9-8C82-34AE32E69DCA}.]]></event><event date='Nov 04 20:05:07' severity='4' hostName='MELETRD-T-IRE1' source='ServerProfile' module='AeXNetComms.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571038437' > <![CDATA[IP information for mel-delldmc1.prod.iress.com.au unavailable or expired, resolved to 172.15.128.21]]></event><event date='Nov 04 20:05:07' severity='4' hostName='MELETRD-T-IRE1' source='ServerProfile' module='AeXNetComms.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571038453' > <![CDATA[IP information for mel-delldmc1 unavailable or expired, resolved to 172.15.128.21]]></event><event date='Nov 04 20:05:16' severity='4' hostName='MELETRD-T-IRE1' source='ServerProfile' module='AeXNetComms.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571047390' > <![CDATA[Speed information for mel-delldmc1 unavailable or expired, tested speed at 4969]]></event><event date='Nov 04 20:05:16' severity='4' hostName='MELETRD-T-IRE1' source='PackageDelivery' module='AeXPackageDelivery.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571047390' > <![CDATA[Begin download for package: Dell OpenManage Server Administrator 6.1.0 Deployment {C6F0BFB0-8048-4EA9-8C82-34AE32E69DCA}]]></event><event date='Nov 04 20:05:16' severity='4' hostName='MELETRD-T-IRE1' source='SWDAgent' module='smfagent.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571047390' > <![CDATA[Begin download for package: {C6F0BFB0-8048-4EA9-8C82-34AE32E69DCA}.]]></event><event date='Nov 04 20:05:16' severity='4' hostName='MELETRD-T-IRE1' source='PackageDownload' module='AeXPackageDelivery.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571047406' > <![CDATA[Download package sources from: http://MEL-DELLDMC1.prod.iress.com.au/Altiris/NS/Agent/GetPackageInfo.aspx]]></event><event date='Nov 04 20:05:16' severity='4' hostName='MELETRD-T-IRE1' source='PackageDownload' module='AeXPackageDelivery.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571047593' > <![CDATA[Download Snapshot: http://mel-delldmc1.prod.iress.com.au/Altiris/NS/Agent/GetPackageSnapshot.aspx?PackageId={C6F0BFB0-8048-4EA9-8C82-34AE32E69DCA}&compress=1]]></event><event date='Nov 04 20:05:23' severity='4' hostName='MELETRD-T-IRE1' source='PackageDownload' module='AeXPackageDelivery.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571054875' > <![CDATA[Download Snapshot complete: OK]]></event><event date='Nov 04 20:05:23' severity='4' hostName='MELETRD-T-IRE1' source='PackageDownload' module='AeXPackageDelivery.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1571054875' > <![CDATA[Download Package from: http://mel-delldmc1.prod.iress.com.au/Altiris/Packages/{c6f0bfb0-8048-4ea9-8c82-34ae32e69dca}]]></event><event date='Nov 04 20:15:29' severity='4' hostName='MELETRD-T-IRE1' source='ServerSettings' module='aexnsagent.exe' process='aexnsagent.exe' pid='2088' thread='928' tickCount='1571660468' > <![CDATA[Next policy request from server MEL-DELLDMC1.prod.iress.com.au will be at 2009-11-04 21:15:29, in 60 minutes]]></event><event date='Nov 04 20:35:07' severity='1' hostName='MELETRD-T-IRE1' source='Client Task Agent' module='client task agent.dll' process='aexnsagent.exe' pid='2088' thread='4716' tickCount='1572838890' > <![CDATA[CClientTaskInstanceBase::OnExecute(): Task 235cf065-272a-4b03-bf09-ea64b9121760 has timed out, attempting to stop]]></event><event date='Nov 04 20:35:08' severity='4' hostName='MELETRD-T-IRE1' source='Client Task Agent' module='client task agent.dll' process='aexnsagent.exe' pid='2088' thread='4716' tickCount='1572839890' > <![CDATA[CClientTaskInstanceBase::OnExecute(): Task 235cf065-272a-4b03-bf09-ea64b9121760 has been told to stop]]></event><event date='Nov 04 20:36:08' severity='1' hostName='MELETRD-T-IRE1' source='Client Task Agent' module='client task agent.dll' process='aexnsagent.exe' pid='2088' thread='4716' tickCount='1572899890' > <![CDATA[CClientTaskInstanceBase::OnExecute(): Task stop timeout, attempting to kill task 235cf065-272a-4b03-bf09-ea64b9121760]]></event><event date='Nov 04 20:36:08' severity='4' hostName='MELETRD-T-IRE1' source='Client Task Agent' module='client task agent.dll' process='aexnsagent.exe' pid='2088' thread='4716' tickCount='1572899890' > <![CDATA[Task: Dell OpenManage Server Administrator 6.1.0 Deployment has finished]]></event><event date='Nov 04 20:36:18' severity='1' hostName='MELETRD-T-IRE1' source='Client Task Agent' module='client task agent.dll' process='aexnsagent.exe' pid='2088' thread='4716' tickCount='1572909890' > <![CDATA[CClientTaskInstance::FinalRelease(): Timed out waiting for m_eventTaskComplete]]></event><event date='Nov 04 20:43:12' severity='4' hostName='MELETRD-T-IRE1' source='PackageDownload' module='AeXPackageDelivery.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1573324187' > <![CDATA[Download Package complete: downloaded 101367538 bytes at 44518 bytes per second, used 0 bytes from cache]]></event><event date='Nov 04 20:43:12' severity='4' hostName='MELETRD-T-IRE1' source='PackageDelivery' module='AeXPackageDelivery.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1573324187' > <![CDATA[End download for package: Dell OpenManage Server Administrator 6.1.0 Deployment {C6F0BFB0-8048-4EA9-8C82-34AE32E69DCA}]]></event><event date='Nov 04 20:43:12' severity='4' hostName='MELETRD-T-IRE1' source='SWDAgent' module='smfagent.dll' process='aexnsagent.exe' pid='2088' thread='5028' tickCount='1573324187' > <![CDATA[End download for package: {C6F0BFB0-8048-4EA9-8C82-34AE32E69DCA}.]]></event>
I just went and checked. It looks like 30 minutes (as you suspected) is the default timeout for tasks. It's not user configurable (as it's never really been a problem). We could look at bumping the timeout to 60 in a future release, but that won't help you at the moment.
Re-reading the thread this morning, it really seems that there are some networking or environmental issues at play here somehow. It would be great if we could get more info on that...
Can you stagger the deployment jobs to 5 servers per task and see if that helps?
Does this server have decent specs (2 proc, 4GB would be min)?
Thx