Comments (8)
Can you try deploying with instance type, Standard_D8s_v4, and let us know if you are still getting these errors?
When installing extensions, more vCPUs and memory are needed. For example, this deployment uses three extensions and deploys the larger instance type by default, as seen here.
from f5-bigip-runtime-init.
Hi - okay I tested with D8s. First time it failed, then passed a couple of times - then failed again. It seems a little better but still no use as it's too unreliable. I've checked the CPU and memory using top for the running system and there does not appear to be any issue with low memory or cpu. I've also done a lot of testing with removing the packages and then re-running the init script to reinstall them. Again, sometimes there is a failure depending on if the F5 is 'busy' with other tasks but generally it works every time on re-run.
I think the underlying issue is that the RPM files are getting bigger each time, but the wait count for install is fixed at 20 seconds. Telemetry streaming RPM has grown from 8.5MB in v1.1 to 20MB in the current version. Would it be possible to just allow a configuration value for the wait/retry time for the packages to cope with transient delays like there is the HTTP_RETRY parm?
from f5-bigip-runtime-init.
Hi - just an update on this. I've noticed a particular issue with a delay after AS3 is loaded. I also see that once loaded, AS3 then automatically requests and downloads Service Discovery RPM. I therefore switched my script so that telemetry was being downloaded first and AS3 last, and this seems to have improved the script processing - I am getting no failures so far.
I would also recommend you look into the logic of the bigip-runtime-init script. As you see in the logs, it is timing out even though the task is returning a "STARTED" status - indicating that the bigip has started processing the task. I don't really see why the script would time out this state so quickly... Surely wait until the task gives another status such as "FAILED" before bailing out, or until the task itself times out in restnoded (which I presume it does eventually).
from f5-bigip-runtime-init.
Thanks for these additional details. A ticket, internal ID EC-147, has been created for engineering to look into.
from f5-bigip-runtime-init.
Hi @antonywm, assuming you aren't using our ARM templates to deploy, can you share the user data script you're using to download, install, and run runtime init? Also, which version of BIG-IP are you using?
The extension installation delay can be configured in the controls block, or using an environment variable: https://github.com/F5Networks/f5-bigip-runtime-init#controls
Also, the iControl REST services used by AT packages have a separate bucket of memory and timeout values that usually need to be tweaked using db variables before mcpd starts up (which is why you wouldn't necessarily see an impact using top). You can see how they are used in our templates here: https://github.com/F5Networks/f5-azure-arm-templates-v2/blob/d5082fac3322d1c24e2112613f2b6cc042f0573f/examples/modules/bigip-standalone/bigip.json#L254
Please add these to your user data if not already present, and let us know how it goes.
these are valid in all versions of BIG-IP
/usr/bin/setdb provision.extramb 1000
/usr/bin/setdb restjavad.useextramb true
these are available on 14.1.4.4, 15.1.4.1, 16.1.2 and later
/usr/bin/setdb iapplxrpm.timeout 300
/usr/bin/setdb icrd.timeout 180
/usr/bin/setdb restjavad.timeout 180
/usr/bin/setdb restnoded.timeout 180
(Issue EC-147 mentioned above is for adding these variables to the runtime init examples/documentation)
from f5-bigip-runtime-init.
Hi @mikeshimkus - my onboard script is here. It's from your example one, just modified a bit as we pull the rpm's and DO scripts from azure storage. bigip version is 16.1.3.3.
I did see the extension delay parm but this is just the delay BETWEEN installing the extensions, not the delay waiting for the install task to complete. I also found the parm "HTTP_RETRY" detailed here which I thought would fix the issue, but it didn't seem to do anything when I tested it.
VM is provisioned through Terraform so there is some parameterization in my template too. I run 'provision.extramb 500' already so let me expand that to 1000 and also add the timeout extensions.
from f5-bigip-runtime-init.
@thepowercoders We just released a new version of Runtime Init: https://github.com/F5Networks/f5-bigip-runtime-init/releases/tag/1.6.1
It adds the db variables and fixes a few other issues you may have run into. Let me know if this helps.
from f5-bigip-runtime-init.
this seems to be more stable now and I am getting successful runs of the script. Thank you!
from f5-bigip-runtime-init.
Related Issues (20)
- RFE: add cloud provider sdk methods to fetch objects (in addition to type=url) HOT 7
- is there a way to pass a set of variables into the config file? HOT 2
- RFE - Log runtime-init success/failure externally HOT 3
- GCP hostname fails to pull metadata - invalid declaration HOT 4
- CFE declaration order will error Filtered bucket does not exist HOT 4
- CFE declaration order can cause as3 asynchronous 503 error HOT 3
- Pre-onboard restjavad memory with 1nic GCP autoscale mig Unable to detect a Project Id HOT 2
- Add support for AWS Parameter Store? HOT 3
- RFE: Add "access_token" to the FIELDS_TO_HIDE list HOT 1
- AS3/FAST RPM installation fails in GCP cloud deployment intermittent HOT 5
- extension_services: "type" field does not accept "file" as value HOT 2
- F5 VM onboarding is failing with error "Cannot read property 'length' of undefined" HOT 11
- F5 onboarding is failing HOT 8
- script halts with error 'Device is not licensed yet' HOT 3
- Will not boot with PAYG-Good image. HOT 2
- Key/Value Secrets HOT 2
- Default password for admin user in GCP is not set
- as3 extension installation failing intermittently HOT 3
- Couldn't verify the f5-bigip-runtime-init package signature HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from f5-bigip-runtime-init.