Comments (8)
It means that Ipopt tried to evaluate the objective at a point in the domain where the function or its derivative was undefined.
This is known and expected behavior and is not a bug. Ipopt assumes the function is defined and twice differentiable at all points in the variable domain, in Float64
precision.
Note that even if you have other constraints (like your quadratic) that should prevent this, Ipopt may evaluate infeasible points during the iteration process.
There are two likely cases:
- Very large value of
x
causingexp(Ax)
to beInf
- Very small value of
sum(...)
, causing the derivative oflog()
to be very large (probablyInf
).
To fix, try adding variable bounds to x
to keep it in a reasonable domain.
BARON does't encounter this issue because it uses a different algorithm.
Instead of using Ipopt, you could also try formulating this as a conic program. It looks like you might have tried this since you mentioned MOSEK, but if you have trouble, please post on https://discourse.julialang.org/c/domain/opt/13.
The tricks you'll need are
- https://jump.dev/JuMP.jl/dev/tutorials/conic/tips_and_tricks/#Log-sum-exp
- https://jump.dev/JuMP.jl/dev/tutorials/conic/tips_and_tricks/#Second-Order-Cone
from ipopt.jl.
Thank you for your reply! This makes great sense to me. MOSEK wouldn't work in this specific example as I am maximizing the convex logsumexp function, but I indeed apply the exp-cone reformulation trick for its minimization. Moreover, BARON typically suffers from exploding exp
terms. So, I think this probably is due to small values of sum(...)
. I will confirm this, but I am closing the issue.
from ipopt.jl.
Ah. I missed reading the Max
. I just assumed you meant Min
.
Ipopt also assumes that the problem is convex, so if you pass it a non-convex problem, anything can happen.
Does it make sense to maximize log-sum-exp? Ipopt will also have trouble with large exp
.
from ipopt.jl.
Thank you for your reply! From Ipopt my only hope is a decent solution, not global. In my research, I am showing some cases where maximizing logsumexp (or convex functions, in general) is useful in ML.
from ipopt.jl.
From Ipopt my only hope is a decent solution, not global
Yeah so then I'd suggest: tight bounds, and a few different starting points.
In my research, I am showing some cases where maximizing logsumexp (or convex functions, in general) is useful in ML.
Interesting
from ipopt.jl.
Yeah so then I'd suggest: tight bounds, and a few different starting points.
Exactly! Many random starting points and prayers :)
from ipopt.jl.
You can check if Ipopt found a solution by looking at termination_status(model)
. I think it returns NUMERICAL_ERROR
if it encountered a problem like that. (But you should double check.)
from ipopt.jl.
Great to know, thank you very much for your support!
from ipopt.jl.
Related Issues (20)
- Segfault julia with unavailable linear solvers HOT 9
- Tests failing on M1 HOT 5
- Failed to precompile Ipopt HOT 5
- add `MathOptInterface.Name()` attribute HOT 1
- `max_wall_time` is still not working HOT 5
- Allow user to specify the Ipopt binary HOT 2
- copy_to does not copy attributes for variable bound constraints HOT 6
- Only evaluate QP callbacks if needed HOT 1
- Problem with HSL solvers since updating to MacOS 13.0 HOT 3
- double free or corruption (out) error HOT 20
- Linking full hsl library to Ipopt.jl on ubuntu HOT 19
- julia 0.6.0 install Ipopt cannot connect to mumps dependency HOT 2
- Add support for GetIpoptCurrentViolations
- Incorrect number of Hessian structure (nonzero entries) HOT 10
- Does Ipopt.jl support giving hessian matrix in JuMP directly, without using the C_wrapper? HOT 2
- pointer being freed was not allocated HOT 33
- Issue with non-negative variable tolerance. HOT 2
- does not allow Ipopt_jll current version HOT 2
- Add some pre-built "debugging" callbacks HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ipopt.jl.