Questions tagged [constrained-optimization]
Questions about optimization problems subject to additional constraints.
302
questions
0
votes
1
answer
38
views
Estimating the rate of convergence of Projected Gradient Descent on constrained polynomial objectives
I am estimating the order of convergence of Projected Gradient Descent (GD) on quadratic polynomials with random coefficients independently drawn from Uniform(-1,1) and bounded by a unit hypercube. I'...
- 23
0
votes
1
answer
106
views
Is the NLP formalism sub-optimal for real-world problems
My home-brew optimization studies have raised yet another fundamental question. The Nonlinear Programming formalism, "minimize f(x) subject to inequality and equality constraints, and x ...
- 329
3
votes
0
answers
66
views
Iterative Solvers for Linear Least Squares with Integer Constraints
The classical linear least squares problem reads $\min_{x\in\mathbb{R}^n}\|Ax-b\|^2_2$ and its solutions satisfy the normal equations $A^{\top}Ax = A^{\top}b$. A standard approach to solve the latter ...
- 2,267
0
votes
2
answers
135
views
BFGS Constrained Optimization Failure Due to Precision Loss
I am trying to optimize the following objective function according to some constraints. However, the optimization fails at the first iteration with the message that the desired error was not ...
0
votes
0
answers
35
views
How conservation of momentum is ensured in (Projected) Gauss-Seidel constrain solver
I'm developing molecular dynamics where my time-step is limited by stiffness of the bonds. I trying to get inspiration from game-engines, where they solve similar problem (hard bond constrains). These ...
- 927
0
votes
0
answers
39
views
Methods for delaying the "break" in non-linear least squares optimisation when the step size gets too small?
I am using the Levenberg-Marquardt method for calibration purposes. Typically, the RMSE of my calibration looks like:
I want to break the algorithm when the algorithm step-updates start to slow down, ...
1
vote
0
answers
33
views
Constraints involving max in ILP
Consider $n$ apps and $m$ transactions. $x_{ij}$ is a binary variable, it takes 0 or 1. $x_{ij}$ takes 1 if $i$th app is used for $j$th transaction, else 0.
min $\sum_{i=1}^{n}\sum_{j=1}^{m} x_{ij}$
...
- 111
5
votes
1
answer
421
views
The nitty-gritty details of augmented Lagrangian methods
I am trying to implement (constrained) minimization of a certain function with the augmented Lagrangian method. Where can I find a reference that discusses in detail the good practices for the various ...
- 11.8k
1
vote
1
answer
48
views
Name this optimum-within-convex-hull algorithm: State is a convex combination of hull vertices; Nonnegativity ensured by reparameterization
I'm looking for the "official" name(s) for a procedure for optimizing a convex loss function over a convex subset. This seems to be a default/naïve algorithm that folks come up with before ...
- 153
1
vote
0
answers
39
views
Find a minium value of a function with discrete parameters, but some combinations are invalid
I'm not a mathematician, so sorry if I miss some obvious stuff. I'm trying to develop a bot for StarCraft 2, in particular the army control for it. For every army of the enemy, I want to find the ...
- 111
1
vote
0
answers
58
views
Beyond the LP relaxation of binary least squares
I have a binary quadratic program with a convex objective function, of the form,
\begin{align}
\text{minimize}\;\;& x^tAx+b^tx\\
\text{subject to}\;\;& x_i\in\{0,1\}
\end{align}
where $A$ is ...
- 503
3
votes
0
answers
108
views
Implementation of the roller constraint
What could be the best way to implement the roller constraint in finite element code, i.e. constraint of the type
$$\mathbf{u} \cdot \mathbf{n} = 0$$
I plan to enforce it in the weak sense by ...
- 289
1
vote
2
answers
239
views
Optimization Problem with Array Index as decision variable
I am trying to formulate an optimization problem where the decision variable is an index of the input array as part of the formulation.
For example, I have the following term (this is simplified):
$A[...
- 131
2
votes
1
answer
153
views
Numerical Simulation of a Quadratic MIP with a highly rational term
I am interested in solving the following minimization problem:
$$
\begin{array}{cl}
\displaystyle\min_{x,y}&\displaystyle\frac{1}{K}\sum_{i=1}^{K}\left(\frac{x_{i}}{y_{i}}-\frac{X}{Y}\right)^{2} \\...
- 169
1
vote
1
answer
141
views
Possible bug with scipy.optimize SHGO sobol: TypeError: <lambda>() takes 1 positional argument but 3 were given
I have been trying to perform some global optimization with SciPy optimizer SHGO
and I've had issues with the sampling method 'sobol'. Specifically, I get an error ...
- 31